[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:14:57.908567  4246 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.37.190:39063
I20260709 13:14:57.910563  4246 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:14:57.911818  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:57.931097  4253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:57.931500  4252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:57.932979  4246 server_base.cc:1061] running on GCE node
W20260709 13:14:57.932093  4255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:59.158824  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:59.159092  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:59.159359  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602899159319 us; error 0 us; skew 500 ppm
I20260709 13:14:59.160658  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:59.168104  4246 webserver.cc:533] Webserver started at http://127.4.37.190:43945/ using document root <none> and password file <none>
I20260709 13:14:59.169111  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:59.169406  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:59.170123  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:59.177383  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/master-0-root/instance:
uuid: "b0111e84cd22477e95055ff9e4d07d91"
format_stamp: "Formatted at 2026-07-09 13:14:59 on dist-test-slave-jk05"
I20260709 13:14:59.186213  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:59.192551  4261 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:59.194240  4246 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:14:59.194672  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/master-0-root
uuid: "b0111e84cd22477e95055ff9e4d07d91"
format_stamp: "Formatted at 2026-07-09 13:14:59 on dist-test-slave-jk05"
I20260709 13:14:59.195070  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:59.270932  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:59.272763  4246 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:14:59.273343  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:59.355679  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.190:39063
I20260709 13:14:59.355803  4312 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.190:39063 every 8 connection(s)
I20260709 13:14:59.364562  4313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:59.387247  4313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91: Bootstrap starting.
I20260709 13:14:59.393414  4313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:59.395454  4313 log.cc:826] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91: Log is configured to *not* fsync() on all Append() calls
I20260709 13:14:59.400375  4313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91: No bootstrap required, opened a new log
I20260709 13:14:59.421510  4313 raft_consensus.cc:359] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0111e84cd22477e95055ff9e4d07d91" member_type: VOTER }
I20260709 13:14:59.422073  4313 raft_consensus.cc:385] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:59.422391  4313 raft_consensus.cc:740] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0111e84cd22477e95055ff9e4d07d91, State: Initialized, Role: FOLLOWER
I20260709 13:14:59.423326  4313 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0111e84cd22477e95055ff9e4d07d91" member_type: VOTER }
I20260709 13:14:59.423882  4313 raft_consensus.cc:399] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:59.424188  4313 raft_consensus.cc:493] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:59.424556  4313 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:59.428838  4313 raft_consensus.cc:515] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0111e84cd22477e95055ff9e4d07d91" member_type: VOTER }
I20260709 13:14:59.429728  4313 leader_election.cc:304] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0111e84cd22477e95055ff9e4d07d91; no voters: 
I20260709 13:14:59.431546  4313 leader_election.cc:290] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:59.432010  4316 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:59.434840  4316 raft_consensus.cc:697] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 1 LEADER]: Becoming Leader. State: Replica: b0111e84cd22477e95055ff9e4d07d91, State: Running, Role: LEADER
I20260709 13:14:59.435887  4316 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0111e84cd22477e95055ff9e4d07d91" member_type: VOTER }
I20260709 13:14:59.436946  4313 sys_catalog.cc:565] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:59.446867  4317 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0111e84cd22477e95055ff9e4d07d91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0111e84cd22477e95055ff9e4d07d91" member_type: VOTER } }
I20260709 13:14:59.447743  4317 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:59.448714  4318 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0111e84cd22477e95055ff9e4d07d91. Latest consensus state: current_term: 1 leader_uuid: "b0111e84cd22477e95055ff9e4d07d91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0111e84cd22477e95055ff9e4d07d91" member_type: VOTER } }
I20260709 13:14:59.449515  4318 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:59.451660  4324 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:59.464982  4324 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:59.470851  4246 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:59.484812  4324 catalog_manager.cc:1383] Generated new cluster ID: 81d3d2dd89d840f3b4db1326ac29441a
I20260709 13:14:59.485131  4324 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:59.505146  4324 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:59.507298  4324 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:59.521054  4324 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91: Generated new TSK 0
I20260709 13:14:59.522111  4324 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:59.538213  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:59.547228  4335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:59.549085  4336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:59.556185  4338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:59.556347  4246 server_base.cc:1061] running on GCE node
I20260709 13:14:59.557314  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:59.557572  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:59.557793  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602899557757 us; error 0 us; skew 500 ppm
I20260709 13:14:59.558449  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:59.567873  4246 webserver.cc:533] Webserver started at http://127.4.37.129:46861/ using document root <none> and password file <none>
I20260709 13:14:59.568542  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:59.568761  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:59.569073  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:59.570335  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-0-root/instance:
uuid: "49bb401e63ab4d16a411b6ede4812b60"
format_stamp: "Formatted at 2026-07-09 13:14:59 on dist-test-slave-jk05"
I20260709 13:14:59.576447  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:59.581348  4343 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:59.582414  4246 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:59.582751  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "49bb401e63ab4d16a411b6ede4812b60"
format_stamp: "Formatted at 2026-07-09 13:14:59 on dist-test-slave-jk05"
I20260709 13:14:59.583060  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:59.610422  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:59.611833  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:59.614745  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:59.619720  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:59.619952  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:59.620301  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:59.620457  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:59.744688  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:44925
I20260709 13:14:59.744765  4405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:44925 every 8 connection(s)
I20260709 13:14:59.752859  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:59.769778  4411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:59.770567  4410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:59.789268  4406 heartbeater.cc:344] Connected to a master server at 127.4.37.190:39063
I20260709 13:14:59.789881  4406 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:59.791285  4406 heartbeater.cc:507] Master 127.4.37.190:39063 requested a full tablet report, sending...
W20260709 13:14:59.793079  4413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:59.794903  4278 ts_manager.cc:194] Registered new tserver with Master: 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925)
I20260709 13:14:59.798048  4246 server_base.cc:1061] running on GCE node
I20260709 13:14:59.798048  4278 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35814
I20260709 13:14:59.799432  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:59.799753  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:59.799957  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602899799940 us; error 0 us; skew 500 ppm
I20260709 13:14:59.800781  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:59.803946  4246 webserver.cc:533] Webserver started at http://127.4.37.130:33463/ using document root <none> and password file <none>
I20260709 13:14:59.804656  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:59.804917  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:59.805403  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:59.807009  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-1-root/instance:
uuid: "570d4db77af946d1a3c92a42133a0820"
format_stamp: "Formatted at 2026-07-09 13:14:59 on dist-test-slave-jk05"
I20260709 13:14:59.814234  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:14:59.820132  4418 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:59.821192  4246 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:14:59.821630  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-1-root
uuid: "570d4db77af946d1a3c92a42133a0820"
format_stamp: "Formatted at 2026-07-09 13:14:59 on dist-test-slave-jk05"
I20260709 13:14:59.822043  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:59.841486  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:59.843267  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:59.846000  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:59.849947  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:59.850247  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:59.850543  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:59.850749  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:59.946918  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.130:42663
I20260709 13:14:59.947168  4480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.130:42663 every 8 connection(s)
I20260709 13:14:59.953670  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:59.964447  4484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:59.969089  4481 heartbeater.cc:344] Connected to a master server at 127.4.37.190:39063
I20260709 13:14:59.969617  4481 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:59.970817  4481 heartbeater.cc:507] Master 127.4.37.190:39063 requested a full tablet report, sending...
I20260709 13:14:59.974052  4278 ts_manager.cc:194] Registered new tserver with Master: 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:14:59.976514  4278 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35824
W20260709 13:14:59.980422  4485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:59.981213  4246 server_base.cc:1061] running on GCE node
W20260709 13:14:59.983178  4487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:59.984424  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:59.984704  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:59.984913  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602899984896 us; error 0 us; skew 500 ppm
I20260709 13:14:59.985697  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:59.988606  4246 webserver.cc:533] Webserver started at http://127.4.37.131:45723/ using document root <none> and password file <none>
I20260709 13:14:59.989243  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:59.989504  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:59.989825  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:59.991261  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-2-root/instance:
uuid: "d7ed711cb3924d829581b45c45f9235f"
format_stamp: "Formatted at 2026-07-09 13:14:59 on dist-test-slave-jk05"
I20260709 13:14:59.997445  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:00.002058  4492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:00.003010  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:15:00.003379  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-2-root
uuid: "d7ed711cb3924d829581b45c45f9235f"
format_stamp: "Formatted at 2026-07-09 13:14:59 on dist-test-slave-jk05"
I20260709 13:15:00.003762  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602897722324-4246-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:00.030925  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:00.032588  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:00.034349  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:00.037089  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:00.037372  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:00.037703  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:00.037914  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:00.129118  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.131:44099
I20260709 13:15:00.129652  4554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.131:44099 every 8 connection(s)
I20260709 13:15:00.147601  4555 heartbeater.cc:344] Connected to a master server at 127.4.37.190:39063
I20260709 13:15:00.148041  4555 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:00.149291  4555 heartbeater.cc:507] Master 127.4.37.190:39063 requested a full tablet report, sending...
I20260709 13:15:00.152139  4278 ts_manager.cc:194] Registered new tserver with Master: d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:00.152679  4246 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017768322s
I20260709 13:15:00.153754  4278 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35830
I20260709 13:15:00.213263  4278 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35840:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:00.217687  4278 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:00.333705  4369 tablet_service.cc:1511] Processing CreateTablet for tablet acc87feed8a94bd28e69741a974b7b70 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:00.331749  4370 tablet_service.cc:1511] Processing CreateTablet for tablet de2cd85925ea49859e5d1d84fb918baa (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:00.331305  4371 tablet_service.cc:1511] Processing CreateTablet for tablet 35e5e0bb2f164d039c7d3a1835389173 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:00.336335  4369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc87feed8a94bd28e69741a974b7b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.337262  4370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2cd85925ea49859e5d1d84fb918baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.340626  4371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e5e0bb2f164d039c7d3a1835389173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.344925  4368 tablet_service.cc:1511] Processing CreateTablet for tablet 37870ee6d9044b5cabe79e830984932b (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:00.347713  4368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37870ee6d9044b5cabe79e830984932b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.368615  4367 tablet_service.cc:1511] Processing CreateTablet for tablet 71dc7f7c06024c34b2fef29bb23ab0bf (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:00.370218  4367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71dc7f7c06024c34b2fef29bb23ab0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.378199  4366 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3366f9baa41bd96e9fffeb819b92d (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:00.387501  4518 tablet_service.cc:1511] Processing CreateTablet for tablet acc87feed8a94bd28e69741a974b7b70 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:00.389994  4520 tablet_service.cc:1511] Processing CreateTablet for tablet 35e5e0bb2f164d039c7d3a1835389173 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:00.391975  4519 tablet_service.cc:1511] Processing CreateTablet for tablet de2cd85925ea49859e5d1d84fb918baa (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:00.394811  4517 tablet_service.cc:1511] Processing CreateTablet for tablet 37870ee6d9044b5cabe79e830984932b (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:00.398767  4366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3366f9baa41bd96e9fffeb819b92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.396760  4518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc87feed8a94bd28e69741a974b7b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.400571  4516 tablet_service.cc:1511] Processing CreateTablet for tablet 71dc7f7c06024c34b2fef29bb23ab0bf (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:00.423590  4446 tablet_service.cc:1511] Processing CreateTablet for tablet 35e5e0bb2f164d039c7d3a1835389173 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:00.425673  4520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e5e0bb2f164d039c7d3a1835389173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.430397  4446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e5e0bb2f164d039c7d3a1835389173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.425992  4445 tablet_service.cc:1511] Processing CreateTablet for tablet de2cd85925ea49859e5d1d84fb918baa (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:00.437209  4517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37870ee6d9044b5cabe79e830984932b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.443466  4443 tablet_service.cc:1511] Processing CreateTablet for tablet 37870ee6d9044b5cabe79e830984932b (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:00.443473  4444 tablet_service.cc:1511] Processing CreateTablet for tablet acc87feed8a94bd28e69741a974b7b70 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:00.429877  4515 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3366f9baa41bd96e9fffeb819b92d (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:00.450809  4445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2cd85925ea49859e5d1d84fb918baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.450914  4441 tablet_service.cc:1511] Processing CreateTablet for tablet d6d3366f9baa41bd96e9fffeb819b92d (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:00.460403  4442 tablet_service.cc:1511] Processing CreateTablet for tablet 71dc7f7c06024c34b2fef29bb23ab0bf (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 13:15:00.458963  4326 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:00.459626  4519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2cd85925ea49859e5d1d84fb918baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.453073  4365 tablet_service.cc:1511] Processing CreateTablet for tablet d16761a7ea5848a9ae81735b1ac101a1 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:00.464053  4573 tablet_bootstrap.cc:492] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
I20260709 13:15:00.465353  4443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37870ee6d9044b5cabe79e830984932b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.466864  4440 tablet_service.cc:1511] Processing CreateTablet for tablet d16761a7ea5848a9ae81735b1ac101a1 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:00.469854  4365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16761a7ea5848a9ae81735b1ac101a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.474143  4515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3366f9baa41bd96e9fffeb819b92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.472188  4514 tablet_service.cc:1511] Processing CreateTablet for tablet d16761a7ea5848a9ae81735b1ac101a1 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:00.480607  4516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71dc7f7c06024c34b2fef29bb23ab0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.483306  4514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16761a7ea5848a9ae81735b1ac101a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.479054  4442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71dc7f7c06024c34b2fef29bb23ab0bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.486610  4369 tablet_service.cc:1511] Processing CreateTablet for tablet 756d15cfb95c456ea43a00a115f20537 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:00.495077  4369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756d15cfb95c456ea43a00a115f20537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.502502  4440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16761a7ea5848a9ae81735b1ac101a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.529937  4441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d3366f9baa41bd96e9fffeb819b92d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.539193  4444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc87feed8a94bd28e69741a974b7b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.624703  4439 tablet_service.cc:1511] Processing CreateTablet for tablet 756d15cfb95c456ea43a00a115f20537 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:00.630328  4439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756d15cfb95c456ea43a00a115f20537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.655076  4516 tablet_service.cc:1511] Processing CreateTablet for tablet 756d15cfb95c456ea43a00a115f20537 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:00.656549  4516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756d15cfb95c456ea43a00a115f20537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.659919  4573 tablet_bootstrap.cc:654] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.667338  4369 tablet_service.cc:1511] Processing CreateTablet for tablet 6168718fbd2f4f309c02e5baea0f0a83 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:00.667387  4515 tablet_service.cc:1511] Processing CreateTablet for tablet 6168718fbd2f4f309c02e5baea0f0a83 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:00.668708  4369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6168718fbd2f4f309c02e5baea0f0a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.669600  4515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6168718fbd2f4f309c02e5baea0f0a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.678671  4574 tablet_bootstrap.cc:492] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
I20260709 13:15:00.660142  4443 tablet_service.cc:1511] Processing CreateTablet for tablet 6168718fbd2f4f309c02e5baea0f0a83 (DEFAULT_TABLE table=test-workload [id=1352121a0f554521bd8b6c538e3c9191]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:00.682523  4575 tablet_bootstrap.cc:492] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
I20260709 13:15:00.695081  4575 tablet_bootstrap.cc:654] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.698179  4443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6168718fbd2f4f309c02e5baea0f0a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:00.715291  4573 tablet_bootstrap.cc:492] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:00.716061  4573 ts_tablet_manager.cc:1403] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.261s	user 0.025s	sys 0.018s
I20260709 13:15:00.725780  4573 raft_consensus.cc:359] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.726727  4573 raft_consensus.cc:385] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.727123  4573 raft_consensus.cc:740] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.728176  4573 consensus_queue.cc:260] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.731268  4574 tablet_bootstrap.cc:654] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.745857  4406 heartbeater.cc:499] Master 127.4.37.190:39063 was elected leader, sending a full tablet report...
I20260709 13:15:00.746433  4573 ts_tablet_manager.cc:1434] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 13:15:00.753192  4573 tablet_bootstrap.cc:492] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
W20260709 13:15:00.754233  4407 tablet.cc:2406] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:00.758461  4575 tablet_bootstrap.cc:492] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:00.759245  4575 ts_tablet_manager.cc:1403] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.022s
I20260709 13:15:00.761896  4573 tablet_bootstrap.cc:654] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.763567  4575 raft_consensus.cc:359] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.764664  4575 raft_consensus.cc:385] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.765040  4575 raft_consensus.cc:740] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.765987  4575 consensus_queue.cc:260] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.776968  4574 tablet_bootstrap.cc:492] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:00.777623  4574 ts_tablet_manager.cc:1403] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.014s
I20260709 13:15:00.780308  4573 tablet_bootstrap.cc:492] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:00.780843  4573 ts_tablet_manager.cc:1403] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 13:15:00.780903  4574 raft_consensus.cc:359] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.781765  4574 raft_consensus.cc:385] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.782132  4574 raft_consensus.cc:740] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.782893  4574 consensus_queue.cc:260] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.784063  4573 raft_consensus.cc:359] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.784687  4573 raft_consensus.cc:385] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.788805  4481 heartbeater.cc:499] Master 127.4.37.190:39063 was elected leader, sending a full tablet report...
I20260709 13:15:00.790211  4575 ts_tablet_manager.cc:1434] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.003s
I20260709 13:15:00.791240  4575 tablet_bootstrap.cc:492] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
I20260709 13:15:00.792064  4574 ts_tablet_manager.cc:1434] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.011s
I20260709 13:15:00.792822  4555 heartbeater.cc:499] Master 127.4.37.190:39063 was elected leader, sending a full tablet report...
I20260709 13:15:00.798592  4575 tablet_bootstrap.cc:654] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.800520  4574 tablet_bootstrap.cc:492] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
I20260709 13:15:00.784957  4573 raft_consensus.cc:740] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.802304  4573 consensus_queue.cc:260] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.804944  4573 ts_tablet_manager.cc:1434] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:15:00.806396  4573 tablet_bootstrap.cc:492] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
I20260709 13:15:00.813957  4574 tablet_bootstrap.cc:654] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.822394  4573 tablet_bootstrap.cc:654] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.838629  4574 tablet_bootstrap.cc:492] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:00.839354  4574 ts_tablet_manager.cc:1403] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.014s
I20260709 13:15:00.852480  4573 tablet_bootstrap.cc:492] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:00.852165  4574 raft_consensus.cc:359] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.852902  4574 raft_consensus.cc:385] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.852965  4573 ts_tablet_manager.cc:1403] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.023s
I20260709 13:15:00.853294  4574 raft_consensus.cc:740] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.854202  4574 consensus_queue.cc:260] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.857160  4573 raft_consensus.cc:359] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.858055  4573 raft_consensus.cc:385] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.858379  4573 raft_consensus.cc:740] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.859184  4573 consensus_queue.cc:260] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.860981  4574 ts_tablet_manager.cc:1434] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:15:00.862040  4574 tablet_bootstrap.cc:492] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
I20260709 13:15:00.861994  4573 ts_tablet_manager.cc:1434] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:00.863106  4573 tablet_bootstrap.cc:492] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
I20260709 13:15:00.870203  4573 tablet_bootstrap.cc:654] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.870581  4581 raft_consensus.cc:493] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.871433  4581 raft_consensus.cc:515] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.874917  4581 leader_election.cc:290] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:00.869237  4574 tablet_bootstrap.cc:654] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.914520  4573 tablet_bootstrap.cc:492] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:00.916035  4573 ts_tablet_manager.cc:1403] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 13:15:00.917974  4575 tablet_bootstrap.cc:492] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:00.918598  4575 ts_tablet_manager.cc:1403] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.128s	user 0.034s	sys 0.055s
I20260709 13:15:00.924253  4573 raft_consensus.cc:359] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.925384  4573 raft_consensus.cc:385] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.925814  4573 raft_consensus.cc:740] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.926883  4574 tablet_bootstrap.cc:492] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:00.926812  4573 consensus_queue.cc:260] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.932632  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:00.927470  4574 ts_tablet_manager.cc:1403] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.004s
I20260709 13:15:00.935814  4573 ts_tablet_manager.cc:1434] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.007s
I20260709 13:15:00.936584  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:00.922955  4575 raft_consensus.cc:359] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.938542  4381 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
W20260709 13:15:00.938555  4422 leader_election.cc:343] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:00.938652  4573 tablet_bootstrap.cc:492] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
I20260709 13:15:00.940140  4574 raft_consensus.cc:359] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.941336  4574 raft_consensus.cc:385] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.941461  4419 leader_election.cc:304] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:00.941929  4574 raft_consensus.cc:740] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.938611  4575 raft_consensus.cc:385] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.942710  4581 raft_consensus.cc:2804] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:00.942806  4575 raft_consensus.cc:740] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.943184  4581 raft_consensus.cc:493] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.943598  4581 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:00.943928  4575 consensus_queue.cc:260] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.943197  4574 consensus_queue.cc:260] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.954136  4575 ts_tablet_manager.cc:1434] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.010s
I20260709 13:15:00.955405  4575 tablet_bootstrap.cc:492] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
I20260709 13:15:00.955066  4581 raft_consensus.cc:515] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.958578  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:00.958927  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:00.959275  4574 ts_tablet_manager.cc:1434] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:15:00.959427  4381 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:00.960312  4574 tablet_bootstrap.cc:492] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
W20260709 13:15:00.960479  4422 leader_election.cc:343] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:00.963898  4575 tablet_bootstrap.cc:654] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.967770  4574 tablet_bootstrap.cc:654] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.957798  4581 leader_election.cc:290] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:00.969551  4573 tablet_bootstrap.cc:654] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:00.984368  4574 tablet_bootstrap.cc:492] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:00.986438  4574 ts_tablet_manager.cc:1403] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.001s
I20260709 13:15:00.989414  4574 raft_consensus.cc:359] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.990257  4574 raft_consensus.cc:385] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:00.990569  4574 raft_consensus.cc:740] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:00.991343  4574 consensus_queue.cc:260] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.994302  4573 tablet_bootstrap.cc:492] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:00.994882  4573 ts_tablet_manager.cc:1403] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.011s
I20260709 13:15:00.995296  4575 tablet_bootstrap.cc:492] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:00.995916  4575 ts_tablet_manager.cc:1403] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.019s
I20260709 13:15:00.997975  4381 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 1.
I20260709 13:15:00.999440  4419 leader_election.cc:304] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:00.998878  4573 raft_consensus.cc:359] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:00.999169  4575 raft_consensus.cc:359] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.000077  4573 raft_consensus.cc:385] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.000258  4581 raft_consensus.cc:2804] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.000334  4575 raft_consensus.cc:385] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.000444  4573 raft_consensus.cc:740] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.000710  4578 raft_consensus.cc:493] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.000829  4581 raft_consensus.cc:697] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:01.000845  4575 raft_consensus.cc:740] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.001242  4578 raft_consensus.cc:515] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.001390  4573 consensus_queue.cc:260] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.001922  4581 consensus_queue.cc:237] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.004657  4582 raft_consensus.cc:493] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.005319  4582 raft_consensus.cc:515] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.008841  4582 leader_election.cc:290] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:01.011197  4578 leader_election.cc:290] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.018831  4574 ts_tablet_manager.cc:1434] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:15:01.020303  4574 tablet_bootstrap.cc:492] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
I20260709 13:15:01.022183  4575 consensus_queue.cc:260] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.027498  4575 ts_tablet_manager.cc:1434] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:15:01.028671  4575 tablet_bootstrap.cc:492] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
I20260709 13:15:01.041712  4574 tablet_bootstrap.cc:654] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.060643  4595 raft_consensus.cc:493] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.065392  4575 tablet_bootstrap.cc:654] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.064868  4595 raft_consensus.cc:515] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.067265  4573 ts_tablet_manager.cc:1434] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.072s	user 0.011s	sys 0.013s
I20260709 13:15:01.076455  4573 tablet_bootstrap.cc:492] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
I20260709 13:15:01.082926  4574 tablet_bootstrap.cc:492] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:01.085678  4574 ts_tablet_manager.cc:1403] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.007s
I20260709 13:15:01.093609  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:01.093892  4574 raft_consensus.cc:359] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.094677  4381 raft_consensus.cc:2468] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 0.
I20260709 13:15:01.095229  4574 raft_consensus.cc:385] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.095799  4574 raft_consensus.cc:740] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.084511  4277 catalog_manager.cc:5697] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 0 to 1, leader changed from <none> to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.097172  4595 leader_election.cc:290] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.096999  4493 leader_election.cc:304] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:01.102240  4582 raft_consensus.cc:2804] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.102663  4582 raft_consensus.cc:493] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.103017  4582 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.096630  4574 consensus_queue.cc:260] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.120059  4573 tablet_bootstrap.cc:654] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.132961  4582 raft_consensus.cc:515] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.133234  4575 tablet_bootstrap.cc:492] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:01.135025  4575 ts_tablet_manager.cc:1403] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.016s
I20260709 13:15:01.134848  4581 raft_consensus.cc:493] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.136723  4581 raft_consensus.cc:515] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.146294  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:01.147351  4381 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.150655  4582 leader_election.cc:290] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:01.151413  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.160434  4581 leader_election.cc:290] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.153509  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.161351  4575 raft_consensus.cc:359] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.167423  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
W20260709 13:15:01.171025  4346 leader_election.cc:343] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.172482  4530 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
I20260709 13:15:01.174163  4454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:01.175240  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.169821  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:01.176614  4380 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
W20260709 13:15:01.178395  4495 leader_election.cc:343] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:01.179638  4495 leader_election.cc:343] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.169358  4575 raft_consensus.cc:385] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.186995  4575 raft_consensus.cc:740] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.188480  4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.192339  4575 consensus_queue.cc:260] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.192965  4419 leader_election.cc:304] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:01.195109  4456 raft_consensus.cc:2468] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 0.
I20260709 13:15:01.204325  4528 raft_consensus.cc:2393] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 49bb401e63ab4d16a411b6ede4812b60 in current term 1: Already voted for candidate d7ed711cb3924d829581b45c45f9235f in this term.
I20260709 13:15:01.185220  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.206804  4347 leader_election.cc:304] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60; no voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:01.207893  4581 raft_consensus.cc:2804] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.207837  4346 leader_election.cc:304] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:01.208437  4581 raft_consensus.cc:493] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.208823  4581 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.208959  4578 raft_consensus.cc:2804] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.209339  4578 raft_consensus.cc:493] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.209729  4578 raft_consensus.cc:3060] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.212435  4574 ts_tablet_manager.cc:1434] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.126s	user 0.014s	sys 0.020s
I20260709 13:15:01.214656  4574 tablet_bootstrap.cc:492] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
W20260709 13:15:01.215914  4347 leader_election.cc:343] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.220726  4575 ts_tablet_manager.cc:1434] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.004s
I20260709 13:15:01.221993  4575 tablet_bootstrap.cc:492] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
I20260709 13:15:01.223462  4381 raft_consensus.cc:2468] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 1.
I20260709 13:15:01.224002  4595 raft_consensus.cc:2749] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:01.226294  4606 raft_consensus.cc:493] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.226490  4581 raft_consensus.cc:515] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.226913  4606 raft_consensus.cc:515] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.229975  4493 leader_election.cc:304] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:01.231232  4582 raft_consensus.cc:2804] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.234709  4606 leader_election.cc:290] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:01.238509  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.239110  4581 leader_election.cc:290] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.234054  4578 raft_consensus.cc:515] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
W20260709 13:15:01.243719  4495 leader_election.cc:343] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.243912  4578 leader_election.cc:290] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.244736  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
W20260709 13:15:01.246824  4493 leader_election.cc:343] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.247488  4493 leader_election.cc:304] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ed711cb3924d829581b45c45f9235f; no voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:01.248358  4606 raft_consensus.cc:2749] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:01.244737  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:01.248972  4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:01.249701  4529 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.250208  4574 tablet_bootstrap.cc:654] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:01.251068  4347 leader_election.cc:343] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.242213  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:01.255519  4581 raft_consensus.cc:493] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.256702  4581 raft_consensus.cc:515] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.252444  4575 tablet_bootstrap.cc:654] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.260188  4581 leader_election.cc:290] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.257781  4380 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.261561  4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.262036  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:01.266882  4528 raft_consensus.cc:2468] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
I20260709 13:15:01.267395  4456 raft_consensus.cc:3060] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.262423  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:01.265522  4573 tablet_bootstrap.cc:492] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:01.268738  4381 raft_consensus.cc:2468] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
I20260709 13:15:01.269106  4422 leader_election.cc:304] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:01.272583  4581 raft_consensus.cc:2804] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.273176  4581 raft_consensus.cc:493] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.275225  4581 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.273676  4573 ts_tablet_manager.cc:1403] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.024s
I20260709 13:15:01.279799  4529 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 1.
I20260709 13:15:01.281503  4422 leader_election.cc:304] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:01.283077  4591 raft_consensus.cc:2804] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.289520  4380 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 1.
I20260709 13:15:01.289352  4573 raft_consensus.cc:359] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.290650  4573 raft_consensus.cc:385] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.291112  4573 raft_consensus.cc:740] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.279258  4582 raft_consensus.cc:697] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 LEADER]: Becoming Leader. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:01.294622  4582 consensus_queue.cc:237] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.298094  4456 raft_consensus.cc:2468] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 1.
I20260709 13:15:01.297520  4573 consensus_queue.cc:260] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.300594  4591 raft_consensus.cc:697] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:01.299746  4346 leader_election.cc:304] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:01.302495  4578 raft_consensus.cc:2804] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.303058  4578 raft_consensus.cc:697] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:01.303468  4573 ts_tablet_manager.cc:1434] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.014s
I20260709 13:15:01.304817  4573 tablet_bootstrap.cc:492] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
I20260709 13:15:01.302052  4591 consensus_queue.cc:237] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.310771  4581 raft_consensus.cc:515] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.311659  4575 tablet_bootstrap.cc:492] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:01.313652  4575 ts_tablet_manager.cc:1403] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.005s
I20260709 13:15:01.317487  4581 leader_election.cc:290] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.318665  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:01.319747  4380 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.322021  4573 tablet_bootstrap.cc:654] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.311923  4574 tablet_bootstrap.cc:492] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:01.318801  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:01.325520  4574 ts_tablet_manager.cc:1403] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.111s	user 0.017s	sys 0.001s
I20260709 13:15:01.325779  4529 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.307402  4578 consensus_queue.cc:237] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.329206  4380 raft_consensus.cc:2468] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 1.
I20260709 13:15:01.331378  4419 leader_election.cc:304] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:01.332578  4581 raft_consensus.cc:2804] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.333473  4581 raft_consensus.cc:697] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:01.317291  4575 raft_consensus.cc:359] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.334113  4575 raft_consensus.cc:385] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.334453  4581 consensus_queue.cc:237] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.336169  4277 catalog_manager.cc:5697] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ed711cb3924d829581b45c45f9235f (127.4.37.131). New cstate: current_term: 1 leader_uuid: "d7ed711cb3924d829581b45c45f9235f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:01.335191  4575 raft_consensus.cc:740] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.338405  4529 raft_consensus.cc:2468] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 1.
I20260709 13:15:01.339094  4575 consensus_queue.cc:260] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.339365  4574 raft_consensus.cc:359] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.342824  4574 raft_consensus.cc:385] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.343303  4574 raft_consensus.cc:740] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.360554  4575 ts_tablet_manager.cc:1434] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 13:15:01.362576  4575 tablet_bootstrap.cc:492] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
I20260709 13:15:01.344269  4574 consensus_queue.cc:260] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.368780  4574 ts_tablet_manager.cc:1434] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:15:01.370015  4574 tablet_bootstrap.cc:492] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
I20260709 13:15:01.385602  4575 tablet_bootstrap.cc:654] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.388242  4573 tablet_bootstrap.cc:492] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:01.388823  4573 ts_tablet_manager.cc:1403] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.022s
I20260709 13:15:01.389575  4574 tablet_bootstrap.cc:654] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.384421  4275 catalog_manager.cc:5697] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 0 to 1, leader changed from <none> to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.388609  4278 catalog_manager.cc:5697] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.400645  4573 raft_consensus.cc:359] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.401633  4573 raft_consensus.cc:385] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.402297  4573 raft_consensus.cc:740] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.403263  4573 consensus_queue.cc:260] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.406905  4573 ts_tablet_manager.cc:1434] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.006s
I20260709 13:15:01.407951  4573 tablet_bootstrap.cc:492] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
I20260709 13:15:01.421573  4573 tablet_bootstrap.cc:654] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.423018  4591 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:01.428117  4277 catalog_manager.cc:5697] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 0 to 1, leader changed from <none> to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.429827  4575 tablet_bootstrap.cc:492] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:01.430485  4575 ts_tablet_manager.cc:1403] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.014s
I20260709 13:15:01.434070  4578 raft_consensus.cc:493] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.434614  4578 raft_consensus.cc:515] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.436867  4578 leader_election.cc:290] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.437650  4574 tablet_bootstrap.cc:492] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:01.438179  4574 ts_tablet_manager.cc:1403] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.006s
I20260709 13:15:01.438618  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.439726  4575 raft_consensus.cc:359] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.440443  4575 raft_consensus.cc:385] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.440737  4575 raft_consensus.cc:740] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.441905  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.441892  4575 consensus_queue.cc:260] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.442032  4574 raft_consensus.cc:359] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
W20260709 13:15:01.443153  4346 leader_election.cc:343] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.443230  4574 raft_consensus.cc:385] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.443877  4574 raft_consensus.cc:740] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.445508  4575 ts_tablet_manager.cc:1434] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 13:15:01.445143  4574 consensus_queue.cc:260] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.446698  4575 tablet_bootstrap.cc:492] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
W20260709 13:15:01.450301  4347 leader_election.cc:343] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.450821  4347 leader_election.cc:304] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60; no voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:01.451372  4574 ts_tablet_manager.cc:1434] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.006s
I20260709 13:15:01.451961  4578 raft_consensus.cc:2749] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:01.452759  4574 tablet_bootstrap.cc:492] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
I20260709 13:15:01.454429  4575 tablet_bootstrap.cc:654] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.465556  4582 raft_consensus.cc:493] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.466164  4582 raft_consensus.cc:515] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.462074  4573 tablet_bootstrap.cc:492] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:01.467967  4573 ts_tablet_manager.cc:1403] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.006s
I20260709 13:15:01.469141  4582 leader_election.cc:290] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:01.470279  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
W20260709 13:15:01.469270  4326 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:01.471225  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:01.473991  4573 raft_consensus.cc:359] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.474690  4573 raft_consensus.cc:385] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.474938  4573 raft_consensus.cc:740] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.475590  4573 consensus_queue.cc:260] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.479285  4495 leader_election.cc:304] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ed711cb3924d829581b45c45f9235f; no voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:01.481741  4582 raft_consensus.cc:2749] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:01.486418  4574 tablet_bootstrap.cc:654] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.488852  4573 ts_tablet_manager.cc:1434] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:15:01.491551  4575 tablet_bootstrap.cc:492] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:01.492223  4575 ts_tablet_manager.cc:1403] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.002s
I20260709 13:15:01.502571  4575 raft_consensus.cc:359] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.503700  4575 raft_consensus.cc:385] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.504112  4575 raft_consensus.cc:740] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.505183  4578 raft_consensus.cc:493] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.506698  4573 tablet_bootstrap.cc:492] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60: Bootstrap starting.
I20260709 13:15:01.505815  4578 raft_consensus.cc:515] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.509876  4578 leader_election.cc:290] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.510488  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.511107  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.511787  4529 raft_consensus.cc:2468] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 0.
W20260709 13:15:01.512337  4346 leader_election.cc:343] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.513167  4347 leader_election.cc:304] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:01.515354  4573 tablet_bootstrap.cc:654] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.530385  4578 raft_consensus.cc:2804] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.531113  4578 raft_consensus.cc:493] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.531654  4578 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.532774  4573 tablet_bootstrap.cc:492] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60: No bootstrap required, opened a new log
I20260709 13:15:01.533370  4573 ts_tablet_manager.cc:1403] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.018s
I20260709 13:15:01.536731  4573 raft_consensus.cc:359] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.537736  4573 raft_consensus.cc:385] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.538071  4573 raft_consensus.cc:740] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.538887  4573 consensus_queue.cc:260] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.542445  4573 ts_tablet_manager.cc:1434] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:01.542969  4578 raft_consensus.cc:515] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.547811  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:01.548506  4578 leader_election.cc:290] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.547896  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:01.549281  4529 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:01.549942  4346 leader_election.cc:343] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.550155  4528 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.556169  4575 consensus_queue.cc:260] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.559512  4575 ts_tablet_manager.cc:1434] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.067s	user 0.011s	sys 0.000s
I20260709 13:15:01.560726  4575 tablet_bootstrap.cc:492] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
I20260709 13:15:01.567764  4575 tablet_bootstrap.cc:654] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.571564  4529 raft_consensus.cc:2468] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 1.
I20260709 13:15:01.573544  4575 tablet_bootstrap.cc:492] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:01.573699  4347 leader_election.cc:304] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:01.574119  4575 ts_tablet_manager.cc:1403] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:15:01.575110  4578 raft_consensus.cc:2804] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.575625  4574 tablet_bootstrap.cc:492] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:01.575640  4578 raft_consensus.cc:697] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:01.576905  4611 raft_consensus.cc:493] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.576949  4578 consensus_queue.cc:237] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.577535  4611 raft_consensus.cc:515] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.580469  4611 leader_election.cc:290] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.576098  4574 ts_tablet_manager.cc:1403] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.053s
I20260709 13:15:01.581717  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:01.582110  4575 raft_consensus.cc:359] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.582576  4380 raft_consensus.cc:2468] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
I20260709 13:15:01.582860  4575 raft_consensus.cc:385] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.583213  4575 raft_consensus.cc:740] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.583902  4575 consensus_queue.cc:260] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.584633  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.585170  4574 raft_consensus.cc:359] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.585954  4574 raft_consensus.cc:385] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.586406  4419 leader_election.cc:304] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:01.586849  4574 raft_consensus.cc:740] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.587457  4611 raft_consensus.cc:2804] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.587832  4611 raft_consensus.cc:493] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.588294  4611 raft_consensus.cc:3060] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.587966  4574 consensus_queue.cc:260] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.586465  4575 ts_tablet_manager.cc:1434] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:01.590097  4575 tablet_bootstrap.cc:492] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820: Bootstrap starting.
I20260709 13:15:01.590729  4574 ts_tablet_manager.cc:1434] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:15:01.591740  4574 tablet_bootstrap.cc:492] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f: Bootstrap starting.
I20260709 13:15:01.593530  4530 raft_consensus.cc:2468] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
I20260709 13:15:01.598202  4574 tablet_bootstrap.cc:654] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.597883  4581 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:01.599244  4276 catalog_manager.cc:5697] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.609179  4611 raft_consensus.cc:515] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.617522  4575 tablet_bootstrap.cc:654] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:01.623175  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:01.623970  4380 raft_consensus.cc:3060] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.625458  4574 tablet_bootstrap.cc:492] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f: No bootstrap required, opened a new log
I20260709 13:15:01.626260  4574 ts_tablet_manager.cc:1403] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.011s
I20260709 13:15:01.628968  4578 raft_consensus.cc:493] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.629743  4578 raft_consensus.cc:515] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.633520  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6168718fbd2f4f309c02e5baea0f0a83" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.634088  4578 leader_election.cc:290] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.634316  4456 raft_consensus.cc:2468] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 0.
I20260709 13:15:01.633579  4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6168718fbd2f4f309c02e5baea0f0a83" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.636507  4380 raft_consensus.cc:2468] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 1.
I20260709 13:15:01.636893  4574 raft_consensus.cc:359] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.637010  4611 leader_election.cc:290] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.637698  4574 raft_consensus.cc:385] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.638042  4574 raft_consensus.cc:740] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.638561  4419 leader_election.cc:304] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:01.638675  4528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:01.638746  4574 consensus_queue.cc:260] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.639402  4528 raft_consensus.cc:3060] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.639736  4611 raft_consensus.cc:2804] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.640434  4611 raft_consensus.cc:697] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:01.640951  4574 ts_tablet_manager.cc:1434] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
W20260709 13:15:01.637274  4347 leader_election.cc:343] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:01.642516  4346 leader_election.cc:304] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:01.643321  4578 raft_consensus.cc:2804] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.643847  4578 raft_consensus.cc:493] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.641492  4611 consensus_queue.cc:237] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.644178  4578 raft_consensus.cc:3060] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.643283  4575 tablet_bootstrap.cc:492] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820: No bootstrap required, opened a new log
I20260709 13:15:01.645651  4575 ts_tablet_manager.cc:1403] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 13:15:01.648191  4575 raft_consensus.cc:359] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.648826  4575 raft_consensus.cc:385] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:01.649073  4575 raft_consensus.cc:740] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Initialized, Role: FOLLOWER
I20260709 13:15:01.649753  4575 consensus_queue.cc:260] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.650636  4578 raft_consensus.cc:515] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.652742  4578 leader_election.cc:290] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.653627  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6168718fbd2f4f309c02e5baea0f0a83" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:01.653779  4575 ts_tablet_manager.cc:1434] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:01.654271  4456 raft_consensus.cc:3060] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.654457  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6168718fbd2f4f309c02e5baea0f0a83" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:01.655640  4529 raft_consensus.cc:3060] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.662149  4528 raft_consensus.cc:2468] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 1.
I20260709 13:15:01.665931  4456 raft_consensus.cc:2468] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 1.
I20260709 13:15:01.667579  4529 raft_consensus.cc:2468] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 1.
I20260709 13:15:01.669253  4346 leader_election.cc:304] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:01.670795  4578 raft_consensus.cc:2804] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.673460  4578 raft_consensus.cc:697] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:01.674659  4578 consensus_queue.cc:237] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.675714  4274 catalog_manager.cc:5697] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 0 to 1, leader changed from <none> to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.688266  4277 catalog_manager.cc:5697] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.698338  4456 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.705869  4582 consensus_queue.cc:1048] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:01.717094  4611 raft_consensus.cc:493] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.718225  4606 consensus_queue.cc:1048] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:01.718106  4611 raft_consensus.cc:515] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.726514  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.727227  4530 raft_consensus.cc:2468] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
I20260709 13:15:01.728467  4578 raft_consensus.cc:493] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.729024  4578 raft_consensus.cc:515] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.729363  4422 leader_election.cc:304] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:01.729748  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:01.730271  4581 raft_consensus.cc:2804] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.730415  4381 raft_consensus.cc:2468] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 0.
I20260709 13:15:01.730695  4581 raft_consensus.cc:493] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.731105  4581 raft_consensus.cc:3060] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.731490  4578 leader_election.cc:290] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.732407  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.734059  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.734728  4530 raft_consensus.cc:2468] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 0.
I20260709 13:15:01.736035  4347 leader_election.cc:304] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:01.737696  4611 leader_election.cc:290] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.738866  4581 raft_consensus.cc:515] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.739473  4595 raft_consensus.cc:2804] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:01.739897  4595 raft_consensus.cc:493] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.740267  4595 raft_consensus.cc:3060] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.742427  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:01.743076  4530 raft_consensus.cc:3060] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.745941  4455 raft_consensus.cc:2393] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 49bb401e63ab4d16a411b6ede4812b60 in current term 1: Already voted for candidate 570d4db77af946d1a3c92a42133a0820 in this term.
I20260709 13:15:01.749655  4595 raft_consensus.cc:515] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.752589  4595 leader_election.cc:290] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.753312  4581 leader_election.cc:290] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.754158  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:01.754803  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:01.755580  4380 raft_consensus.cc:2393] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 570d4db77af946d1a3c92a42133a0820 in current term 1: Already voted for candidate 49bb401e63ab4d16a411b6ede4812b60 in this term.
I20260709 13:15:01.755872  4530 raft_consensus.cc:2468] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 1.
I20260709 13:15:01.754158  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d16761a7ea5848a9ae81735b1ac101a1" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:01.757673  4422 leader_election.cc:304] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:01.760723  4455 raft_consensus.cc:2393] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 49bb401e63ab4d16a411b6ede4812b60 in current term 1: Already voted for candidate 570d4db77af946d1a3c92a42133a0820 in this term.
I20260709 13:15:01.761392  4530 raft_consensus.cc:3060] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.761634  4581 raft_consensus.cc:2804] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:01.762298  4581 raft_consensus.cc:697] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:01.762737  4346 leader_election.cc:304] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60; no voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:01.763664  4578 raft_consensus.cc:2749] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:01.764556  4581 consensus_queue.cc:237] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.767318  4578 consensus_queue.cc:1048] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:01.773147  4578 consensus_queue.cc:1048] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:01.776743  4582 raft_consensus.cc:493] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.777309  4582 raft_consensus.cc:515] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.782157  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:01.783938  4582 leader_election.cc:290] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:01.785542  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "570d4db77af946d1a3c92a42133a0820" is_pre_election: true
I20260709 13:15:01.787205  4495 leader_election.cc:304] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ed711cb3924d829581b45c45f9235f; no voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:01.788754  4277 catalog_manager.cc:5697] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 0 to 1, leader changed from <none> to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:01.793313  4582 raft_consensus.cc:2749] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:01.821942  4581 consensus_queue.cc:1048] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:01.835250  4591 consensus_queue.cc:1048] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:01.881289  4591 consensus_queue.cc:1048] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:01.888801  4591 raft_consensus.cc:493] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.889323  4591 raft_consensus.cc:515] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:01.893600  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bb401e63ab4d16a411b6ede4812b60" is_pre_election: true
I20260709 13:15:01.895936  4591 leader_election.cc:290] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:01.903309  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ed711cb3924d829581b45c45f9235f" is_pre_election: true
I20260709 13:15:01.903331  4611 consensus_queue.cc:1048] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:01.904517  4530 raft_consensus.cc:2393] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 570d4db77af946d1a3c92a42133a0820 in current term 1: Already voted for candidate 49bb401e63ab4d16a411b6ede4812b60 in this term.
I20260709 13:15:01.911444  4422 leader_election.cc:304] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820; no voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:01.912916  4581 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:01.923347  4581 raft_consensus.cc:2749] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:02.046912  4581 consensus_queue.cc:1048] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:02.060680  4645 consensus_queue.cc:1048] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:02.082556  4641 consensus_queue.cc:1048] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:02.097393  4595 consensus_queue.cc:1048] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:02.105368  4595 consensus_queue.cc:1048] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:02.144539  4578 consensus_queue.cc:1048] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:02.159484  4456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
mode: GRACEFUL
new_leader_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:37834
I20260709 13:15:02.160219  4456 raft_consensus.cc:606] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Received request to transfer leadership to TS 49bb401e63ab4d16a411b6ede4812b60
I20260709 13:15:02.183418  4530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70"
dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
mode: GRACEFUL
new_leader_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:35386
I20260709 13:15:02.184197  4530 raft_consensus.cc:606] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 LEADER]: Received request to transfer leadership to TS 49bb401e63ab4d16a411b6ede4812b60
I20260709 13:15:02.191278  4456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
mode: GRACEFUL
new_leader_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:37834
I20260709 13:15:02.191818  4456 raft_consensus.cc:606] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Received request to transfer leadership to TS 49bb401e63ab4d16a411b6ede4812b60
I20260709 13:15:02.213601  4380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
mode: GRACEFUL
new_leader_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:15:02.214171  4380 raft_consensus.cc:606] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Received request to transfer leadership to TS 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:02.229784  4380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6168718fbd2f4f309c02e5baea0f0a83"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
mode: GRACEFUL
new_leader_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:15:02.230356  4380 raft_consensus.cc:606] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Received request to transfer leadership to TS d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:02.287774  4645 consensus_queue.cc:1048] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:02.301249  4591 consensus_queue.cc:1048] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:02.399366  4581 raft_consensus.cc:993] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820: : Instructing follower 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:02.399959  4591 raft_consensus.cc:1081] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Signalling peer 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:02.402019  4380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:33852
I20260709 13:15:02.402598  4380 raft_consensus.cc:493] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.402917  4380 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.410730  4380 raft_consensus.cc:515] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.415050  4380 leader_election.cc:290] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 2 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:02.416000  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:02.416427  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:02.416663  4456 raft_consensus.cc:3055] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:02.416977  4530 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.417004  4456 raft_consensus.cc:740] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:02.418004  4456 consensus_queue.cc:260] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.419328  4456 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.426205  4530 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 2.
I20260709 13:15:02.428408  4347 leader_election.cc:304] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:02.428843  4456 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 2.
I20260709 13:15:02.429481  4578 raft_consensus.cc:2804] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.430380  4578 raft_consensus.cc:697] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:02.431380  4578 consensus_queue.cc:237] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.440392  4278 catalog_manager.cc:5697] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 1 to 2, leader changed from 570d4db77af946d1a3c92a42133a0820 (127.4.37.130) to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.491595  4578 raft_consensus.cc:993] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60: : Instructing follower 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:02.492059  4578 raft_consensus.cc:1081] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Signalling peer 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:02.493961  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:37818
I20260709 13:15:02.494578  4456 raft_consensus.cc:493] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.495154  4456 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.500679  4456 raft_consensus.cc:515] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.502786  4456 leader_election.cc:290] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 2 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:02.503701  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:02.504072  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:02.504443  4380 raft_consensus.cc:3055] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:02.504808  4530 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.504817  4380 raft_consensus.cc:740] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:02.506211  4380 consensus_queue.cc:260] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.507421  4380 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.514577  4380 raft_consensus.cc:2468] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 2.
I20260709 13:15:02.514504  4530 raft_consensus.cc:2468] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 2.
I20260709 13:15:02.516139  4419 leader_election.cc:304] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:02.517724  4645 raft_consensus.cc:2804] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.518224  4645 raft_consensus.cc:697] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 2 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:02.519078  4645 consensus_queue.cc:237] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.520948  4581 raft_consensus.cc:993] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820: : Instructing follower 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:02.521404  4581 raft_consensus.cc:1081] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Signalling peer 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:02.524647  4380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:33852
I20260709 13:15:02.525243  4380 raft_consensus.cc:493] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.525661  4380 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.530439  4278 catalog_manager.cc:5697] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 1 to 2, leader changed from 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129) to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.545951  4380 raft_consensus.cc:515] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.550839  4380 leader_election.cc:290] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 2 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:02.552035  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:02.552583  4582 raft_consensus.cc:993] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f: : Instructing follower 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:02.552747  4456 raft_consensus.cc:3055] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:02.553036  4582 raft_consensus.cc:1081] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 LEADER]: Signalling peer 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:02.553089  4456 raft_consensus.cc:740] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:02.554409  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:02.555042  4530 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.555760  4380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:33860
I20260709 13:15:02.556351  4380 raft_consensus.cc:493] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.556718  4380 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.557816  4456 consensus_queue.cc:260] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.559233  4456 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.564589  4380 raft_consensus.cc:515] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.566668  4530 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 2.
I20260709 13:15:02.567675  4380 leader_election.cc:290] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 2 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:02.568586  4347 leader_election.cc:304] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:02.569196  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:02.569415  4641 raft_consensus.cc:2804] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.569831  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:02.569983  4641 raft_consensus.cc:697] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:02.569887  4455 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.571209  4641 consensus_queue.cc:237] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.577140  4455 raft_consensus.cc:2468] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 2.
I20260709 13:15:02.579028  4346 leader_election.cc:304] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:02.580096  4578 raft_consensus.cc:2804] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.580718  4578 raft_consensus.cc:697] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:02.581468  4456 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 2.
I20260709 13:15:02.581759  4578 consensus_queue.cc:237] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.582504  4276 catalog_manager.cc:5697] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 1 to 2, leader changed from 570d4db77af946d1a3c92a42133a0820 (127.4.37.130) to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.586406  4530 raft_consensus.cc:3055] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:02.586794  4530 raft_consensus.cc:740] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:02.587559  4530 consensus_queue.cc:260] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.588873  4530 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.596153  4530 raft_consensus.cc:2468] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 2.
I20260709 13:15:02.602926  4276 catalog_manager.cc:5697] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 1 to 2, leader changed from d7ed711cb3924d829581b45c45f9235f (127.4.37.131) to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.617311  4578 raft_consensus.cc:993] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60: : Instructing follower d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:02.617916  4641 raft_consensus.cc:1081] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Signalling peer d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:02.620731  4530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6168718fbd2f4f309c02e5baea0f0a83"
dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:35372
I20260709 13:15:02.621371  4530 raft_consensus.cc:493] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.621819  4530 raft_consensus.cc:3060] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.628887  4530 raft_consensus.cc:515] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.631124  4530 leader_election.cc:290] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 2 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:02.632249  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6168718fbd2f4f309c02e5baea0f0a83" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:02.632344  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6168718fbd2f4f309c02e5baea0f0a83" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:02.632987  4380 raft_consensus.cc:3055] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:02.633050  4456 raft_consensus.cc:3060] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.633497  4380 raft_consensus.cc:740] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:02.634357  4380 consensus_queue.cc:260] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.635622  4380 raft_consensus.cc:3060] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.638517  4456 raft_consensus.cc:2468] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 2.
I20260709 13:15:02.639715  4495 leader_election.cc:304] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:02.640458  4582 raft_consensus.cc:2804] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.640900  4582 raft_consensus.cc:697] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 2 LEADER]: Becoming Leader. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:02.641786  4582 consensus_queue.cc:237] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:02.642772  4380 raft_consensus.cc:2468] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 2.
I20260709 13:15:02.651391  4276 catalog_manager.cc:5697] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f reported cstate change: term changed from 1 to 2, leader changed from 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129) to d7ed711cb3924d829581b45c45f9235f (127.4.37.131). New cstate: current_term: 2 leader_uuid: "d7ed711cb3924d829581b45c45f9235f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:02.872226  4530 raft_consensus.cc:1275] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:02.874498  4641 consensus_queue.cc:1048] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:02.888741  4456 raft_consensus.cc:1275] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:02.891498  4641 consensus_queue.cc:1048] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:02.925931  4530 raft_consensus.cc:1275] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:02.929580  4645 consensus_queue.cc:1048] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:02.939036  4380 raft_consensus.cc:1275] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:02.941629  4591 consensus_queue.cc:1048] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:03.008189  4530 raft_consensus.cc:1275] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.010128  4641 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:03.016157  4456 raft_consensus.cc:1275] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.017583  4595 consensus_queue.cc:1048] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:03.022408  4456 raft_consensus.cc:1275] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.024679  4578 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:03.030627  4380 raft_consensus.cc:1275] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.033756  4582 consensus_queue.cc:1048] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:03.043452  4530 raft_consensus.cc:1275] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.045514  4641 consensus_queue.cc:1048] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:03.051137  4455 raft_consensus.cc:1275] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.053057  4582 consensus_queue.cc:1048] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:05.275475  4246 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:15:05.276471  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:05.305871  4381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
mode: GRACEFUL
new_leader_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:45968
I20260709 13:15:05.306528  4381 raft_consensus.cc:606] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Received request to transfer leadership to TS d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:05.321058  4455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
mode: GRACEFUL
new_leader_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:57598
I20260709 13:15:05.322319  4455 raft_consensus.cc:606] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Received request to transfer leadership to TS d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:05.324198  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:05.325254  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:05.435405  4680 raft_consensus.cc:993] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820: : Instructing follower d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:05.435971  4680 raft_consensus.cc:1081] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Signalling peer d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:05.437695  4530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf"
dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:35356
I20260709 13:15:05.438217  4530 raft_consensus.cc:493] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.438524  4530 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.443034  4530 raft_consensus.cc:515] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:05.444995  4530 leader_election.cc:290] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 2 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:05.445762  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:05.446421  4381 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.446471  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:05.447412  4455 raft_consensus.cc:3055] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:05.447775  4455 raft_consensus.cc:740] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:05.448669  4455 consensus_queue.cc:260] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:05.449831  4455 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:05.452610  4381 raft_consensus.cc:2468] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 2.
I20260709 13:15:05.454571  4493 leader_election.cc:304] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:05.455507  4674 raft_consensus.cc:2804] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:05.456804  4455 raft_consensus.cc:2468] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 2.
I20260709 13:15:05.456897  4674 raft_consensus.cc:697] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 2 LEADER]: Becoming Leader. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:05.458113  4674 consensus_queue.cc:237] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:05.469360  4277 catalog_manager.cc:5697] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f reported cstate change: term changed from 1 to 2, leader changed from 570d4db77af946d1a3c92a42133a0820 (127.4.37.130) to d7ed711cb3924d829581b45c45f9235f (127.4.37.131). New cstate: current_term: 2 leader_uuid: "d7ed711cb3924d829581b45c45f9235f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:05.740577  4595 raft_consensus.cc:993] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60: : Instructing follower d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:05.741047  4595 raft_consensus.cc:1081] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Signalling peer d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:05.743047  4530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b"
dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:35372
I20260709 13:15:05.743501  4530 raft_consensus.cc:493] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:05.743744  4530 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.749675  4530 raft_consensus.cc:515] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:05.751545  4530 leader_election.cc:290] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 3 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:05.752849  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:05.753399  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:05.753579  4381 raft_consensus.cc:3055] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:05.753916  4381 raft_consensus.cc:740] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:05.753966  4455 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.755446  4381 consensus_queue.cc:260] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:05.756651  4381 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.760779  4455 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 3.
I20260709 13:15:05.762267  4495 leader_election.cc:304] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:05.762365  4381 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 3.
I20260709 13:15:05.763144  4674 raft_consensus.cc:2804] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:05.763741  4674 raft_consensus.cc:697] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 3 LEADER]: Becoming Leader. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:05.764575  4674 consensus_queue.cc:237] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:05.774926  4277 catalog_manager.cc:5697] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f reported cstate change: term changed from 2 to 3, leader changed from 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129) to d7ed711cb3924d829581b45c45f9235f (127.4.37.131). New cstate: current_term: 3 leader_uuid: "d7ed711cb3924d829581b45c45f9235f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:05.932029  4455 raft_consensus.cc:1275] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.932590  4381 raft_consensus.cc:1275] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:05.933645  4674 consensus_queue.cc:1048] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:05.934410  4681 consensus_queue.cc:1048] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:06.241093  4381 raft_consensus.cc:1275] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.242641  4681 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.252851  4455 raft_consensus.cc:1275] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.254419  4691 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.326488  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:06.336831  4381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
mode: GRACEFUL
new_leader_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:15:06.337401  4381 raft_consensus.cc:606] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Received request to transfer leadership to TS 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:06.343115  4381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
mode: GRACEFUL
new_leader_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:15:06.343605  4381 raft_consensus.cc:606] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Received request to transfer leadership to TS 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:06.350600  4381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
mode: GRACEFUL
new_leader_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:15:06.351136  4381 raft_consensus.cc:606] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Received request to transfer leadership to TS 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:06.356825  4530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b"
dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
mode: GRACEFUL
new_leader_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:35386
I20260709 13:15:06.357300  4530 raft_consensus.cc:606] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 3 LEADER]: Received request to transfer leadership to TS 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:06.362334  4530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf"
dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
mode: GRACEFUL
new_leader_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:35386
I20260709 13:15:06.362776  4530 raft_consensus.cc:606] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 2 LEADER]: Received request to transfer leadership to TS 570d4db77af946d1a3c92a42133a0820
I20260709 13:15:06.436115  4595 raft_consensus.cc:993] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60: : Instructing follower 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.436538  4697 raft_consensus.cc:1081] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Signalling peer 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.438182  4455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:37818
I20260709 13:15:06.438747  4455 raft_consensus.cc:493] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.439069  4455 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.444733  4455 raft_consensus.cc:515] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.447398  4455 leader_election.cc:290] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 3 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:06.447952  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:06.448170  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:06.448511  4530 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.448764  4381 raft_consensus.cc:3055] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:06.449129  4381 raft_consensus.cc:740] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:06.449939  4381 consensus_queue.cc:260] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.451905  4681 raft_consensus.cc:993] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f: : Instructing follower 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.451761  4381 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.452502  4681 raft_consensus.cc:1081] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 2 LEADER]: Signalling peer 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.453800  4530 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 3.
I20260709 13:15:06.454622  4455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:37820
I20260709 13:15:06.455211  4455 raft_consensus.cc:493] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.455127  4422 leader_election.cc:304] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:06.455646  4455 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.455998  4675 raft_consensus.cc:2804] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:06.457520  4675 raft_consensus.cc:697] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:06.458482  4675 consensus_queue.cc:237] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.460347  4381 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 3.
I20260709 13:15:06.462589  4455 raft_consensus.cc:515] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.464924  4455 leader_election.cc:290] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 3 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:06.465598  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:06.466382  4381 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.466408  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71dc7f7c06024c34b2fef29bb23ab0bf" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:06.467190  4530 raft_consensus.cc:3055] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:06.466804  4277 catalog_manager.cc:5697] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 2 to 3, leader changed from 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129) to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.467490  4530 raft_consensus.cc:740] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:06.468320  4530 consensus_queue.cc:260] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.469455  4530 raft_consensus.cc:3060] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.474615  4530 raft_consensus.cc:2468] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 3.
I20260709 13:15:06.475270  4381 raft_consensus.cc:2468] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 3.
I20260709 13:15:06.476094  4422 leader_election.cc:304] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:06.477154  4675 raft_consensus.cc:2804] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:06.477643  4675 raft_consensus.cc:697] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:06.478374  4675 consensus_queue.cc:237] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.484678  4277 catalog_manager.cc:5697] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 2 to 3, leader changed from d7ed711cb3924d829581b45c45f9235f (127.4.37.131) to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.640738  4595 raft_consensus.cc:993] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60: : Instructing follower 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.641258  4697 raft_consensus.cc:1081] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Signalling peer 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.642858  4456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:37818
I20260709 13:15:06.643464  4456 raft_consensus.cc:493] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.643878  4691 raft_consensus.cc:993] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f: : Instructing follower 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.643848  4456 raft_consensus.cc:3060] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.644397  4681 raft_consensus.cc:1081] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 3 LEADER]: Signalling peer 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.646113  4455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:37820
I20260709 13:15:06.646699  4455 raft_consensus.cc:493] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.647066  4455 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.653548  4456 raft_consensus.cc:515] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.656991  4456 leader_election.cc:290] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 2 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:06.657061  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:06.657887  4381 raft_consensus.cc:3055] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:06.657687  4455 raft_consensus.cc:515] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.658149  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2cd85925ea49859e5d1d84fb918baa" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:06.658257  4381 raft_consensus.cc:740] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:06.658695  4530 raft_consensus.cc:3060] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.659128  4381 consensus_queue.cc:260] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.660187  4455 leader_election.cc:290] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 4 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:06.660379  4381 raft_consensus.cc:3060] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.661511  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:06.661680  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:06.662181  4529 raft_consensus.cc:3055] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:06.662281  4380 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.662629  4529 raft_consensus.cc:740] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:06.663580  4529 consensus_queue.cc:260] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.664954  4529 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.667620  4381 raft_consensus.cc:2468] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 2.
I20260709 13:15:06.667505  4530 raft_consensus.cc:2468] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 2.
I20260709 13:15:06.668959  4419 leader_election.cc:304] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:06.670145  4675 raft_consensus.cc:2804] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:06.670397  4380 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 4.
I20260709 13:15:06.670660  4675 raft_consensus.cc:697] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 2 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:06.671625  4419 leader_election.cc:304] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, 570d4db77af946d1a3c92a42133a0820; no voters: 
I20260709 13:15:06.671507  4675 consensus_queue.cc:237] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.673731  4703 raft_consensus.cc:2804] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:06.674451  4703 raft_consensus.cc:697] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 4 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:06.675036  4529 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 4.
I20260709 13:15:06.675637  4703 consensus_queue.cc:237] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.681559  4277 catalog_manager.cc:5697] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 1 to 2, leader changed from 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129) to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.696054  4277 catalog_manager.cc:5697] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 3 to 4, leader changed from d7ed711cb3924d829581b45c45f9235f (127.4.37.131) to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 4 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.791460  4595 raft_consensus.cc:993] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60: : Instructing follower 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.792143  4697 raft_consensus.cc:1081] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Signalling peer 570d4db77af946d1a3c92a42133a0820 to start an election
I20260709 13:15:06.794269  4455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
 from {username='slave'} at 127.0.0.1:37818
I20260709 13:15:06.794881  4455 raft_consensus.cc:493] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.795177  4455 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.799856  4455 raft_consensus.cc:515] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.801558  4455 leader_election.cc:290] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 3 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:06.802923  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:06.802934  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "570d4db77af946d1a3c92a42133a0820" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:06.803494  4529 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.803768  4381 raft_consensus.cc:3055] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:06.804122  4381 raft_consensus.cc:740] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:06.804917  4381 consensus_queue.cc:260] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.806006  4381 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.808918  4529 raft_consensus.cc:2468] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 3.
I20260709 13:15:06.810189  4422 leader_election.cc:304] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:06.810950  4703 raft_consensus.cc:2804] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:06.811368  4703 raft_consensus.cc:697] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Becoming Leader. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:06.812016  4703 consensus_queue.cc:237] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:06.814145  4381 raft_consensus.cc:2468] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 570d4db77af946d1a3c92a42133a0820 in term 3.
I20260709 13:15:06.819736  4277 catalog_manager.cc:5697] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 reported cstate change: term changed from 2 to 3, leader changed from 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129) to 570d4db77af946d1a3c92a42133a0820 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "570d4db77af946d1a3c92a42133a0820" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.886030  4381 raft_consensus.cc:1275] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.888088  4703 consensus_queue.cc:1048] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.899165  4529 raft_consensus.cc:1275] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.901120  4703 consensus_queue.cc:1048] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:06.921224  4381 raft_consensus.cc:1275] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.922624  4698 consensus_queue.cc:1048] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.931453  4529 raft_consensus.cc:1275] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:06.933617  4698 consensus_queue.cc:1048] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.191046  4529 raft_consensus.cc:1275] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.192780  4698 consensus_queue.cc:1048] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:07.203755  4381 raft_consensus.cc:1275] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:07.205468  4675 consensus_queue.cc:1048] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:07.213970  4529 raft_consensus.cc:1275] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:07.215366  4675 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:07.225147  4381 raft_consensus.cc:1275] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:07.226722  4698 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:07.323791  4381 raft_consensus.cc:1275] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:07.325739  4713 consensus_queue.cc:1048] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:07.338397  4529 raft_consensus.cc:1275] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Refusing update from remote peer 570d4db77af946d1a3c92a42133a0820: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:07.340787  4713 consensus_queue.cc:1048] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:09.376694  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:09.384186  4455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
mode: GRACEFUL
new_leader_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:57598
I20260709 13:15:09.384965  4455 raft_consensus.cc:606] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Received request to transfer leadership to TS d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:09.389704  4455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
mode: GRACEFUL
new_leader_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:57598
I20260709 13:15:09.390308  4455 raft_consensus.cc:606] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 4 LEADER]: Received request to transfer leadership to TS d7ed711cb3924d829581b45c45f9235f
I20260709 13:15:09.393615  4455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
mode: GRACEFUL
new_leader_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:57598
I20260709 13:15:09.394244  4455 raft_consensus.cc:606] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Received request to transfer leadership to TS 49bb401e63ab4d16a411b6ede4812b60
I20260709 13:15:09.396955  4455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
mode: GRACEFUL
new_leader_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:57598
I20260709 13:15:09.397626  4455 raft_consensus.cc:606] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Received request to transfer leadership to TS 49bb401e63ab4d16a411b6ede4812b60
I20260709 13:15:09.400362  4455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d"
dest_uuid: "570d4db77af946d1a3c92a42133a0820"
mode: GRACEFUL
new_leader_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:57598
I20260709 13:15:09.400955  4455 raft_consensus.cc:606] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 2 LEADER]: Received request to transfer leadership to TS 49bb401e63ab4d16a411b6ede4812b60
I20260709 13:15:09.402321  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:09.402781  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:09.450349  4718 raft_consensus.cc:993] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820: : Instructing follower 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:09.450942  4718 raft_consensus.cc:1081] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Signalling peer 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:09.452834  4380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:33852
I20260709 13:15:09.453387  4380 raft_consensus.cc:493] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.453902  4380 raft_consensus.cc:3060] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.459189  4380 raft_consensus.cc:515] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.461025  4380 leader_election.cc:290] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 2 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:09.462248  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:09.462388  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d15cfb95c456ea43a00a115f20537" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:09.463048  4455 raft_consensus.cc:3055] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:09.463124  4530 raft_consensus.cc:3060] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.463346  4455 raft_consensus.cc:740] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:09.464144  4455 consensus_queue.cc:260] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.465372  4455 raft_consensus.cc:3060] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:09.469058  4530 raft_consensus.cc:2468] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 2.
I20260709 13:15:09.470515  4347 leader_election.cc:304] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:09.471822  4455 raft_consensus.cc:2468] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 2.
I20260709 13:15:09.472529  4719 raft_consensus.cc:2804] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:09.473798  4719 raft_consensus.cc:697] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:09.474697  4719 consensus_queue.cc:237] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.482471  4277 catalog_manager.cc:5697] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 1 to 2, leader changed from 570d4db77af946d1a3c92a42133a0820 (127.4.37.130) to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.583920  4675 raft_consensus.cc:993] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820: : Instructing follower 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:09.584542  4718 raft_consensus.cc:1081] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 2 LEADER]: Signalling peer 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:09.587220  4380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:33852
I20260709 13:15:09.587878  4380 raft_consensus.cc:493] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.588317  4380 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.595461  4675 raft_consensus.cc:993] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820: : Instructing follower 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:09.595603  4380 raft_consensus.cc:515] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.596060  4675 raft_consensus.cc:1081] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Signalling peer 49bb401e63ab4d16a411b6ede4812b60 to start an election
I20260709 13:15:09.597833  4380 leader_election.cc:290] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 3 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:09.598276  4381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70"
dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
 from {username='slave'} at 127.0.0.1:33852
I20260709 13:15:09.598870  4381 raft_consensus.cc:493] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.599341  4381 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.599005  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:09.599005  4530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d3366f9baa41bd96e9fffeb819b92d" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:09.599951  4455 raft_consensus.cc:3055] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:09.600018  4530 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.600431  4455 raft_consensus.cc:740] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:09.601336  4455 consensus_queue.cc:260] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.602809  4455 raft_consensus.cc:3060] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.607453  4381 raft_consensus.cc:515] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.609825  4381 leader_election.cc:290] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 4 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), d7ed711cb3924d829581b45c45f9235f (127.4.37.131:44099)
I20260709 13:15:09.609884  4530 raft_consensus.cc:2468] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 3.
I20260709 13:15:09.611668  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:09.611811  4529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc87feed8a94bd28e69741a974b7b70" candidate_uuid: "49bb401e63ab4d16a411b6ede4812b60" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
I20260709 13:15:09.612406  4456 raft_consensus.cc:3055] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.612571  4529 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.612782  4456 raft_consensus.cc:740] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:09.613322  4455 raft_consensus.cc:2468] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 3.
I20260709 13:15:09.615059  4456 consensus_queue.cc:260] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.616393  4456 raft_consensus.cc:3060] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.611682  4347 leader_election.cc:304] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:09.618460  4719 raft_consensus.cc:2804] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:09.618932  4719 raft_consensus.cc:697] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 3 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:09.619820  4719 consensus_queue.cc:237] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.621763  4529 raft_consensus.cc:2468] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 4.
I20260709 13:15:09.624075  4347 leader_election.cc:304] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:09.625285  4720 raft_consensus.cc:2804] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:09.627282  4720 raft_consensus.cc:697] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 LEADER]: Becoming Leader. State: Replica: 49bb401e63ab4d16a411b6ede4812b60, State: Running, Role: LEADER
I20260709 13:15:09.629031  4720 consensus_queue.cc:237] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.630743  4277 catalog_manager.cc:5697] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 2 to 3, leader changed from 570d4db77af946d1a3c92a42133a0820 (127.4.37.130) to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.633190  4456 raft_consensus.cc:2468] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bb401e63ab4d16a411b6ede4812b60 in term 4.
I20260709 13:15:09.644963  4729 raft_consensus.cc:993] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820: : Instructing follower d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:09.646664  4675 raft_consensus.cc:1081] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 4 LEADER]: Signalling peer d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:09.650061  4529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b"
dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:35356
I20260709 13:15:09.651986  4529 raft_consensus.cc:493] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.652835  4529 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.652559  4718 raft_consensus.cc:993] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820: : Instructing follower d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:09.659339  4718 raft_consensus.cc:1081] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Signalling peer d7ed711cb3924d829581b45c45f9235f to start an election
I20260709 13:15:09.659475  4529 raft_consensus.cc:515] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.658253  4277 catalog_manager.cc:5697] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 reported cstate change: term changed from 3 to 4, leader changed from 570d4db77af946d1a3c92a42133a0820 (127.4.37.130) to 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129). New cstate: current_term: 4 leader_uuid: "49bb401e63ab4d16a411b6ede4812b60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.662345  4530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173"
dest_uuid: "d7ed711cb3924d829581b45c45f9235f"
 from {username='slave'} at 127.0.0.1:35356
I20260709 13:15:09.663048  4530 raft_consensus.cc:493] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:09.663323  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:09.663518  4530 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.663956  4381 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.670653  4381 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 5.
I20260709 13:15:09.670662  4530 raft_consensus.cc:515] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.672279  4493 leader_election.cc:304] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bb401e63ab4d16a411b6ede4812b60, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:09.673570  4681 raft_consensus.cc:2804] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:09.673780  4530 leader_election.cc:290] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 4 election: Requested vote from peers 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663), 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925)
I20260709 13:15:09.673755  4456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:09.674564  4456 raft_consensus.cc:3055] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.674897  4456 raft_consensus.cc:740] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:09.675822  4456 consensus_queue.cc:260] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.676200  4380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e5e0bb2f164d039c7d3a1835389173" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "49bb401e63ab4d16a411b6ede4812b60"
I20260709 13:15:09.676899  4456 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.676954  4380 raft_consensus.cc:3060] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.681274  4529 leader_election.cc:290] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 5 election: Requested vote from peers 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925), 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663)
I20260709 13:15:09.682636  4456 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 4.
I20260709 13:15:09.682868  4455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37870ee6d9044b5cabe79e830984932b" candidate_uuid: "d7ed711cb3924d829581b45c45f9235f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "570d4db77af946d1a3c92a42133a0820"
I20260709 13:15:09.683434  4455 raft_consensus.cc:3055] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.683728  4455 raft_consensus.cc:740] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 570d4db77af946d1a3c92a42133a0820, State: Running, Role: LEADER
I20260709 13:15:09.684144  4495 leader_election.cc:304] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 570d4db77af946d1a3c92a42133a0820, d7ed711cb3924d829581b45c45f9235f; no voters: 
I20260709 13:15:09.684468  4380 raft_consensus.cc:2468] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 4.
I20260709 13:15:09.684465  4455 consensus_queue.cc:260] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.685918  4455 raft_consensus.cc:3060] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.689584  4681 raft_consensus.cc:697] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 5 LEADER]: Becoming Leader. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:09.690959  4681 consensus_queue.cc:237] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.688987  4732 raft_consensus.cc:2804] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:09.693842  4455 raft_consensus.cc:2468] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ed711cb3924d829581b45c45f9235f in term 5.
I20260709 13:15:09.696655  4732 raft_consensus.cc:697] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 4 LEADER]: Becoming Leader. State: Replica: d7ed711cb3924d829581b45c45f9235f, State: Running, Role: LEADER
I20260709 13:15:09.697856  4732 consensus_queue.cc:237] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } }
I20260709 13:15:09.703202  4277 catalog_manager.cc:5697] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f reported cstate change: term changed from 4 to 5, leader changed from 570d4db77af946d1a3c92a42133a0820 (127.4.37.130) to d7ed711cb3924d829581b45c45f9235f (127.4.37.131). New cstate: current_term: 5 leader_uuid: "d7ed711cb3924d829581b45c45f9235f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.717826  4277 catalog_manager.cc:5697] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f reported cstate change: term changed from 3 to 4, leader changed from 570d4db77af946d1a3c92a42133a0820 (127.4.37.130) to d7ed711cb3924d829581b45c45f9235f (127.4.37.131). New cstate: current_term: 4 leader_uuid: "d7ed711cb3924d829581b45c45f9235f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.916150  4455 raft_consensus.cc:1275] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.917716  4720 consensus_queue.cc:1048] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:09.930801  4529 raft_consensus.cc:1275] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:09.932571  4720 consensus_queue.cc:1048] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:10.070967  4455 raft_consensus.cc:1275] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:10.072307  4720 consensus_queue.cc:1048] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:10.081997  4529 raft_consensus.cc:1275] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:10.084174  4727 consensus_queue.cc:1048] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:10.125532  4380 raft_consensus.cc:1275] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 5 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:10.127593  4681 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:10.138001  4455 raft_consensus.cc:1275] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 5 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:10.140373  4733 consensus_queue.cc:1048] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:10.159392  4455 raft_consensus.cc:1275] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:10.161178  4727 consensus_queue.cc:1048] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:10.172374  4529 raft_consensus.cc:1275] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Refusing update from remote peer 49bb401e63ab4d16a411b6ede4812b60: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:10.174108  4719 consensus_queue.cc:1048] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ed711cb3924d829581b45c45f9235f" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:10.175722  4380 raft_consensus.cc:1275] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:10.177532  4733 consensus_queue.cc:1048] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bb401e63ab4d16a411b6ede4812b60" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 44925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:10.189704  4455 raft_consensus.cc:1275] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Refusing update from remote peer d7ed711cb3924d829581b45c45f9235f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:10.191039  4733 consensus_queue.cc:1048] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [LEADER]: Connected to new peer: Peer: permanent_uuid: "570d4db77af946d1a3c92a42133a0820" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:10.403716  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:10.410113  4246 tablet_server.cc:179] TabletServer@127.4.37.129:0 shutting down...
I20260709 13:15:10.441588  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:10.442665  4246 tablet_replica.cc:333] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.443593  4246 raft_consensus.cc:2243] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.444420  4246 raft_consensus.cc:2272] T 756d15cfb95c456ea43a00a115f20537 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.447932  4246 tablet_replica.cc:333] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.448853  4246 raft_consensus.cc:2243] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:10.449209  4419 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:10.449398  4246 raft_consensus.cc:2272] T d16761a7ea5848a9ae81735b1ac101a1 P 49bb401e63ab4d16a411b6ede4812b60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.451815  4246 tablet_replica.cc:333] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.452497  4246 raft_consensus.cc:2243] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:10.452908  4419 consensus_peers.cc:597] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 -> Peer 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925): Couldn't send request to peer 49bb401e63ab4d16a411b6ede4812b60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:10.452991  4246 raft_consensus.cc:2272] T 71dc7f7c06024c34b2fef29bb23ab0bf P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.455389  4246 tablet_replica.cc:333] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.455870  4246 raft_consensus.cc:2243] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.456488  4246 raft_consensus.cc:2272] T 6168718fbd2f4f309c02e5baea0f0a83 P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.458683  4246 tablet_replica.cc:333] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.459296  4246 raft_consensus.cc:2243] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.460266  4246 raft_consensus.cc:2272] T acc87feed8a94bd28e69741a974b7b70 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.462837  4246 tablet_replica.cc:333] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.463366  4246 raft_consensus.cc:2243] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.463786  4246 raft_consensus.cc:2272] T 35e5e0bb2f164d039c7d3a1835389173 P 49bb401e63ab4d16a411b6ede4812b60 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.466598  4246 tablet_replica.cc:333] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.467168  4246 raft_consensus.cc:2243] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.467686  4246 raft_consensus.cc:2272] T 37870ee6d9044b5cabe79e830984932b P 49bb401e63ab4d16a411b6ede4812b60 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.470453  4246 tablet_replica.cc:333] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.470979  4246 raft_consensus.cc:2243] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.471764  4246 raft_consensus.cc:2272] T d6d3366f9baa41bd96e9fffeb819b92d P 49bb401e63ab4d16a411b6ede4812b60 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.474005  4246 tablet_replica.cc:333] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60: stopping tablet replica
I20260709 13:15:10.474478  4246 raft_consensus.cc:2243] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.474889  4246 raft_consensus.cc:2272] T de2cd85925ea49859e5d1d84fb918baa P 49bb401e63ab4d16a411b6ede4812b60 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.591796  4246 tablet_server.cc:196] TabletServer@127.4.37.129:0 shutdown complete.
W20260709 13:15:10.592123  4419 consensus_peers.cc:597] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 -> Peer 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925): Couldn't send request to peer 49bb401e63ab4d16a411b6ede4812b60. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:44925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:10.611873  4246 tablet_server.cc:179] TabletServer@127.4.37.130:0 shutting down...
I20260709 13:15:10.645654  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:10.646342  4246 tablet_replica.cc:333] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.646867  4246 raft_consensus.cc:2243] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.647280  4246 raft_consensus.cc:2272] T 6168718fbd2f4f309c02e5baea0f0a83 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.649034  4246 tablet_replica.cc:333] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.649657  4246 raft_consensus.cc:2243] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.650056  4246 raft_consensus.cc:2272] T acc87feed8a94bd28e69741a974b7b70 P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.652076  4246 tablet_replica.cc:333] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.652554  4246 raft_consensus.cc:2243] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.652920  4246 raft_consensus.cc:2272] T 756d15cfb95c456ea43a00a115f20537 P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.655786  4246 tablet_replica.cc:333] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.656273  4246 raft_consensus.cc:2243] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.656651  4246 raft_consensus.cc:2272] T 37870ee6d9044b5cabe79e830984932b P 570d4db77af946d1a3c92a42133a0820 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.659627  4246 tablet_replica.cc:333] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.660161  4246 raft_consensus.cc:2243] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.660568  4246 raft_consensus.cc:2272] T 35e5e0bb2f164d039c7d3a1835389173 P 570d4db77af946d1a3c92a42133a0820 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.663604  4246 tablet_replica.cc:333] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.664161  4246 raft_consensus.cc:2243] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.664901  4246 raft_consensus.cc:2272] T 71dc7f7c06024c34b2fef29bb23ab0bf P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.666713  4246 tablet_replica.cc:333] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.667191  4246 raft_consensus.cc:2243] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.667891  4246 raft_consensus.cc:2272] T d16761a7ea5848a9ae81735b1ac101a1 P 570d4db77af946d1a3c92a42133a0820 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.669777  4246 tablet_replica.cc:333] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.670250  4246 raft_consensus.cc:2243] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.670608  4246 raft_consensus.cc:2272] T d6d3366f9baa41bd96e9fffeb819b92d P 570d4db77af946d1a3c92a42133a0820 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.672706  4246 tablet_replica.cc:333] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820: stopping tablet replica
I20260709 13:15:10.673146  4246 raft_consensus.cc:2243] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.674045  4246 raft_consensus.cc:2272] T de2cd85925ea49859e5d1d84fb918baa P 570d4db77af946d1a3c92a42133a0820 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:10.698019  4493 consensus_peers.cc:597] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f -> Peer 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925): Couldn't send request to peer 49bb401e63ab4d16a411b6ede4812b60. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:44925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:10.703039  4246 tablet_server.cc:196] TabletServer@127.4.37.130:0 shutdown complete.
W20260709 13:15:10.706717  4493 consensus_peers.cc:597] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f -> Peer 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925): Couldn't send request to peer 49bb401e63ab4d16a411b6ede4812b60. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:44925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:10.722229  4246 tablet_server.cc:179] TabletServer@127.4.37.131:0 shutting down...
W20260709 13:15:10.730074  4495 consensus_peers.cc:597] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f -> Peer 570d4db77af946d1a3c92a42133a0820 (127.4.37.130:42663): Couldn't send request to peer 570d4db77af946d1a3c92a42133a0820. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:42663: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:10.737694  4493 consensus_peers.cc:597] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f -> Peer 49bb401e63ab4d16a411b6ede4812b60 (127.4.37.129:44925): Couldn't send request to peer 49bb401e63ab4d16a411b6ede4812b60. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:44925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:10.761116  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:10.762749  4246 tablet_replica.cc:333] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.764808  4246 raft_consensus.cc:2243] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.765321  4246 raft_consensus.cc:2272] T 756d15cfb95c456ea43a00a115f20537 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.767731  4246 tablet_replica.cc:333] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.768256  4246 raft_consensus.cc:2243] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.769091  4246 raft_consensus.cc:2272] T 35e5e0bb2f164d039c7d3a1835389173 P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.771330  4246 tablet_replica.cc:333] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.771829  4246 raft_consensus.cc:2243] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.772493  4246 raft_consensus.cc:2272] T 37870ee6d9044b5cabe79e830984932b P d7ed711cb3924d829581b45c45f9235f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.774672  4246 tablet_replica.cc:333] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.775295  4246 raft_consensus.cc:2243] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.775736  4246 raft_consensus.cc:2272] T 71dc7f7c06024c34b2fef29bb23ab0bf P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.777509  4246 tablet_replica.cc:333] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.777997  4246 raft_consensus.cc:2243] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.778352  4246 raft_consensus.cc:2272] T d16761a7ea5848a9ae81735b1ac101a1 P d7ed711cb3924d829581b45c45f9235f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.779985  4246 tablet_replica.cc:333] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.780579  4246 raft_consensus.cc:2243] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.781018  4246 raft_consensus.cc:2272] T de2cd85925ea49859e5d1d84fb918baa P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.782769  4246 tablet_replica.cc:333] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.783196  4246 raft_consensus.cc:2243] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.783558  4246 raft_consensus.cc:2272] T d6d3366f9baa41bd96e9fffeb819b92d P d7ed711cb3924d829581b45c45f9235f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.785808  4246 tablet_replica.cc:333] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.786259  4246 raft_consensus.cc:2243] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:10.786980  4246 raft_consensus.cc:2272] T 6168718fbd2f4f309c02e5baea0f0a83 P d7ed711cb3924d829581b45c45f9235f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.788658  4246 tablet_replica.cc:333] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f: stopping tablet replica
I20260709 13:15:10.789085  4246 raft_consensus.cc:2243] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:10.789541  4246 raft_consensus.cc:2272] T acc87feed8a94bd28e69741a974b7b70 P d7ed711cb3924d829581b45c45f9235f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:10.820253  4246 tablet_server.cc:196] TabletServer@127.4.37.131:0 shutdown complete.
I20260709 13:15:10.842432  4246 master.cc:562] Master@127.4.37.190:39063 shutting down...
I20260709 13:15:11.094399  4246 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:11.094966  4246 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:11.095595  4246 tablet_replica.cc:333] T 00000000000000000000000000000000 P b0111e84cd22477e95055ff9e4d07d91: stopping tablet replica
I20260709 13:15:11.117787  4246 master.cc:584] Master@127.4.37.190:39063 shutdown complete.
49bb401e63ab4d16a411b6ede4812b60  4
570d4db77af946d1a3c92a42133a0820  4
d7ed711cb3924d829581b45c45f9235f  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13258 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:15:11.163780  4246 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.37.190:40113
I20260709 13:15:11.164983  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:11.171967  4754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.171973  4755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.173489  4757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:11.176173  4246 server_base.cc:1061] running on GCE node
I20260709 13:15:11.177098  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:11.177280  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:11.177517  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602911177494 us; error 0 us; skew 500 ppm
I20260709 13:15:11.178102  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:11.180591  4246 webserver.cc:533] Webserver started at http://127.4.37.190:43341/ using document root <none> and password file <none>
I20260709 13:15:11.181109  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:11.181274  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:11.181751  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:11.182901  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/master-0-root/instance:
uuid: "d46dadfe12c5400b959bb854ac1db130"
format_stamp: "Formatted at 2026-07-09 13:15:11 on dist-test-slave-jk05"
I20260709 13:15:11.187469  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:11.192448  4762 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.193728  4246 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:15:11.194136  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/master-0-root
uuid: "d46dadfe12c5400b959bb854ac1db130"
format_stamp: "Formatted at 2026-07-09 13:15:11 on dist-test-slave-jk05"
I20260709 13:15:11.194489  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:11.216034  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:11.217252  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:11.263567  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.190:40113
I20260709 13:15:11.263674  4813 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.190:40113 every 8 connection(s)
I20260709 13:15:11.268500  4814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.280510  4814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130: Bootstrap starting.
I20260709 13:15:11.285463  4814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.290606  4814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130: No bootstrap required, opened a new log
I20260709 13:15:11.293493  4814 raft_consensus.cc:359] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46dadfe12c5400b959bb854ac1db130" member_type: VOTER }
I20260709 13:15:11.294108  4814 raft_consensus.cc:385] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.294394  4814 raft_consensus.cc:740] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d46dadfe12c5400b959bb854ac1db130, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.295174  4814 consensus_queue.cc:260] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46dadfe12c5400b959bb854ac1db130" member_type: VOTER }
I20260709 13:15:11.295954  4814 raft_consensus.cc:399] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:11.296265  4814 raft_consensus.cc:493] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:11.296576  4814 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.301048  4814 raft_consensus.cc:515] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46dadfe12c5400b959bb854ac1db130" member_type: VOTER }
I20260709 13:15:11.301658  4814 leader_election.cc:304] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d46dadfe12c5400b959bb854ac1db130; no voters: 
I20260709 13:15:11.302865  4814 leader_election.cc:290] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:11.303283  4817 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.305029  4817 raft_consensus.cc:697] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 1 LEADER]: Becoming Leader. State: Replica: d46dadfe12c5400b959bb854ac1db130, State: Running, Role: LEADER
I20260709 13:15:11.305804  4817 consensus_queue.cc:237] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46dadfe12c5400b959bb854ac1db130" member_type: VOTER }
I20260709 13:15:11.306039  4814 sys_catalog.cc:565] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:11.312039  4819 sys_catalog.cc:455] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d46dadfe12c5400b959bb854ac1db130. Latest consensus state: current_term: 1 leader_uuid: "d46dadfe12c5400b959bb854ac1db130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46dadfe12c5400b959bb854ac1db130" member_type: VOTER } }
I20260709 13:15:11.312814  4819 sys_catalog.cc:458] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:11.314435  4818 sys_catalog.cc:455] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d46dadfe12c5400b959bb854ac1db130" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d46dadfe12c5400b959bb854ac1db130" member_type: VOTER } }
I20260709 13:15:11.315057  4818 sys_catalog.cc:458] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:11.316113  4827 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:11.321491  4827 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:11.323693  4246 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:11.331286  4827 catalog_manager.cc:1383] Generated new cluster ID: f3e40b65f4c94639b3ab11c1c76b0dd0
I20260709 13:15:11.331728  4827 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:11.354283  4827 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:11.356208  4827 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:11.378557  4827 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130: Generated new TSK 0
I20260709 13:15:11.379251  4827 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:11.390931  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:11.399259  4835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.399901  4836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.402271  4838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:11.403107  4246 server_base.cc:1061] running on GCE node
I20260709 13:15:11.403964  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:11.404199  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:11.404372  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602911404350 us; error 0 us; skew 500 ppm
I20260709 13:15:11.404887  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:11.408280  4246 webserver.cc:533] Webserver started at http://127.4.37.129:41031/ using document root <none> and password file <none>
I20260709 13:15:11.408915  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:11.409148  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:11.409575  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:11.410941  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-0-root/instance:
uuid: "bc920ef401084dca862e05e8715a22d7"
format_stamp: "Formatted at 2026-07-09 13:15:11 on dist-test-slave-jk05"
I20260709 13:15:11.417511  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:15:11.421126  4843 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.422140  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:11.422523  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "bc920ef401084dca862e05e8715a22d7"
format_stamp: "Formatted at 2026-07-09 13:15:11 on dist-test-slave-jk05"
I20260709 13:15:11.422876  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:11.443405  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:11.444729  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:11.446326  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:11.448719  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:11.449046  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.449338  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:11.449569  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:11.497498  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:42461
I20260709 13:15:11.497526  4905 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:42461 every 8 connection(s)
I20260709 13:15:11.503019  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:11.512202  4910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.513656  4911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.517259  4913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:11.517388  4246 server_base.cc:1061] running on GCE node
I20260709 13:15:11.519134  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:11.519428  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:11.519704  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602911519682 us; error 0 us; skew 500 ppm
I20260709 13:15:11.520361  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:11.522656  4906 heartbeater.cc:344] Connected to a master server at 127.4.37.190:40113
I20260709 13:15:11.523028  4906 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:11.523638  4246 webserver.cc:533] Webserver started at http://127.4.37.130:45411/ using document root <none> and password file <none>
I20260709 13:15:11.523840  4906 heartbeater.cc:507] Master 127.4.37.190:40113 requested a full tablet report, sending...
I20260709 13:15:11.524204  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:11.524433  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:11.524740  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:11.526103  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-1-root/instance:
uuid: "3d93642c55ca499893ab99052cfea8c1"
format_stamp: "Formatted at 2026-07-09 13:15:11 on dist-test-slave-jk05"
I20260709 13:15:11.526216  4779 ts_manager.cc:194] Registered new tserver with Master: bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461)
I20260709 13:15:11.528230  4779 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55344
I20260709 13:15:11.532403  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:15:11.536943  4918 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.537961  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:11.538378  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-1-root
uuid: "3d93642c55ca499893ab99052cfea8c1"
format_stamp: "Formatted at 2026-07-09 13:15:11 on dist-test-slave-jk05"
I20260709 13:15:11.538656  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:11.576486  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:11.577844  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:11.579392  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:11.581758  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:11.581970  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.582279  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:11.582423  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.631219  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.130:34019
I20260709 13:15:11.631356  4980 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.130:34019 every 8 connection(s)
I20260709 13:15:11.635931  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:11.644430  4984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.645728  4985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:11.648756  4987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:11.650439  4981 heartbeater.cc:344] Connected to a master server at 127.4.37.190:40113
I20260709 13:15:11.650785  4246 server_base.cc:1061] running on GCE node
I20260709 13:15:11.651181  4981 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:11.651928  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:11.652218  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:11.652196  4981 heartbeater.cc:507] Master 127.4.37.190:40113 requested a full tablet report, sending...
I20260709 13:15:11.652575  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602911652552 us; error 0 us; skew 500 ppm
I20260709 13:15:11.653340  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:11.655618  4779 ts_manager.cc:194] Registered new tserver with Master: 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:11.657199  4246 webserver.cc:533] Webserver started at http://127.4.37.131:37701/ using document root <none> and password file <none>
I20260709 13:15:11.657344  4779 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55346
I20260709 13:15:11.657824  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:11.658063  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:11.658360  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:11.660094  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-2-root/instance:
uuid: "58df74a8ef6b42aeb707585da24f3c76"
format_stamp: "Formatted at 2026-07-09 13:15:11 on dist-test-slave-jk05"
I20260709 13:15:11.664779  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:11.668347  4992 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.669281  4246 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:11.669612  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-2-root
uuid: "58df74a8ef6b42aeb707585da24f3c76"
format_stamp: "Formatted at 2026-07-09 13:15:11 on dist-test-slave-jk05"
I20260709 13:15:11.669870  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602897722324-4246-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:11.696396  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:11.697822  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:11.699103  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:11.701443  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:11.701675  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.701920  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:11.702092  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.742738  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.131:42431
I20260709 13:15:11.742802  5054 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.131:42431 every 8 connection(s)
I20260709 13:15:11.760672  5055 heartbeater.cc:344] Connected to a master server at 127.4.37.190:40113
I20260709 13:15:11.761060  5055 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:11.761859  5055 heartbeater.cc:507] Master 127.4.37.190:40113 requested a full tablet report, sending...
I20260709 13:15:11.763904  4779 ts_manager.cc:194] Registered new tserver with Master: 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:11.764786  4246 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018133507s
I20260709 13:15:11.765535  4779 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55360
I20260709 13:15:11.800308  4779 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55364:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:11.803256  4779 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:11.874224  4871 tablet_service.cc:1511] Processing CreateTablet for tablet d318acd345914c07ad7689aed477d1cd (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:11.875736  4871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d318acd345914c07ad7689aed477d1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.880347  4870 tablet_service.cc:1511] Processing CreateTablet for tablet 36ae2f481350447a959659dc2ec997db (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:11.882376  4870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ae2f481350447a959659dc2ec997db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.885876  4869 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd4aa0db4b44779b923958f31e13770 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:11.887480  4869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd4aa0db4b44779b923958f31e13770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.892850  4868 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1530bab80048529cceec2093e377f0 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:11.894832  4868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1530bab80048529cceec2093e377f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.898042  4867 tablet_service.cc:1511] Processing CreateTablet for tablet b546611d735a4830bc213200bf9ec051 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:11.899726  4867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546611d735a4830bc213200bf9ec051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.902994  4866 tablet_service.cc:1511] Processing CreateTablet for tablet b4a13aad855b4dce8999daa1610d82c6 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:11.904702  4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a13aad855b4dce8999daa1610d82c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.908038  5020 tablet_service.cc:1511] Processing CreateTablet for tablet d318acd345914c07ad7689aed477d1cd (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:11.908303  4865 tablet_service.cc:1511] Processing CreateTablet for tablet ae448f3b3a824ae8b7ece648bd2253fe (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:11.909550  5020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d318acd345914c07ad7689aed477d1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.909698  4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae448f3b3a824ae8b7ece648bd2253fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.910216  5015 tablet_service.cc:1511] Processing CreateTablet for tablet b4a13aad855b4dce8999daa1610d82c6 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:11.911593  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a13aad855b4dce8999daa1610d82c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.914978  5016 tablet_service.cc:1511] Processing CreateTablet for tablet b546611d735a4830bc213200bf9ec051 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:11.916770  5016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546611d735a4830bc213200bf9ec051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.919793  5019 tablet_service.cc:1511] Processing CreateTablet for tablet 36ae2f481350447a959659dc2ec997db (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:11.922851  5018 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd4aa0db4b44779b923958f31e13770 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:11.925587  5017 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1530bab80048529cceec2093e377f0 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:11.927371  5019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ae2f481350447a959659dc2ec997db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.929792  5018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd4aa0db4b44779b923958f31e13770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.933902  5017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1530bab80048529cceec2093e377f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.940724  5070 tablet_bootstrap.cc:492] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:11.947199  4945 tablet_service.cc:1511] Processing CreateTablet for tablet 36ae2f481350447a959659dc2ec997db (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:11.947949  5070 tablet_bootstrap.cc:654] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.951355  4944 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd4aa0db4b44779b923958f31e13770 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:11.953959  4943 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1530bab80048529cceec2093e377f0 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:11.959213  4941 tablet_service.cc:1511] Processing CreateTablet for tablet b4a13aad855b4dce8999daa1610d82c6 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:11.945035  4946 tablet_service.cc:1511] Processing CreateTablet for tablet d318acd345914c07ad7689aed477d1cd (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:11.956784  4942 tablet_service.cc:1511] Processing CreateTablet for tablet b546611d735a4830bc213200bf9ec051 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:11.949168  4945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ae2f481350447a959659dc2ec997db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.971871  4943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1530bab80048529cceec2093e377f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.977914  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a13aad855b4dce8999daa1610d82c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.981997  4946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d318acd345914c07ad7689aed477d1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.985908  4944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd4aa0db4b44779b923958f31e13770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.990612  4942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b546611d735a4830bc213200bf9ec051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.024053  5073 tablet_bootstrap.cc:492] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.034556  4942 tablet_service.cc:1511] Processing CreateTablet for tablet ae448f3b3a824ae8b7ece648bd2253fe (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:12.036538  4942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae448f3b3a824ae8b7ece648bd2253fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.059093  5073 tablet_bootstrap.cc:654] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.080483  5073 tablet_bootstrap.cc:492] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.080231  5014 tablet_service.cc:1511] Processing CreateTablet for tablet ae448f3b3a824ae8b7ece648bd2253fe (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:12.081110  5073 ts_tablet_manager.cc:1403] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.000s
I20260709 13:15:12.081732  5014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae448f3b3a824ae8b7ece648bd2253fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.082847  4865 tablet_service.cc:1511] Processing CreateTablet for tablet a214808f9d1f4fa794a84ccc5c810ba8 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:12.084676  5073 raft_consensus.cc:359] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.085778  5073 raft_consensus.cc:385] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.086175  5073 raft_consensus.cc:740] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.084705  4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a214808f9d1f4fa794a84ccc5c810ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.090607  4942 tablet_service.cc:1511] Processing CreateTablet for tablet a214808f9d1f4fa794a84ccc5c810ba8 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:12.098325  4942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a214808f9d1f4fa794a84ccc5c810ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.092092  5073 consensus_queue.cc:260] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.116097  5071 tablet_bootstrap.cc:492] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.130457  5073 ts_tablet_manager.cc:1434] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.007s
I20260709 13:15:12.131294  4981 heartbeater.cc:499] Master 127.4.37.190:40113 was elected leader, sending a full tablet report...
I20260709 13:15:12.131614  5073 tablet_bootstrap.cc:492] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.143167  5070 tablet_bootstrap.cc:492] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.142772  4871 tablet_service.cc:1511] Processing CreateTablet for tablet 01ef8d40a0424447b95525d308ae65dd (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:12.143724  5070 ts_tablet_manager.cc:1403] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.203s	user 0.067s	sys 0.084s
I20260709 13:15:12.144328  4871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ef8d40a0424447b95525d308ae65dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.147126  5071 tablet_bootstrap.cc:654] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.150967  5017 tablet_service.cc:1511] Processing CreateTablet for tablet a214808f9d1f4fa794a84ccc5c810ba8 (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:12.152397  5017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a214808f9d1f4fa794a84ccc5c810ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.153357  5070 raft_consensus.cc:359] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.154170  5070 raft_consensus.cc:385] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.154469  5070 raft_consensus.cc:740] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.155299  5070 consensus_queue.cc:260] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.159654  5073 tablet_bootstrap.cc:654] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.166728  4943 tablet_service.cc:1511] Processing CreateTablet for tablet 01ef8d40a0424447b95525d308ae65dd (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:12.168684  4943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ef8d40a0424447b95525d308ae65dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.171084  5015 tablet_service.cc:1511] Processing CreateTablet for tablet 01ef8d40a0424447b95525d308ae65dd (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:12.172997  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ef8d40a0424447b95525d308ae65dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.188064  4865 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae8f41c0ad04b23b4f5ba300af8820c (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:12.190097  4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae8f41c0ad04b23b4f5ba300af8820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.196883  5073 tablet_bootstrap.cc:492] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.197633  5073 ts_tablet_manager.cc:1403] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.023s
I20260709 13:15:12.200935  5073 raft_consensus.cc:359] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.201799  5073 raft_consensus.cc:385] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.202135  5073 raft_consensus.cc:740] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.203008  5073 consensus_queue.cc:260] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.205087  5073 ts_tablet_manager.cc:1434] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:12.206315  5073 tablet_bootstrap.cc:492] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.213227  5073 tablet_bootstrap.cc:654] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.226361  5073 tablet_bootstrap.cc:492] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.227056  5073 ts_tablet_manager.cc:1403] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:15:12.230430  5073 raft_consensus.cc:359] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.231509  5073 raft_consensus.cc:385] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.232337  5073 raft_consensus.cc:740] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.233780  5073 consensus_queue.cc:260] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.237205  5073 ts_tablet_manager.cc:1434] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:15:12.238561  5073 tablet_bootstrap.cc:492] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.249220  5073 tablet_bootstrap.cc:654] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.262199  4943 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae8f41c0ad04b23b4f5ba300af8820c (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:12.264137  4943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae8f41c0ad04b23b4f5ba300af8820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.280270  5017 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae8f41c0ad04b23b4f5ba300af8820c (DEFAULT_TABLE table=test-workload [id=fe55f1ecbd4e420eaa5c3c91c6ce31fb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:12.282398  5017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae8f41c0ad04b23b4f5ba300af8820c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:12.295254  4906 heartbeater.cc:499] Master 127.4.37.190:40113 was elected leader, sending a full tablet report...
I20260709 13:15:12.299329  5070 ts_tablet_manager.cc:1434] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.155s	user 0.044s	sys 0.033s
I20260709 13:15:12.300745  5070 tablet_bootstrap.cc:492] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.309643  5070 tablet_bootstrap.cc:654] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:12.316515  4826 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:12.320825  5073 tablet_bootstrap.cc:492] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.321584  5073 ts_tablet_manager.cc:1403] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.083s	user 0.032s	sys 0.050s
I20260709 13:15:12.322960  5071 tablet_bootstrap.cc:492] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.323499  5071 ts_tablet_manager.cc:1403] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.208s	user 0.068s	sys 0.080s
I20260709 13:15:12.324923  5073 raft_consensus.cc:359] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.325922  5073 raft_consensus.cc:385] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.326288  5073 raft_consensus.cc:740] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.327005  5071 raft_consensus.cc:359] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.327128  5073 consensus_queue.cc:260] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.327833  5071 raft_consensus.cc:385] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.327962  5070 tablet_bootstrap.cc:492] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.328322  5071 raft_consensus.cc:740] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.328634  5070 ts_tablet_manager.cc:1403] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.005s
I20260709 13:15:12.329377  5071 consensus_queue.cc:260] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.331678  5070 raft_consensus.cc:359] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.332427  5073 ts_tablet_manager.cc:1434] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:12.332473  5070 raft_consensus.cc:385] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.332906  5070 raft_consensus.cc:740] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.333637  5073 tablet_bootstrap.cc:492] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.333727  5070 consensus_queue.cc:260] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.335969  5070 ts_tablet_manager.cc:1434] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:15:12.336921  5070 tablet_bootstrap.cc:492] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.340837  5073 tablet_bootstrap.cc:654] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.342355  5077 raft_consensus.cc:493] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.342990  5077 raft_consensus.cc:515] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.343756  5070 tablet_bootstrap.cc:654] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.352365  5071 ts_tablet_manager.cc:1434] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.006s
I20260709 13:15:12.354871  5071 tablet_bootstrap.cc:492] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.356834  5055 heartbeater.cc:499] Master 127.4.37.190:40113 was elected leader, sending a full tablet report...
I20260709 13:15:12.356289  5077 leader_election.cc:290] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.364830  5073 tablet_bootstrap.cc:492] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.365411  5073 ts_tablet_manager.cc:1403] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.004s
I20260709 13:15:12.361666  5075 raft_consensus.cc:493] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.367391  5075 raft_consensus.cc:515] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.368948  5073 raft_consensus.cc:359] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.370260  5073 raft_consensus.cc:385] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.371093  5073 raft_consensus.cc:740] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.372581  5073 consensus_queue.cc:260] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.378679  5075 leader_election.cc:290] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.393362  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ae2f481350447a959659dc2ec997db" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:12.394378  4956 raft_consensus.cc:2468] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 0.
I20260709 13:15:12.395888  5070 tablet_bootstrap.cc:492] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.396546  5070 ts_tablet_manager.cc:1403] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.003s
I20260709 13:15:12.396467  4846 leader_election.cc:304] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.397575  5077 raft_consensus.cc:2804] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.398072  5077 raft_consensus.cc:493] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.398877  5077 raft_consensus.cc:3060] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.398335  5071 tablet_bootstrap.cc:654] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.411664  5070 raft_consensus.cc:359] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.412786  5070 raft_consensus.cc:385] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.413193  5070 raft_consensus.cc:740] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.421414  5073 ts_tablet_manager.cc:1434] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.056s	user 0.019s	sys 0.028s
I20260709 13:15:12.422804  5073 tablet_bootstrap.cc:492] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.422786  5077 raft_consensus.cc:515] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.428714  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ae2f481350447a959659dc2ec997db" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:12.429369  4956 raft_consensus.cc:3060] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.432473  5070 consensus_queue.cc:260] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.436580  5073 tablet_bootstrap.cc:654] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.439983  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ae2f481350447a959659dc2ec997db" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.442806  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ae2f481350447a959659dc2ec997db" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:12.443377  5089 raft_consensus.cc:493] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.444024  5089 raft_consensus.cc:515] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.445624  5075 raft_consensus.cc:493] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.446187  5075 raft_consensus.cc:515] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.448012  5089 leader_election.cc:290] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.448558  5075 leader_election.cc:290] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
W20260709 13:15:12.445163  4844 leader_election.cc:343] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.426659  5077 leader_election.cc:290] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
W20260709 13:15:12.454465  4844 leader_election.cc:343] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.461733  5073 tablet_bootstrap.cc:492] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.462634  5073 ts_tablet_manager.cc:1403] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.009s
I20260709 13:15:12.463620  5070 ts_tablet_manager.cc:1434] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.067s	user 0.016s	sys 0.012s
I20260709 13:15:12.463989  5075 raft_consensus.cc:493] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.464808  5070 tablet_bootstrap.cc:492] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.464469  5075 raft_consensus.cc:515] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.465915  5073 raft_consensus.cc:359] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.466588  5075 leader_election.cc:290] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.466732  5073 raft_consensus.cc:385] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.467176  5073 raft_consensus.cc:740] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.468356  5073 consensus_queue.cc:260] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.472123  5070 tablet_bootstrap.cc:654] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.472149  5073 ts_tablet_manager.cc:1434] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:12.473788  5073 tablet_bootstrap.cc:492] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.469830  4956 raft_consensus.cc:2468] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 1.
I20260709 13:15:12.475539  4846 leader_election.cc:304] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:12.476924  5091 raft_consensus.cc:2804] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.477722  5091 raft_consensus.cc:697] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:12.478586  5091 consensus_queue.cc:237] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.481920  4881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ae2f481350447a959659dc2ec997db" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.483865  4879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.484726  5073 tablet_bootstrap.cc:654] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.485550  4878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1530bab80048529cceec2093e377f0" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.486366  4878 raft_consensus.cc:2468] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 0.
W20260709 13:15:12.496743  4922 leader_election.cc:343] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.498472  4922 leader_election.cc:304] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.499672  5075 raft_consensus.cc:2804] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.500170  5075 raft_consensus.cc:493] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.500605  5075 raft_consensus.cc:3060] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.492560  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.519441  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ae2f481350447a959659dc2ec997db" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.521456  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
W20260709 13:15:12.522063  4922 leader_election.cc:343] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:12.524027  4919 leader_election.cc:343] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.523891  5075 raft_consensus.cc:515] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.524780  4919 leader_election.cc:304] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1; no voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7
W20260709 13:15:12.526734  4919 leader_election.cc:343] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.527349  4919 leader_election.cc:304] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1; no voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7
I20260709 13:15:12.529179  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1530bab80048529cceec2093e377f0" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:12.530344  4880 raft_consensus.cc:3060] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.532393  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1530bab80048529cceec2093e377f0" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.533800  5089 raft_consensus.cc:2749] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.536047  5089 raft_consensus.cc:2749] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.520313  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.538574  5028 raft_consensus.cc:2468] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 0.
W20260709 13:15:12.541354  4919 leader_election.cc:343] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.541975  5073 tablet_bootstrap.cc:492] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.542485  5073 ts_tablet_manager.cc:1403] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.069s	user 0.035s	sys 0.022s
I20260709 13:15:12.542380  4919 leader_election.cc:304] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: bc920ef401084dca862e05e8715a22d7
I20260709 13:15:12.543269  5089 raft_consensus.cc:2804] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.543509  5075 leader_election.cc:290] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.543658  5089 raft_consensus.cc:493] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.544008  5089 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.545320  5071 tablet_bootstrap.cc:492] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.545835  5071 ts_tablet_manager.cc:1403] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.192s	user 0.023s	sys 0.000s
I20260709 13:15:12.546576  5073 raft_consensus.cc:359] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.547155  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1530bab80048529cceec2093e377f0" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:12.548251  5073 raft_consensus.cc:385] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.555475  4880 raft_consensus.cc:2468] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 1.
I20260709 13:15:12.555874  5073 raft_consensus.cc:740] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.555790  5077 raft_consensus.cc:493] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.556979  4922 leader_election.cc:304] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.556741  5077 raft_consensus.cc:515] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.556996  5073 consensus_queue.cc:260] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.558089  5075 raft_consensus.cc:2804] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.560988  5073 ts_tablet_manager.cc:1434] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:15:12.561368  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.562029  5073 tablet_bootstrap.cc:492] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
W20260709 13:15:12.563776  4844 leader_election.cc:343] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.564082  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:12.564797  4956 raft_consensus.cc:2468] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 0.
I20260709 13:15:12.568805  5073 tablet_bootstrap.cc:654] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.572815  4846 leader_election.cc:304] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:12.573812  5077 leader_election.cc:290] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:12.548856  5071 raft_consensus.cc:359] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.578523  5077 raft_consensus.cc:2804] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.578187  5071 raft_consensus.cc:385] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.578917  5077 raft_consensus.cc:493] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.580717  5070 tablet_bootstrap.cc:492] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.580596  5077 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.581571  5070 ts_tablet_manager.cc:1403] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.117s	user 0.031s	sys 0.043s
I20260709 13:15:12.584897  5070 raft_consensus.cc:359] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.586714  5070 raft_consensus.cc:385] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.587066  5070 raft_consensus.cc:740] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.587960  5070 consensus_queue.cc:260] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.587785  4779 catalog_manager.cc:5697] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.568619  5089 raft_consensus.cc:515] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.590581  5070 ts_tablet_manager.cc:1434] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:15:12.591642  5070 tablet_bootstrap.cc:492] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.580013  5071 raft_consensus.cc:740] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.587983  5073 tablet_bootstrap.cc:492] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.593043  5073 ts_tablet_manager.cc:1403] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:15:12.592572  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7"
W20260709 13:15:12.595474  4922 leader_election.cc:343] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.595173  5071 consensus_queue.cc:260] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.596426  5028 raft_consensus.cc:3060] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.599453  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:12.600164  5027 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.599720  5077 raft_consensus.cc:515] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.595954  5073 raft_consensus.cc:359] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.602387  5073 raft_consensus.cc:385] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.602655  5073 raft_consensus.cc:740] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.603264  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:12.603307  5073 consensus_queue.cc:260] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.604023  5028 raft_consensus.cc:2468] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 1.
W20260709 13:15:12.604972  4844 leader_election.cc:343] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.606931  5070 tablet_bootstrap.cc:654] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.607156  5077 leader_election.cc:290] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Requested vote from peers 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:12.610508  5073 ts_tablet_manager.cc:1434] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:12.611873  5027 raft_consensus.cc:2468] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 1.
I20260709 13:15:12.612315  5073 tablet_bootstrap.cc:492] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.613243  4919 leader_election.cc:304] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: bc920ef401084dca862e05e8715a22d7
I20260709 13:15:12.614126  5097 raft_consensus.cc:2804] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.614584  5097 raft_consensus.cc:697] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:12.615629  5097 consensus_queue.cc:237] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.619241  5073 tablet_bootstrap.cc:654] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.625986  5070 tablet_bootstrap.cc:492] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.626689  5089 leader_election.cc:290] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.626771  5070 ts_tablet_manager.cc:1403] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:15:12.630276  5070 raft_consensus.cc:359] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.631179  5070 raft_consensus.cc:385] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.631476  5070 raft_consensus.cc:740] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.631922  5071 ts_tablet_manager.cc:1434] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.086s	user 0.002s	sys 0.005s
I20260709 13:15:12.632153  5070 consensus_queue.cc:260] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.634469  5070 ts_tablet_manager.cc:1434] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:12.635490  5070 tablet_bootstrap.cc:492] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.636392  5071 tablet_bootstrap.cc:492] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.642702  5075 raft_consensus.cc:697] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:12.644028  5075 consensus_queue.cc:237] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
W20260709 13:15:12.648701  4846 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:34019, user_credentials={real_user=slave}} blocked reactor thread for 75968.7us
I20260709 13:15:12.649487  5070 tablet_bootstrap.cc:654] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.651034  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:12.651759  4956 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.664247  4956 raft_consensus.cc:2468] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 1.
I20260709 13:15:12.667151  5070 tablet_bootstrap.cc:492] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.667277  5073 tablet_bootstrap.cc:492] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.667707  5070 ts_tablet_manager.cc:1403] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.003s
I20260709 13:15:12.667822  5073 ts_tablet_manager.cc:1403] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.008s
I20260709 13:15:12.669874  4846 leader_election.cc:304] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:12.670912  5073 raft_consensus.cc:359] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.671355  5099 raft_consensus.cc:2804] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.671664  5070 raft_consensus.cc:359] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.672722  5070 raft_consensus.cc:385] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.672852  5099 raft_consensus.cc:697] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:12.673128  5070 raft_consensus.cc:740] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.674705  5071 tablet_bootstrap.cc:654] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.674098  5070 consensus_queue.cc:260] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.674150  5099 consensus_queue.cc:237] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.674418  4779 catalog_manager.cc:5697] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.676908  5070 ts_tablet_manager.cc:1434] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:15:12.671746  5073 raft_consensus.cc:385] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.677805  5073 raft_consensus.cc:740] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.678140  5070 tablet_bootstrap.cc:492] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.678723  5073 consensus_queue.cc:260] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.681335  5073 ts_tablet_manager.cc:1434] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:15:12.682226  5073 tablet_bootstrap.cc:492] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1: Bootstrap starting.
I20260709 13:15:12.686529  5073 tablet_bootstrap.cc:654] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.686575  5070 tablet_bootstrap.cc:654] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.695484  5073 tablet_bootstrap.cc:492] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1: No bootstrap required, opened a new log
I20260709 13:15:12.696169  5073 ts_tablet_manager.cc:1403] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:15:12.700114  5073 raft_consensus.cc:359] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.701155  5073 raft_consensus.cc:385] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.701375  4777 catalog_manager.cc:5697] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.701583  5073 raft_consensus.cc:740] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.704944  5071 tablet_bootstrap.cc:492] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.705732  5071 ts_tablet_manager.cc:1403] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.010s
I20260709 13:15:12.704995  5073 consensus_queue.cc:260] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.705874  5070 tablet_bootstrap.cc:492] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.706804  5070 ts_tablet_manager.cc:1403] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.011s
I20260709 13:15:12.707597  5073 ts_tablet_manager.cc:1434] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:15:12.708809  5071 raft_consensus.cc:359] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.709324  5071 raft_consensus.cc:385] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.709649  5071 raft_consensus.cc:740] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.710052  5070 raft_consensus.cc:359] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.710453  5071 consensus_queue.cc:260] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.711225  5070 raft_consensus.cc:385] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.711750  5070 raft_consensus.cc:740] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.713063  5070 consensus_queue.cc:260] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.715734  5071 ts_tablet_manager.cc:1434] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:15:12.716070  5070 ts_tablet_manager.cc:1434] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:12.716813  5071 tablet_bootstrap.cc:492] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.717202  5070 tablet_bootstrap.cc:492] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.721241  4776 catalog_manager.cc:5697] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.724211  5070 tablet_bootstrap.cc:654] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.724947  5071 tablet_bootstrap.cc:654] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.736267  5071 tablet_bootstrap.cc:492] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.736822  5070 tablet_bootstrap.cc:492] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.736984  5099 raft_consensus.cc:493] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.736874  5071 ts_tablet_manager.cc:1403] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.007s
I20260709 13:15:12.737897  5070 ts_tablet_manager.cc:1403] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:15:12.737687  5099 raft_consensus.cc:515] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.740242  5099 leader_election.cc:290] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.741389  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.741641  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:12.741726  5071 raft_consensus.cc:359] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.742451  5071 raft_consensus.cc:385] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.742369  4956 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 0.
W20260709 13:15:12.742875  4844 leader_election.cc:343] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.743481  5070 raft_consensus.cc:359] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.743716  4846 leader_election.cc:304] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:12.744192  5070 raft_consensus.cc:385] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.744486  5070 raft_consensus.cc:740] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.744588  5099 raft_consensus.cc:2804] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.744746  5071 raft_consensus.cc:740] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.745193  5070 consensus_queue.cc:260] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.745162  5099 raft_consensus.cc:493] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.746768  5099 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.746011  5071 consensus_queue.cc:260] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.747743  5070 ts_tablet_manager.cc:1434] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.005s
I20260709 13:15:12.748719  5070 tablet_bootstrap.cc:492] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.748859  5071 ts_tablet_manager.cc:1434] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:15:12.752557  5071 tablet_bootstrap.cc:492] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.759407  5071 tablet_bootstrap.cc:654] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.760757  5070 tablet_bootstrap.cc:654] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.768680  5075 raft_consensus.cc:493] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.768463  5071 tablet_bootstrap.cc:492] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.769182  5075 raft_consensus.cc:515] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.770140  5071 ts_tablet_manager.cc:1403] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 13:15:12.770785  5070 tablet_bootstrap.cc:492] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.771462  5070 ts_tablet_manager.cc:1403] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:15:12.771942  5099 raft_consensus.cc:515] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.774231  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.774616  5099 leader_election.cc:290] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.774462  5071 raft_consensus.cc:359] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.775635  5071 raft_consensus.cc:385] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.775954  5071 raft_consensus.cc:740] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.776347  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:12.776960  4956 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.776683  5071 consensus_queue.cc:260] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
W20260709 13:15:12.777839  4922 leader_election.cc:343] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.779171  5071 ts_tablet_manager.cc:1434] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:12.780174  5071 tablet_bootstrap.cc:492] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.780705  5075 leader_election.cc:290] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.781566  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:12.782160  5028 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.776315  5070 raft_consensus.cc:359] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.786578  5070 raft_consensus.cc:385] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.786660  4956 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 1.
I20260709 13:15:12.786945  5070 raft_consensus.cc:740] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.777226  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.787382  5071 tablet_bootstrap.cc:654] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.788003  4846 leader_election.cc:304] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
W20260709 13:15:12.788492  4919 leader_election.cc:343] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.789192  5070 consensus_queue.cc:260] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.789491  4919 leader_election.cc:304] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1; no voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7
I20260709 13:15:12.790246  5077 raft_consensus.cc:2804] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.790769  5075 raft_consensus.cc:2749] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.790777  5077 raft_consensus.cc:697] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:12.792455  5070 ts_tablet_manager.cc:1434] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:15:12.793386  5070 tablet_bootstrap.cc:492] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7: Bootstrap starting.
I20260709 13:15:12.793576  5077 consensus_queue.cc:237] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.797322  5082 raft_consensus.cc:493] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.797689  5028 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 1.
I20260709 13:15:12.798041  5082 raft_consensus.cc:515] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:12.800443  5070 tablet_bootstrap.cc:654] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.809535  5082 leader_election.cc:290] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:12.812971  5070 tablet_bootstrap.cc:492] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7: No bootstrap required, opened a new log
I20260709 13:15:12.813695  5070 ts_tablet_manager.cc:1403] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 13:15:12.817178  5070 raft_consensus.cc:359] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.817986  5070 raft_consensus.cc:385] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.818300  5070 raft_consensus.cc:740] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.819051  5070 consensus_queue.cc:260] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.821185  5070 ts_tablet_manager.cc:1434] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:12.828064  5071 tablet_bootstrap.cc:492] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.828653  5071 ts_tablet_manager.cc:1403] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.024s
I20260709 13:15:12.829202  4776 catalog_manager.cc:5697] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.832013  5071 raft_consensus.cc:359] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.832795  5071 raft_consensus.cc:385] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.833092  5071 raft_consensus.cc:740] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.833878  5071 consensus_queue.cc:260] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.835690  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.836402  5071 ts_tablet_manager.cc:1434] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:15:12.837406  5071 tablet_bootstrap.cc:492] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.841751  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:12.842603  4956 raft_consensus.cc:2393] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58df74a8ef6b42aeb707585da24f3c76 in current term 1: Already voted for candidate bc920ef401084dca862e05e8715a22d7 in this term.
I20260709 13:15:12.844485  5071 tablet_bootstrap.cc:654] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.844791  4995 leader_election.cc:304] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76; no voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7
I20260709 13:15:12.845947  5082 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.850863  5071 tablet_bootstrap.cc:492] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.851428  5071 ts_tablet_manager.cc:1403] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:15:12.854050  5071 raft_consensus.cc:359] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.854853  5071 raft_consensus.cc:385] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.855170  5071 raft_consensus.cc:740] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.855757  5082 raft_consensus.cc:2749] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.855922  5071 consensus_queue.cc:260] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.858739  5071 ts_tablet_manager.cc:1434] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:12.859830  5071 tablet_bootstrap.cc:492] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.865996  5071 tablet_bootstrap.cc:654] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.871026  5071 tablet_bootstrap.cc:492] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.871639  5071 ts_tablet_manager.cc:1403] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:15:12.873706  5071 raft_consensus.cc:359] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.874181  5071 raft_consensus.cc:385] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.874439  5071 raft_consensus.cc:740] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.875016  5071 consensus_queue.cc:260] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.876559  5071 ts_tablet_manager.cc:1434] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:15:12.877729  5071 tablet_bootstrap.cc:492] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.883530  5071 tablet_bootstrap.cc:654] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.885504  5082 raft_consensus.cc:493] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.886055  5082 raft_consensus.cc:515] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.888863  5082 leader_election.cc:290] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:12.890647  5075 raft_consensus.cc:493] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.890576  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.890663  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:12.891390  4880 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 0.
I20260709 13:15:12.891470  4956 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 0.
I20260709 13:15:12.891283  5075 raft_consensus.cc:515] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.891921  5071 tablet_bootstrap.cc:492] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.892369  5071 ts_tablet_manager.cc:1403] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:15:12.894614  5075 leader_election.cc:290] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.892987  4996 leader_election.cc:304] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.895645  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.896333  5082 raft_consensus.cc:2804] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.896471  4880 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 0.
I20260709 13:15:12.897083  5082 raft_consensus.cc:493] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.897511  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.898063  5071 raft_consensus.cc:359] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.897542  5082 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.898208  4922 leader_election.cc:304] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.898847  5071 raft_consensus.cc:385] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.898226  5028 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 0.
I20260709 13:15:12.899178  5071 raft_consensus.cc:740] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.899503  5075 raft_consensus.cc:2804] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.899858  5075 raft_consensus.cc:493] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.900244  5075 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.899961  5071 consensus_queue.cc:260] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.902837  5071 ts_tablet_manager.cc:1434] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:12.904114  5071 tablet_bootstrap.cc:492] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76: Bootstrap starting.
I20260709 13:15:12.907596  5082 raft_consensus.cc:515] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.910470  5075 raft_consensus.cc:515] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.911427  5071 tablet_bootstrap.cc:654] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.911710  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:12.912367  4880 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.913861  5075 leader_election.cc:290] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.914322  5082 leader_election.cc:290] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:12.915512  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:12.916106  4956 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.918002  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:12.918633  5028 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.919999  4880 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 1.
I20260709 13:15:12.921484  4996 leader_election.cc:304] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.921931  4878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:12.922674  4878 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.923272  5082 raft_consensus.cc:2804] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.923835  5082 raft_consensus.cc:697] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Becoming Leader. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:12.925083  5082 consensus_queue.cc:237] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.931890  5027 raft_consensus.cc:3060] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.933351  5071 tablet_bootstrap.cc:492] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76: No bootstrap required, opened a new log
I20260709 13:15:12.933921  5071 ts_tablet_manager.cc:1403] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.007s
I20260709 13:15:12.934115  5028 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 1.
I20260709 13:15:12.935739  4919 leader_election.cc:304] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:12.936723  5075 raft_consensus.cc:2804] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.937348  5075 raft_consensus.cc:697] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:12.938143  5071 raft_consensus.cc:359] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.938359  4956 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 1.
I20260709 13:15:12.938151  4878 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 1.
I20260709 13:15:12.938882  5071 raft_consensus.cc:385] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.938438  5075 consensus_queue.cc:237] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.939694  5071 raft_consensus.cc:740] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.940403  5071 consensus_queue.cc:260] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.942512  5071 ts_tablet_manager.cc:1434] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:15:12.944278  5077 consensus_queue.cc:1048] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.952924  4777 catalog_manager.cc:5697] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "58df74a8ef6b42aeb707585da24f3c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.956524  5125 raft_consensus.cc:493] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.957129  5125 raft_consensus.cc:515] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.959581  5125 leader_election.cc:290] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:12.961552  4878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7" is_pre_election: true
I20260709 13:15:12.962255  4878 raft_consensus.cc:2468] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 0.
I20260709 13:15:12.963227  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:12.963575  4996 leader_election.cc:304] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.964231  4956 raft_consensus.cc:2468] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 0.
I20260709 13:15:12.965526  5077 raft_consensus.cc:493] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.966001  5077 raft_consensus.cc:515] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.968336  5091 raft_consensus.cc:493] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.968974  5091 raft_consensus.cc:515] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:12.972133  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.972321  5077 leader_election.cc:290] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.972815  5028 raft_consensus.cc:2468] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 0.
I20260709 13:15:12.964401  5082 raft_consensus.cc:2804] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.973726  5082 raft_consensus.cc:493] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.974121  5082 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.974164  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:12.974821  4956 raft_consensus.cc:2468] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 0.
I20260709 13:15:12.976019  5091 leader_election.cc:290] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:12.979017  4777 catalog_manager.cc:5697] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.983232  4846 leader_election.cc:304] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.984397  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ef8d40a0424447b95525d308ae65dd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:12.985109  4956 raft_consensus.cc:2468] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 0.
I20260709 13:15:12.986703  4846 leader_election.cc:304] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:12.988757  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ef8d40a0424447b95525d308ae65dd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:12.989392  5028 raft_consensus.cc:2468] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 0.
I20260709 13:15:12.985226  5091 raft_consensus.cc:2804] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.990425  5091 raft_consensus.cc:493] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.990821  5091 raft_consensus.cc:3060] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.995159  5077 raft_consensus.cc:2804] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.995743  5077 raft_consensus.cc:493] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.996140  5077 raft_consensus.cc:3060] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.006412  5132 consensus_queue.cc:1048] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.017546  5091 raft_consensus.cc:515] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.019426  5082 raft_consensus.cc:515] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.023094  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:13.023931  4955 raft_consensus.cc:3060] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.025303  5082 leader_election.cc:290] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:13.025902  4878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:13.026728  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:13.026744  4878 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.027448  4954 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.033257  4954 raft_consensus.cc:2468] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 1.
I20260709 13:15:13.035410  4995 leader_election.cc:304] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:13.036311  5132 raft_consensus.cc:493] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.036641  5082 raft_consensus.cc:2804] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.038276  5082 raft_consensus.cc:697] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Becoming Leader. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:13.038865  5132 raft_consensus.cc:515] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.043293  5132 leader_election.cc:290] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.045949  4955 raft_consensus.cc:2468] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 1.
I20260709 13:15:13.048038  5091 leader_election.cc:290] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.017630  5077 raft_consensus.cc:515] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.039475  5082 consensus_queue.cc:237] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.049319  4846 leader_election.cc:304] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:13.050680  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76" is_pre_election: true
I20260709 13:15:13.051476  5027 raft_consensus.cc:2393] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc920ef401084dca862e05e8715a22d7 in current term 1: Already voted for candidate 3d93642c55ca499893ab99052cfea8c1 in this term.
I20260709 13:15:13.052469  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.052920  5091 raft_consensus.cc:2804] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.053215  5028 raft_consensus.cc:3060] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.055687  5091 raft_consensus.cc:697] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:13.059274  5091 consensus_queue.cc:237] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.060544  4878 raft_consensus.cc:2468] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 1.
I20260709 13:15:13.062318  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ef8d40a0424447b95525d308ae65dd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.062934  5027 raft_consensus.cc:3060] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.058175  5077 leader_election.cc:290] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.066753  4777 catalog_manager.cc:5697] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "58df74a8ef6b42aeb707585da24f3c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.050891  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1" is_pre_election: true
I20260709 13:15:13.070506  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ef8d40a0424447b95525d308ae65dd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:13.070847  4846 leader_election.cc:304] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc920ef401084dca862e05e8715a22d7; no voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:13.070506  5027 raft_consensus.cc:2468] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 1.
I20260709 13:15:13.071687  4954 raft_consensus.cc:3060] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.072566  4844 leader_election.cc:304] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:13.073724  5136 raft_consensus.cc:2804] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.074210  5136 raft_consensus.cc:697] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:13.074456  5028 raft_consensus.cc:2468] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 1.
I20260709 13:15:13.075094  5136 consensus_queue.cc:237] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.071043  4878 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.084023  4954 raft_consensus.cc:2468] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 1.
I20260709 13:15:13.083447  4776 catalog_manager.cc:5697] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.098925  5075 consensus_queue.cc:1048] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.103448  5077 raft_consensus.cc:2749] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.104104  5075 consensus_queue.cc:1048] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.112882  4777 catalog_manager.cc:5697] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.117444  5098 consensus_queue.cc:1048] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.130618  5098 consensus_queue.cc:1048] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.156931  5077 consensus_queue.cc:1048] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.170279  5091 consensus_queue.cc:1048] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.268409  5091 consensus_queue.cc:1048] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.281273  5077 consensus_queue.cc:1048] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.302716  4956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
mode: GRACEFUL
new_leader_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:43102
I20260709 13:15:13.303299  4956 raft_consensus.cc:606] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Received request to transfer leadership to TS bc920ef401084dca862e05e8715a22d7
I20260709 13:15:13.309684  4956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d1530bab80048529cceec2093e377f0"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
mode: GRACEFUL
new_leader_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:43102
I20260709 13:15:13.310277  4956 raft_consensus.cc:606] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Received request to transfer leadership to TS bc920ef401084dca862e05e8715a22d7
I20260709 13:15:13.316509  4956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b546611d735a4830bc213200bf9ec051"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
mode: GRACEFUL
new_leader_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:43102
I20260709 13:15:13.317305  4956 raft_consensus.cc:606] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Received request to transfer leadership to TS bc920ef401084dca862e05e8715a22d7
I20260709 13:15:13.324193  5098 consensus_queue.cc:1048] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.334084  5098 consensus_queue.cc:1048] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.339368  5075 raft_consensus.cc:993] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1: : Instructing follower bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:13.339824  5075 raft_consensus.cc:1081] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Signalling peer bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:13.341534  5028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
mode: GRACEFUL
new_leader_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:43238
I20260709 13:15:13.342674  5028 raft_consensus.cc:606] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Received request to transfer leadership to TS 3d93642c55ca499893ab99052cfea8c1
I20260709 13:15:13.343861  4878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:52592
I20260709 13:15:13.344442  4878 raft_consensus.cc:493] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.344820  4878 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.357326  4878 raft_consensus.cc:515] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.358757  4880 raft_consensus.cc:1240] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Rejecting Update request from peer 3d93642c55ca499893ab99052cfea8c1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:13.359987  4878 leader_election.cc:290] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 2 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.361112  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:13.361786  4956 raft_consensus.cc:3055] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.362251  4956 raft_consensus.cc:740] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:13.363101  4956 consensus_queue.cc:260] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.364050  4956 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.365623  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.371409  4956 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 2.
I20260709 13:15:13.372692  4846 leader_election.cc:304] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:13.373795  5077 raft_consensus.cc:2804] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.374369  5077 raft_consensus.cc:697] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:13.375203  5077 consensus_queue.cc:237] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.381173  4880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:60320
I20260709 13:15:13.381776  4880 raft_consensus.cc:606] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Received request to transfer leadership to TS 3d93642c55ca499893ab99052cfea8c1
I20260709 13:15:13.382697  4779 catalog_manager.cc:5697] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 1 to 2, leader changed from 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130) to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.388281  5027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
mode: GRACEFUL
new_leader_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:43238
I20260709 13:15:13.388849  5027 raft_consensus.cc:606] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Received request to transfer leadership to TS 3d93642c55ca499893ab99052cfea8c1
I20260709 13:15:13.394747  4880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ef8d40a0424447b95525d308ae65dd"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:60320
I20260709 13:15:13.395226  4880 raft_consensus.cc:606] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Received request to transfer leadership to TS 3d93642c55ca499893ab99052cfea8c1
I20260709 13:15:13.401347  4880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:60320
I20260709 13:15:13.402202  4880 raft_consensus.cc:606] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Received request to transfer leadership to TS 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:13.436836  5082 consensus_queue.cc:1048] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.451773  5082 consensus_queue.cc:1048] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.455817  5082 consensus_queue.cc:1048] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.461400  5082 raft_consensus.cc:993] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76: : Instructing follower 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:13.462041  5154 raft_consensus.cc:1081] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Signalling peer 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:13.463999  4954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:43094
I20260709 13:15:13.464552  4954 raft_consensus.cc:493] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.464890  4954 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.465199  5082 raft_consensus.cc:993] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76: : Instructing follower 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:13.465724  5125 raft_consensus.cc:1081] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Signalling peer 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:13.467458  4956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:43094
I20260709 13:15:13.468039  4956 raft_consensus.cc:493] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.468429  4956 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.473392  4954 raft_consensus.cc:515] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.475766  4954 leader_election.cc:290] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.476907  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.477556  5027 raft_consensus.cc:3055] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.477855  4880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:13.477881  5027 raft_consensus.cc:740] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:13.478415  4880 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.479148  5027 consensus_queue.cc:260] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.480345  5027 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.481091  4956 raft_consensus.cc:515] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.482429  4955 raft_consensus.cc:1240] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Rejecting Update request from peer 58df74a8ef6b42aeb707585da24f3c76 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:13.483661  4956 leader_election.cc:290] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.485034  5157 consensus_queue.cc:1048] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.485653  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.485298  4878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:13.486197  5028 raft_consensus.cc:3055] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.486560  5028 raft_consensus.cc:740] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:13.487484  5028 consensus_queue.cc:260] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.488019  4880 raft_consensus.cc:2468] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:13.486613  4878 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.488965  5082 consensus_queue.cc:1059] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.489262  4922 leader_election.cc:304] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:13.490114  5098 raft_consensus.cc:2804] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.490561  5098 raft_consensus.cc:697] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:13.491389  5098 consensus_queue.cc:237] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.493163  5028 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.496488  5027 raft_consensus.cc:2468] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:13.499356  4779 catalog_manager.cc:5697] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 1 to 2, leader changed from 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131) to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.500687  5028 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:13.501969  4919 leader_election.cc:304] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:13.502324  4878 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:13.502465  5077 consensus_queue.cc:1048] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.502905  5098 raft_consensus.cc:2804] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.503186  4879 raft_consensus.cc:1240] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Rejecting Update request from peer 58df74a8ef6b42aeb707585da24f3c76 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:13.503587  5098 raft_consensus.cc:697] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:13.504494  5098 consensus_queue.cc:237] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.522933  4777 catalog_manager.cc:5697] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 1 to 2, leader changed from 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131) to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.523330  5136 consensus_queue.cc:1048] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.534154  5077 raft_consensus.cc:993] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7: : Instructing follower 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:13.534667  5077 raft_consensus.cc:1081] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Signalling peer 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:13.536511  4955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ef8d40a0424447b95525d308ae65dd"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:55468
I20260709 13:15:13.537027  4955 raft_consensus.cc:493] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.537348  4955 raft_consensus.cc:3060] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.542909  4955 raft_consensus.cc:515] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.544925  4955 leader_election.cc:290] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.546214  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ef8d40a0424447b95525d308ae65dd" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.546021  4878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ef8d40a0424447b95525d308ae65dd" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:13.546820  5030 raft_consensus.cc:3060] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.546988  4878 raft_consensus.cc:3055] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.547497  4878 raft_consensus.cc:740] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:13.548460  4878 consensus_queue.cc:260] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.549564  4878 raft_consensus.cc:3060] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.553618  5030 raft_consensus.cc:2468] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:13.555401  4919 leader_election.cc:304] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:13.556301  5098 raft_consensus.cc:2804] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.556907  4878 raft_consensus.cc:2468] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:13.557327  5097 raft_consensus.cc:993] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1: : Instructing follower bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:13.557745  5097 raft_consensus.cc:1081] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Signalling peer bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:13.556815  5098 raft_consensus.cc:697] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:13.559214  5098 consensus_queue.cc:237] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.560961  4878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b546611d735a4830bc213200bf9ec051"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:52592
I20260709 13:15:13.561826  4878 raft_consensus.cc:493] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.562299  4878 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.565059  5136 consensus_queue.cc:1048] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.567394  4776 catalog_manager.cc:5697] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 1 to 2, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.570261  4878 raft_consensus.cc:515] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.575006  5135 raft_consensus.cc:993] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7: : Instructing follower 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:13.575448  5135 raft_consensus.cc:1081] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Signalling peer 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:13.576421  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:13.577055  4955 raft_consensus.cc:3055] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.577402  4955 raft_consensus.cc:740] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:13.578291  4955 consensus_queue.cc:260] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.579849  4955 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.580479  5028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:56588
I20260709 13:15:13.582705  5136 consensus_queue.cc:1048] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.583142  5028 raft_consensus.cc:493] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.583570  5028 raft_consensus.cc:3060] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.586864  4878 leader_election.cc:290] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 2 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.587075  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.587626  5027 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.590615  4955 raft_consensus.cc:2468] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 2.
I20260709 13:15:13.592249  4846 leader_election.cc:304] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:13.593266  5091 raft_consensus.cc:2804] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.594115  5091 raft_consensus.cc:697] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:13.595036  5028 raft_consensus.cc:515] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.595003  5091 consensus_queue.cc:237] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.596159  5027 raft_consensus.cc:2468] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 2.
I20260709 13:15:13.603575  4878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:13.604239  4878 raft_consensus.cc:3055] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.604591  4878 raft_consensus.cc:740] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:13.605327  4878 consensus_queue.cc:260] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.606330  4878 raft_consensus.cc:3060] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.607419  5028 leader_election.cc:290] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 2 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:13.608801  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ae8f41c0ad04b23b4f5ba300af8820c" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:13.609457  4955 raft_consensus.cc:3060] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.614391  4878 raft_consensus.cc:2468] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 2.
I20260709 13:15:13.615056  4777 catalog_manager.cc:5697] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 1 to 2, leader changed from 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130) to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.616562  4996 leader_election.cc:304] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:13.616580  4955 raft_consensus.cc:2468] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 2.
I20260709 13:15:13.617506  5154 raft_consensus.cc:2804] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.618012  5154 raft_consensus.cc:697] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 2 LEADER]: Becoming Leader. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:13.618808  5154 consensus_queue.cc:237] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.627743  4777 catalog_manager.cc:5697] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 reported cstate change: term changed from 1 to 2, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "58df74a8ef6b42aeb707585da24f3c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.669377  5075 raft_consensus.cc:993] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1: : Instructing follower bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:13.670297  5098 raft_consensus.cc:1081] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Signalling peer bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:13.671917  4878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d1530bab80048529cceec2093e377f0"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:52592
I20260709 13:15:13.672502  4878 raft_consensus.cc:493] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.673117  4878 raft_consensus.cc:3060] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.679340  4878 raft_consensus.cc:515] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.681169  4878 leader_election.cc:290] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 2 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.682204  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1530bab80048529cceec2093e377f0" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:13.682332  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1530bab80048529cceec2093e377f0" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.682996  4955 raft_consensus.cc:3055] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.683033  5028 raft_consensus.cc:3060] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.683470  4955 raft_consensus.cc:740] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:13.684396  4955 consensus_queue.cc:260] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.685559  4955 raft_consensus.cc:3060] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.689100  5028 raft_consensus.cc:2468] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 2.
I20260709 13:15:13.690522  4844 leader_election.cc:304] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:13.691576  5091 raft_consensus.cc:2804] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.692097  5091 raft_consensus.cc:697] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:13.692906  5091 consensus_queue.cc:237] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.694233  4955 raft_consensus.cc:2468] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 2.
I20260709 13:15:13.700491  4777 catalog_manager.cc:5697] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 1 to 2, leader changed from 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130) to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.758059  4955 raft_consensus.cc:1275] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.759636  5091 consensus_queue.cc:1048] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.773303  5028 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.779755  5028 raft_consensus.cc:1275] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.781819  5135 consensus_queue.cc:1048] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.888337  5028 raft_consensus.cc:1275] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.890746  5091 raft_consensus.cc:993] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7: : Instructing follower 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:13.890439  5098 consensus_queue.cc:1048] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:13.891391  5135 raft_consensus.cc:1081] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Signalling peer 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:13.892999  4955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:55468
I20260709 13:15:13.893589  4955 raft_consensus.cc:493] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.893982  4955 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.899374  4878 raft_consensus.cc:1275] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.901427  5089 consensus_queue.cc:1048] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.902313  4955 raft_consensus.cc:515] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.905544  4955 leader_election.cc:290] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:13.906026  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:13.907022  5027 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.911417  4878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:13.912549  4878 raft_consensus.cc:3055] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.913064  4878 raft_consensus.cc:740] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:13.914700  4878 consensus_queue.cc:260] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.916287  4878 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.919668  5027 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:13.920874  4919 leader_election.cc:304] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:13.921622  5089 raft_consensus.cc:2804] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.922035  5089 raft_consensus.cc:697] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:13.922838  5089 consensus_queue.cc:237] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:13.923134  4878 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:13.930773  4776 catalog_manager.cc:5697] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 1 to 2, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.042301  4955 raft_consensus.cc:1275] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.043718  5135 consensus_queue.cc:1048] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.047823  5027 raft_consensus.cc:1275] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.049228  5089 consensus_queue.cc:1048] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.056365  5027 raft_consensus.cc:1275] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.057953  5135 consensus_queue.cc:1048] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.061192  4878 raft_consensus.cc:1275] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.062798  5098 consensus_queue.cc:1048] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:14.074304  5027 raft_consensus.cc:1275] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.077502  5089 consensus_queue.cc:1048] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.078325  4878 raft_consensus.cc:1275] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.080066  5089 consensus_queue.cc:1048] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.163012  4955 raft_consensus.cc:1275] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.164583  5154 consensus_queue.cc:1048] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.176261  4878 raft_consensus.cc:1275] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.178969  5164 consensus_queue.cc:1048] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.229369  5027 raft_consensus.cc:1275] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.230852  5132 consensus_queue.cc:1048] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.242425  4955 raft_consensus.cc:1275] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.244910  5091 consensus_queue.cc:1048] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.754808  4879 raft_consensus.cc:1275] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.757296  5167 consensus_queue.cc:1048] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:14.808041  5030 raft_consensus.cc:1275] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.810606  5097 consensus_queue.cc:1048] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:15.722955  4977 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9960 after lost signal to thread 4249
W20260709 13:15:15.723871  4977 debug-util.cc:398] Leaking SignalData structure 0x7b08001db3a0 after lost signal to thread 4813
W20260709 13:15:15.724750  4977 debug-util.cc:398] Leaking SignalData structure 0x7b08000772c0 after lost signal to thread 4905
W20260709 13:15:15.725585  4977 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3740 after lost signal to thread 4980
W20260709 13:15:15.726329  4977 debug-util.cc:398] Leaking SignalData structure 0x7b080019ba80 after lost signal to thread 5054
I20260709 13:15:16.550935  4246 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:15:16.552780  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:16.582901  4879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:60322
I20260709 13:15:16.583514  4879 raft_consensus.cc:606] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Received request to transfer leadership to TS 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:16.586474  4879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:60322
I20260709 13:15:16.587364  4879 raft_consensus.cc:606] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Received request to transfer leadership to TS 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:16.588485  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:16.589012  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:16.827502  5135 raft_consensus.cc:993] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7: : Instructing follower 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:16.828015  5176 raft_consensus.cc:1081] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Signalling peer 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:16.829907  5030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:56588
I20260709 13:15:16.830502  5030 raft_consensus.cc:493] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.830812  5030 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.837692  5030 raft_consensus.cc:515] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:16.841403  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:16.841378  4879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:16.842139  5176 raft_consensus.cc:993] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7: : Instructing follower 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:16.842341  4956 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.842432  4879 raft_consensus.cc:3055] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:16.842638  5176 raft_consensus.cc:1081] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Signalling peer 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:16.843029  4879 raft_consensus.cc:740] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:16.844005  4879 consensus_queue.cc:260] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:16.844763  5027 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:56588
I20260709 13:15:16.845402  5027 raft_consensus.cc:493] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.845919  5027 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.845316  4879 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.857463  4879 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 3.
I20260709 13:15:16.841343  5030 leader_election.cc:290] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 3 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:16.858831  4956 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 3.
I20260709 13:15:16.860318  4995 leader_election.cc:304] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:16.859952  5027 raft_consensus.cc:515] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:16.862433  5164 raft_consensus.cc:2804] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:16.868813  5027 leader_election.cc:290] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 2 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:16.872818  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:16.876884  4956 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.873682  4879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:16.879387  4879 raft_consensus.cc:3055] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.879825  4879 raft_consensus.cc:740] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:16.880791  4879 consensus_queue.cc:260] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:16.882273  4879 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.886214  4956 raft_consensus.cc:2468] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 2.
I20260709 13:15:16.887622  5164 raft_consensus.cc:697] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 LEADER]: Becoming Leader. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:16.888008  4995 leader_election.cc:304] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:16.889060  5177 raft_consensus.cc:2804] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.889629  5164 consensus_queue.cc:237] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:16.891075  4879 raft_consensus.cc:2468] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 2.
I20260709 13:15:16.894282  5177 raft_consensus.cc:697] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 LEADER]: Becoming Leader. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:16.896474  5177 consensus_queue.cc:237] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:16.902269  4777 catalog_manager.cc:5697] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 reported cstate change: term changed from 2 to 3, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "58df74a8ef6b42aeb707585da24f3c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:16.923578  4777 catalog_manager.cc:5697] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 reported cstate change: term changed from 1 to 2, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "58df74a8ef6b42aeb707585da24f3c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.291713  4879 raft_consensus.cc:1275] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.293062  5177 consensus_queue.cc:1048] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.316416  4878 raft_consensus.cc:1275] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:17.319118  5177 consensus_queue.cc:1048] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:17.332672  4956 raft_consensus.cc:1275] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.334362  5164 consensus_queue.cc:1048] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.347364  4955 raft_consensus.cc:1275] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:17.353225  5178 consensus_queue.cc:1048] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:17.589978  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:17.606495  5027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
mode: GRACEFUL
new_leader_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:43238
I20260709 13:15:17.607187  5027 raft_consensus.cc:606] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 LEADER]: Received request to transfer leadership to TS bc920ef401084dca862e05e8715a22d7
I20260709 13:15:17.618389  5027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
mode: GRACEFUL
new_leader_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:43238
I20260709 13:15:17.618950  5027 raft_consensus.cc:606] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 LEADER]: Received request to transfer leadership to TS bc920ef401084dca862e05e8715a22d7
I20260709 13:15:17.635424  4955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
mode: GRACEFUL
new_leader_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:43102
I20260709 13:15:17.636045  4955 raft_consensus.cc:606] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Received request to transfer leadership to TS bc920ef401084dca862e05e8715a22d7
I20260709 13:15:17.641628  4955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
mode: GRACEFUL
new_leader_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:43102
I20260709 13:15:17.642175  4955 raft_consensus.cc:606] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Received request to transfer leadership to TS bc920ef401084dca862e05e8715a22d7
I20260709 13:15:17.651080  4955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
mode: GRACEFUL
new_leader_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:43102
I20260709 13:15:17.651770  4955 raft_consensus.cc:606] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Received request to transfer leadership to TS bc920ef401084dca862e05e8715a22d7
I20260709 13:15:17.662295  5192 raft_consensus.cc:993] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1: : Instructing follower bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:17.662946  5089 raft_consensus.cc:1081] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Signalling peer bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:17.664718  4878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:52592
I20260709 13:15:17.665268  4878 raft_consensus.cc:493] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.665683  4878 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.671766  4878 raft_consensus.cc:515] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.673538  4878 leader_election.cc:290] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 3 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:17.674667  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:17.675202  5027 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.675335  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:17.675997  4955 raft_consensus.cc:3055] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:17.676357  4955 raft_consensus.cc:740] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:17.677254  4955 consensus_queue.cc:260] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.678921  4955 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.681747  5027 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 3.
I20260709 13:15:17.683071  4844 leader_election.cc:304] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:17.683938  5135 raft_consensus.cc:2804] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:17.684489  5135 raft_consensus.cc:697] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:17.685297  5135 consensus_queue.cc:237] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.687240  4955 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 3.
I20260709 13:15:17.693105  4776 catalog_manager.cc:5697] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 2 to 3, leader changed from 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130) to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.699633  5192 raft_consensus.cc:993] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1: : Instructing follower bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:17.700088  5089 raft_consensus.cc:1081] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Signalling peer bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:17.701843  4878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:52592
I20260709 13:15:17.702536  4878 raft_consensus.cc:493] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.703125  4878 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.718346  4878 raft_consensus.cc:515] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.720571  4878 leader_election.cc:290] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 3 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:17.721678  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:17.721788  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:17.722397  5027 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.722465  4955 raft_consensus.cc:3055] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:17.722895  4955 raft_consensus.cc:740] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:17.723764  4955 consensus_queue.cc:260] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.725083  4955 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.728044  5027 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 3.
I20260709 13:15:17.729156  4844 leader_election.cc:304] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58df74a8ef6b42aeb707585da24f3c76, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:17.729972  5135 raft_consensus.cc:2804] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:17.730559  5135 raft_consensus.cc:697] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:17.731267  5135 consensus_queue.cc:237] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.745178  4955 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 3.
I20260709 13:15:17.751323  4776 catalog_manager.cc:5697] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 2 to 3, leader changed from 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130) to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.824065  5177 raft_consensus.cc:993] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76: : Instructing follower bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:17.824538  5178 raft_consensus.cc:1081] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 LEADER]: Signalling peer bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:17.826213  4879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:60316
I20260709 13:15:17.826754  4879 raft_consensus.cc:493] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.827164  4879 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.827785  5164 raft_consensus.cc:993] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76: : Instructing follower bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:17.828382  5178 raft_consensus.cc:1081] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 LEADER]: Signalling peer bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:17.830277  4878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:60316
I20260709 13:15:17.830945  4878 raft_consensus.cc:493] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.831367  4878 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.833482  4879 raft_consensus.cc:515] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:17.835469  4879 leader_election.cc:290] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 3 election: Requested vote from peers 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:17.836252  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:17.836652  5027 raft_consensus.cc:3055] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:17.836826  5027 raft_consensus.cc:740] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:17.837496  5027 consensus_queue.cc:260] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:17.838773  5027 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.839607  4878 raft_consensus.cc:515] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.841796  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d318acd345914c07ad7689aed477d1cd" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:17.842692  4955 raft_consensus.cc:3060] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.843003  4878 leader_election.cc:290] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 4 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:17.842909  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:17.844338  4956 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.846485  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd4aa0db4b44779b923958f31e13770" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:17.847182  5030 raft_consensus.cc:3055] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:17.847515  5030 raft_consensus.cc:740] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:17.848465  5030 consensus_queue.cc:260] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.851353  5030 raft_consensus.cc:3060] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.852766  4955 raft_consensus.cc:2468] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 3.
I20260709 13:15:17.852962  4956 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 4.
I20260709 13:15:17.854382  4846 leader_election.cc:304] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:17.855379  4846 leader_election.cc:304] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:17.856333  5176 raft_consensus.cc:2804] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:17.856407  5135 raft_consensus.cc:2804] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:17.859459  5027 raft_consensus.cc:2468] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 3.
I20260709 13:15:17.866025  5135 raft_consensus.cc:697] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 4 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:17.866931  5176 raft_consensus.cc:697] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:17.867323  5135 consensus_queue.cc:237] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:17.867828  5176 consensus_queue.cc:237] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } }
I20260709 13:15:17.871734  5030 raft_consensus.cc:2468] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 4.
I20260709 13:15:17.878363  4776 catalog_manager.cc:5697] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 2 to 3, leader changed from 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131) to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.879753  4776 catalog_manager.cc:5697] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 3 to 4, leader changed from 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131) to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 4 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.109189  4955 raft_consensus.cc:1275] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.111542  5176 consensus_queue.cc:1048] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:18.113618  5030 raft_consensus.cc:1275] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.115278  5176 consensus_queue.cc:1048] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.128786  5089 raft_consensus.cc:993] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1: : Instructing follower bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:18.129516  5089 raft_consensus.cc:1081] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Signalling peer bc920ef401084dca862e05e8715a22d7 to start an election
I20260709 13:15:18.132117  4878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
 from {username='slave'} at 127.0.0.1:52592
I20260709 13:15:18.133023  4878 raft_consensus.cc:493] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:18.133411  4878 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:18.148330  4878 raft_consensus.cc:515] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:18.152529  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:18.153322  4956 raft_consensus.cc:3055] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:18.153676  4956 raft_consensus.cc:740] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:18.154575  4956 consensus_queue.cc:260] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:18.155790  4956 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:18.167493  4956 raft_consensus.cc:2468] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 3.
I20260709 13:15:18.169085  4846 leader_election.cc:304] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, bc920ef401084dca862e05e8715a22d7; no voters: 
I20260709 13:15:18.170456  5199 raft_consensus.cc:2804] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:18.170996  5199 raft_consensus.cc:697] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Becoming Leader. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:18.171857  4878 leader_election.cc:290] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [CANDIDATE]: Term 3 election: Requested vote from peers 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:18.172307  5199 consensus_queue.cc:237] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:18.174996  5027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a214808f9d1f4fa794a84ccc5c810ba8" candidate_uuid: "bc920ef401084dca862e05e8715a22d7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:18.175624  5027 raft_consensus.cc:3060] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:18.184268  5027 raft_consensus.cc:2468] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc920ef401084dca862e05e8715a22d7 in term 3.
I20260709 13:15:18.193012  4779 catalog_manager.cc:5697] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 reported cstate change: term changed from 2 to 3, leader changed from 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130) to bc920ef401084dca862e05e8715a22d7 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "bc920ef401084dca862e05e8715a22d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.261260  5027 raft_consensus.cc:1275] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.262995  5199 consensus_queue.cc:1048] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.278213  4956 raft_consensus.cc:1275] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.280948  5176 consensus_queue.cc:1048] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.383590  5027 raft_consensus.cc:1275] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:18.384864  5176 consensus_queue.cc:1048] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:18.396601  4956 raft_consensus.cc:1275] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:18.398274  5199 consensus_queue.cc:1048] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:18.429584  5027 raft_consensus.cc:1275] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.433815  5199 consensus_queue.cc:1048] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.446336  4955 raft_consensus.cc:1275] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.447873  5198 consensus_queue.cc:1048] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.744797  5027 raft_consensus.cc:1275] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.746371  5135 consensus_queue.cc:1048] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.756124  4956 raft_consensus.cc:1275] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Refusing update from remote peer bc920ef401084dca862e05e8715a22d7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:18.758491  5176 consensus_queue.cc:1048] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.664014  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:20.672494  4878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36ae2f481350447a959659dc2ec997db"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:60322
I20260709 13:15:20.673061  4878 raft_consensus.cc:606] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Received request to transfer leadership to TS 3d93642c55ca499893ab99052cfea8c1
I20260709 13:15:20.676412  4878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:60322
I20260709 13:15:20.676903  4878 raft_consensus.cc:606] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Received request to transfer leadership to TS 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:20.679625  4878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:60322
I20260709 13:15:20.680119  4878 raft_consensus.cc:606] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Received request to transfer leadership to TS 3d93642c55ca499893ab99052cfea8c1
I20260709 13:15:20.683132  4879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b546611d735a4830bc213200bf9ec051"
dest_uuid: "bc920ef401084dca862e05e8715a22d7"
mode: GRACEFUL
new_leader_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:60322
I20260709 13:15:20.683841  4879 raft_consensus.cc:606] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Received request to transfer leadership to TS 58df74a8ef6b42aeb707585da24f3c76
I20260709 13:15:20.685405  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:20.685951  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:20.820194  5176 raft_consensus.cc:993] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7: : Instructing follower 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:20.820777  5176 raft_consensus.cc:1081] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Signalling peer 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:20.822552  4956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:55468
I20260709 13:15:20.823100  4956 raft_consensus.cc:493] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.823423  4956 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.828872  4956 raft_consensus.cc:515] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:20.830621  4956 leader_election.cc:290] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 4 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:20.831909  4879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:20.832944  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a13aad855b4dce8999daa1610d82c6" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:20.833122  4879 raft_consensus.cc:3055] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:20.833568  5030 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.833774  4879 raft_consensus.cc:740] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:20.834702  4879 consensus_queue.cc:260] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:20.835736  4879 raft_consensus.cc:3060] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.840286  5030 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 4.
I20260709 13:15:20.841732  4919 leader_election.cc:304] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:20.842396  4879 raft_consensus.cc:2468] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 4.
I20260709 13:15:20.842635  5192 raft_consensus.cc:2804] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:20.843744  5192 raft_consensus.cc:697] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 4 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:20.844695  5192 consensus_queue.cc:237] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:20.853493  4779 catalog_manager.cc:5697] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 3 to 4, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 4 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.885123  5176 raft_consensus.cc:993] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7: : Instructing follower 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:20.885664  5217 raft_consensus.cc:1081] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Signalling peer 3d93642c55ca499893ab99052cfea8c1 to start an election
I20260709 13:15:20.887786  4956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36ae2f481350447a959659dc2ec997db"
dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
 from {username='slave'} at 127.0.0.1:55468
I20260709 13:15:20.888392  4956 raft_consensus.cc:493] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.889060  4956 raft_consensus.cc:3060] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.895246  4956 raft_consensus.cc:515] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:20.897293  4956 leader_election.cc:290] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131:42431)
I20260709 13:15:20.898363  4879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ae2f481350447a959659dc2ec997db" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:20.898499  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ae2f481350447a959659dc2ec997db" candidate_uuid: "3d93642c55ca499893ab99052cfea8c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
I20260709 13:15:20.899120  4879 raft_consensus.cc:3055] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:20.899204  5030 raft_consensus.cc:3060] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.899464  4879 raft_consensus.cc:740] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:20.900311  4879 consensus_queue.cc:260] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:20.901280  4879 raft_consensus.cc:3060] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.904978  5030 raft_consensus.cc:2468] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:20.906525  4919 leader_election.cc:304] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:20.907362  5192 raft_consensus.cc:2804] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.907039  4879 raft_consensus.cc:2468] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d93642c55ca499893ab99052cfea8c1 in term 2.
I20260709 13:15:20.907831  5192 raft_consensus.cc:697] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Becoming Leader. State: Replica: 3d93642c55ca499893ab99052cfea8c1, State: Running, Role: LEADER
I20260709 13:15:20.909894  5192 consensus_queue.cc:237] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:20.918730  4779 catalog_manager.cc:5697] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 reported cstate change: term changed from 1 to 2, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3d93642c55ca499893ab99052cfea8c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:21.000767  5176 raft_consensus.cc:993] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7: : Instructing follower 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:21.001327  5176 raft_consensus.cc:1081] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Signalling peer 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:21.003435  5030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b546611d735a4830bc213200bf9ec051"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:56588
I20260709 13:15:21.004004  5030 raft_consensus.cc:493] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.004370  5030 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:21.012838  5030 raft_consensus.cc:515] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:21.016472  5030 leader_election.cc:290] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 3 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:21.017578  4879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:21.017661  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b546611d735a4830bc213200bf9ec051" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:21.018324  4879 raft_consensus.cc:3055] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:21.018340  4956 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:21.018779  4879 raft_consensus.cc:740] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:21.019603  4879 consensus_queue.cc:260] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:21.020665  4879 raft_consensus.cc:3060] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:21.024029  4956 raft_consensus.cc:2468] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 3.
I20260709 13:15:21.025689  4995 leader_election.cc:304] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:21.026569  5225 raft_consensus.cc:2804] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:21.026603  4879 raft_consensus.cc:2468] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 3.
I20260709 13:15:21.028520  5225 raft_consensus.cc:697] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 LEADER]: Becoming Leader. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:21.029712  5225 consensus_queue.cc:237] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:21.038420  4779 catalog_manager.cc:5697] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 reported cstate change: term changed from 2 to 3, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "58df74a8ef6b42aeb707585da24f3c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.061928  5217 raft_consensus.cc:993] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7: : Instructing follower 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:21.062378  5176 raft_consensus.cc:1081] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Signalling peer 58df74a8ef6b42aeb707585da24f3c76 to start an election
I20260709 13:15:21.063802  5030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe"
dest_uuid: "58df74a8ef6b42aeb707585da24f3c76"
 from {username='slave'} at 127.0.0.1:56588
I20260709 13:15:21.064306  5030 raft_consensus.cc:493] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:21.064615  5030 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:21.070096  5030 raft_consensus.cc:515] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:21.072171  5030 leader_election.cc:290] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 4 election: Requested vote from peers bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461), 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019)
I20260709 13:15:21.072892  4879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc920ef401084dca862e05e8715a22d7"
I20260709 13:15:21.073176  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae448f3b3a824ae8b7ece648bd2253fe" candidate_uuid: "58df74a8ef6b42aeb707585da24f3c76" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3d93642c55ca499893ab99052cfea8c1"
I20260709 13:15:21.073621  4879 raft_consensus.cc:3055] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:21.073722  4956 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:21.073976  4879 raft_consensus.cc:740] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc920ef401084dca862e05e8715a22d7, State: Running, Role: LEADER
I20260709 13:15:21.074774  4879 consensus_queue.cc:260] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:21.075767  4879 raft_consensus.cc:3060] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:21.078853  4956 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 4.
I20260709 13:15:21.081218  4879 raft_consensus.cc:2468] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58df74a8ef6b42aeb707585da24f3c76 in term 4.
I20260709 13:15:21.082558  4995 leader_election.cc:304] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d93642c55ca499893ab99052cfea8c1, 58df74a8ef6b42aeb707585da24f3c76; no voters: 
I20260709 13:15:21.083287  5225 raft_consensus.cc:2804] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:21.083756  5225 raft_consensus.cc:697] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 4 LEADER]: Becoming Leader. State: Replica: 58df74a8ef6b42aeb707585da24f3c76, State: Running, Role: LEADER
I20260709 13:15:21.084524  5225 consensus_queue.cc:237] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } }
I20260709 13:15:21.091874  4779 catalog_manager.cc:5697] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 reported cstate change: term changed from 3 to 4, leader changed from bc920ef401084dca862e05e8715a22d7 (127.4.37.129) to 58df74a8ef6b42aeb707585da24f3c76 (127.4.37.131). New cstate: current_term: 4 leader_uuid: "58df74a8ef6b42aeb707585da24f3c76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.306403  4879 raft_consensus.cc:1275] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:21.308305  5192 consensus_queue.cc:1048] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:21.323097  5030 raft_consensus.cc:1275] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:21.324489  5192 consensus_queue.cc:1048] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.449296  5030 raft_consensus.cc:1275] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.451511  5192 consensus_queue.cc:1048] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58df74a8ef6b42aeb707585da24f3c76" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 42431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:21.453125  4879 raft_consensus.cc:1275] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Refusing update from remote peer 3d93642c55ca499893ab99052cfea8c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.455856  5192 consensus_queue.cc:1048] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.461031  4956 raft_consensus.cc:1275] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:21.462741  5225 consensus_queue.cc:1048] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.490410  4879 raft_consensus.cc:1275] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:21.492882  5240 consensus_queue.cc:1048] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.564499  4956 raft_consensus.cc:1275] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:21.565807  5240 consensus_queue.cc:1048] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d93642c55ca499893ab99052cfea8c1" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 34019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.576035  4879 raft_consensus.cc:1275] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Refusing update from remote peer 58df74a8ef6b42aeb707585da24f3c76: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:21.577709  5225 consensus_queue.cc:1048] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc920ef401084dca862e05e8715a22d7" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 42461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.686885  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:21.693907  4246 tablet_server.cc:179] TabletServer@127.4.37.129:0 shutting down...
I20260709 13:15:21.738339  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:21.739156  4246 tablet_replica.cc:333] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.739869  4246 raft_consensus.cc:2243] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.740413  4246 raft_consensus.cc:2272] T 3ae8f41c0ad04b23b4f5ba300af8820c P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.742895  4246 tablet_replica.cc:333] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.743512  4246 raft_consensus.cc:2243] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.744294  4246 raft_consensus.cc:2272] T a214808f9d1f4fa794a84ccc5c810ba8 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.746165  4246 tablet_replica.cc:333] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.746718  4246 raft_consensus.cc:2243] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.747160  4246 raft_consensus.cc:2272] T b546611d735a4830bc213200bf9ec051 P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.751579  4246 tablet_replica.cc:333] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.752341  4246 raft_consensus.cc:2243] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.753038  4246 raft_consensus.cc:2272] T b4a13aad855b4dce8999daa1610d82c6 P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.757017  4246 tablet_replica.cc:333] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.757814  4246 raft_consensus.cc:2243] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.758757  4246 raft_consensus.cc:2272] T 9bd4aa0db4b44779b923958f31e13770 P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.761304  4246 tablet_replica.cc:333] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.762027  4246 raft_consensus.cc:2243] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.762598  4246 raft_consensus.cc:2272] T ae448f3b3a824ae8b7ece648bd2253fe P bc920ef401084dca862e05e8715a22d7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.765477  4246 tablet_replica.cc:333] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.767537  4246 raft_consensus.cc:2243] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.771533  4246 raft_consensus.cc:2272] T d318acd345914c07ad7689aed477d1cd P bc920ef401084dca862e05e8715a22d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.775481  4246 tablet_replica.cc:333] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.776324  4246 raft_consensus.cc:2243] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.776902  4246 raft_consensus.cc:2272] T 36ae2f481350447a959659dc2ec997db P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:21.778795  4922 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 13:15:21.780035  4246 tablet_replica.cc:333] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.780616  4246 raft_consensus.cc:2243] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.781190  4246 raft_consensus.cc:2272] T 01ef8d40a0424447b95525d308ae65dd P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:21.781919  4922 consensus_peers.cc:597] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 -> Peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Couldn't send request to peer bc920ef401084dca862e05e8715a22d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.783432  4246 tablet_replica.cc:333] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7: stopping tablet replica
I20260709 13:15:21.784021  4246 raft_consensus.cc:2243] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.784811  4246 raft_consensus.cc:2272] T 6d1530bab80048529cceec2093e377f0 P bc920ef401084dca862e05e8715a22d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:21.821959  4922 consensus_peers.cc:597] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 -> Peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Couldn't send request to peer bc920ef401084dca862e05e8715a22d7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:42461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.822402  4246 tablet_server.cc:196] TabletServer@127.4.37.129:0 shutdown complete.
I20260709 13:15:21.845793  4246 tablet_server.cc:179] TabletServer@127.4.37.130:0 shutting down...
I20260709 13:15:21.873719  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:21.874486  4246 tablet_replica.cc:333] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.875119  4246 raft_consensus.cc:2243] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.875866  4246 raft_consensus.cc:2272] T 3ae8f41c0ad04b23b4f5ba300af8820c P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.878124  4246 tablet_replica.cc:333] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.878943  4246 raft_consensus.cc:2243] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.879447  4246 raft_consensus.cc:2272] T a214808f9d1f4fa794a84ccc5c810ba8 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.881609  4246 tablet_replica.cc:333] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.882227  4246 raft_consensus.cc:2243] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.882970  4246 raft_consensus.cc:2272] T b4a13aad855b4dce8999daa1610d82c6 P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:21.884341  4995 consensus_peers.cc:597] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 -> Peer 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019): Couldn't send request to peer 3d93642c55ca499893ab99052cfea8c1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.885322  4246 tablet_replica.cc:333] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.885958  4246 raft_consensus.cc:2243] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.886437  4246 raft_consensus.cc:2272] T 9bd4aa0db4b44779b923958f31e13770 P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.888173  4246 tablet_replica.cc:333] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.888904  4246 raft_consensus.cc:2243] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.890025  4246 raft_consensus.cc:2272] T ae448f3b3a824ae8b7ece648bd2253fe P 3d93642c55ca499893ab99052cfea8c1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.893944  4246 tablet_replica.cc:333] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.894703  4246 raft_consensus.cc:2243] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.895284  4246 raft_consensus.cc:2272] T d318acd345914c07ad7689aed477d1cd P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.897708  4246 tablet_replica.cc:333] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.898407  4246 raft_consensus.cc:2243] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.899427  4246 raft_consensus.cc:2272] T 01ef8d40a0424447b95525d308ae65dd P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.902027  4246 tablet_replica.cc:333] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.902786  4246 raft_consensus.cc:2243] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.903381  4246 raft_consensus.cc:2272] T 6d1530bab80048529cceec2093e377f0 P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:21.905580  4996 consensus_peers.cc:597] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 -> Peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Couldn't send request to peer bc920ef401084dca862e05e8715a22d7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:42461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.905763  4246 tablet_replica.cc:333] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.906450  4246 raft_consensus.cc:2243] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.907251  4246 raft_consensus.cc:2272] T 36ae2f481350447a959659dc2ec997db P 3d93642c55ca499893ab99052cfea8c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.911300  4246 tablet_replica.cc:333] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1: stopping tablet replica
I20260709 13:15:21.912012  4246 raft_consensus.cc:2243] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.912892  4246 raft_consensus.cc:2272] T b546611d735a4830bc213200bf9ec051 P 3d93642c55ca499893ab99052cfea8c1 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:21.942330  4995 consensus_peers.cc:597] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 -> Peer 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019): Couldn't send request to peer 3d93642c55ca499893ab99052cfea8c1. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:34019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.966256  4246 tablet_server.cc:196] TabletServer@127.4.37.130:0 shutdown complete.
W20260709 13:15:21.979592  4995 consensus_peers.cc:597] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 -> Peer 3d93642c55ca499893ab99052cfea8c1 (127.4.37.130:34019): Couldn't send request to peer 3d93642c55ca499893ab99052cfea8c1. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:34019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.994339  4246 tablet_server.cc:179] TabletServer@127.4.37.131:0 shutting down...
W20260709 13:15:21.999014  4996 consensus_peers.cc:597] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 -> Peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Couldn't send request to peer bc920ef401084dca862e05e8715a22d7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:42461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:22.025981  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:22.026767  4246 tablet_replica.cc:333] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.027419  4246 raft_consensus.cc:2243] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:22.028257  4246 raft_consensus.cc:2272] T 3ae8f41c0ad04b23b4f5ba300af8820c P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.030244  4246 tablet_replica.cc:333] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.031204  4246 raft_consensus.cc:2243] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:22.032091  4246 raft_consensus.cc:2272] T a214808f9d1f4fa794a84ccc5c810ba8 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.035354  4246 tablet_replica.cc:333] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.036197  4246 raft_consensus.cc:2243] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:22.036837  4246 raft_consensus.cc:2272] T 9bd4aa0db4b44779b923958f31e13770 P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:22.038235  4996 consensus_peers.cc:597] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 -> Peer bc920ef401084dca862e05e8715a22d7 (127.4.37.129:42461): Couldn't send request to peer bc920ef401084dca862e05e8715a22d7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:42461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:22.039074  4246 tablet_replica.cc:333] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.039568  4246 raft_consensus.cc:2243] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:22.039986  4246 raft_consensus.cc:2272] T b4a13aad855b4dce8999daa1610d82c6 P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.041975  4246 tablet_replica.cc:333] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.042431  4246 raft_consensus.cc:2243] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:22.043109  4246 raft_consensus.cc:2272] T ae448f3b3a824ae8b7ece648bd2253fe P 58df74a8ef6b42aeb707585da24f3c76 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.045113  4246 tablet_replica.cc:333] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.045694  4246 raft_consensus.cc:2243] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:22.046067  4246 raft_consensus.cc:2272] T d318acd345914c07ad7689aed477d1cd P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.047780  4246 tablet_replica.cc:333] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.048228  4246 raft_consensus.cc:2243] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:22.048584  4246 raft_consensus.cc:2272] T 36ae2f481350447a959659dc2ec997db P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.050658  4246 tablet_replica.cc:333] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.051120  4246 raft_consensus.cc:2243] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:22.051494  4246 raft_consensus.cc:2272] T 01ef8d40a0424447b95525d308ae65dd P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.053117  4246 tablet_replica.cc:333] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.053619  4246 raft_consensus.cc:2243] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:22.054000  4246 raft_consensus.cc:2272] T 6d1530bab80048529cceec2093e377f0 P 58df74a8ef6b42aeb707585da24f3c76 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.055641  4246 tablet_replica.cc:333] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76: stopping tablet replica
I20260709 13:15:22.056041  4246 raft_consensus.cc:2243] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:22.056720  4246 raft_consensus.cc:2272] T b546611d735a4830bc213200bf9ec051 P 58df74a8ef6b42aeb707585da24f3c76 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.086210  4246 tablet_server.cc:196] TabletServer@127.4.37.131:0 shutdown complete.
I20260709 13:15:22.109797  4246 master.cc:562] Master@127.4.37.190:40113 shutting down...
I20260709 13:15:22.143433  4246 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:22.144150  4246 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:22.144549  4246 tablet_replica.cc:333] T 00000000000000000000000000000000 P d46dadfe12c5400b959bb854ac1db130: stopping tablet replica
I20260709 13:15:22.169704  4246 master.cc:584] Master@127.4.37.190:40113 shutdown complete.
3d93642c55ca499893ab99052cfea8c1  4
58df74a8ef6b42aeb707585da24f3c76  1
bc920ef401084dca862e05e8715a22d7  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11059 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:15:22.223487  4246 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.37.190:41135
I20260709 13:15:22.224566  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:22.231674  5249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:22.231845  5248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:22.232456  5251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:22.233183  4246 server_base.cc:1061] running on GCE node
I20260709 13:15:22.234184  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:22.234375  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:22.234484  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602922234473 us; error 0 us; skew 500 ppm
I20260709 13:15:22.235072  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:22.237965  4246 webserver.cc:533] Webserver started at http://127.4.37.190:39553/ using document root <none> and password file <none>
I20260709 13:15:22.238445  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:22.238613  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:22.238847  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:22.239950  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/master-0-root/instance:
uuid: "76d1a118b8e24e8fbc379c88999cb11f"
format_stamp: "Formatted at 2026-07-09 13:15:22 on dist-test-slave-jk05"
I20260709 13:15:22.244719  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:15:22.248538  5256 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.249634  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:22.250103  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/master-0-root
uuid: "76d1a118b8e24e8fbc379c88999cb11f"
format_stamp: "Formatted at 2026-07-09 13:15:22 on dist-test-slave-jk05"
I20260709 13:15:22.250543  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:22.277776  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:22.279664  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:22.323457  5307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.190:41135 every 8 connection(s)
I20260709 13:15:22.323346  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.190:41135
I20260709 13:15:22.328197  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.340978  5308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Bootstrap starting.
I20260709 13:15:22.345974  5308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.351219  5308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: No bootstrap required, opened a new log
I20260709 13:15:22.354357  5308 raft_consensus.cc:359] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d1a118b8e24e8fbc379c88999cb11f" member_type: VOTER }
I20260709 13:15:22.354859  5308 raft_consensus.cc:385] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.355163  5308 raft_consensus.cc:740] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76d1a118b8e24e8fbc379c88999cb11f, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.356123  5308 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d1a118b8e24e8fbc379c88999cb11f" member_type: VOTER }
I20260709 13:15:22.356693  5308 raft_consensus.cc:399] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:22.356925  5308 raft_consensus.cc:493] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:22.357246  5308 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.361886  5308 raft_consensus.cc:515] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d1a118b8e24e8fbc379c88999cb11f" member_type: VOTER }
I20260709 13:15:22.362516  5308 leader_election.cc:304] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76d1a118b8e24e8fbc379c88999cb11f; no voters: 
I20260709 13:15:22.363771  5308 leader_election.cc:290] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:22.364243  5311 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.365654  5311 raft_consensus.cc:697] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 1 LEADER]: Becoming Leader. State: Replica: 76d1a118b8e24e8fbc379c88999cb11f, State: Running, Role: LEADER
I20260709 13:15:22.366518  5311 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d1a118b8e24e8fbc379c88999cb11f" member_type: VOTER }
I20260709 13:15:22.367133  5308 sys_catalog.cc:565] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:22.371382  5313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76d1a118b8e24e8fbc379c88999cb11f. Latest consensus state: current_term: 1 leader_uuid: "76d1a118b8e24e8fbc379c88999cb11f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d1a118b8e24e8fbc379c88999cb11f" member_type: VOTER } }
I20260709 13:15:22.371730  5312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76d1a118b8e24e8fbc379c88999cb11f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76d1a118b8e24e8fbc379c88999cb11f" member_type: VOTER } }
I20260709 13:15:22.372287  5313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:22.372495  5312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:22.378521  5318 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:22.383574  5318 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:22.385864  4246 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:22.394323  5318 catalog_manager.cc:1383] Generated new cluster ID: 033bd7c82adb4518afa4a7dfff136303
I20260709 13:15:22.394785  5318 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:22.436152  5318 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:22.438151  5318 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:22.455663  5318 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Generated new TSK 0
I20260709 13:15:22.456347  5318 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:22.517683  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:22.524528  5329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:22.531107  5330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:22.532485  4246 server_base.cc:1061] running on GCE node
W20260709 13:15:22.533034  5332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:22.534590  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:22.534919  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:22.535156  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602922535132 us; error 0 us; skew 500 ppm
I20260709 13:15:22.535893  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:22.538808  4246 webserver.cc:533] Webserver started at http://127.4.37.129:41223/ using document root <none> and password file <none>
I20260709 13:15:22.539373  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:22.539539  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:22.539871  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:22.540963  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-0-root/instance:
uuid: "86b410d62f4040c39d33dc0698998562"
format_stamp: "Formatted at 2026-07-09 13:15:22 on dist-test-slave-jk05"
I20260709 13:15:22.545814  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:22.549226  5337 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.550488  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:15:22.550844  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "86b410d62f4040c39d33dc0698998562"
format_stamp: "Formatted at 2026-07-09 13:15:22 on dist-test-slave-jk05"
I20260709 13:15:22.551146  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:22.577026  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:22.578724  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:22.580856  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:22.583804  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:22.584024  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.584386  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:22.584559  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.651947  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:43931
I20260709 13:15:22.653642  5399 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:43931 every 8 connection(s)
I20260709 13:15:22.660181  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:22.668401  5404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:22.672104  5405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:22.676100  4246 server_base.cc:1061] running on GCE node
W20260709 13:15:22.676456  5407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:22.677933  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:22.678216  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:22.678409  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602922678390 us; error 0 us; skew 500 ppm
I20260709 13:15:22.678985  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:22.682632  5400 heartbeater.cc:344] Connected to a master server at 127.4.37.190:41135
I20260709 13:15:22.682863  4246 webserver.cc:533] Webserver started at http://127.4.37.130:46259/ using document root <none> and password file <none>
I20260709 13:15:22.683025  5400 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:22.683658  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:22.684075  5400 heartbeater.cc:507] Master 127.4.37.190:41135 requested a full tablet report, sending...
I20260709 13:15:22.684209  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:22.684721  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:22.686266  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-1-root/instance:
uuid: "b781c7e31b7145aea647a7ff649e6ac7"
format_stamp: "Formatted at 2026-07-09 13:15:22 on dist-test-slave-jk05"
I20260709 13:15:22.686421  5273 ts_manager.cc:194] Registered new tserver with Master: 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:15:22.688699  5273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37110
I20260709 13:15:22.694854  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:22.700127  5412 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.701280  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:22.701675  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-1-root
uuid: "b781c7e31b7145aea647a7ff649e6ac7"
format_stamp: "Formatted at 2026-07-09 13:15:22 on dist-test-slave-jk05"
I20260709 13:15:22.702000  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:22.721206  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:22.722560  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:22.724136  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:22.727865  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:22.728453  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:15:22.728730  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:22.728910  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.792790  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.130:36703
I20260709 13:15:22.794675  5474 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.130:36703 every 8 connection(s)
I20260709 13:15:22.800159  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:22.809660  5478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:22.810859  5479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:22.819002  5481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:22.822312  5475 heartbeater.cc:344] Connected to a master server at 127.4.37.190:41135
I20260709 13:15:22.822800  5475 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:22.823185  4246 server_base.cc:1061] running on GCE node
I20260709 13:15:22.823812  5475 heartbeater.cc:507] Master 127.4.37.190:41135 requested a full tablet report, sending...
I20260709 13:15:22.824064  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:22.824267  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:22.824616  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602922824582 us; error 0 us; skew 500 ppm
I20260709 13:15:22.825356  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:22.826133  5273 ts_manager.cc:194] Registered new tserver with Master: b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:22.828980  5273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37112
I20260709 13:15:22.829231  4246 webserver.cc:533] Webserver started at http://127.4.37.131:34815/ using document root <none> and password file <none>
I20260709 13:15:22.829931  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:22.830173  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:22.830721  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:22.832856  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-2-root/instance:
uuid: "544c82a50cc4477886bb6f7d58f455ca"
format_stamp: "Formatted at 2026-07-09 13:15:22 on dist-test-slave-jk05"
I20260709 13:15:22.838373  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:15:22.842031  5486 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.843071  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:15:22.843492  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-2-root
uuid: "544c82a50cc4477886bb6f7d58f455ca"
format_stamp: "Formatted at 2026-07-09 13:15:22 on dist-test-slave-jk05"
I20260709 13:15:22.843868  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:22.870496  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:22.871822  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:22.873273  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:22.877328  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:22.877718  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:22.877997  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:22.878185  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.937583  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.131:36363
I20260709 13:15:22.937757  5548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.131:36363 every 8 connection(s)
I20260709 13:15:22.956534  5549 heartbeater.cc:344] Connected to a master server at 127.4.37.190:41135
I20260709 13:15:22.957028  5549 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:22.957894  5549 heartbeater.cc:507] Master 127.4.37.190:41135 requested a full tablet report, sending...
I20260709 13:15:22.960068  5273 ts_manager.cc:194] Registered new tserver with Master: 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:22.960248  4246 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018868899s
I20260709 13:15:22.961588  5273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37120
I20260709 13:15:22.990249  5273 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37126:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:22.998378  5273 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:23.215255  5514 tablet_service.cc:1511] Processing CreateTablet for tablet c1ab6ed89888463bba6c2914a30a48d7 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:23.217352  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ab6ed89888463bba6c2914a30a48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.222483  5513 tablet_service.cc:1511] Processing CreateTablet for tablet fd246431fed24a99b47e2ccdf988b1ff (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:23.224026  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd246431fed24a99b47e2ccdf988b1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.227856  5512 tablet_service.cc:1511] Processing CreateTablet for tablet b36b8170596a4e4eb051a1d9ee58e16c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:23.229359  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36b8170596a4e4eb051a1d9ee58e16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.231320  5440 tablet_service.cc:1511] Processing CreateTablet for tablet c1ab6ed89888463bba6c2914a30a48d7 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:23.233028  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ab6ed89888463bba6c2914a30a48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.234777  5436 tablet_service.cc:1511] Processing CreateTablet for tablet bac3d18b18df469b8638e92d4034ba81 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:23.236406  5436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac3d18b18df469b8638e92d4034ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.236058  5438 tablet_service.cc:1511] Processing CreateTablet for tablet b36b8170596a4e4eb051a1d9ee58e16c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:23.236891  5363 tablet_service.cc:1511] Processing CreateTablet for tablet b36b8170596a4e4eb051a1d9ee58e16c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:23.238261  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36b8170596a4e4eb051a1d9ee58e16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.238785  5362 tablet_service.cc:1511] Processing CreateTablet for tablet be5ebf56a6624ec4803ae0c224dfc44e (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:23.239316  5364 tablet_service.cc:1511] Processing CreateTablet for tablet fd246431fed24a99b47e2ccdf988b1ff (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:23.240329  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5ebf56a6624ec4803ae0c224dfc44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.241518  5365 tablet_service.cc:1511] Processing CreateTablet for tablet c1ab6ed89888463bba6c2914a30a48d7 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:23.242867  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1ab6ed89888463bba6c2914a30a48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.244390  5435 tablet_service.cc:1511] Processing CreateTablet for tablet 28ae73f1403d44db9d77ab1da61496ea (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:23.246614  5437 tablet_service.cc:1511] Processing CreateTablet for tablet be5ebf56a6624ec4803ae0c224dfc44e (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:23.251911  5432 tablet_service.cc:1511] Processing CreateTablet for tablet efe06c4beff94d32a1cfc10e6b7cacb8 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:23.253073  5433 tablet_service.cc:1511] Processing CreateTablet for tablet 862a628beec44315b003538bc747056b (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:23.234784  5439 tablet_service.cc:1511] Processing CreateTablet for tablet fd246431fed24a99b47e2ccdf988b1ff (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:23.258750  5511 tablet_service.cc:1511] Processing CreateTablet for tablet be5ebf56a6624ec4803ae0c224dfc44e (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:23.260598  5511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5ebf56a6624ec4803ae0c224dfc44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.246528  5434 tablet_service.cc:1511] Processing CreateTablet for tablet ca2e1b811ab74659a981695c9bb25bc7 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:23.264145  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd246431fed24a99b47e2ccdf988b1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.265277  5431 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbe0fc532464dc7bdc351bd1ac98fd2 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:23.266110  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36b8170596a4e4eb051a1d9ee58e16c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.267221  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ae73f1403d44db9d77ab1da61496ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.268162  5434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2e1b811ab74659a981695c9bb25bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.269047  5432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe06c4beff94d32a1cfc10e6b7cacb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.269752  5437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5ebf56a6624ec4803ae0c224dfc44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.270548  5433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862a628beec44315b003538bc747056b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.271193  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd246431fed24a99b47e2ccdf988b1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.276465  5510 tablet_service.cc:1511] Processing CreateTablet for tablet bac3d18b18df469b8638e92d4034ba81 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:23.279793  5509 tablet_service.cc:1511] Processing CreateTablet for tablet 28ae73f1403d44db9d77ab1da61496ea (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:23.281939  5508 tablet_service.cc:1511] Processing CreateTablet for tablet ca2e1b811ab74659a981695c9bb25bc7 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:23.285980  5509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ae73f1403d44db9d77ab1da61496ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.286350  5507 tablet_service.cc:1511] Processing CreateTablet for tablet 862a628beec44315b003538bc747056b (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:23.288154  5507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862a628beec44315b003538bc747056b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.290233  5508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2e1b811ab74659a981695c9bb25bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.293761  5361 tablet_service.cc:1511] Processing CreateTablet for tablet bac3d18b18df469b8638e92d4034ba81 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:23.293821  5360 tablet_service.cc:1511] Processing CreateTablet for tablet 28ae73f1403d44db9d77ab1da61496ea (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:23.294760  5359 tablet_service.cc:1511] Processing CreateTablet for tablet ca2e1b811ab74659a981695c9bb25bc7 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:23.298979  5358 tablet_service.cc:1511] Processing CreateTablet for tablet 862a628beec44315b003538bc747056b (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:23.297169  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac3d18b18df469b8638e92d4034ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.309376  5431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbe0fc532464dc7bdc351bd1ac98fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.297225  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac3d18b18df469b8638e92d4034ba81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.311959  5506 tablet_service.cc:1511] Processing CreateTablet for tablet efe06c4beff94d32a1cfc10e6b7cacb8 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:23.327936  5506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe06c4beff94d32a1cfc10e6b7cacb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.329931  5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2e1b811ab74659a981695c9bb25bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.333856  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862a628beec44315b003538bc747056b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.347438  5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ae73f1403d44db9d77ab1da61496ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.378263  5356 tablet_service.cc:1511] Processing CreateTablet for tablet 31315bfcd25442efb6a2944803593a9c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:23.381024  5357 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbe0fc532464dc7bdc351bd1ac98fd2 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:23.382189  5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31315bfcd25442efb6a2944803593a9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:23.385180  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:23.390198  5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbe0fc532464dc7bdc351bd1ac98fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.398077  5567 tablet_bootstrap.cc:492] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:23.422075  5363 tablet_service.cc:1511] Processing CreateTablet for tablet efe06c4beff94d32a1cfc10e6b7cacb8 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:23.427330  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe06c4beff94d32a1cfc10e6b7cacb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.430821  5358 tablet_service.cc:1511] Processing CreateTablet for tablet d659cc559a5e4a99be73c9ce46dd2cf4 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:23.435565  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d659cc559a5e4a99be73c9ce46dd2cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.384287  5505 tablet_service.cc:1511] Processing CreateTablet for tablet 6fbe0fc532464dc7bdc351bd1ac98fd2 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:23.454375  5505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fbe0fc532464dc7bdc351bd1ac98fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.475817  5365 tablet_service.cc:1511] Processing CreateTablet for tablet ef276ea910334ad38fb1112a61709988 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:23.476430  5567 tablet_bootstrap.cc:654] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.491786  5361 tablet_service.cc:1511] Processing CreateTablet for tablet 071f7516f6b64068bdcc88167bd9f6ae (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:23.492441  5507 tablet_service.cc:1511] Processing CreateTablet for tablet 31315bfcd25442efb6a2944803593a9c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:23.492027  5364 tablet_service.cc:1511] Processing CreateTablet for tablet d519198f00cc429b8d95c8d66a24c7f5 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:23.494122  5507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31315bfcd25442efb6a2944803593a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.495801  5512 tablet_service.cc:1511] Processing CreateTablet for tablet ef276ea910334ad38fb1112a61709988 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:23.482642  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef276ea910334ad38fb1112a61709988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.504133  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d519198f00cc429b8d95c8d66a24c7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.507030  5360 tablet_service.cc:1511] Processing CreateTablet for tablet 2efc28bc52fe484b89b667f19e0fe8ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:23.508610  5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efc28bc52fe484b89b667f19e0fe8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.511034  5436 tablet_service.cc:1511] Processing CreateTablet for tablet ef276ea910334ad38fb1112a61709988 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:23.512555  5436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef276ea910334ad38fb1112a61709988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.513684  5356 tablet_service.cc:1511] Processing CreateTablet for tablet 7b301483f19c4d508e00d917819ac039 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:23.515738  5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b301483f19c4d508e00d917819ac039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.516381  5433 tablet_service.cc:1511] Processing CreateTablet for tablet 2efc28bc52fe484b89b667f19e0fe8ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:23.511034  5440 tablet_service.cc:1511] Processing CreateTablet for tablet 31315bfcd25442efb6a2944803593a9c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:23.523300  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31315bfcd25442efb6a2944803593a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.524631  5362 tablet_service.cc:1511] Processing CreateTablet for tablet 12cac82a5dba4ed4b6457efb7b474a24 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:23.528941  5432 tablet_service.cc:1511] Processing CreateTablet for tablet 7b301483f19c4d508e00d917819ac039 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:23.534655  5511 tablet_service.cc:1511] Processing CreateTablet for tablet 2efc28bc52fe484b89b667f19e0fe8ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:23.536733  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef276ea910334ad38fb1112a61709988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.545855  5433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efc28bc52fe484b89b667f19e0fe8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.546506  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071f7516f6b64068bdcc88167bd9f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.557965  5432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b301483f19c4d508e00d917819ac039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.558805  5434 tablet_service.cc:1511] Processing CreateTablet for tablet 071f7516f6b64068bdcc88167bd9f6ae (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:23.560245  5434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071f7516f6b64068bdcc88167bd9f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.565758  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cac82a5dba4ed4b6457efb7b474a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.567710  5567 tablet_bootstrap.cc:492] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:23.568223  5567 ts_tablet_manager.cc:1403] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.171s	user 0.004s	sys 0.010s
I20260709 13:15:23.569211  5514 tablet_service.cc:1511] Processing CreateTablet for tablet d659cc559a5e4a99be73c9ce46dd2cf4 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:23.569392  5510 tablet_service.cc:1511] Processing CreateTablet for tablet d519198f00cc429b8d95c8d66a24c7f5 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:23.548889  5506 tablet_service.cc:1511] Processing CreateTablet for tablet 071f7516f6b64068bdcc88167bd9f6ae (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:23.571856  5357 tablet_service.cc:1511] Processing CreateTablet for tablet 9510ba0f78fa4449a7cc7fde29e88b4d (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:23.573786  5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9510ba0f78fa4449a7cc7fde29e88b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.574463  5567 raft_consensus.cc:359] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:23.578478  5508 tablet_service.cc:1511] Processing CreateTablet for tablet 7b301483f19c4d508e00d917819ac039 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:23.579793  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d659cc559a5e4a99be73c9ce46dd2cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.581938  5435 tablet_service.cc:1511] Processing CreateTablet for tablet d659cc559a5e4a99be73c9ce46dd2cf4 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:23.604846  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d659cc559a5e4a99be73c9ce46dd2cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.588392  5511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efc28bc52fe484b89b667f19e0fe8ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.590639  5365 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6e697f3d3040e4b2c502a614c55888 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:23.593849  5358 tablet_service.cc:1511] Processing CreateTablet for tablet 23048b90f57d48a4be8be78bc78d9204 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:23.585304  5567 raft_consensus.cc:385] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.606707  5567 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.607156  5506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071f7516f6b64068bdcc88167bd9f6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.607697  5567 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:23.600065  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 9510ba0f78fa4449a7cc7fde29e88b4d (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:23.609728  5508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b301483f19c4d508e00d917819ac039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.610369  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9510ba0f78fa4449a7cc7fde29e88b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.597066  5356 tablet_service.cc:1511] Processing CreateTablet for tablet 6f76d25595424c71acc6031d1608a975 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:23.586580  5568 tablet_bootstrap.cc:492] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:23.618536  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d519198f00cc429b8d95c8d66a24c7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.623718  5568 tablet_bootstrap.cc:654] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.646086  5509 tablet_service.cc:1511] Processing CreateTablet for tablet 12cac82a5dba4ed4b6457efb7b474a24 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:23.648689  5509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cac82a5dba4ed4b6457efb7b474a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.655350  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23048b90f57d48a4be8be78bc78d9204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.660804  5431 tablet_service.cc:1511] Processing CreateTablet for tablet 12cac82a5dba4ed4b6457efb7b474a24 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:23.662294  5432 tablet_service.cc:1511] Processing CreateTablet for tablet 9510ba0f78fa4449a7cc7fde29e88b4d (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:23.662685  5437 tablet_service.cc:1511] Processing CreateTablet for tablet 23048b90f57d48a4be8be78bc78d9204 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:23.663312  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6e697f3d3040e4b2c502a614c55888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.669672  5570 tablet_bootstrap.cc:492] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:23.674328  5432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9510ba0f78fa4449a7cc7fde29e88b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.654107  5360 tablet_service.cc:1511] Processing CreateTablet for tablet 9d883e5d309d4113a821624777a85d05 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:23.682791  5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d883e5d309d4113a821624777a85d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.683576  5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f76d25595424c71acc6031d1608a975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.645001  5359 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae97666ff274da1b89c929a0af197ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:23.694801  5400 heartbeater.cc:499] Master 127.4.37.190:41135 was elected leader, sending a full tablet report...
I20260709 13:15:23.669977  5438 tablet_service.cc:1511] Processing CreateTablet for tablet d519198f00cc429b8d95c8d66a24c7f5 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:23.706672  5439 tablet_service.cc:1511] Processing CreateTablet for tablet 6f76d25595424c71acc6031d1608a975 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:23.711796  5567 ts_tablet_manager.cc:1434] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.143s	user 0.012s	sys 0.016s
I20260709 13:15:23.714452  5431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cac82a5dba4ed4b6457efb7b474a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.724767  5507 tablet_service.cc:1511] Processing CreateTablet for tablet 23048b90f57d48a4be8be78bc78d9204 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:23.722999  5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae97666ff274da1b89c929a0af197ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.723044  5571 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.741600  5507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23048b90f57d48a4be8be78bc78d9204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.740398  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d519198f00cc429b8d95c8d66a24c7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.725565  5433 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6e697f3d3040e4b2c502a614c55888 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:23.745606  5571 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:23.759670  5364 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6edac4f8b644eb9445f8d270ce2dd6 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:23.775465  5358 tablet_service.cc:1511] Processing CreateTablet for tablet e3f62ebef8b04990ab6f34443d897c80 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:23.780042  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6edac4f8b644eb9445f8d270ce2dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.781077  5570 tablet_bootstrap.cc:654] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.781770  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f62ebef8b04990ab6f34443d897c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.783573  5571 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:23.787721  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f76d25595424c71acc6031d1608a975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.807228  5363 tablet_service.cc:1511] Processing CreateTablet for tablet 82b92e5b61b340dc9b480b452ceee4a0 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:23.822136  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b92e5b61b340dc9b480b452ceee4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.792303  5505 tablet_service.cc:1511] Processing CreateTablet for tablet 4e6e697f3d3040e4b2c502a614c55888 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:23.833524  5475 heartbeater.cc:499] Master 127.4.37.190:41135 was elected leader, sending a full tablet report...
I20260709 13:15:23.833920  5437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23048b90f57d48a4be8be78bc78d9204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.834874  5361 tablet_service.cc:1511] Processing CreateTablet for tablet 041443b19a6248948edd8e88378fd175 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:23.836771  5568 tablet_bootstrap.cc:492] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:23.853068  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae97666ff274da1b89c929a0af197ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:23.854576  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae97666ff274da1b89c929a0af197ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.854374  5362 tablet_service.cc:1511] Processing CreateTablet for tablet d07d1fef577c411787d1f686a4774389 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:23.855791  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07d1fef577c411787d1f686a4774389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.861137  5356 tablet_service.cc:1511] Processing CreateTablet for tablet 92b870ccd68b4f2da5f6e32b1dfe77aa (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:23.862142  5505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6e697f3d3040e4b2c502a614c55888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.861533  5434 tablet_service.cc:1511] Processing CreateTablet for tablet 9d883e5d309d4113a821624777a85d05 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:23.864848  5434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d883e5d309d4113a821624777a85d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.862193  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041443b19a6248948edd8e88378fd175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.862733  5568 ts_tablet_manager.cc:1403] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.276s	user 0.021s	sys 0.018s
I20260709 13:15:23.870250  5510 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6edac4f8b644eb9445f8d270ce2dd6 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:23.845940  5506 tablet_service.cc:1511] Processing CreateTablet for tablet 6f76d25595424c71acc6031d1608a975 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:23.875685  5506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f76d25595424c71acc6031d1608a975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.823774  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 9d883e5d309d4113a821624777a85d05 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:23.877476  5568 raft_consensus.cc:359] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:23.890369  5568 raft_consensus.cc:385] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.890738  5568 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.891601  5512 tablet_service.cc:1511] Processing CreateTablet for tablet 82b92e5b61b340dc9b480b452ceee4a0 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:23.878808  5567 tablet_bootstrap.cc:492] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:23.880290  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6edac4f8b644eb9445f8d270ce2dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.895614  5568 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:23.900313  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d883e5d309d4113a821624777a85d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.903432  5433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6e697f3d3040e4b2c502a614c55888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.910109  5511 tablet_service.cc:1511] Processing CreateTablet for tablet d07d1fef577c411787d1f686a4774389 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:23.911373  5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b870ccd68b4f2da5f6e32b1dfe77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.912034  5511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07d1fef577c411787d1f686a4774389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.910142  5436 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae97666ff274da1b89c929a0af197ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:23.915042  5436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae97666ff274da1b89c929a0af197ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.914783  5432 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6edac4f8b644eb9445f8d270ce2dd6 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:23.916142  5432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6edac4f8b644eb9445f8d270ce2dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.886420  5508 tablet_service.cc:1511] Processing CreateTablet for tablet e3f62ebef8b04990ab6f34443d897c80 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:23.923328  5508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f62ebef8b04990ab6f34443d897c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.927299  5358 tablet_service.cc:1511] Processing CreateTablet for tablet ec36d10767c748a59dbf28cb7fc52487 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:23.928700  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec36d10767c748a59dbf28cb7fc52487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.932581  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:23.934957  5340 leader_election.cc:343] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.935761  5360 tablet_service.cc:1511] Processing CreateTablet for tablet b655965f5ab4410b8f331ea47595c0fd (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:23.936616  5567 tablet_bootstrap.cc:654] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.940253  5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b655965f5ab4410b8f331ea47595c0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.949472  5509 tablet_service.cc:1511] Processing CreateTablet for tablet 041443b19a6248948edd8e88378fd175 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:23.955418  5570 tablet_bootstrap.cc:492] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:23.956022  5570 ts_tablet_manager.cc:1403] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.287s	user 0.013s	sys 0.009s
I20260709 13:15:23.959529  5570 raft_consensus.cc:359] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:23.959978  5357 tablet_service.cc:1511] Processing CreateTablet for tablet b7ef40d8b72f47f9b405aa70b3a9d166 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:23.960470  5570 raft_consensus.cc:385] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.960880  5570 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.964588  5549 heartbeater.cc:499] Master 127.4.37.190:41135 was elected leader, sending a full tablet report...
I20260709 13:15:23.969336  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:23.970033  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b92e5b61b340dc9b480b452ceee4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.974983  5365 tablet_service.cc:1511] Processing CreateTablet for tablet 5e725a9779684377b88a2fbc508c37df (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:15:23.976338  5339 leader_election.cc:343] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.976855  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:23.978228  5571 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.989781  5435 tablet_service.cc:1511] Processing CreateTablet for tablet e3f62ebef8b04990ab6f34443d897c80 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:23.992545  5359 tablet_service.cc:1511] Processing CreateTablet for tablet 505e05548ee2401d969672320dea8a9b (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:23.993824  5509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041443b19a6248948edd8e88378fd175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.995061  5570 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:23.996161  5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ef40d8b72f47f9b405aa70b3a9d166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.993842  5440 tablet_service.cc:1511] Processing CreateTablet for tablet 82b92e5b61b340dc9b480b452ceee4a0 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:24.008325  5437 tablet_service.cc:1511] Processing CreateTablet for tablet d07d1fef577c411787d1f686a4774389 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:23.992532  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f62ebef8b04990ab6f34443d897c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.025810  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b92e5b61b340dc9b480b452ceee4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.029867  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e725a9779684377b88a2fbc508c37df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.034219  5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505e05548ee2401d969672320dea8a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.034765  5361 tablet_service.cc:1511] Processing CreateTablet for tablet 4d1e120f33ae49089fa860a4ac895b35 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:24.045292  5437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07d1fef577c411787d1f686a4774389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.059818  5507 tablet_service.cc:1511] Processing CreateTablet for tablet 92b870ccd68b4f2da5f6e32b1dfe77aa (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:24.071947  5510 tablet_service.cc:1511] Processing CreateTablet for tablet ec36d10767c748a59dbf28cb7fc52487 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:24.072721  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d1e120f33ae49089fa860a4ac895b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.074906  5505 tablet_service.cc:1511] Processing CreateTablet for tablet b655965f5ab4410b8f331ea47595c0fd (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:24.078202  5363 tablet_service.cc:1511] Processing CreateTablet for tablet e1289dc7debf403aa87416568de586e6 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:24.090608  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec36d10767c748a59dbf28cb7fc52487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.096153  5435 tablet_service.cc:1511] Processing CreateTablet for tablet 041443b19a6248948edd8e88378fd175 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:24.097503  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041443b19a6248948edd8e88378fd175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.101541  5433 tablet_service.cc:1511] Processing CreateTablet for tablet ec36d10767c748a59dbf28cb7fc52487 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:24.102896  5433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec36d10767c748a59dbf28cb7fc52487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.091761  5568 ts_tablet_manager.cc:1434] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.218s	user 0.014s	sys 0.018s
I20260709 13:15:24.094570  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1289dc7debf403aa87416568de586e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.104615  5568 tablet_bootstrap.cc:492] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:24.105933  5567 tablet_bootstrap.cc:492] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:24.106525  5567 ts_tablet_manager.cc:1403] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.228s	user 0.005s	sys 0.014s
I20260709 13:15:24.111001  5505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b655965f5ab4410b8f331ea47595c0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.111397  5514 tablet_service.cc:1511] Processing CreateTablet for tablet b7ef40d8b72f47f9b405aa70b3a9d166 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:24.113185  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ef40d8b72f47f9b405aa70b3a9d166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.120543  5431 tablet_service.cc:1511] Processing CreateTablet for tablet b655965f5ab4410b8f331ea47595c0fd (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:24.122566  5432 tablet_service.cc:1511] Processing CreateTablet for tablet b7ef40d8b72f47f9b405aa70b3a9d166 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:24.124238  5438 tablet_service.cc:1511] Processing CreateTablet for tablet 5e725a9779684377b88a2fbc508c37df (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:24.124552  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 5e725a9779684377b88a2fbc508c37df (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:24.128917  5568 tablet_bootstrap.cc:654] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.130450  5439 tablet_service.cc:1511] Processing CreateTablet for tablet 92b870ccd68b4f2da5f6e32b1dfe77aa (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:24.132498  5567 raft_consensus.cc:359] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.143993  5364 tablet_service.cc:1511] Processing CreateTablet for tablet bfa8a3a375f94c92a91bd291429fb615 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:24.145896  5507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b870ccd68b4f2da5f6e32b1dfe77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.153034  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa8a3a375f94c92a91bd291429fb615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.158321  5570 ts_tablet_manager.cc:1434] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.198s	user 0.020s	sys 0.010s
I20260709 13:15:24.158793  5434 tablet_service.cc:1511] Processing CreateTablet for tablet 505e05548ee2401d969672320dea8a9b (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:24.161368  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92b870ccd68b4f2da5f6e32b1dfe77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.162104  5431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b655965f5ab4410b8f331ea47595c0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.164148  5570 tablet_bootstrap.cc:492] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:24.168443  5434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505e05548ee2401d969672320dea8a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.146687  5567 raft_consensus.cc:385] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.182479  5361 tablet_service.cc:1511] Processing CreateTablet for tablet 0276d804ade348368656bbe6805214df (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:24.190436  5356 tablet_service.cc:1511] Processing CreateTablet for tablet b85a688fd7794c83bef13f0caeceda13 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:24.177380  5436 tablet_service.cc:1511] Processing CreateTablet for tablet 4d1e120f33ae49089fa860a4ac895b35 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:24.195336  5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85a688fd7794c83bef13f0caeceda13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.196095  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0276d804ade348368656bbe6805214df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.179100  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e725a9779684377b88a2fbc508c37df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.178766  5512 tablet_service.cc:1511] Processing CreateTablet for tablet 505e05548ee2401d969672320dea8a9b (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:24.202869  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e725a9779684377b88a2fbc508c37df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.205673  5362 tablet_service.cc:1511] Processing CreateTablet for tablet d219441478644a3e8915df9d2083022c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:24.207010  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d219441478644a3e8915df9d2083022c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.209759  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505e05548ee2401d969672320dea8a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.201915  5436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d1e120f33ae49089fa860a4ac895b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.216516  5508 tablet_service.cc:1511] Processing CreateTablet for tablet bfa8a3a375f94c92a91bd291429fb615 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:24.217248  5579 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.217988  5508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa8a3a375f94c92a91bd291429fb615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.217746  5579 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:24.218732  5431 tablet_service.cc:1511] Processing CreateTablet for tablet e1289dc7debf403aa87416568de586e6 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:24.220178  5431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1289dc7debf403aa87416568de586e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.226243  5579 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:24.254572  5432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ef40d8b72f47f9b405aa70b3a9d166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.182545  5506 tablet_service.cc:1511] Processing CreateTablet for tablet 4d1e120f33ae49089fa860a4ac895b35 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:24.259829  5506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d1e120f33ae49089fa860a4ac895b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.182927  5567 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.261997  5567 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.264659  5567 ts_tablet_manager.cc:1434] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.158s	user 0.006s	sys 0.002s
I20260709 13:15:24.265918  5567 tablet_bootstrap.cc:492] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:24.274283  5440 tablet_service.cc:1511] Processing CreateTablet for tablet bfa8a3a375f94c92a91bd291429fb615 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:24.281999  5435 tablet_service.cc:1511] Processing CreateTablet for tablet 0276d804ade348368656bbe6805214df (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:24.282953  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa8a3a375f94c92a91bd291429fb615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.277031  5358 tablet_service.cc:1511] Processing CreateTablet for tablet c3b5667547cf44e88316b27d3edb3a4c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:24.286839  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3b5667547cf44e88316b27d3edb3a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.295468  5505 tablet_service.cc:1511] Processing CreateTablet for tablet 0276d804ade348368656bbe6805214df (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:24.302670  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0276d804ade348368656bbe6805214df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.311071  5510 tablet_service.cc:1511] Processing CreateTablet for tablet e1289dc7debf403aa87416568de586e6 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:24.332762  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1289dc7debf403aa87416568de586e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.332230  5434 tablet_service.cc:1511] Processing CreateTablet for tablet b85a688fd7794c83bef13f0caeceda13 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:24.336863  5570 tablet_bootstrap.cc:654] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.322988  5363 tablet_service.cc:1511] Processing CreateTablet for tablet 04c2527a380a499db649c9aa30957175 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:24.338107  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c2527a380a499db649c9aa30957175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.340317  5434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85a688fd7794c83bef13f0caeceda13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.343472  5439 tablet_service.cc:1511] Processing CreateTablet for tablet d219441478644a3e8915df9d2083022c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:24.345108  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d219441478644a3e8915df9d2083022c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.347776  5505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0276d804ade348368656bbe6805214df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.361280  5365 tablet_service.cc:1511] Processing CreateTablet for tablet 271a3e03527c4fd990f6961a94d3b6ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:24.366366  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271a3e03527c4fd990f6961a94d3b6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.373669  5511 tablet_service.cc:1511] Processing CreateTablet for tablet b85a688fd7794c83bef13f0caeceda13 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:24.375097  5511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85a688fd7794c83bef13f0caeceda13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.377693  5580 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.378396  5580 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.391471  5509 tablet_service.cc:1511] Processing CreateTablet for tablet c3b5667547cf44e88316b27d3edb3a4c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:24.392882  5509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3b5667547cf44e88316b27d3edb3a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.398975  5580 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:24.415244  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:24.418002  5568 tablet_bootstrap.cc:492] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:24.418545  5568 ts_tablet_manager.cc:1403] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.314s	user 0.013s	sys 0.006s
I20260709 13:15:24.418862  5361 tablet_service.cc:1511] Processing CreateTablet for tablet c1e0f2ddc67f4a12a80821b5a945c5c4 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:24.421007  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e0f2ddc67f4a12a80821b5a945c5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.426730  5568 raft_consensus.cc:359] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.427280  5440 tablet_service.cc:1511] Processing CreateTablet for tablet c3b5667547cf44e88316b27d3edb3a4c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:24.381964  5506 tablet_service.cc:1511] Processing CreateTablet for tablet d219441478644a3e8915df9d2083022c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:24.437477  5568 raft_consensus.cc:385] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.448122  5568 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.456491  5568 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.446458  5506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d219441478644a3e8915df9d2083022c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.464320  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3b5667547cf44e88316b27d3edb3a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.455240  5567 tablet_bootstrap.cc:654] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.473457  5357 tablet_service.cc:1511] Processing CreateTablet for tablet 6bad22fee0614f38b77d2fbec2761370 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:24.474823  5357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bad22fee0614f38b77d2fbec2761370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.485237  5431 tablet_service.cc:1511] Processing CreateTablet for tablet 04c2527a380a499db649c9aa30957175 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:24.494282  5431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c2527a380a499db649c9aa30957175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.498582  5433 tablet_service.cc:1511] Processing CreateTablet for tablet c1e0f2ddc67f4a12a80821b5a945c5c4 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:24.499912  5433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e0f2ddc67f4a12a80821b5a945c5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.502321  5508 tablet_service.cc:1511] Processing CreateTablet for tablet 04c2527a380a499db649c9aa30957175 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:24.504621  5568 ts_tablet_manager.cc:1434] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.000s
I20260709 13:15:24.505762  5568 tablet_bootstrap.cc:492] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:24.511576  5437 tablet_service.cc:1511] Processing CreateTablet for tablet 6bad22fee0614f38b77d2fbec2761370 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:24.513008  5437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bad22fee0614f38b77d2fbec2761370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.485158  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 271a3e03527c4fd990f6961a94d3b6ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:24.502345  5361 tablet_service.cc:1511] Processing CreateTablet for tablet 23d42b81e4844d79aa9b7194da0bacd0 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:24.522357  5361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d42b81e4844d79aa9b7194da0bacd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.521009  5438 tablet_service.cc:1511] Processing CreateTablet for tablet 271a3e03527c4fd990f6961a94d3b6ce (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:24.526892  5570 tablet_bootstrap.cc:492] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:24.527462  5570 ts_tablet_manager.cc:1403] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.368s	user 0.011s	sys 0.026s
I20260709 13:15:24.528139  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271a3e03527c4fd990f6961a94d3b6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.534255  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:24.535928  5489 leader_election.cc:343] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.542976  5508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c2527a380a499db649c9aa30957175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.520072  5514 tablet_service.cc:1511] Processing CreateTablet for tablet c1e0f2ddc67f4a12a80821b5a945c5c4 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:24.547983  5512 tablet_service.cc:1511] Processing CreateTablet for tablet 6bad22fee0614f38b77d2fbec2761370 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:24.548746  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e0f2ddc67f4a12a80821b5a945c5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.550413  5507 tablet_service.cc:1511] Processing CreateTablet for tablet 23d42b81e4844d79aa9b7194da0bacd0 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:24.552709  5579 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.553391  5579 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.553840  5363 tablet_service.cc:1511] Processing CreateTablet for tablet 04c8c3b741e7461c8c4c145d8b652ece (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:24.555586  5363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c8c3b741e7461c8c4c145d8b652ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.540791  5436 tablet_service.cc:1511] Processing CreateTablet for tablet 23d42b81e4844d79aa9b7194da0bacd0 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:24.567081  5436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d42b81e4844d79aa9b7194da0bacd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.573289  5507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d42b81e4844d79aa9b7194da0bacd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.587874  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:24.589519  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:24.589811  5364 tablet_service.cc:1511] Processing CreateTablet for tablet f68a24d9e2f74d7697fec4f27e4c7f0c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:24.590541  5439 tablet_service.cc:1511] Processing CreateTablet for tablet f68a24d9e2f74d7697fec4f27e4c7f0c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:24.592077  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68a24d9e2f74d7697fec4f27e4c7f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.592162  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68a24d9e2f74d7697fec4f27e4c7f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.596163  5358 tablet_service.cc:1511] Processing CreateTablet for tablet 1a0a4db2904f41359369d5678178fb28 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:24.599988  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bad22fee0614f38b77d2fbec2761370. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:24.601253  5416 leader_election.cc:343] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.603843  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0a4db2904f41359369d5678178fb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.605902  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271a3e03527c4fd990f6961a94d3b6ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.607004  5356 tablet_service.cc:1511] Processing CreateTablet for tablet 98e834db0dd44fe4a118d1b82fb1ff47 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:24.608392  5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e834db0dd44fe4a118d1b82fb1ff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.618263  5359 tablet_service.cc:1511] Processing CreateTablet for tablet 4a548ed234e342789833cf138d282543 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:24.619694  5359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a548ed234e342789833cf138d282543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.586954  5570 raft_consensus.cc:359] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:24.622128  5570 raft_consensus.cc:385] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.622493  5570 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.622993  5433 tablet_service.cc:1511] Processing CreateTablet for tablet 1a0a4db2904f41359369d5678178fb28 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:24.623266  5570 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:24.626879  5362 tablet_service.cc:1511] Processing CreateTablet for tablet c06ab136607a405bbdfe9d04f533a566 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:24.630609  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06ab136607a405bbdfe9d04f533a566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.633955  5365 tablet_service.cc:1511] Processing CreateTablet for tablet 35a03ca070694c4880dc2efbf4b89052 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:24.635331  5365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a03ca070694c4880dc2efbf4b89052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.635478  5512 tablet_service.cc:1511] Processing CreateTablet for tablet f68a24d9e2f74d7697fec4f27e4c7f0c (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:24.636821  5512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68a24d9e2f74d7697fec4f27e4c7f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.638293  5568 tablet_bootstrap.cc:654] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.639634  5505 tablet_service.cc:1511] Processing CreateTablet for tablet 04c8c3b741e7461c8c4c145d8b652ece (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:24.641039  5570 ts_tablet_manager.cc:1434] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.006s
I20260709 13:15:24.642179  5570 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:24.646560  5579 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:24.647289  5434 tablet_service.cc:1511] Processing CreateTablet for tablet 98e834db0dd44fe4a118d1b82fb1ff47 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:24.647938  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:24.649085  5433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0a4db2904f41359369d5678178fb28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:24.649344  5489 leader_election.cc:343] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.656932  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:24.658171  5360 tablet_service.cc:1511] Processing CreateTablet for tablet bd0b01346dc74436aa3ac464cde50753 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:15:24.658857  5414 leader_election.cc:343] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.659524  5360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0b01346dc74436aa3ac464cde50753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.659302  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:24.660574  5580 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:24.662482  5490 leader_election.cc:343] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.662997  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:24.640986  5505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c8c3b741e7461c8c4c145d8b652ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.664490  5571 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.664978  5571 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.668108  5571 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:24.669085  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:24.669795  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:24.670433  5524 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
W20260709 13:15:24.670594  5340 leader_election.cc:343] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.671856  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:24.673996  5571 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.674530  5571 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.674845  5571 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.676657  5579 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:24.679383  5432 tablet_service.cc:1511] Processing CreateTablet for tablet 4a548ed234e342789833cf138d282543 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:24.680922  5432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a548ed234e342789833cf138d282543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.681501  5567 tablet_bootstrap.cc:492] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:24.682005  5567 ts_tablet_manager.cc:1403] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.416s	user 0.012s	sys 0.008s
I20260709 13:15:24.685504  5435 tablet_service.cc:1511] Processing CreateTablet for tablet 04c8c3b741e7461c8c4c145d8b652ece (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:24.686317  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:24.686849  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c8c3b741e7461c8c4c145d8b652ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.687090  5440 tablet_service.cc:1511] Processing CreateTablet for tablet c06ab136607a405bbdfe9d04f533a566 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:24.688520  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06ab136607a405bbdfe9d04f533a566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.696194  5434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e834db0dd44fe4a118d1b82fb1ff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.698151  5511 tablet_service.cc:1511] Processing CreateTablet for tablet 1a0a4db2904f41359369d5678178fb28 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:24.699632  5511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0a4db2904f41359369d5678178fb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.701828  5510 tablet_service.cc:1511] Processing CreateTablet for tablet 98e834db0dd44fe4a118d1b82fb1ff47 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:24.703277  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e834db0dd44fe4a118d1b82fb1ff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.685037  5567 raft_consensus.cc:359] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:24.714000  5567 raft_consensus.cc:385] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.714370  5567 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.715222  5567 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:24.716988  5364 tablet_service.cc:1511] Processing CreateTablet for tablet 879d2cd65f6c495494da47d5d0edf67f (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:24.718394  5364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879d2cd65f6c495494da47d5d0edf67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.721189  5431 tablet_service.cc:1511] Processing CreateTablet for tablet 35a03ca070694c4880dc2efbf4b89052 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:24.722623  5431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a03ca070694c4880dc2efbf4b89052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.726104  5571 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.728250  5374 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 1: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:24.733330  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:24.734900  5340 leader_election.cc:343] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.736753  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:24.737066  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:24.738196  5524 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.746045  5570 tablet_bootstrap.cc:654] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.748220  5524 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:24.749641  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:24.750615  5579 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:24.712071  5514 tablet_service.cc:1511] Processing CreateTablet for tablet 4a548ed234e342789833cf138d282543 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:24.785261  5514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a548ed234e342789833cf138d282543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.785339  5567 ts_tablet_manager.cc:1434] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.003s
I20260709 13:15:24.749835  5362 tablet_service.cc:1511] Processing CreateTablet for tablet ced41742c4474d4197a4dfeed7d56536 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:24.794579  5362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced41742c4474d4197a4dfeed7d56536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.797116  5567 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:24.785197  5438 tablet_service.cc:1511] Processing CreateTablet for tablet bd0b01346dc74436aa3ac464cde50753 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:24.806747  5438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0b01346dc74436aa3ac464cde50753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.807906  5568 tablet_bootstrap.cc:492] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:24.808429  5568 ts_tablet_manager.cc:1403] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.303s	user 0.014s	sys 0.002s
I20260709 13:15:24.808108  5436 tablet_service.cc:1511] Processing CreateTablet for tablet ced41742c4474d4197a4dfeed7d56536 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:24.810474  5358 tablet_service.cc:1511] Processing CreateTablet for tablet db91d6fa74dd4308ae267c81a83d8d5f (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:24.811795  5358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db91d6fa74dd4308ae267c81a83d8d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.811558  5568 raft_consensus.cc:359] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.812320  5568 raft_consensus.cc:385] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.812655  5568 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.814419  5568 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.815629  5506 tablet_service.cc:1511] Processing CreateTablet for tablet 35a03ca070694c4880dc2efbf4b89052 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:24.750640  5571 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:24.818135  5571 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:24.818615  5571 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:24.818820  5568 ts_tablet_manager.cc:1434] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:15:24.803896  5510 tablet_service.cc:1511] Processing CreateTablet for tablet c06ab136607a405bbdfe9d04f533a566 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:24.819540  5571 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.819609  5437 tablet_service.cc:1511] Processing CreateTablet for tablet 879d2cd65f6c495494da47d5d0edf67f (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:24.825647  5436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced41742c4474d4197a4dfeed7d56536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.826122  5510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06ab136607a405bbdfe9d04f533a566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.830926  5435 tablet_service.cc:1511] Processing CreateTablet for tablet db91d6fa74dd4308ae267c81a83d8d5f (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:24.831271  5356 tablet_service.cc:1511] Processing CreateTablet for tablet a64a51af80064074aad9aefb8f176299 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:24.832494  5435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db91d6fa74dd4308ae267c81a83d8d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.832795  5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64a51af80064074aad9aefb8f176299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.839447  5568 tablet_bootstrap.cc:492] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:24.841300  5437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879d2cd65f6c495494da47d5d0edf67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.846794  5570 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:24.850970  5570 ts_tablet_manager.cc:1403] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.209s	user 0.032s	sys 0.024s
I20260709 13:15:24.843036  5509 tablet_service.cc:1511] Processing CreateTablet for tablet bd0b01346dc74436aa3ac464cde50753 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:24.852754  5507 tablet_service.cc:1511] Processing CreateTablet for tablet ced41742c4474d4197a4dfeed7d56536 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:24.854909  5508 tablet_service.cc:1511] Processing CreateTablet for tablet db91d6fa74dd4308ae267c81a83d8d5f (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:24.856302  5570 raft_consensus.cc:359] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.852743  5439 tablet_service.cc:1511] Processing CreateTablet for tablet a64a51af80064074aad9aefb8f176299 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:24.858888  5513 tablet_service.cc:1511] Processing CreateTablet for tablet 879d2cd65f6c495494da47d5d0edf67f (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:24.870548  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64a51af80064074aad9aefb8f176299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.867185  5505 tablet_service.cc:1511] Processing CreateTablet for tablet a64a51af80064074aad9aefb8f176299 (DEFAULT_TABLE table=test-workload [id=54c067332db640d79c6a4737498b4456]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:24.875257  5506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a03ca070694c4880dc2efbf4b89052. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.876430  5509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0b01346dc74436aa3ac464cde50753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.881814  5513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879d2cd65f6c495494da47d5d0edf67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.883119  5580 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.883632  5580 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:24.885844  5508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db91d6fa74dd4308ae267c81a83d8d5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.888950  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:24.889755  5524 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:24.890388  5507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ced41742c4474d4197a4dfeed7d56536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.891180  5580 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:15:24.891304  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:24.893069  5374 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:24.875276  5570 raft_consensus.cc:385] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:24.893770  5570 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:24.892253  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:24.894559  5570 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.895423  5580 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.898355  5567 tablet_bootstrap.cc:654] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.901718  5580 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.902484  5580 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:24.905503  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 147236us
I20260709 13:15:24.911545  5568 tablet_bootstrap.cc:654] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:24.915705  5273 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.921566  5505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64a51af80064074aad9aefb8f176299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:24.951709  5579 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.953827  5579 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.956043  5579 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:24.959810  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:24.962756  5489 leader_election.cc:343] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:24.974874  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:24.975627  5374 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:24.976934  5490 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:24.978096  5579 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:24.978470  5579 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.978819  5579 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:24.988435  5579 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:24.991395  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:24.992017  5374 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.014290  5570 ts_tablet_manager.cc:1434] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.163s	user 0.015s	sys 0.022s
I20260709 13:15:25.015514  5570 tablet_bootstrap.cc:492] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:25.018720  5579 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:25.016084  5580 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:25.032960  5596 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.040784  5596 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.042997  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:25.043754  5524 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.044839  5596 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.021173  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:25.046216  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:25.046942  5375 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.047925  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:25.032249  5374 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:25.048336  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:25.049135  5489 leader_election.cc:343] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.043195  5580 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:15:25.057673  5490 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:25.059861  5414 leader_election.cc:343] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.060539  5579 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:25.062517  5416 leader_election.cc:343] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.063090  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:25.066001  5568 tablet_bootstrap.cc:492] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:25.066570  5568 ts_tablet_manager.cc:1403] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.227s	user 0.013s	sys 0.006s
I20260709 13:15:25.067304  5567 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:25.067862  5567 ts_tablet_manager.cc:1403] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.272s	user 0.016s	sys 0.063s
I20260709 13:15:25.071036  5568 raft_consensus.cc:359] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.071036  5567 raft_consensus.cc:359] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.076277  5375 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:25.078953  5570 tablet_bootstrap.cc:654] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.084233  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:25.080541  5579 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:25.085562  5596 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.086223  5596 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:25.086355  5579 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.087316  5596 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:25.080058  5568 raft_consensus.cc:385] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.089608  5568 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.090469  5568 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.080665  5567 raft_consensus.cc:385] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.094049  5567 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.095105  5567 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.093148  5568 ts_tablet_manager.cc:1434] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
I20260709 13:15:25.080902  5580 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.110275  5568 tablet_bootstrap.cc:492] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:25.100585  5524 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:25.121011  5567 ts_tablet_manager.cc:1434] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.004s
I20260709 13:15:25.122169  5567 tablet_bootstrap.cc:492] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:25.127383  5271 catalog_manager.cc:5697] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.129169  5567 tablet_bootstrap.cc:654] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.133275  5272 catalog_manager.cc:5697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.131462  5568 tablet_bootstrap.cc:654] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.131966  5570 tablet_bootstrap.cc:492] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:25.136576  5570 ts_tablet_manager.cc:1403] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.021s
I20260709 13:15:25.140515  5570 raft_consensus.cc:359] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.141327  5570 raft_consensus.cc:385] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.141906  5570 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.142915  5570 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.144395  5567 tablet_bootstrap.cc:492] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:25.145061  5567 ts_tablet_manager.cc:1403] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 13:15:25.145649  5570 ts_tablet_manager.cc:1434] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:15:25.146812  5570 tablet_bootstrap.cc:492] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:25.146924  5568 tablet_bootstrap.cc:492] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:25.147676  5568 ts_tablet_manager.cc:1403] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.004s
I20260709 13:15:25.148293  5567 raft_consensus.cc:359] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.149641  5567 raft_consensus.cc:385] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.150130  5567 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.151145  5567 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.151970  5568 raft_consensus.cc:359] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.152946  5568 raft_consensus.cc:385] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.153350  5568 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.154037  5567 ts_tablet_manager.cc:1434] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:15:25.155098  5567 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:25.155704  5570 tablet_bootstrap.cc:654] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.154512  5568 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.159345  5568 ts_tablet_manager.cc:1434] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:15:25.160734  5568 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:25.164672  5567 tablet_bootstrap.cc:654] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.173362  5568 tablet_bootstrap.cc:654] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.180244  5570 tablet_bootstrap.cc:492] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:25.180802  5570 ts_tablet_manager.cc:1403] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.017s
I20260709 13:15:25.184352  5570 raft_consensus.cc:359] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.185169  5570 raft_consensus.cc:385] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.185503  5570 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.186407  5570 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.188795  5570 ts_tablet_manager.cc:1434] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:25.189864  5570 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:25.196180  5570 tablet_bootstrap.cc:654] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.201326  5594 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.201941  5594 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.204289  5594 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.207288  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:25.208808  5340 leader_election.cc:343] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.209203  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:25.210529  5339 leader_election.cc:343] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.210918  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:25.211174  5567 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:25.211593  5594 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.211726  5567 ts_tablet_manager.cc:1403] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.021s
I20260709 13:15:25.213546  5568 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:25.214068  5568 ts_tablet_manager.cc:1403] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.016s
I20260709 13:15:25.215720  5570 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:25.216208  5570 ts_tablet_manager.cc:1403] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.004s
I20260709 13:15:25.215611  5567 raft_consensus.cc:359] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.216601  5567 raft_consensus.cc:385] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.216946  5567 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.217325  5568 raft_consensus.cc:359] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.218191  5568 raft_consensus.cc:385] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.217803  5567 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.218532  5568 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.218972  5570 raft_consensus.cc:359] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.219674  5570 raft_consensus.cc:385] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.219982  5570 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.219508  5568 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.220359  5567 ts_tablet_manager.cc:1434] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:25.220865  5570 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.223047  5570 ts_tablet_manager.cc:1434] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:25.223848  5568 ts_tablet_manager.cc:1434] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:25.224916  5568 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:25.226532  5567 tablet_bootstrap.cc:492] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:25.226691  5570 tablet_bootstrap.cc:492] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:25.233002  5570 tablet_bootstrap.cc:654] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.233374  5567 tablet_bootstrap.cc:654] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.241530  5570 tablet_bootstrap.cc:492] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:25.242306  5570 ts_tablet_manager.cc:1403] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:15:25.246877  5567 tablet_bootstrap.cc:492] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:25.246404  5570 raft_consensus.cc:359] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.247432  5570 raft_consensus.cc:385] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.247610  5567 ts_tablet_manager.cc:1403] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:15:25.247815  5570 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.248834  5568 tablet_bootstrap.cc:654] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.249032  5570 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.251638  5567 raft_consensus.cc:359] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.252310  5570 ts_tablet_manager.cc:1434] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:15:25.252550  5567 raft_consensus.cc:385] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.253043  5567 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.253639  5570 tablet_bootstrap.cc:492] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:25.253929  5567 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.256742  5567 ts_tablet_manager.cc:1434] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:25.259616  5567 tablet_bootstrap.cc:492] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:25.261664  5570 tablet_bootstrap.cc:654] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.267297  5567 tablet_bootstrap.cc:654] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.279668  5567 tablet_bootstrap.cc:492] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:25.280182  5567 ts_tablet_manager.cc:1403] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:15:25.282702  5570 tablet_bootstrap.cc:492] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:25.282771  5568 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:25.283315  5570 ts_tablet_manager.cc:1403] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.030s	user 0.002s	sys 0.025s
I20260709 13:15:25.282773  5567 raft_consensus.cc:359] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.283875  5567 raft_consensus.cc:385] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.283707  5568 ts_tablet_manager.cc:1403] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.014s
I20260709 13:15:25.284229  5567 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.284986  5567 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.286067  5570 raft_consensus.cc:359] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.286983  5570 raft_consensus.cc:385] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.287317  5567 ts_tablet_manager.cc:1434] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:25.287273  5570 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.287917  5568 raft_consensus.cc:359] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.288163  5570 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.288628  5567 tablet_bootstrap.cc:492] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:25.288626  5568 raft_consensus.cc:385] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.289112  5568 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.290395  5570 ts_tablet_manager.cc:1434] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:15:25.290051  5568 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.295770  5567 tablet_bootstrap.cc:654] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.296296  5568 ts_tablet_manager.cc:1434] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:25.298308  5568 tablet_bootstrap.cc:492] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:25.305285  5568 tablet_bootstrap.cc:654] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.303020  5570 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:25.310895  5567 tablet_bootstrap.cc:492] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:25.311421  5567 ts_tablet_manager.cc:1403] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 13:15:25.312840  5570 tablet_bootstrap.cc:654] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.313016  5450 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.314489  5567 raft_consensus.cc:359] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.315263  5567 raft_consensus.cc:385] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.315582  5567 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.316571  5567 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.318563  5594 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:25.319715  5567 ts_tablet_manager.cc:1434] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:15:25.319993  5568 tablet_bootstrap.cc:492] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:25.320472  5568 ts_tablet_manager.cc:1403] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:15:25.321138  5567 tablet_bootstrap.cc:492] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:25.323267  5568 raft_consensus.cc:359] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.323942  5568 raft_consensus.cc:385] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.324195  5568 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.325075  5568 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.325949  5579 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.326412  5579 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.327183  5568 ts_tablet_manager.cc:1434] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:15:25.328048  5568 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:25.328464  5579 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:25.330530  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:25.331096  5594 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.331315  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:25.331998  5490 leader_election.cc:343] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.332363  5449 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:25.332544  5594 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.333745  5567 tablet_bootstrap.cc:654] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.333930  5489 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:25.335642  5568 tablet_bootstrap.cc:654] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.337858  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:25.340216  5340 leader_election.cc:343] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.343011  5579 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.343161  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:25.343472  5579 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.343820  5579 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:25.344663  5339 leader_election.cc:343] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.345126  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:25.346284  5571 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.345121  5594 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.387845  5594 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.390748  5596 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.391474  5596 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.400177  5596 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.402144  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:25.407829  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:25.410511  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:25.415676  5580 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.416198  5580 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.419153  5580 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:25.419430  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:25.421646  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:25.422662  5523 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:25.424655  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:25.426014  5580 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.426510  5580 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.426960  5580 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.430004  5571 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.430545  5571 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.433233  5571 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.436478  5571 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.437057  5571 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.441615  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:25.444701  5339 leader_election.cc:343] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.448668  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:25.450780  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:25.451876  5447 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
W20260709 13:15:25.453558  5340 leader_election.cc:343] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.454300  5340 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:25.456256  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:25.458315  5598 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.460163  5598 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.464476  5598 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.467108  5601 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.467335  5628 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.467870  5601 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.468060  5628 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.471524  5601 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:25.475021  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:25.475936  5447 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:25.476728  5628 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.479249  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:25.481781  5601 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.482335  5601 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.482760  5601 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.491066  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:25.492218  5523 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:25.526629  5594 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.527971  5594 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.528524  5594 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.529026  5594 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.549685  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:25.551033  5523 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:25.560729  5627 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.574009  5596 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:25.582943  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:25.582973  5414 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:25.585024  5447 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.587746  5596 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.588358  5596 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.588832  5596 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:25.597653  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 141504us
I20260709 13:15:25.606051  5596 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.609647  5571 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.620299  5596 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.626482  5631 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.627353  5631 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.632616  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:25.634238  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:25.636004  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:25.670048  5374 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:25.670552  5371 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:25.636166  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:25.637288  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:25.637604  5627 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.639479  5596 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.644025  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:25.674844  5524 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.674993  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:25.676827  5416 leader_election.cc:343] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:25.679777  5416 leader_election.cc:343] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.646497  5629 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.678084  5596 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.692010  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:25.696278  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:25.698589  5339 leader_election.cc:343] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.700609  5627 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.667763  5580 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:25.707754  5340 leader_election.cc:343] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.718251  5375 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:25.730155  5524 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:25.724170  5629 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:15:25.743212  5414 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:25.746299  5596 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.747284  5596 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:25.748476  5596 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.771613  5598 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:25.712298  5579 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.652156  5601 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.723170  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:25.800238  5568 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:25.801103  5568 ts_tablet_manager.cc:1403] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.473s	user 0.151s	sys 0.258s
I20260709 13:15:25.805212  5568 raft_consensus.cc:359] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.806919  5568 raft_consensus.cc:385] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.807538  5568 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.829823  5627 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.831041  5631 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:25.832237  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 129834us
I20260709 13:15:25.834110  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:25.834633  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:25.834762  5447 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:25.835479  5523 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 1: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:25.834118  5273 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:25.838302  5568 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.840035  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:25.840545  5568 ts_tablet_manager.cc:1434] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:15:25.841883  5627 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:25.842428  5627 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.846262  5627 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.851910  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:25.855813  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:25.856549  5450 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.858103  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:25.858851  5375 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.867777  5568 tablet_bootstrap.cc:492] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:25.867595  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:25.868232  5447 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.873605  5601 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:25.875381  5580 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.858964  5579 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:25.876024  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:25.877632  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:15:25.877854  5490 leader_election.cc:343] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:25.878327  5524 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.879987  5450 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:25.880386  5567 tablet_bootstrap.cc:492] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:25.881269  5567 ts_tablet_manager.cc:1403] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.560s	user 0.119s	sys 0.249s
I20260709 13:15:25.842162  5594 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.886073  5627 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.886951  5524 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:25.890048  5568 tablet_bootstrap.cc:654] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.896183  5375 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:25.896508  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:25.900030  5372 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 1: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:25.901134  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:25.901396  5447 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:25.901639  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:25.902711  5594 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.901607  5579 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.903613  5579 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:25.904163  5567 raft_consensus.cc:359] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.904603  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:25.904882  5567 raft_consensus.cc:385] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.905390  5567 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.902642  5489 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:25.905488  5522 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.897578  5627 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:25.902786  5580 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.913208  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:25.904487  5579 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.913923  5450 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.917615  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:25.919080  5447 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 1: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:25.920019  5601 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.920748  5601 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:25.921160  5580 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:25.907680  5567 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.922387  5601 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.922642  5580 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.924109  5567 ts_tablet_manager.cc:1434] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:15:25.928731  5567 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
W20260709 13:15:25.929088  5570 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.163s	sys 0.274s
W20260709 13:15:25.930037  5570 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.163s	sys 0.274s
I20260709 13:15:25.933010  5570 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:25.933636  5570 ts_tablet_manager.cc:1403] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.631s	user 0.170s	sys 0.278s
I20260709 13:15:25.936685  5567 tablet_bootstrap.cc:654] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.939697  5522 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:25.943106  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:25.944483  5627 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.945209  5627 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:25.946400  5627 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.957916  5339 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:25.959486  5594 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:25.964455  5450 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:25.968968  5570 raft_consensus.cc:359] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.970096  5570 raft_consensus.cc:385] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.970466  5570 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.971421  5570 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.974206  5570 ts_tablet_manager.cc:1434] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:15:25.980700  5568 tablet_bootstrap.cc:492] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:25.981472  5568 ts_tablet_manager.cc:1403] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.016s
I20260709 13:15:25.981575  5570 tablet_bootstrap.cc:492] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:25.985536  5568 raft_consensus.cc:359] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.986183  5568 raft_consensus.cc:385] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.986397  5568 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.987005  5568 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:25.988684  5568 ts_tablet_manager.cc:1434] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:25.990861  5570 tablet_bootstrap.cc:654] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.989410  5568 tablet_bootstrap.cc:492] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:25.995988  5567 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:25.996632  5567 ts_tablet_manager.cc:1403] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.000s
I20260709 13:15:26.000388  5567 raft_consensus.cc:359] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.001222  5567 raft_consensus.cc:385] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.001811  5567 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.002696  5567 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.004060  5568 tablet_bootstrap.cc:654] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.004583  5570 tablet_bootstrap.cc:492] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:26.005203  5570 ts_tablet_manager.cc:1403] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 13:15:26.008098  5567 ts_tablet_manager.cc:1434] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:15:26.008121  5570 raft_consensus.cc:359] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.009052  5570 raft_consensus.cc:385] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.009212  5567 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:26.009392  5570 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.019507  5567 tablet_bootstrap.cc:654] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.022815  5270 catalog_manager.cc:5697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.031942  5567 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:26.032735  5567 ts_tablet_manager.cc:1403] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 13:15:26.011994  5570 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.035444  5570 ts_tablet_manager.cc:1434] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.003s
I20260709 13:15:26.036098  5567 raft_consensus.cc:359] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.036592  5570 tablet_bootstrap.cc:492] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:26.036798  5567 raft_consensus.cc:385] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.037084  5567 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.039134  5271 catalog_manager.cc:5697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.043723  5570 tablet_bootstrap.cc:654] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.044410  5567 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.047695  5567 ts_tablet_manager.cc:1434] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:26.048638  5567 tablet_bootstrap.cc:492] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:26.055279  5567 tablet_bootstrap.cc:654] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.055359  5580 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.055907  5580 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.058409  5580 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.062601  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:26.062860  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.063427  5372 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
W20260709 13:15:26.064455  5414 leader_election.cc:343] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.070890  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:26.072036  5567 tablet_bootstrap.cc:492] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:26.072043  5570 tablet_bootstrap.cc:492] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:26.072675  5570 ts_tablet_manager.cc:1403] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.005s
I20260709 13:15:26.073513  5580 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.074122  5580 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.074644  5580 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.075860  5570 raft_consensus.cc:359] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.072674  5567 ts_tablet_manager.cc:1403] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 13:15:26.076680  5570 raft_consensus.cc:385] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.077071  5570 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.078269  5570 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.079352  5567 raft_consensus.cc:359] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.080045  5567 raft_consensus.cc:385] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.080314  5567 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.081117  5570 ts_tablet_manager.cc:1434] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:26.080981  5567 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.082223  5570 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:26.083199  5567 ts_tablet_manager.cc:1434] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:26.084101  5567 tablet_bootstrap.cc:492] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:26.085732  5270 catalog_manager.cc:5697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.089449  5627 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.090272  5567 tablet_bootstrap.cc:654] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.089982  5627 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.094579  5601 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.095197  5601 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.097689  5601 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:26.098768  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:26.099378  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:26.098899  5273 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.099812  5372 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
W20260709 13:15:26.100968  5489 leader_election.cc:343] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.102217  5490 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:26.103473  5601 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.103894  5601 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.104287  5601 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.104494  5627 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.108279  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:26.109019  5450 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:26.110270  5570 tablet_bootstrap.cc:654] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.110340  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:26.106535  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.111404  5627 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.111852  5627 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.112226  5627 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:26.113018  5339 leader_election.cc:343] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.104954  5580 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.122311  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:26.123211  5372 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.125847  5627 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.122850  5601 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.129928  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:26.130800  5450 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.132629  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:26.133285  5375 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.134657  5627 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.134465  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:26.136209  5489 leader_election.cc:343] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.136503  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:26.136807  5601 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:26.139617  5339 leader_election.cc:343] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.139606  5568 tablet_bootstrap.cc:492] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:26.146366  5568 ts_tablet_manager.cc:1403] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.157s	user 0.034s	sys 0.064s
I20260709 13:15:26.147912  5601 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.148519  5601 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.152271  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:26.153043  5370 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:26.154525  5375 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:26.154649  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:26.155929  5601 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:26.157655  5580 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.157842  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:26.158864  5601 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.159296  5601 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.159224  5490 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:26.160136  5489 leader_election.cc:343] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.160432  5642 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.160935  5642 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:26.161331  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:26.159883  5601 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.162024  5568 raft_consensus.cc:359] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.161840  5642 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.163053  5568 raft_consensus.cc:385] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.163522  5568 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
W20260709 13:15:26.164940  5414 leader_election.cc:343] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.164718  5568 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.167900  5568 ts_tablet_manager.cc:1434] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:15:26.169144  5568 tablet_bootstrap.cc:492] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:26.170655  5372 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:26.173185  5567 tablet_bootstrap.cc:492] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:26.173750  5567 ts_tablet_manager.cc:1403] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.090s	user 0.049s	sys 0.036s
I20260709 13:15:26.174317  5450 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:26.175849  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:26.178544  5580 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.179098  5580 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:26.179976  5580 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.180747  5568 tablet_bootstrap.cc:654] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.180400  5601 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.183589  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:26.185289  5627 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.188176  5627 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:26.190864  5570 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:26.191383  5570 ts_tablet_manager.cc:1403] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.000s
I20260709 13:15:26.189010  5627 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.191972  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:26.191095  5601 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:26.186319  5567 raft_consensus.cc:359] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.193626  5567 raft_consensus.cc:385] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.193888  5567 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
W20260709 13:15:26.195170  5489 leader_election.cc:343] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.194900  5567 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.196544  5567 ts_tablet_manager.cc:1434] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:15:26.197467  5567 tablet_bootstrap.cc:492] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:26.200563  5570 raft_consensus.cc:359] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.201848  5570 raft_consensus.cc:385] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.202266  5570 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.203259  5570 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.208666  5570 ts_tablet_manager.cc:1434] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:26.210074  5570 tablet_bootstrap.cc:492] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:26.210497  5271 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.212708  5273 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.218953  5570 tablet_bootstrap.cc:654] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.219523  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:26.220192  5372 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.222427  5567 tablet_bootstrap.cc:654] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.226948  5568 tablet_bootstrap.cc:492] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:26.227442  5568 ts_tablet_manager.cc:1403] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.028s
I20260709 13:15:26.231141  5270 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.231963  5568 raft_consensus.cc:359] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.232800  5568 raft_consensus.cc:385] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.233099  5568 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.233810  5568 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.235787  5568 ts_tablet_manager.cc:1434] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:26.236749  5568 tablet_bootstrap.cc:492] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:26.232322  5372 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:26.240945  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:26.242246  5601 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.242740  5601 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:26.245302  5601 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.246055  5568 tablet_bootstrap.cc:654] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.273162  5567 tablet_bootstrap.cc:492] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:26.282004  5567 ts_tablet_manager.cc:1403] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.021s
I20260709 13:15:26.284307  5570 tablet_bootstrap.cc:492] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:26.284818  5570 ts_tablet_manager.cc:1403] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.001s
I20260709 13:15:26.286202  5567 raft_consensus.cc:359] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.287180  5567 raft_consensus.cc:385] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.287544  5567 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.288137  5570 raft_consensus.cc:359] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.288511  5567 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.289258  5570 raft_consensus.cc:385] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.283542  5271 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.289901  5570 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.291066  5567 ts_tablet_manager.cc:1434] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:26.290773  5570 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.293231  5570 ts_tablet_manager.cc:1434] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:26.294212  5567 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:26.295037  5570 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:26.298251  5580 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.298818  5580 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.302304  5580 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.304966  5567 tablet_bootstrap.cc:654] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.305609  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:26.306407  5372 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:26.307473  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.311731  5570 tablet_bootstrap.cc:654] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.313716  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:26.318624  5580 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.321183  5627 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.321805  5627 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.324716  5567 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:26.325340  5567 ts_tablet_manager.cc:1403] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.004s
I20260709 13:15:26.325870  5594 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.326434  5594 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.328773  5594 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.329715  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:26.331164  5580 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:26.331534  5340 leader_election.cc:343] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.332690  5567 raft_consensus.cc:359] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.333573  5567 raft_consensus.cc:385] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.333947  5567 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.334257  5568 tablet_bootstrap.cc:492] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:26.334748  5568 ts_tablet_manager.cc:1403] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.098s	user 0.020s	sys 0.011s
I20260709 13:15:26.335052  5627 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.334794  5567 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.338835  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:26.339021  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.339890  5580 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.340194  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.340448  5580 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:26.342466  5340 leader_election.cc:343] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.343688  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:26.343879  5339 leader_election.cc:343] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.344396  5372 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:26.345914  5567 ts_tablet_manager.cc:1434] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:15:26.345968  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:26.347621  5567 tablet_bootstrap.cc:492] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:26.347529  5628 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.348042  5628 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.348438  5628 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.344313  5339 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:26.350232  5568 raft_consensus.cc:359] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.351240  5627 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.351423  5568 raft_consensus.cc:385] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.352521  5568 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.353173  5568 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:26.350322  5339 leader_election.cc:343] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.351984  5594 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.355743  5339 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:26.358667  5594 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.353622  5627 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.360193  5580 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.362051  5627 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.363621  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:26.368175  5642 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.370358  5340 leader_election.cc:343] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.370482  5642 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.370934  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.368731  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:26.372434  5339 leader_election.cc:343] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.372843  5642 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:26.374370  5568 ts_tablet_manager.cc:1434] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 13:15:26.375806  5568 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:26.369959  5601 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:15:26.376688  5414 leader_election.cc:343] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.377619  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:26.378285  5375 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:26.379448  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:26.380287  5372 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.380685  5601 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.381052  5601 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.381286  5601 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.373617  5580 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:15:26.384946  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:26.387118  5580 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.387773  5580 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.395957  5570 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:26.396508  5570 ts_tablet_manager.cc:1403] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.003s
W20260709 13:15:26.396569  5416 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:26.397164  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:26.401000  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.373726  5339 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:26.406783  5570 raft_consensus.cc:359] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:26.406003  5416 leader_election.cc:343] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.402019  5523 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:26.405654  5642 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.407918  5594 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.408978  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:26.410027  5598 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.410429  5598 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.410780  5598 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.413777  5570 raft_consensus.cc:385] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.414261  5570 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.415267  5570 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.398108  5580 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.423041  5567 tablet_bootstrap.cc:654] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.423273  5570 ts_tablet_manager.cc:1434] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.003s
W20260709 13:15:26.426855  5489 leader_election.cc:343] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.427912  5570 tablet_bootstrap.cc:492] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:26.449291  5598 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.454500  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:26.455265  5523 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.437608  5628 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.461285  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:26.463650  5568 tablet_bootstrap.cc:654] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.464187  5601 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.459785  5598 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:26.467549  5416 leader_election.cc:343] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.468079  5628 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.470669  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:26.470582  5594 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.472283  5523 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
W20260709 13:15:26.473198  5414 leader_election.cc:343] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.474140  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:26.481372  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:26.483258  5489 leader_election.cc:343] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.480139  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:26.486821  5570 tablet_bootstrap.cc:654] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.479740  5601 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:26.484700  5370 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.498652  5642 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.485771  5628 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.499819  5670 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:26.503751  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:26.504446  5374 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.510630  5670 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.517082  5627 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.517640  5627 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.520116  5627 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:26.541798  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:26.543419  5627 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.544052  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:26.544785  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.553176  5601 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:26.553385  5340 leader_election.cc:343] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:26.555423  5339 leader_election.cc:343] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.581511  5339 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:26.604770  5568 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:26.605314  5568 ts_tablet_manager.cc:1403] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.230s	user 0.028s	sys 0.007s
I20260709 13:15:26.623688  5677 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.635236  5567 tablet_bootstrap.cc:492] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:26.636528  5374 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:26.638530  5567 ts_tablet_manager.cc:1403] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.291s	user 0.015s	sys 0.007s
I20260709 13:15:26.656965  5642 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.658900  5522 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.666626  5370 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:26.669335  5628 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:26.686714  5567 raft_consensus.cc:359] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.687518  5567 raft_consensus.cc:385] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.687871  5567 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.686924  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:26.686578  5568 raft_consensus.cc:359] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.689284  5568 raft_consensus.cc:385] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.688651  5567 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.689834  5568 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.694631  5568 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.700565  5570 tablet_bootstrap.cc:492] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:26.701102  5570 ts_tablet_manager.cc:1403] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.008s
I20260709 13:15:26.710559  5567 ts_tablet_manager.cc:1434] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 13:15:26.711675  5567 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:26.698006  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:26.713644  5670 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.696537  5642 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.714195  5670 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:26.714495  5642 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:26.715346  5570 raft_consensus.cc:359] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.716177  5568 ts_tablet_manager.cc:1434] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.002s
I20260709 13:15:26.716629  5570 raft_consensus.cc:385] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.717129  5570 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.718235  5570 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.733054  5570 ts_tablet_manager.cc:1434] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:15:26.734318  5570 tablet_bootstrap.cc:492] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:26.731454  5642 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.752540  5579 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:26.680037  5628 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.721726  5670 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.765606  5568 tablet_bootstrap.cc:492] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:26.778062  5683 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.780649  5683 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.783901  5683 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:26.787312  5489 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:26.790254  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:26.791180  5524 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:26.800374  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:26.804750  5670 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.831384  5670 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.893298  5670 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.898152  5567 tablet_bootstrap.cc:654] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.904183  5568 tablet_bootstrap.cc:654] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:26.904455  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 350908us
I20260709 13:15:26.910295  5570 tablet_bootstrap.cc:654] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:26.915702  5690 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:15:26.925940  5688 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.925581  5670 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.926496  5688 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.928809  5688 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.934882  5670 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:26.937340  5568 tablet_bootstrap.cc:492] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:26.937976  5568 ts_tablet_manager.cc:1403] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.173s	user 0.026s	sys 0.000s
I20260709 13:15:26.965394  5567 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:26.965978  5567 ts_tablet_manager.cc:1403] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.255s	user 0.014s	sys 0.004s
I20260709 13:15:26.966580  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:26.967329  5374 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:26.968959  5567 raft_consensus.cc:359] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.969774  5567 raft_consensus.cc:385] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.970095  5567 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.973604  5570 tablet_bootstrap.cc:492] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:26.976675  5570 ts_tablet_manager.cc:1403] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.243s	user 0.018s	sys 0.039s
I20260709 13:15:26.978513  5568 raft_consensus.cc:359] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.979395  5568 raft_consensus.cc:385] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.979691  5568 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.982278  5568 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.989373  5568 ts_tablet_manager.cc:1434] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:15:26.985081  5570 raft_consensus.cc:359] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.990499  5570 raft_consensus.cc:385] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.990898  5570 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.992403  5568 tablet_bootstrap.cc:492] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:26.992777  5570 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.995216  5570 ts_tablet_manager.cc:1434] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:15:26.996299  5570 tablet_bootstrap.cc:492] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:26.991542  5567 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:26.999585  5567 ts_tablet_manager.cc:1434] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:15:27.000831  5567 tablet_bootstrap.cc:492] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:27.000989  5568 tablet_bootstrap.cc:654] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.009996  5570 tablet_bootstrap.cc:654] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.020332  5568 tablet_bootstrap.cc:492] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.029752  5568 ts_tablet_manager.cc:1403] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.007s
I20260709 13:15:27.024932  5567 tablet_bootstrap.cc:654] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.032980  5568 raft_consensus.cc:359] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.033865  5568 raft_consensus.cc:385] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.042449  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:27.044343  5339 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 -> Peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Couldn't send request to peer 544c82a50cc4477886bb6f7d58f455ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:27.046063  5339 leader_election.cc:343] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.034323  5568 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.053222  5601 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.047855  5568 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.053900  5601 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.055523  5568 ts_tablet_manager.cc:1434] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:15:27.056322  5568 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
W20260709 13:15:27.059900  5692 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260709 13:15:27.062908  5568 tablet_bootstrap.cc:654] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.065758  5570 tablet_bootstrap.cc:492] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:27.066314  5570 ts_tablet_manager.cc:1403] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.001s
I20260709 13:15:27.065780  5567 tablet_bootstrap.cc:492] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:27.070029  5567 ts_tablet_manager.cc:1403] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.069s	user 0.003s	sys 0.014s
I20260709 13:15:27.069172  5570 raft_consensus.cc:359] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.070917  5570 raft_consensus.cc:385] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.071223  5570 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.071960  5570 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.072764  5567 raft_consensus.cc:359] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.073505  5567 raft_consensus.cc:385] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.073865  5567 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.074591  5567 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.073521  5570 ts_tablet_manager.cc:1434] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:27.077716  5567 ts_tablet_manager.cc:1434] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:27.078613  5567 tablet_bootstrap.cc:492] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:27.081465  5568 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.082008  5568 ts_tablet_manager.cc:1403] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.003s
I20260709 13:15:27.082923  5570 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:27.085155  5568 raft_consensus.cc:359] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.085985  5568 raft_consensus.cc:385] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.086331  5568 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.087757  5568 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.090430  5568 ts_tablet_manager.cc:1434] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:27.091591  5568 tablet_bootstrap.cc:492] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:27.094638  5567 tablet_bootstrap.cc:654] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.098448  5568 tablet_bootstrap.cc:654] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.101188  5570 tablet_bootstrap.cc:654] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:27.111004  5689 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.221s	user 0.003s	sys 0.000s
I20260709 13:15:27.117868  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:27.118702  5524 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.125092  5683 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.124876  5628 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.125742  5683 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.128327  5683 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:27.130143  5642 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.134974  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:27.135671  5522 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:27.136853  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:27.137722  5628 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.138083  5628 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.138418  5628 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.143952  5524 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
W20260709 13:15:27.147373  5691 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 13:15:27.148767  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:27.149688  5683 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.150339  5683 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:27.151458  5683 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.163467  5372 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.167768  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:27.163537  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:27.170666  5370 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.174770  5601 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.176033  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:27.176764  5371 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:27.176980  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:27.178146  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:27.180270  5601 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:27.180703  5601 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:27.181109  5601 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:27.191442  5693 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:15:27.194924  5601 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.204685  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:27.206068  5521 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:27.208065  5375 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.198155  5670 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:27.210039  5370 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:27.212966  5598 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.205209  5601 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.206790  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:27.225677  5375 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:27.227157  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:27.220244  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51586us
I20260709 13:15:27.228407  5579 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:27.228912  5579 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:15:27.228432  5416 leader_election.cc:343] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.229805  5579 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.232381  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:27.235663  5627 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:27.235697  5340 leader_election.cc:343] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.237027  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:27.238567  5627 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.245487  5448 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.147634  5628 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.247457  5580 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:27.247886  5580 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:27.248759  5628 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:27.248759  5580 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.250520  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:27.250710  5580 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.251139  5521 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.252079  5567 tablet_bootstrap.cc:492] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:27.252544  5567 ts_tablet_manager.cc:1403] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.174s	user 0.059s	sys 0.040s
I20260709 13:15:27.253782  5568 tablet_bootstrap.cc:492] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.255558  5567 raft_consensus.cc:359] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.256083  5568 ts_tablet_manager.cc:1403] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.165s	user 0.031s	sys 0.011s
I20260709 13:15:27.256269  5567 raft_consensus.cc:385] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.256589  5567 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.256882  5524 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.257246  5567 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.257331  5270 catalog_manager.cc:5697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.262631  5567 ts_tablet_manager.cc:1434] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:15:27.263773  5567 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:27.259009  5568 raft_consensus.cc:359] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.265223  5568 raft_consensus.cc:385] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.265620  5568 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.266265  5372 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.267023  5568 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.273028  5579 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.276381  5568 ts_tablet_manager.cc:1434] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:15:27.277245  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:27.279651  5372 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:27.279825  5567 tablet_bootstrap.cc:654] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.281817  5568 tablet_bootstrap.cc:492] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:27.281499  5709 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.283560  5522 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.295729  5570 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:27.296439  5570 ts_tablet_manager.cc:1403] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.214s	user 0.010s	sys 0.000s
W20260709 13:15:27.297294  5416 leader_election.cc:343] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.306875  5521 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:27.308907  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:27.310214  5598 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.312008  5598 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.312685  5598 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:27.319787  5598 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.322083  5567 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:27.322674  5567 ts_tablet_manager.cc:1403] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.059s	user 0.028s	sys 0.020s
I20260709 13:15:27.323096  5568 tablet_bootstrap.cc:654] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.326336  5567 raft_consensus.cc:359] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.330858  5567 raft_consensus.cc:385] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.331676  5567 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.343580  5567 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.355070  5567 ts_tablet_manager.cc:1434] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 13:15:27.356449  5567 tablet_bootstrap.cc:492] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:27.358104  5570 raft_consensus.cc:359] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.362164  5570 raft_consensus.cc:385] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.362509  5570 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.363996  5570 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.365940  5570 ts_tablet_manager.cc:1434] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.069s	user 0.011s	sys 0.002s
I20260709 13:15:27.366968  5570 tablet_bootstrap.cc:492] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:27.372076  5579 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.381074  5450 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.405535  5628 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:27.392449  5579 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.410395  5579 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.412930  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:27.414413  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:27.414628  5489 leader_election.cc:343] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.415118  5371 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:27.418376  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:27.420197  5628 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:27.435189  5714 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:15:27.449204  5568 tablet_bootstrap.cc:492] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.449923  5568 ts_tablet_manager.cc:1403] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.173s	user 0.034s	sys 0.030s
I20260709 13:15:27.440347  5579 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.456513  5579 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.461383  5579 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.488108  5598 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.488678  5598 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.492916  5598 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:27.493517  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:27.493512  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:27.497072  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:27.497937  5642 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.498433  5670 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:27.499200  5273 catalog_manager.cc:5697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.500689  5568 raft_consensus.cc:359] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.501681  5570 tablet_bootstrap.cc:654] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.505697  5627 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.503299  5567 tablet_bootstrap.cc:654] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.506234  5627 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.508409  5627 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:27.509615  5568 raft_consensus.cc:385] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.510010  5568 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.510776  5568 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.513309  5568 ts_tablet_manager.cc:1434] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.000s
I20260709 13:15:27.514395  5568 tablet_bootstrap.cc:492] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:27.516337  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:27.518189  5340 leader_election.cc:343] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.521342  5568 tablet_bootstrap.cc:654] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.526110  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:27.524134  5579 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:27.534322  5339 leader_election.cc:343] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.535009  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:27.536932  5688 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.538134  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:27.539916  5489 leader_election.cc:343] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.542495  5579 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.544070  5677 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.544620  5677 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.547825  5677 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:27.560791  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:27.562390  5339 leader_election.cc:343] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.566582  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:27.568338  5340 leader_election.cc:343] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.568778  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:27.570047  5677 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.576004  5273 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.577601  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:27.579005  5273 catalog_manager.cc:5697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:15:27.579843  5371 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:27.581513  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:27.584367  5570 tablet_bootstrap.cc:492] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:27.585433  5570 ts_tablet_manager.cc:1403] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.219s	user 0.022s	sys 0.004s
I20260709 13:15:27.589874  5568 tablet_bootstrap.cc:492] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.590503  5568 ts_tablet_manager.cc:1403] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.011s
I20260709 13:15:27.589098  5570 raft_consensus.cc:359] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.591977  5567 tablet_bootstrap.cc:492] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:27.592096  5570 raft_consensus.cc:385] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.592464  5570 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.592536  5567 ts_tablet_manager.cc:1403] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.236s	user 0.007s	sys 0.047s
I20260709 13:15:27.593715  5568 raft_consensus.cc:359] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.594375  5568 raft_consensus.cc:385] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.594763  5568 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.595419  5568 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.595772  5567 raft_consensus.cc:359] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.596504  5567 raft_consensus.cc:385] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.596808  5567 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.597488  5568 ts_tablet_manager.cc:1434] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:15:27.597543  5567 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.598594  5568 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:27.593218  5570 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.599864  5567 ts_tablet_manager.cc:1434] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:27.600769  5570 ts_tablet_manager.cc:1434] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:27.600857  5567 tablet_bootstrap.cc:492] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:27.601843  5570 tablet_bootstrap.cc:492] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:27.605479  5568 tablet_bootstrap.cc:654] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.608057  5567 tablet_bootstrap.cc:654] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.615481  5270 catalog_manager.cc:5697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.609107  5570 tablet_bootstrap.cc:654] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.632865  5568 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.633378  5568 ts_tablet_manager.cc:1403] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.009s
I20260709 13:15:27.636068  5568 raft_consensus.cc:359] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.636782  5568 raft_consensus.cc:385] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.637054  5568 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.618407  5371 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:27.637415  5570 tablet_bootstrap.cc:492] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:27.638038  5570 ts_tablet_manager.cc:1403] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.003s
I20260709 13:15:27.637760  5568 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.638742  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:27.639977  5568 ts_tablet_manager.cc:1434] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:27.640163  5642 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.640496  5567 tablet_bootstrap.cc:492] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:27.640669  5642 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:27.640939  5567 ts_tablet_manager.cc:1403] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.010s
I20260709 13:15:27.640884  5570 raft_consensus.cc:359] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.643122  5579 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.643323  5570 raft_consensus.cc:385] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.640941  5568 tablet_bootstrap.cc:492] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:27.643988  5579 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.645943  5567 raft_consensus.cc:359] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.646811  5567 raft_consensus.cc:385] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.647249  5567 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.647953  5567 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.648290  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:27.649399  5448 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:27.649874  5270 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.650887  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:27.642124  5642 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.652089  5630 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.652472  5630 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.652815  5630 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.643996  5570 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.655316  5579 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.657773  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:27.659186  5371 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:27.670368  5570 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.671777  5567 ts_tablet_manager.cc:1434] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.030s	user 0.021s	sys 0.005s
I20260709 13:15:27.672648  5567 tablet_bootstrap.cc:492] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:27.676503  5568 tablet_bootstrap.cc:654] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.677935  5598 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.681233  5570 ts_tablet_manager.cc:1434] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.043s	user 0.015s	sys 0.008s
I20260709 13:15:27.685667  5598 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.687475  5630 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.689007  5570 tablet_bootstrap.cc:492] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:27.693465  5630 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.694362  5567 tablet_bootstrap.cc:654] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.694777  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:27.696252  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:27.697196  5370 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.697528  5448 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.708921  5570 tablet_bootstrap.cc:654] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.712441  5370 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:27.715253  5490 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:27.716114  5630 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.717736  5630 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:27.718928  5630 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.728029  5448 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:27.736526  5270 catalog_manager.cc:5697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.740235  5568 tablet_bootstrap.cc:492] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.740765  5568 ts_tablet_manager.cc:1403] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.100s	user 0.020s	sys 0.012s
I20260709 13:15:27.744663  5568 raft_consensus.cc:359] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.749069  5598 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.749626  5568 raft_consensus.cc:385] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.749984  5568 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.752527  5568 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.756111  5568 ts_tablet_manager.cc:1434] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:27.757179  5568 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:27.757441  5371 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.760505  5630 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.765193  5567 tablet_bootstrap.cc:492] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:27.765823  5567 ts_tablet_manager.cc:1403] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.093s	user 0.006s	sys 0.008s
I20260709 13:15:27.768455  5567 raft_consensus.cc:359] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.769131  5567 raft_consensus.cc:385] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.769397  5567 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.770246  5567 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.770908  5570 tablet_bootstrap.cc:492] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:27.772729  5567 ts_tablet_manager.cc:1434] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:27.773380  5570 ts_tablet_manager.cc:1403] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.000s
I20260709 13:15:27.773968  5567 tablet_bootstrap.cc:492] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:27.776436  5570 raft_consensus.cc:359] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.777393  5570 raft_consensus.cc:385] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.777807  5570 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.778673  5570 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.780877  5567 tablet_bootstrap.cc:654] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.781674  5630 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.782166  5630 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.780988  5570 ts_tablet_manager.cc:1434] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:15:27.783830  5570 tablet_bootstrap.cc:492] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:27.784228  5630 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.785789  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:27.787879  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:27.788326  5448 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:27.789695  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:27.790607  5630 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.791005  5630 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.791364  5630 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:27.793514  5490 leader_election.cc:343] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.797118  5570 tablet_bootstrap.cc:654] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.799220  5630 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.802500  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:27.803115  5448 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.804466  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:15:27.806027  5490 leader_election.cc:343] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.810523  5448 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:27.787168  5568 tablet_bootstrap.cc:654] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.813148  5570 tablet_bootstrap.cc:492] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:27.812781  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:27.813709  5570 ts_tablet_manager.cc:1403] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.005s
I20260709 13:15:27.814218  5642 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:27.815143  5642 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:27.816211  5642 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.821010  5630 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.828485  5570 raft_consensus.cc:359] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.829550  5570 raft_consensus.cc:385] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.829912  5570 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.833377  5568 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.832995  5570 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.833897  5568 ts_tablet_manager.cc:1403] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.005s
I20260709 13:15:27.836145  5375 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.836400  5570 ts_tablet_manager.cc:1434] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:15:27.837091  5568 raft_consensus.cc:359] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.837993  5568 raft_consensus.cc:385] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.838420  5568 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.839830  5568 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.841194  5448 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.842873  5630 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.843211  5568 ts_tablet_manager.cc:1434] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:15:27.844761  5568 tablet_bootstrap.cc:492] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:27.853343  5568 tablet_bootstrap.cc:654] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.853660  5272 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.872411  5628 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.876722  5567 tablet_bootstrap.cc:492] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:27.877601  5567 ts_tablet_manager.cc:1403] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.104s	user 0.053s	sys 0.031s
I20260709 13:15:27.882272  5570 tablet_bootstrap.cc:492] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:27.893488  5568 tablet_bootstrap.cc:492] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.893997  5568 ts_tablet_manager.cc:1403] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.026s
I20260709 13:15:27.896529  5570 tablet_bootstrap.cc:654] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.896903  5568 raft_consensus.cc:359] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.897624  5568 raft_consensus.cc:385] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.897933  5568 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.898366  5627 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.898732  5568 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.898861  5627 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.901185  5568 ts_tablet_manager.cc:1434] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:27.900961  5567 raft_consensus.cc:359] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.901747  5567 raft_consensus.cc:385] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.902027  5567 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.902117  5568 tablet_bootstrap.cc:492] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:27.901006  5627 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:27.912451  5567 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.912995  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:27.913672  5448 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:27.914968  5567 ts_tablet_manager.cc:1434] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.003s
I20260709 13:15:27.915939  5567 tablet_bootstrap.cc:492] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:27.916934  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:27.917821  5568 tablet_bootstrap.cc:654] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.917827  5627 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.918340  5627 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.918725  5627 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.925256  5272 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.927187  5627 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.932264  5627 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:27.933751  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:27.933666  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:27.935848  5570 tablet_bootstrap.cc:492] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:27.936364  5570 ts_tablet_manager.cc:1403] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.007s
W20260709 13:15:27.936789  5339 leader_election.cc:343] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:27.938095  5339 leader_election.cc:343] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.939082  5570 raft_consensus.cc:359] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.940267  5642 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.940737  5642 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.943027  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:27.943933  5448 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.945210  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:27.947191  5489 leader_election.cc:343] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.943323  5642 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.950428  5567 tablet_bootstrap.cc:654] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.951120  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:27.939787  5570 raft_consensus.cc:385] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:27.953478  5570 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:27.955116  5570 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.957219  5570 ts_tablet_manager.cc:1434] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:27.958156  5570 tablet_bootstrap.cc:492] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:27.952123  5371 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:27.961011  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:27.965903  5601 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:27.966326  5601 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.966699  5601 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.975057  5601 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.982132  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:27.980324  5601 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.988260  5642 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.991212  5642 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:27.993968  5642 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:27.994866  5570 tablet_bootstrap.cc:654] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:27.995725  5627 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.996217  5627 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:27.985299  5489 leader_election.cc:343] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:27.989311  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:27.984400  5448 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:27.998741  5627 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:27.999145  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:27.995599  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:27.999790  5447 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:28.000525  5375 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:27.997840  5371 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.001030  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:28.002408  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:27.998014  5568 tablet_bootstrap.cc:492] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:27.999790  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:28.003870  5677 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.004141  5523 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:28.004383  5677 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:28.004585  5688 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.005137  5688 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.005255  5677 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.005784  5688 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.006691  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:28.008549  5601 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.008962  5601 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.009289  5601 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.010898  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:28.011546  5447 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:28.016050  5601 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.018356  5601 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:28.019742  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:28.020452  5448 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.021255  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:28.022881  5375 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.026798  5371 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:27.988685  5567 tablet_bootstrap.cc:492] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:28.028347  5567 ts_tablet_manager.cc:1403] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.015s
I20260709 13:15:28.028520  5448 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:28.004154  5568 ts_tablet_manager.cc:1403] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.102s	user 0.042s	sys 0.038s
I20260709 13:15:28.030722  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:28.033293  5567 raft_consensus.cc:359] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.036983  5567 raft_consensus.cc:385] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.037292  5567 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.037675  5642 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.038041  5567 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.038460  5642 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:28.039642  5642 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.043831  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:28.044660  5567 ts_tablet_manager.cc:1434] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:28.045372  5630 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.045707  5567 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:28.045907  5630 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:28.046725  5630 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.052078  5568 raft_consensus.cc:359] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.053103  5568 raft_consensus.cc:385] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.056088  5568 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.056972  5688 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.063943  5567 tablet_bootstrap.cc:654] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.066031  5688 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:28.067728  5568 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.070837  5568 ts_tablet_manager.cc:1434] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:15:28.074034  5570 tablet_bootstrap.cc:492] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:28.074581  5570 ts_tablet_manager.cc:1403] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.035s
I20260709 13:15:28.117668  5568 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:28.117333  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:28.118158  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:28.119102  5448 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.119258  5523 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.125398  5567 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:28.126525  5567 ts_tablet_manager.cc:1403] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.001s
I20260709 13:15:28.129032  5601 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.130715  5570 raft_consensus.cc:359] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.131698  5570 raft_consensus.cc:385] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.132129  5570 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.136715  5598 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.136484  5567 raft_consensus.cc:359] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.138933  5567 raft_consensus.cc:385] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.139397  5567 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.139153  5598 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.140426  5567 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.143878  5598 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:28.137969  5570 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.144825  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:28.146128  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:28.153410  5521 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:28.153556  5601 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.153962  5371 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:28.155145  5375 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:28.155654  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:28.148283  5567 ts_tablet_manager.cc:1434] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
W20260709 13:15:28.160076  5545 debug-util.cc:398] Leaking SignalData structure 0x7b080017ab20 after lost signal to thread 4249
I20260709 13:15:28.160326  5670 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.160883  5670 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.161393  5670 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.161863  5567 tablet_bootstrap.cc:492] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:28.173555  5271 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.179014  5448 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
W20260709 13:15:28.187902  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08001ebb60 after lost signal to thread 5307
I20260709 13:15:28.192821  5570 ts_tablet_manager.cc:1434] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.005s
I20260709 13:15:28.194574  5570 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:28.199472  5447 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:28.196216  5545 debug-util.cc:398] Leaking SignalData structure 0x7b0800216360 after lost signal to thread 5399
I20260709 13:15:28.218832  5630 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.220646  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:28.221873  5688 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.222604  5688 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:28.223788  5688 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.227502  5568 tablet_bootstrap.cc:654] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:28.232182  5545 debug-util.cc:398] Leaking SignalData structure 0x7b0800104fc0 after lost signal to thread 5474
I20260709 13:15:28.242307  5523 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
W20260709 13:15:28.250547  5545 debug-util.cc:398] Leaking SignalData structure 0x7b080010db40 after lost signal to thread 5548
I20260709 13:15:28.247138  5271 catalog_manager.cc:5697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.258236  5642 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:28.264421  5670 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.267252  5670 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:28.274307  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:28.275209  5370 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.276510  5567 tablet_bootstrap.cc:654] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.288102  5271 catalog_manager.cc:5697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.296337  5370 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:28.298640  5642 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.299235  5642 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.284418  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:28.302531  5523 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.302740  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:28.299711  5570 tablet_bootstrap.cc:654] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.310827  5628 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.308269  5642 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:28.319283  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:28.322829  5489 leader_election.cc:343] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.311583  5628 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:28.329802  5628 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.356189  5568 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:28.356922  5568 ts_tablet_manager.cc:1403] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.285s	user 0.023s	sys 0.015s
I20260709 13:15:28.351025  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:28.378868  5375 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:28.386453  5567 tablet_bootstrap.cc:492] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:28.387218  5567 ts_tablet_manager.cc:1403] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.226s	user 0.007s	sys 0.044s
I20260709 13:15:28.388463  5568 raft_consensus.cc:359] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.391947  5568 raft_consensus.cc:385] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.392426  5568 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.403133  5568 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.430441  5568 ts_tablet_manager.cc:1434] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.008s
I20260709 13:15:28.432307  5490 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:28.438982  5567 raft_consensus.cc:359] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.439903  5567 raft_consensus.cc:385] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.439916  5688 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.440424  5272 catalog_manager.cc:5697] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.441990  5568 tablet_bootstrap.cc:492] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:28.444211  5523 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:28.445534  5630 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.445992  5630 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.446377  5630 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.440311  5567 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.455027  5767 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.455670  5767 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.458555  5767 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:28.462604  5567 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.464964  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:28.465202  5767 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.465966  5374 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:28.466687  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:28.468431  5489 leader_election.cc:343] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:28.468765  5339 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 -> Peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Couldn't send request to peer 544c82a50cc4477886bb6f7d58f455ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.473276  5567 ts_tablet_manager.cc:1434] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.004s
I20260709 13:15:28.476147  5270 catalog_manager.cc:5697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.474666  5570 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
W20260709 13:15:28.474937  5490 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.488196  5567 tablet_bootstrap.cc:492] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:28.488408  5570 ts_tablet_manager.cc:1403] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.294s	user 0.020s	sys 0.008s
I20260709 13:15:28.491482  5568 tablet_bootstrap.cc:654] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.491887  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:28.497813  5772 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:28.498298  5772 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.502259  5570 raft_consensus.cc:359] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.498687  5772 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.504633  5570 raft_consensus.cc:385] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.504961  5570 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.505698  5570 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.516206  5570 ts_tablet_manager.cc:1434] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:15:28.516112  5688 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:28.517819  5771 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:15:28.512472  5630 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.518198  5688 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.523773  5570 tablet_bootstrap.cc:492] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:28.525664  5767 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.529223  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:28.564643  5688 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:28.570308  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:28.572443  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:28.526607  5630 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:28.580490  5772 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:28.585824  5340 leader_election.cc:343] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.587205  5772 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:28.588308  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:28.575244  5374 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:28.577610  5450 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:28.597638  5339 leader_election.cc:343] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.598227  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:28.601287  5627 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.617631  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:28.622068  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:28.622826  5371 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:28.623186  5489 leader_election.cc:343] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.622998  5627 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.634977  5568 tablet_bootstrap.cc:492] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:28.635645  5568 ts_tablet_manager.cc:1403] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.194s	user 0.008s	sys 0.016s
I20260709 13:15:28.642079  5567 tablet_bootstrap.cc:654] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:28.651459  5489 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:28.655543  5767 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.672747  5767 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:28.675407  5371 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:28.672780  5374 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:28.676710  5450 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:28.676734  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:28.678932  5568 raft_consensus.cc:359] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.684407  5568 raft_consensus.cc:385] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.684863  5568 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.691119  5570 tablet_bootstrap.cc:654] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.690963  5490 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:28.686050  5568 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.696563  5767 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.693449  5772 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:28.705679  5767 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:28.710843  5772 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:28.712386  5767 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.715171  5568 ts_tablet_manager.cc:1434] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 13:15:28.716435  5568 tablet_bootstrap.cc:492] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:28.717353  5627 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.717901  5627 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.711937  5772 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.757272  5627 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:28.764089  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:28.768682  5339 leader_election.cc:343] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.769518  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:28.771118  5628 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:28.771813  5340 leader_election.cc:343] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.772403  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:28.773775  5677 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.774550  5568 tablet_bootstrap.cc:654] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.779397  5777 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.775009  5570 tablet_bootstrap.cc:492] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:28.775213  5567 tablet_bootstrap.cc:492] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:28.784152  5567 ts_tablet_manager.cc:1403] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.306s	user 0.019s	sys 0.013s
I20260709 13:15:28.787225  5628 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:28.804337  5570 ts_tablet_manager.cc:1403] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.281s	user 0.016s	sys 0.021s
W20260709 13:15:28.804054  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:28.787345  5567 raft_consensus.cc:359] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.808638  5567 raft_consensus.cc:385] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.809084  5567 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.816183  5567 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.828922  5567 ts_tablet_manager.cc:1434] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:15:28.855675  5567 tablet_bootstrap.cc:492] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:28.855888  5273 catalog_manager.cc:5697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.862919  5568 tablet_bootstrap.cc:492] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:28.863634  5568 ts_tablet_manager.cc:1403] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.009s
I20260709 13:15:28.873560  5677 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.874298  5677 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.884017  5642 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.887674  5642 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.890831  5570 raft_consensus.cc:359] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.891721  5570 raft_consensus.cc:385] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.891907  5570 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.892344  5570 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.895745  5570 ts_tablet_manager.cc:1434] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.002s
I20260709 13:15:28.896905  5570 tablet_bootstrap.cc:492] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:28.897045  5677 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:28.897302  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:28.897835  5642 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:28.900887  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:28.902187  5339 leader_election.cc:343] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.904465  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:28.908694  5489 leader_election.cc:343] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.909898  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:28.912213  5340 leader_election.cc:343] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.912724  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:28.921573  5677 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.921913  5568 raft_consensus.cc:359] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:28.926798  5490 leader_election.cc:343] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:28.927410  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:28.929037  5630 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:28.930663  5568 raft_consensus.cc:385] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.932880  5568 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.936898  5272 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.939839  5568 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.940668  5570 tablet_bootstrap.cc:654] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.942332  5568 ts_tablet_manager.cc:1434] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.006s
I20260709 13:15:28.935832  5567 tablet_bootstrap.cc:654] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.956689  5570 tablet_bootstrap.cc:492] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:28.957190  5570 ts_tablet_manager.cc:1403] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.004s
I20260709 13:15:28.958974  5568 tablet_bootstrap.cc:492] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:28.960516  5570 raft_consensus.cc:359] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.961380  5570 raft_consensus.cc:385] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.961717  5570 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.963289  5570 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.966054  5570 ts_tablet_manager.cc:1434] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:28.967206  5570 tablet_bootstrap.cc:492] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:28.969859  5568 tablet_bootstrap.cc:654] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.973802  5570 tablet_bootstrap.cc:654] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.976960  5567 tablet_bootstrap.cc:492] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:28.977689  5567 ts_tablet_manager.cc:1403] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.002s
I20260709 13:15:28.981396  5567 raft_consensus.cc:359] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.982192  5567 raft_consensus.cc:385] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.982504  5567 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.983359  5568 tablet_bootstrap.cc:492] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:28.983235  5567 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.983968  5568 ts_tablet_manager.cc:1403] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:15:28.985839  5567 ts_tablet_manager.cc:1434] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:28.987612  5567 tablet_bootstrap.cc:492] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:28.987893  5568 raft_consensus.cc:359] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.988633  5568 raft_consensus.cc:385] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:28.988898  5568 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:28.989614  5568 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:28.991741  5568 ts_tablet_manager.cc:1434] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:15:28.992982  5568 tablet_bootstrap.cc:492] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:28.998939  5570 tablet_bootstrap.cc:492] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:28.999104  5568 tablet_bootstrap.cc:654] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:28.999691  5570 ts_tablet_manager.cc:1403] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.000s
I20260709 13:15:29.006089  5570 raft_consensus.cc:359] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.006968  5570 raft_consensus.cc:385] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.007440  5570 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.008159  5570 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.010346  5567 tablet_bootstrap.cc:654] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.010820  5570 ts_tablet_manager.cc:1434] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:29.012027  5570 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:29.025863  5568 tablet_bootstrap.cc:492] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:29.026417  5568 ts_tablet_manager.cc:1403] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.003s
I20260709 13:15:29.030133  5568 raft_consensus.cc:359] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.030869  5568 raft_consensus.cc:385] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.031147  5568 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.031826  5568 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.033363  5570 tablet_bootstrap.cc:654] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.034646  5568 ts_tablet_manager.cc:1434] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:29.036161  5642 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.036656  5642 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.039393  5642 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:29.040856  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:29.041888  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.045310  5568 tablet_bootstrap.cc:492] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:29.045469  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:29.046703  5642 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.053841  5567 tablet_bootstrap.cc:492] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:29.054418  5567 ts_tablet_manager.cc:1403] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.009s
I20260709 13:15:29.054826  5568 tablet_bootstrap.cc:654] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.056315  5570 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:29.056794  5570 ts_tablet_manager.cc:1403] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.002s
I20260709 13:15:29.057230  5567 raft_consensus.cc:359] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.058032  5567 raft_consensus.cc:385] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.058310  5567 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.058970  5567 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.059830  5568 tablet_bootstrap.cc:492] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:29.059571  5570 raft_consensus.cc:359] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.060287  5568 ts_tablet_manager.cc:1403] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.005s
I20260709 13:15:29.060245  5570 raft_consensus.cc:385] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.060751  5570 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.061969  5570 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.065595  5570 ts_tablet_manager.cc:1434] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.006s
I20260709 13:15:29.067152  5570 tablet_bootstrap.cc:492] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:29.072850  5670 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.073392  5670 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.075713  5670 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.077673  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.078253  5570 tablet_bootstrap.cc:654] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.078552  5370 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:29.079620  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.080683  5567 ts_tablet_manager.cc:1434] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:15:29.082523  5416 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:29.084187  5670 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.085489  5567 tablet_bootstrap.cc:492] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:29.092684  5567 tablet_bootstrap.cc:654] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.075388  5568 raft_consensus.cc:359] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.097651  5568 raft_consensus.cc:385] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.097987  5568 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.100813  5568 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.097270  5670 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.113801  5568 ts_tablet_manager.cc:1434] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 13:15:29.114965  5568 tablet_bootstrap.cc:492] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:29.123566  5568 tablet_bootstrap.cc:654] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.125874  5570 tablet_bootstrap.cc:492] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:29.126535  5570 ts_tablet_manager.cc:1403] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.015s
I20260709 13:15:29.126726  5567 tablet_bootstrap.cc:492] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:29.127439  5567 ts_tablet_manager.cc:1403] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.012s
I20260709 13:15:29.130111  5570 raft_consensus.cc:359] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.130760  5570 raft_consensus.cc:385] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.131081  5570 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.130623  5567 raft_consensus.cc:359] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.131455  5567 raft_consensus.cc:385] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.131752  5567 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.131772  5570 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.133876  5570 ts_tablet_manager.cc:1434] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:29.135443  5568 tablet_bootstrap.cc:492] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:29.135980  5568 ts_tablet_manager.cc:1403] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:15:29.136221  5570 tablet_bootstrap.cc:492] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:29.138744  5568 raft_consensus.cc:359] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.139904  5568 raft_consensus.cc:385] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.140285  5568 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.132520  5567 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.142896  5570 tablet_bootstrap.cc:654] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.147488  5670 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.147637  5777 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.148088  5670 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.148310  5777 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.151847  5777 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.152964  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.154145  5567 ts_tablet_manager.cc:1434] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.003s
I20260709 13:15:29.154358  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:29.155894  5567 tablet_bootstrap.cc:492] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
W20260709 13:15:29.156467  5340 leader_election.cc:343] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.141047  5568 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.157276  5642 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.157804  5642 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.159320  5670 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.161120  5568 ts_tablet_manager.cc:1434] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:15:29.161441  5523 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:29.162755  5568 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:29.162897  5670 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.163552  5670 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.166149  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:29.168170  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.168272  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:29.170171  5416 leader_election.cc:343] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.170260  5777 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.170739  5777 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.171095  5777 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.171046  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.168208  5567 tablet_bootstrap.cc:654] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.174093  5568 tablet_bootstrap.cc:654] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.175537  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:29.176853  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.179803  5777 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.181152  5370 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 1: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:29.183233  5628 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.185290  5628 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.185786  5628 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.187831  5628 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.189356  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:29.189978  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.190909  5523 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
W20260709 13:15:29.191524  5489 leader_election.cc:343] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.192569  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:29.192953  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.193624  5375 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:29.194825  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:29.196072  5601 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.198616  5628 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.198988  5628 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.199312  5628 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.198091  5670 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.205534  5642 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:29.209964  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.215368  5523 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:29.216553  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:29.217306  5601 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.223225  5769 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.224781  5769 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.225327  5769 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.236618  5567 tablet_bootstrap.cc:492] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:29.237238  5567 ts_tablet_manager.cc:1403] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.007s
I20260709 13:15:29.240016  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:29.240506  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:29.240797  5567 raft_consensus.cc:359] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.241591  5567 raft_consensus.cc:385] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.241873  5567 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.243033  5567 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.244019  5568 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
W20260709 13:15:29.244179  5340 leader_election.cc:343] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.244632  5568 ts_tablet_manager.cc:1403] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.002s
I20260709 13:15:29.239284  5777 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.246424  5567 ts_tablet_manager.cc:1434] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:29.247944  5567 tablet_bootstrap.cc:492] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:29.249166  5642 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.247557  5628 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.233147  5769 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.267686  5570 tablet_bootstrap.cc:492] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:29.268316  5570 ts_tablet_manager.cc:1403] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.132s	user 0.039s	sys 0.048s
I20260709 13:15:29.268667  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:29.269322  5521 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.254184  5567 tablet_bootstrap.cc:654] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.270073  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:29.257020  5568 raft_consensus.cc:359] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.270720  5371 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.270805  5568 raft_consensus.cc:385] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.271193  5568 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.271876  5568 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.274051  5568 ts_tablet_manager.cc:1434] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:15:29.275102  5568 tablet_bootstrap.cc:492] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:29.258769  5772 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.263896  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:29.276919  5375 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.264124  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:29.281706  5524 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.283182  5568 tablet_bootstrap.cc:654] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.257926  5447 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.287832  5521 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:29.288733  5769 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.289276  5628 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.303871  5523 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:29.306528  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:29.307502  5777 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.313342  5777 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:15:29.316987  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47767us
I20260709 13:15:29.318238  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:29.319289  5570 raft_consensus.cc:359] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.319969  5628 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.320245  5570 raft_consensus.cc:385] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.320497  5628 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:29.320693  5570 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.321406  5628 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.314622  5777 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.335182  5767 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:29.333142  5570 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.343312  5570 ts_tablet_manager.cc:1434] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:15:29.344756  5570 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:29.380326  5767 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.378993  5670 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.389482  5371 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:29.393210  5568 tablet_bootstrap.cc:492] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:29.393782  5568 ts_tablet_manager.cc:1403] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.119s	user 0.058s	sys 0.036s
I20260709 13:15:29.383271  5767 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.394472  5670 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.400851  5670 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.400579  5601 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:29.401113  5767 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:29.409914  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.401808  5375 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:29.411684  5273 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.395978  5524 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
W20260709 13:15:29.425276  5414 leader_election.cc:343] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.428838  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:29.431360  5568 raft_consensus.cc:359] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.432138  5568 raft_consensus.cc:385] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.432408  5568 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.433059  5568 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.439317  5570 tablet_bootstrap.cc:654] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.447136  5524 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.451999  5567 tablet_bootstrap.cc:492] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:29.454878  5567 ts_tablet_manager.cc:1403] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.207s	user 0.021s	sys 0.025s
I20260709 13:15:29.454139  5777 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.457677  5777 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.462292  5568 ts_tablet_manager.cc:1434] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
W20260709 13:15:29.459208  5489 leader_election.cc:343] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.464525  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.465204  5375 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:29.447747  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:29.467204  5777 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.468441  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.469091  5375 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:29.470024  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.463565  5567 raft_consensus.cc:359] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.473146  5598 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.473412  5567 raft_consensus.cc:385] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.473691  5598 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:29.474455  5601 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.473742  5567 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.474920  5601 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.475698  5567 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.478971  5601 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:29.479591  5568 tablet_bootstrap.cc:492] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:29.481911  5272 catalog_manager.cc:5697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.484131  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:29.484975  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:29.486136  5772 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.486310  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:29.486594  5772 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.486447  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:29.487036  5772 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.488456  5670 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.488874  5670 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.489220  5670 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.474642  5598 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.490723  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.494271  5567 ts_tablet_manager.cc:1434] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:15:29.498703  5567 tablet_bootstrap.cc:492] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:29.503093  5570 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:29.503827  5570 ts_tablet_manager.cc:1403] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.159s	user 0.018s	sys 0.001s
W20260709 13:15:29.510330  5490 leader_election.cc:343] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.521910  5489 leader_election.cc:343] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.522447  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:29.523659  5601 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.539856  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:29.539937  5772 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.541045  5777 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:29.542212  5772 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:29.546723  5570 raft_consensus.cc:359] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.547453  5570 raft_consensus.cc:385] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.547755  5570 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.548671  5570 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.556470  5374 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.556895  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:29.555490  5570 ts_tablet_manager.cc:1434] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.003s
W20260709 13:15:29.564405  5489 leader_election.cc:343] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.559089  5670 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:29.577198  5810 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:15:29.577884  5570 tablet_bootstrap.cc:492] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:29.582968  5567 tablet_bootstrap.cc:654] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.591398  5272 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.596053  5568 tablet_bootstrap.cc:654] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.605180  5777 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.605962  5777 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.665519  5767 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.666404  5767 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.691203  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:29.692092  5370 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.713560  5598 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.714335  5598 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:29.744920  5340 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.768998  5767 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:29.774482  5777 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.774722  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.775439  5521 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:29.775565  5598 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.776707  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:29.777726  5777 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.778472  5777 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.778927  5777 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.780421  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:29.782718  5340 leader_election.cc:343] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.788374  5777 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.791353  5777 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.791554  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:29.792439  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:15:29.793035  5340 leader_election.cc:343] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.793088  5521 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.807094  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:29.808795  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:29.811633  5568 tablet_bootstrap.cc:492] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:29.812522  5568 ts_tablet_manager.cc:1403] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.349s	user 0.038s	sys 0.031s
I20260709 13:15:29.815639  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:29.816375  5449 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:29.816766  5568 raft_consensus.cc:359] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.817591  5568 raft_consensus.cc:385] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.817881  5568 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.818647  5568 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:29.820241  5414 leader_election.cc:343] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:29.821408  5414 leader_election.cc:343] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:29.820817  5521 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:29.738021  5670 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:29.823465  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:29.826514  5568 ts_tablet_manager.cc:1434] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:15:29.827785  5568 tablet_bootstrap.cc:492] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:29.829794  5677 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:29.830421  5677 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:29.831807  5677 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.834684  5568 tablet_bootstrap.cc:654] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.837013  5370 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:29.845971  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.852142  5567 tablet_bootstrap.cc:492] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:29.855225  5567 ts_tablet_manager.cc:1403] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.357s	user 0.013s	sys 0.001s
I20260709 13:15:29.858904  5777 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:29.861912  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:29.863830  5767 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.864300  5767 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.867027  5767 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.870323  5568 tablet_bootstrap.cc:492] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:29.875533  5568 ts_tablet_manager.cc:1403] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.008s
I20260709 13:15:29.892851  5767 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.896786  5568 raft_consensus.cc:359] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.926033  5568 raft_consensus.cc:385] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.926374  5568 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.926796  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:29.927490  5449 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.927199  5568 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.833272  5570 tablet_bootstrap.cc:654] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:29.901887  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:29.898563  5567 raft_consensus.cc:359] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.925362  5767 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:29.912304  5598 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:29.929224  5567 raft_consensus.cc:385] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:29.929670  5567 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:29.913313  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:29.931375  5372 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:29.933350  5567 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:29.920535  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:29.934813  5568 ts_tablet_manager.cc:1434] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.013s
I20260709 13:15:29.935317  5370 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.936079  5568 tablet_bootstrap.cc:492] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:29.936344  5567 ts_tablet_manager.cc:1434] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.081s	user 0.002s	sys 0.007s
I20260709 13:15:29.938038  5567 tablet_bootstrap.cc:492] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:29.944518  5567 tablet_bootstrap.cc:654] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:29.981213  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:29.985746  5769 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:29.988499  5769 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.988850  5769 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:29.967028  5449 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:29.993535  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:29.985342  5370 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:29.986413  5628 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:15:29.998477  5670 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:30.004364  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48701.1us
I20260709 13:15:30.001644  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:30.000459  5270 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.006585  5601 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.007072  5601 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:30.007833  5601 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.013160  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:30.021292  5570 tablet_bootstrap.cc:492] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:30.022334  5570 ts_tablet_manager.cc:1403] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.445s	user 0.015s	sys 0.004s
I20260709 13:15:30.018170  5598 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.025804  5570 raft_consensus.cc:359] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.026793  5570 raft_consensus.cc:385] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.027097  5570 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.027839  5570 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.037151  5567 tablet_bootstrap.cc:492] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:30.037753  5567 ts_tablet_manager.cc:1403] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.008s
I20260709 13:15:30.033658  5598 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:30.048246  5567 raft_consensus.cc:359] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.049135  5567 raft_consensus.cc:385] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.049481  5567 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.050866  5567 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.052388  5567 ts_tablet_manager.cc:1434] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:15:30.053359  5567 tablet_bootstrap.cc:492] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:30.049365  5598 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.054517  5769 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.065999  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:30.067771  5372 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.058802  5769 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.068620  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:30.083577  5523 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.100382  5568 tablet_bootstrap.cc:654] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.070875  5826 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:15:30.108397  5570 ts_tablet_manager.cc:1434] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.007s
I20260709 13:15:30.110350  5570 tablet_bootstrap.cc:492] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
W20260709 13:15:30.115301  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 72385.8us
I20260709 13:15:30.116043  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.114565  5523 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:30.119042  5767 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:30.118878  5490 leader_election.cc:343] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.120074  5767 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:30.123378  5767 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.132097  5567 tablet_bootstrap.cc:654] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.139771  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:15:30.139261  5490 leader_election.cc:343] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.169642  5837 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.171977  5837 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:30.179414  5570 tablet_bootstrap.cc:654] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.179931  5372 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:30.209208  5272 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.228364  5837 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.239825  5568 tablet_bootstrap.cc:492] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:30.240617  5568 ts_tablet_manager.cc:1403] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.305s	user 0.020s	sys 0.014s
I20260709 13:15:30.247467  5568 raft_consensus.cc:359] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.248991  5568 raft_consensus.cc:385] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.249547  5568 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.250643  5568 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.254211  5568 ts_tablet_manager.cc:1434] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:15:30.255764  5568 tablet_bootstrap.cc:492] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:30.256363  5567 tablet_bootstrap.cc:492] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:30.256858  5567 ts_tablet_manager.cc:1403] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.010s
I20260709 13:15:30.263377  5570 tablet_bootstrap.cc:492] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:30.263983  5570 ts_tablet_manager.cc:1403] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.154s	user 0.003s	sys 0.038s
I20260709 13:15:30.266884  5568 tablet_bootstrap.cc:654] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.266741  5567 raft_consensus.cc:359] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.267530  5567 raft_consensus.cc:385] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.267848  5567 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.270643  5567 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.271435  5570 raft_consensus.cc:359] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.272418  5570 raft_consensus.cc:385] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.272692  5570 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.273671  5567 ts_tablet_manager.cc:1434] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:15:30.275784  5567 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:30.276479  5273 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.277845  5273 catalog_manager.cc:5697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.283123  5449 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.286485  5568 tablet_bootstrap.cc:492] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:30.287145  5568 ts_tablet_manager.cc:1403] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.007s
I20260709 13:15:30.290912  5568 raft_consensus.cc:359] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.293329  5568 raft_consensus.cc:385] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.293157  5777 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.293884  5568 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.294724  5568 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.299319  5567 tablet_bootstrap.cc:654] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.300570  5272 catalog_manager.cc:5697] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.305182  5568 ts_tablet_manager.cc:1434] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:15:30.273381  5570 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.312157  5601 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.312667  5601 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.314661  5601 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:30.330403  5570 ts_tablet_manager.cc:1434] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 13:15:30.332050  5570 tablet_bootstrap.cc:492] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:30.332135  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:30.334957  5490 leader_election.cc:343] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.338779  5568 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:30.340619  5567 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:30.341148  5567 ts_tablet_manager.cc:1403] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.000s
I20260709 13:15:30.345889  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:30.347515  5489 leader_election.cc:343] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.350179  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.347719  5567 raft_consensus.cc:359] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.350700  5567 raft_consensus.cc:385] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.350827  5601 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.351380  5567 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.349395  5777 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:30.355962  5570 tablet_bootstrap.cc:654] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.359035  5601 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.359169  5567 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.359588  5601 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.365084  5601 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:30.367218  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:30.368148  5370 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 1: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:30.372915  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:30.379557  5567 ts_tablet_manager.cc:1434] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:15:30.381021  5567 tablet_bootstrap.cc:492] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:30.384747  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.385860  5601 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.385867  5568 tablet_bootstrap.cc:654] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.393013  5601 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.407416  5570 tablet_bootstrap.cc:492] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:30.407941  5570 ts_tablet_manager.cc:1403] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.006s
I20260709 13:15:30.408352  5568 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:30.408854  5568 ts_tablet_manager.cc:1403] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.004s
I20260709 13:15:30.410936  5570 raft_consensus.cc:359] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.411664  5570 raft_consensus.cc:385] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.411906  5570 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.412190  5568 raft_consensus.cc:359] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.412618  5570 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.413411  5848 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.414165  5848 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.415625  5567 tablet_bootstrap.cc:654] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.419277  5777 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.419852  5777 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.421229  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:30.421625  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:30.423388  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:30.423991  5340 leader_election.cc:343] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.424718  5848 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:30.424782  5339 leader_election.cc:343] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.425320  5777 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.412966  5568 raft_consensus.cc:385] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.426086  5568 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.426872  5570 ts_tablet_manager.cc:1434] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:15:30.426836  5568 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.429234  5522 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:30.429378  5568 ts_tablet_manager.cc:1434] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:15:30.429720  5777 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.430230  5777 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.431027  5568 tablet_bootstrap.cc:492] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:30.432392  5339 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.433343  5848 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.433924  5848 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.434304  5848 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.432777  5777 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.435946  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:30.437454  5339 leader_election.cc:343] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.426868  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:30.441807  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:30.442425  5445 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:30.444146  5570 tablet_bootstrap.cc:492] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:30.450557  5570 tablet_bootstrap.cc:654] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.451433  5848 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:30.454291  5340 leader_election.cc:343] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.454821  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.456072  5677 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.458491  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:30.460107  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:30.463387  5340 leader_election.cc:343] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.469334  5777 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.469878  5777 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.470280  5777 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.472540  5568 tablet_bootstrap.cc:654] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.474056  5848 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.486475  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:30.487490  5522 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.493273  5568 tablet_bootstrap.cc:492] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:30.494886  5568 ts_tablet_manager.cc:1403] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.011s
I20260709 13:15:30.497953  5568 raft_consensus.cc:359] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.498713  5568 raft_consensus.cc:385] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.498999  5568 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.499693  5568 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.500927  5601 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.501617  5568 ts_tablet_manager.cc:1434] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:30.502696  5568 tablet_bootstrap.cc:492] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:30.509486  5568 tablet_bootstrap.cc:654] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.522912  5568 tablet_bootstrap.cc:492] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:30.523406  5568 ts_tablet_manager.cc:1403] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
I20260709 13:15:30.596444  5848 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.597286  5848 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:30.553623  5490 consensus_peers.cc:597] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:30.601567  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48112.4us
I20260709 13:15:30.601881  5848 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.603775  5777 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.606874  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:30.607502  5449 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.609567  5568 raft_consensus.cc:359] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.610296  5568 raft_consensus.cc:385] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.610606  5568 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.611231  5568 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.611661  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:30.612417  5524 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:30.612856  5568 ts_tablet_manager.cc:1434] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.088s	user 0.012s	sys 0.001s
I20260709 13:15:30.613587  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:30.615137  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:30.616089  5848 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:30.616462  5848 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.616793  5848 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.613802  5568 tablet_bootstrap.cc:492] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
W20260709 13:15:30.624701  5340 leader_election.cc:343] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.629889  5522 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:30.631564  5339 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.631789  5848 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.632405  5677 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.632877  5677 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:30.633728  5677 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.637101  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:30.637820  5568 tablet_bootstrap.cc:654] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:30.638788  5340 leader_election.cc:343] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.643702  5449 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:30.651216  5567 tablet_bootstrap.cc:492] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:30.651526  5568 tablet_bootstrap.cc:492] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:30.651774  5567 ts_tablet_manager.cc:1403] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.271s	user 0.055s	sys 0.048s
I20260709 13:15:30.651921  5568 ts_tablet_manager.cc:1403] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.001s
I20260709 13:15:30.651324  5272 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.654471  5832 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:30.655540  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:30.660164  5677 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.660713  5677 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:30.661724  5837 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.663753  5568 raft_consensus.cc:359] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.664908  5568 raft_consensus.cc:385] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.665478  5568 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.670320  5568 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.662218  5777 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.644557  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:30.676455  5568 ts_tablet_manager.cc:1434] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:15:30.690766  5568 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:30.680413  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:30.691920  5524 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.681282  5447 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.671973  5567 raft_consensus.cc:359] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.694131  5567 raft_consensus.cc:385] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.694394  5567 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.686559  5677 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.682144  5521 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.670701  5848 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.708585  5767 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.711464  5570 tablet_bootstrap.cc:492] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:30.715902  5570 ts_tablet_manager.cc:1403] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.272s	user 0.017s	sys 0.016s
I20260709 13:15:30.717507  5767 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.718052  5767 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.718633  5570 raft_consensus.cc:359] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.719321  5570 raft_consensus.cc:385] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.719766  5570 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.721241  5767 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:30.721581  5570 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.721931  5767 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:30.723793  5570 ts_tablet_manager.cc:1434] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:30.724649  5837 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.725242  5837 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.726895  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:30.726080  5567 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.730036  5524 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:30.730762  5568 tablet_bootstrap.cc:654] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.735780  5837 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.735898  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:30.737092  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:30.737756  5767 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.732915  5490 leader_election.cc:343] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.755272  5570 tablet_bootstrap.cc:492] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:30.762220  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:30.775350  5567 ts_tablet_manager.cc:1434] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.123s	user 0.005s	sys 0.004s
I20260709 13:15:30.750361  5521 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:30.753468  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:30.765040  5767 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.783962  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.785727  5767 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:30.793959  5567 tablet_bootstrap.cc:492] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
W20260709 13:15:30.795329  5489 leader_election.cc:343] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.795675  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.792055  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:30.791913  5848 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:30.799357  5767 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:30.800665  5490 leader_election.cc:343] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.799660  5848 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:30.802374  5598 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.802203  5848 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.802909  5598 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.805102  5598 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.807956  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:30.810123  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:30.811017  5567 tablet_bootstrap.cc:654] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:30.811491  5489 leader_election.cc:343] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:30.811946  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:30.813601  5829 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.814222  5826 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:30.815996  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:30.818559  5521 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:30.820550  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:30.825366  5826 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:30.827082  5273 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.822472  5598 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:30.855849  5837 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:30.860105  5568 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:30.860611  5568 ts_tablet_manager.cc:1403] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.170s	user 0.006s	sys 0.013s
W20260709 13:15:30.853242  5401 tablet.cc:2406] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:30.873701  5568 raft_consensus.cc:359] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.881291  5568 raft_consensus.cc:385] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:30.879626  5570 tablet_bootstrap.cc:654] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:30.884054  5568 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:30.885402  5826 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:30.889690  5568 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.875900  5273 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.911535  5568 ts_tablet_manager.cc:1434] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 13:15:30.984627  5777 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.985220  5777 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:30.987802  5777 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:30.999897  5568 tablet_bootstrap.cc:492] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:31.020670  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.021130  5567 tablet_bootstrap.cc:492] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:31.021654  5567 ts_tablet_manager.cc:1403] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.240s	user 0.026s	sys 0.064s
W20260709 13:15:31.023746  5340 leader_election.cc:343] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:31.030213  5863 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:15:31.041217  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.041957  5522 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:31.047222  5567 raft_consensus.cc:359] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.048267  5567 raft_consensus.cc:385] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.050446  5567 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.056425  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.057390  5677 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.057821  5677 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.058162  5677 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.065073  5568 tablet_bootstrap.cc:654] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.063814  5567 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.069756  5567 ts_tablet_manager.cc:1434] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 13:15:31.071141  5567 tablet_bootstrap.cc:492] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:31.076239  5570 tablet_bootstrap.cc:492] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:31.076766  5570 ts_tablet_manager.cc:1403] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.322s	user 0.009s	sys 0.010s
W20260709 13:15:31.084681  5340 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.087038  5677 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.089044  5677 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.090261  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:31.093055  5777 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.096920  5777 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.099854  5777 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.100917  5772 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.101648  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.101488  5772 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.103889  5524 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:31.104477  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:31.105154  5370 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:31.106284  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:31.095219  5848 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:31.093315  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:15:31.106366  5340 leader_election.cc:343] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.095382  5570 raft_consensus.cc:359] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.107995  5642 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.108481  5522 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.108958  5772 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.108777  5570 raft_consensus.cc:385] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.109261  5642 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.109532  5570 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.109714  5642 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.114001  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.114413  5570 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:31.115878  5340 leader_election.cc:343] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.118031  5567 tablet_bootstrap.cc:654] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.118723  5642 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.122212  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:31.131181  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:31.132336  5777 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.132395  5848 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:31.132860  5777 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.133246  5777 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.124069  5570 ts_tablet_manager.cc:1434] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:15:31.136119  5642 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.128026  5568 tablet_bootstrap.cc:492] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:31.147061  5568 ts_tablet_manager.cc:1403] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.150s	user 0.007s	sys 0.013s
I20260709 13:15:31.126812  5522 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:31.144232  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.145046  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:31.149204  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:31.156411  5777 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.139467  5570 tablet_bootstrap.cc:492] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:31.157768  5370 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 1: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:31.162119  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.163427  5848 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.163931  5848 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:31.164803  5848 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:31.172302  5489 leader_election.cc:343] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.168519  5568 raft_consensus.cc:359] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.173070  5568 raft_consensus.cc:385] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:31.176792  5489 leader_election.cc:343] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.173215  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.194867  5767 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.196173  5777 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.197453  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:31.198058  5567 tablet_bootstrap.cc:492] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:31.198516  5567 ts_tablet_manager.cc:1403] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.001s
I20260709 13:15:31.196442  5568 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.199936  5568 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.202315  5568 ts_tablet_manager.cc:1434] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.055s	user 0.017s	sys 0.004s
I20260709 13:15:31.203284  5568 tablet_bootstrap.cc:492] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
W20260709 13:15:31.204303  5340 leader_election.cc:343] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.205399  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:31.206547  5522 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 1: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:31.213124  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.216624  5777 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.217654  5570 tablet_bootstrap.cc:654] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.215631  5567 raft_consensus.cc:359] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.220379  5567 raft_consensus.cc:385] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.220696  5567 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.221741  5567 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.223838  5567 ts_tablet_manager.cc:1434] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.001s
I20260709 13:15:31.225957  5567 tablet_bootstrap.cc:492] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:31.227435  5272 catalog_manager.cc:5697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.244367  5567 tablet_bootstrap.cc:654] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.254622  5570 tablet_bootstrap.cc:492] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:31.255155  5570 ts_tablet_manager.cc:1403] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.010s
I20260709 13:15:31.255770  5568 tablet_bootstrap.cc:654] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.267886  5567 tablet_bootstrap.cc:492] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:31.268481  5567 ts_tablet_manager.cc:1403] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.009s
I20260709 13:15:31.270166  5570 raft_consensus.cc:359] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.270903  5570 raft_consensus.cc:385] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.271153  5567 raft_consensus.cc:359] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.271802  5567 raft_consensus.cc:385] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.272038  5567 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.272652  5567 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.274688  5567 ts_tablet_manager.cc:1434] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:31.275781  5567 tablet_bootstrap.cc:492] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:31.271175  5570 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.278294  5570 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.280800  5570 ts_tablet_manager.cc:1434] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:15:31.281466  5848 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:31.283116  5568 tablet_bootstrap.cc:492] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:31.285117  5642 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.285960  5642 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.286710  5570 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:31.288009  5642 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.285977  5568 ts_tablet_manager.cc:1403] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.000s
I20260709 13:15:31.293560  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:31.294981  5489 leader_election.cc:343] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.295624  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:31.296187  5568 raft_consensus.cc:359] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:31.296912  5490 leader_election.cc:343] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.297188  5568 raft_consensus.cc:385] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.297539  5568 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.297394  5490 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.298482  5568 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.301194  5836 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.304960  5567 tablet_bootstrap.cc:654] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.308717  5568 ts_tablet_manager.cc:1434] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:31.310288  5570 tablet_bootstrap.cc:654] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.320050  5568 tablet_bootstrap.cc:492] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:31.330751  5848 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.336937  5848 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.338142  5570 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:31.338647  5570 ts_tablet_manager.cc:1403] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.002s
I20260709 13:15:31.339313  5848 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.346319  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.347049  5568 tablet_bootstrap.cc:654] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:31.350981  5340 leader_election.cc:343] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.351837  5567 tablet_bootstrap.cc:492] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:31.352392  5567 ts_tablet_manager.cc:1403] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.003s
I20260709 13:15:31.356040  5567 raft_consensus.cc:359] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.356890  5567 raft_consensus.cc:385] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.357154  5567 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.349598  5570 raft_consensus.cc:359] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.357658  5570 raft_consensus.cc:385] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.357930  5570 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.357286  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.365808  5523 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:31.358618  5570 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.367542  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.368464  5570 ts_tablet_manager.cc:1434] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:15:31.369005  5677 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.369552  5677 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.370112  5677 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.359899  5567 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.373967  5567 ts_tablet_manager.cc:1434] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:15:31.374956  5567 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:31.378989  5848 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.379479  5570 tablet_bootstrap.cc:492] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:31.379568  5848 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.387209  5568 tablet_bootstrap.cc:492] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:31.387861  5568 ts_tablet_manager.cc:1403] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.007s
I20260709 13:15:31.390203  5848 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.390733  5568 raft_consensus.cc:359] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.391458  5568 raft_consensus.cc:385] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.391518  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.391777  5568 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
W20260709 13:15:31.393281  5340 leader_election.cc:343] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.396296  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.397399  5570 tablet_bootstrap.cc:654] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:31.398365  5339 leader_election.cc:343] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.398885  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.399825  5627 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.398985  5848 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:31.401558  5568 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.402554  5567 tablet_bootstrap.cc:654] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.408380  5677 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.411705  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:31.411163  5568 ts_tablet_manager.cc:1434] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:15:31.413695  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:31.414093  5568 tablet_bootstrap.cc:492] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:31.414431  5524 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.416559  5836 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.417110  5836 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:31.422602  5340 leader_election.cc:343] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.425659  5836 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.425855  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:31.428431  5490 leader_election.cc:343] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.429538  5642 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.430104  5642 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.431515  5777 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:31.432082  5642 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.433785  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.434582  5524 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:31.434902  5570 tablet_bootstrap.cc:492] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:31.435140  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.435397  5570 ts_tablet_manager.cc:1403] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.000s
I20260709 13:15:31.435875  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.436767  5848 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:31.436829  5489 leader_election.cc:343] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:31.437686  5489 leader_election.cc:343] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.437297  5848 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:31.438387  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.439610  5848 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.424664  5677 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.443138  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:31.443799  5373 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:31.455334  5568 tablet_bootstrap.cc:654] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.455627  5836 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.463096  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.464677  5772 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.465062  5772 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.465400  5772 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.469110  5767 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.469945  5767 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.471834  5570 raft_consensus.cc:359] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.472553  5570 raft_consensus.cc:385] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.472822  5570 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.473297  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:31.473608  5570 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.474799  5767 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.474916  5370 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:31.476538  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:31.481946  5767 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.482532  5767 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.482972  5767 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.486281  5832 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.493857  5832 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.496819  5570 ts_tablet_manager.cc:1434] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:15:31.498239  5567 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:31.498857  5567 ts_tablet_manager.cc:1403] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.124s	user 0.007s	sys 0.014s
I20260709 13:15:31.512342  5570 tablet_bootstrap.cc:492] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:31.512646  5449 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.534462  5570 tablet_bootstrap.cc:654] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.538335  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.539055  5445 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:31.543653  5772 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.545461  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:31.545706  5826 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.548559  5767 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.553184  5826 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.555251  5826 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.555775  5567 raft_consensus.cc:359] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.555814  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:31.556548  5567 raft_consensus.cc:385] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.556726  5370 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.556882  5567 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.557211  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.558138  5524 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:31.561890  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:31.565311  5448 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.566627  5370 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:31.564863  5567 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.566979  5772 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.569751  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:31.569751  5567 ts_tablet_manager.cc:1434] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:15:31.570894  5272 catalog_manager.cc:5697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.585637  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:31.586606  5373 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.587106  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:31.588845  5598 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.596454  5598 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.601642  5567 tablet_bootstrap.cc:492] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:31.579927  5772 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.611006  5772 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:31.612061  5772 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.619515  5568 tablet_bootstrap.cc:492] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:31.620036  5568 ts_tablet_manager.cc:1403] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.206s	user 0.016s	sys 0.013s
I20260709 13:15:31.631786  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:31.633690  5567 tablet_bootstrap.cc:654] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.620323  5767 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.643033  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:31.644004  5445 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.637887  5848 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:31.651021  5489 leader_election.cc:343] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.653847  5832 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.655030  5373 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:31.655522  5568 raft_consensus.cc:359] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.659188  5568 raft_consensus.cc:385] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.659492  5568 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.648415  5848 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.656482  5570 tablet_bootstrap.cc:492] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:31.662781  5570 ts_tablet_manager.cc:1403] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.025s
I20260709 13:15:31.657996  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.667879  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:31.669234  5826 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.670166  5848 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.661165  5568 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.672554  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:31.673341  5772 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.674069  5772 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:31.674885  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.674958  5772 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.671085  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.679783  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.681478  5848 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.684239  5570 raft_consensus.cc:359] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.685233  5570 raft_consensus.cc:385] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.685587  5570 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.686681  5570 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.687575  5568 ts_tablet_manager.cc:1434] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:15:31.688786  5568 tablet_bootstrap.cc:492] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:31.692314  5570 ts_tablet_manager.cc:1434] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:15:31.693524  5570 tablet_bootstrap.cc:492] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:31.685374  5445 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:31.700125  5272 catalog_manager.cc:5697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:31.714617  5567 tablet_bootstrap.cc:492] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:31.715164  5567 ts_tablet_manager.cc:1403] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.117s	user 0.023s	sys 0.010s
I20260709 13:15:31.716271  5568 tablet_bootstrap.cc:654] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.719084  5567 raft_consensus.cc:359] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.720019  5570 tablet_bootstrap.cc:654] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.719843  5567 raft_consensus.cc:385] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.720419  5567 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.721221  5567 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.722162  5373 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.725867  5567 ts_tablet_manager.cc:1434] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 13:15:31.737888  5340 consensus_peers.cc:597] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.727123  5567 tablet_bootstrap.cc:492] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:31.764185  5848 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.768285  5848 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.774133  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.775044  5523 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:31.774134  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.783326  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:31.783852  5772 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.785445  5272 catalog_manager.cc:5697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:31.793944  5777 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.782516  5848 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.812505  5777 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.813086  5777 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.784502  5772 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:31.805699  5340 leader_election.cc:343] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:31.864851  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56142.6us
I20260709 13:15:31.865446  5568 tablet_bootstrap.cc:492] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:31.865995  5568 ts_tablet_manager.cc:1403] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.030s
I20260709 13:15:31.870857  5568 raft_consensus.cc:359] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.871595  5568 raft_consensus.cc:385] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.871860  5568 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.873616  5568 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.878275  5570 tablet_bootstrap.cc:492] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:31.877966  5627 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:31.878803  5570 ts_tablet_manager.cc:1403] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.186s	user 0.009s	sys 0.030s
I20260709 13:15:31.882090  5772 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.884373  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:31.885281  5370 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:31.887169  5570 raft_consensus.cc:359] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.887957  5570 raft_consensus.cc:385] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:31.888285  5570 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:31.888796  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:31.892037  5891 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:31.893656  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:31.901970  5570 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.892598  5891 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.903723  5891 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.903992  5832 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.904515  5832 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.904678  5449 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:31.906876  5832 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.908701  5568 ts_tablet_manager.cc:1434] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:15:31.911710  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:31.912600  5372 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:31.881536  5777 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.918211  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:31.918992  5523 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:31.921229  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:31.921977  5567 tablet_bootstrap.cc:654] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.922753  5837 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.927004  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:31.930126  5340 leader_election.cc:343] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:31.931092  5570 ts_tablet_manager.cc:1434] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:15:31.932642  5568 tablet_bootstrap.cc:492] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:31.932709  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:31.933329  5523 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.933568  5777 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:31.940567  5570 tablet_bootstrap.cc:492] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:31.955816  5523 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:31.961573  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:31.963265  5777 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:31.963842  5777 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:31.966123  5567 tablet_bootstrap.cc:492] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:31.967715  5567 ts_tablet_manager.cc:1403] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.241s	user 0.014s	sys 0.009s
I20260709 13:15:31.968657  5777 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.970809  5837 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:31.975097  5568 tablet_bootstrap.cc:654] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.964278  5891 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:31.981858  5891 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:31.988972  5677 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:31.993345  5570 tablet_bootstrap.cc:654] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:31.993942  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:31.994630  5373 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.995839  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:31.996520  5449 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:31.998647  5570 tablet_bootstrap.cc:492] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:31.999136  5570 ts_tablet_manager.cc:1403] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.005s
I20260709 13:15:32.001924  5570 raft_consensus.cc:359] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.002166  5567 raft_consensus.cc:359] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.002787  5570 raft_consensus.cc:385] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.002864  5567 raft_consensus.cc:385] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.003149  5570 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.003237  5567 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.003949  5570 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.006135  5570 ts_tablet_manager.cc:1434] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:32.006547  5373 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:32.007061  5570 tablet_bootstrap.cc:492] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:32.008129  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:32.007252  5567 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.009040  5891 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.009598  5891 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:32.010792  5891 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.014530  5567 ts_tablet_manager.cc:1434] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:15:32.016981  5826 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.017549  5826 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.018996  5570 tablet_bootstrap.cc:654] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.020689  5826 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.026775  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:32.040266  5570 tablet_bootstrap.cc:492] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:32.041034  5570 ts_tablet_manager.cc:1403] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.005s
I20260709 13:15:32.041472  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:32.042919  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:32.044252  5837 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.044381  5570 raft_consensus.cc:359] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.045159  5570 raft_consensus.cc:385] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.045476  5570 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.046319  5570 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.048471  5570 ts_tablet_manager.cc:1434] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:32.049412  5570 tablet_bootstrap.cc:492] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:32.049590  5271 catalog_manager.cc:5697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.056003  5570 tablet_bootstrap.cc:654] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.036747  5449 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:32.056098  5567 tablet_bootstrap.cc:492] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:32.055953  5272 catalog_manager.cc:5697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:32.070003  5848 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.093832  5891 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.079632  5567 tablet_bootstrap.cc:654] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.100288  5570 tablet_bootstrap.cc:492] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:32.100809  5570 ts_tablet_manager.cc:1403] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.035s
I20260709 13:15:32.103999  5570 raft_consensus.cc:359] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.104873  5570 raft_consensus.cc:385] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.105194  5570 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.106076  5570 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.109006  5891 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.115063  5570 ts_tablet_manager.cc:1434] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:15:32.116711  5570 tablet_bootstrap.cc:492] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:32.120496  5767 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.121034  5767 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.123493  5767 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:32.123718  5570 tablet_bootstrap.cc:654] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.126139  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:32.126375  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:32.128103  5490 leader_election.cc:343] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:32.132305  5489 leader_election.cc:343] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.132750  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:32.134858  5767 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.141598  5449 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.153184  5772 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:32.170517  5772 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.197594  5837 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.198329  5837 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.204281  5837 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.222978  5448 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.226706  5568 tablet_bootstrap.cc:492] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:32.205538  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:32.196872  5567 tablet_bootstrap.cc:492] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:32.232215  5567 ts_tablet_manager.cc:1403] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.187s	user 0.009s	sys 0.006s
I20260709 13:15:32.235455  5567 raft_consensus.cc:359] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.227360  5568 ts_tablet_manager.cc:1403] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.306s	user 0.024s	sys 0.011s
I20260709 13:15:32.238219  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:32.286250  5523 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:32.288383  5568 raft_consensus.cc:359] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.289147  5568 raft_consensus.cc:385] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.293231  5568 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.293751  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:32.294062  5568 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.296386  5568 ts_tablet_manager.cc:1434] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:15:32.297531  5567 raft_consensus.cc:385] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.297747  5837 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.303993  5570 tablet_bootstrap.cc:492] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:32.304550  5570 ts_tablet_manager.cc:1403] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.188s	user 0.057s	sys 0.114s
I20260709 13:15:32.307345  5570 raft_consensus.cc:359] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.308109  5570 raft_consensus.cc:385] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.297888  5567 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.310326  5837 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.310187  5567 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.314810  5567 ts_tablet_manager.cc:1434] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.000s
I20260709 13:15:32.315883  5567 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:32.319519  5568 tablet_bootstrap.cc:492] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:32.308389  5570 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.328393  5567 tablet_bootstrap.cc:654] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.320806  5570 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.338230  5570 ts_tablet_manager.cc:1434] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 13:15:32.339257  5570 tablet_bootstrap.cc:492] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:32.345706  5570 tablet_bootstrap.cc:654] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.335848  5568 tablet_bootstrap.cc:654] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.362326  5570 tablet_bootstrap.cc:492] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:32.363906  5570 ts_tablet_manager.cc:1403] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.008s
W20260709 13:15:32.372037  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:32.376497  5567 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:32.381961  5568 tablet_bootstrap.cc:492] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:32.382555  5567 ts_tablet_manager.cc:1403] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.002s
I20260709 13:15:32.382615  5568 ts_tablet_manager.cc:1403] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.007s
I20260709 13:15:32.389691  5568 raft_consensus.cc:359] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.390426  5568 raft_consensus.cc:385] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.390751  5568 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.391510  5568 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.392886  5570 raft_consensus.cc:359] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.393579  5570 raft_consensus.cc:385] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.398653  5570 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.397797  5567 raft_consensus.cc:359] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.399746  5567 raft_consensus.cc:385] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.401149  5567 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.401458  5772 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.402611  5567 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.414497  5568 ts_tablet_manager.cc:1434] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:15:32.400291  5570 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.416728  5567 ts_tablet_manager.cc:1434] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:15:32.420148  5567 tablet_bootstrap.cc:492] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:32.423900  5777 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.447635  5777 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.450665  5777 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.425107  5677 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:32.452519  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:32.453215  5523 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:32.426610  5570 ts_tablet_manager.cc:1434] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.003s
I20260709 13:15:32.427167  5568 tablet_bootstrap.cc:492] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:32.440438  5836 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:32.455974  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:32.462165  5891 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.483183  5891 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.460274  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:32.474613  5570 tablet_bootstrap.cc:492] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:32.490866  5567 tablet_bootstrap.cc:654] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.485392  5891 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:32.503468  5340 leader_election.cc:343] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.509253  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:32.492898  5777 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.516256  5777 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.517194  5568 tablet_bootstrap.cc:654] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.516641  5777 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.516526  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:32.520313  5570 tablet_bootstrap.cc:654] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:32.520753  5489 leader_election.cc:343] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.532651  5627 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:32.534847  5777 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:32.537866  5490 leader_election.cc:343] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.538412  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:32.539376  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:32.541368  5340 leader_election.cc:343] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.544818  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:32.545554  5523 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.555765  5568 tablet_bootstrap.cc:492] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:32.556319  5568 ts_tablet_manager.cc:1403] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.130s	user 0.024s	sys 0.008s
I20260709 13:15:32.561969  5567 tablet_bootstrap.cc:492] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:32.562544  5567 ts_tablet_manager.cc:1403] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.012s
I20260709 13:15:32.564821  5836 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.568322  5777 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.570891  5568 raft_consensus.cc:359] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.571607  5568 raft_consensus.cc:385] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.571880  5568 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.574332  5567 raft_consensus.cc:359] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.577135  5567 raft_consensus.cc:385] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.577906  5568 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.580333  5567 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.585719  5567 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.587440  5567 ts_tablet_manager.cc:1434] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:15:32.587761  5523 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:32.589236  5568 ts_tablet_manager.cc:1434] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:15:32.591293  5568 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:32.591468  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:32.594451  5848 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.595112  5848 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:32.595597  5567 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:32.596021  5848 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.601194  5837 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.601790  5837 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.604080  5837 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.608086  5568 tablet_bootstrap.cc:654] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.612180  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:32.613821  5521 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:32.612979  5567 tablet_bootstrap.cc:654] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.615629  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:32.617260  5826 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.617671  5826 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.618023  5826 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.621246  5568 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:32.621750  5568 ts_tablet_manager.cc:1403] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:15:32.624485  5777 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.624436  5568 raft_consensus.cc:359] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.625533  5568 raft_consensus.cc:385] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.625248  5777 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.625993  5568 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.626281  5570 tablet_bootstrap.cc:492] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:32.626754  5570 ts_tablet_manager.cc:1403] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.020s
I20260709 13:15:32.630573  5777 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.633716  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:32.634138  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:32.634652  5374 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:32.631228  5570 raft_consensus.cc:359] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.636212  5570 raft_consensus.cc:385] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.636643  5570 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.631629  5826 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.637492  5570 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.626756  5568 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.639765  5568 ts_tablet_manager.cc:1434] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:15:32.640791  5568 tablet_bootstrap.cc:492] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:32.640908  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:32.641454  5523 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:32.641587  5521 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.642200  5826 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.632133  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:32.651998  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:32.652665  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:32.660697  5340 leader_election.cc:343] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.661571  5777 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.661944  5777 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.662333  5777 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.655042  5570 ts_tablet_manager.cc:1434] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:15:32.659188  5374 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.667258  5521 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:32.668709  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:32.669534  5832 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.670001  5832 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:32.670782  5832 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.672047  5777 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.673341  5570 tablet_bootstrap.cc:492] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:32.675910  5848 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.676410  5848 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.702651  5837 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.703419  5837 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.743602  5777 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.748618  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:32.751238  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:32.751924  5521 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.752640  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:32.754946  5568 tablet_bootstrap.cc:654] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.756776  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:32.757731  5522 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
W20260709 13:15:32.758836  5340 leader_election.cc:343] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:32.759913  5340 leader_election.cc:343] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.762286  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:32.763381  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:32.763582  5826 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:32.764266  5826 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.764770  5826 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:32.766809  5339 leader_election.cc:343] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.767298  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:32.768316  5777 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.753131  5848 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.783906  5767 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.784466  5767 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.778273  5837 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.805263  5567 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:32.805850  5567 ts_tablet_manager.cc:1403] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.210s	user 0.018s	sys 0.008s
I20260709 13:15:32.808966  5374 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:32.811264  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:32.812992  5767 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:32.817344  5489 leader_election.cc:343] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.829381  5570 tablet_bootstrap.cc:654] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.821211  5271 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.835770  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:32.840641  5416 leader_election.cc:343] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.839726  5521 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:32.845520  5826 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.846601  5568 tablet_bootstrap.cc:492] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:32.853883  5568 ts_tablet_manager.cc:1403] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.213s	user 0.028s	sys 0.034s
I20260709 13:15:32.846342  5567 raft_consensus.cc:359] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.847182  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:32.854473  5567 raft_consensus.cc:385] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.848567  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:32.854786  5567 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.855202  5848 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.855731  5848 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:32.856547  5848 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.860140  5826 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.861115  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:32.861775  5521 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.861202  5567 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.864097  5567 ts_tablet_manager.cc:1434] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:15:32.860635  5568 raft_consensus.cc:359] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.866044  5568 raft_consensus.cc:385] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.866389  5567 tablet_bootstrap.cc:492] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:32.865643  5272 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.872220  5568 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.880498  5826 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.881246  5826 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.885316  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:32.886009  5524 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:32.886936  5567 tablet_bootstrap.cc:654] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.887285  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:32.873246  5568 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.888695  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:32.889405  5826 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.889528  5931 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:32.891173  5416 leader_election.cc:343] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.890520  5931 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.897881  5931 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.898567  5568 ts_tablet_manager.cc:1434] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.044s	user 0.000s	sys 0.007s
W20260709 13:15:32.891003  5490 leader_election.cc:343] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.899461  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:32.900771  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:32.908291  5568 tablet_bootstrap.cc:492] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
W20260709 13:15:32.907830  5416 leader_election.cc:343] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.911114  5521 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:32.918465  5932 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:32.934450  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:32.935626  5832 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.936200  5832 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:32.937072  5832 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.921741  5931 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.923288  5570 tablet_bootstrap.cc:492] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:32.942917  5570 ts_tablet_manager.cc:1403] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.270s	user 0.012s	sys 0.028s
I20260709 13:15:32.944435  5567 tablet_bootstrap.cc:492] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:32.944972  5567 ts_tablet_manager.cc:1403] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.014s
I20260709 13:15:32.950814  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:32.951433  5521 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.957779  5570 raft_consensus.cc:359] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.958592  5570 raft_consensus.cc:385] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.958885  5570 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.960245  5570 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.962482  5570 ts_tablet_manager.cc:1434] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:15:32.963114  5521 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:32.963527  5570 tablet_bootstrap.cc:492] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:32.964066  5931 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:32.964143  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:32.930089  5568 tablet_bootstrap.cc:654] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.964969  5931 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.966056  5931 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:32.967037  5567 raft_consensus.cc:359] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.967965  5567 raft_consensus.cc:385] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.968341  5567 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.968014  5931 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.970712  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:32.971753  5567 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:32.975494  5567 ts_tablet_manager.cc:1434] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.002s
I20260709 13:15:32.978528  5567 tablet_bootstrap.cc:492] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
W20260709 13:15:32.978881  5416 leader_election.cc:343] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:32.999826  5568 tablet_bootstrap.cc:492] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:33.000313  5568 ts_tablet_manager.cc:1403] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.002s
I20260709 13:15:33.000833  5567 tablet_bootstrap.cc:654] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.006340  5568 raft_consensus.cc:359] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.007084  5568 raft_consensus.cc:385] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.007360  5568 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.008054  5568 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.010181  5568 ts_tablet_manager.cc:1434] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:33.011179  5568 tablet_bootstrap.cc:492] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:33.022579  5570 tablet_bootstrap.cc:654] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.041653  5627 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:33.059928  5627 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.064117  5627 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.068699  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:33.070271  5340 leader_election.cc:343] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.074482  5627 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.075292  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:33.078581  5524 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:33.079970  5339 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.088542  5777 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.089002  5777 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.089316  5777 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.090509  5826 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.090883  5568 tablet_bootstrap.cc:654] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.097309  5777 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.101579  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:33.103188  5340 leader_election.cc:343] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.104774  5777 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.106469  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:33.107455  5523 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.116273  5449 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.116611  5933 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.117053  5933 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.119297  5933 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:33.120572  5777 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.121065  5777 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.123689  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:33.124342  5445 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:33.124888  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:33.125304  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:33.125555  5521 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:33.126675  5848 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:33.126992  5777 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.127068  5848 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.127543  5848 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.128731  5523 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:33.135883  5339 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.135975  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:33.137346  5848 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.139235  5777 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.139786  5777 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:33.140496  5777 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.148453  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:33.149088  5445 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.150300  5568 tablet_bootstrap.cc:492] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
W20260709 13:15:33.150303  5490 leader_election.cc:343] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.150967  5568 ts_tablet_manager.cc:1403] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.005s
I20260709 13:15:33.153155  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:33.080833  5272 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:33.162205  5489 leader_election.cc:343] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.162685  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.163405  5933 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.168509  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:33.169157  5524 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.177940  5524 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:33.179425  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:33.181557  5627 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:33.182060  5627 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:33.182865  5627 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.183177  5568 raft_consensus.cc:359] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.184360  5568 raft_consensus.cc:385] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.184723  5568 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.188984  5848 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.189299  5826 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.194957  5955 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.205960  5568 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.212955  5570 tablet_bootstrap.cc:492] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:33.213603  5570 ts_tablet_manager.cc:1403] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.250s	user 0.018s	sys 0.057s
I20260709 13:15:33.217926  5570 raft_consensus.cc:359] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.218348  5273 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.220852  5570 raft_consensus.cc:385] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.221203  5570 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.222090  5570 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.223629  5570 ts_tablet_manager.cc:1434] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:33.223685  5568 ts_tablet_manager.cc:1434] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:15:33.231335  5570 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:33.231787  5273 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.217124  5445 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:33.238590  5570 tablet_bootstrap.cc:654] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.243009  5932 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.243762  5932 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.248378  5932 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:33.249272  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:33.250391  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:33.251276  5490 leader_election.cc:343] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.252393  5568 tablet_bootstrap.cc:492] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
W20260709 13:15:33.254833  5489 leader_election.cc:343] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.255327  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.257265  5935 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.260429  5567 tablet_bootstrap.cc:492] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:33.260955  5567 ts_tablet_manager.cc:1403] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.283s	user 0.068s	sys 0.054s
I20260709 13:15:33.267271  5567 raft_consensus.cc:359] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.268501  5567 raft_consensus.cc:385] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.268860  5567 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.269712  5567 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.276335  5272 catalog_manager.cc:5697] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 2, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.278455  5272 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.280618  5567 ts_tablet_manager.cc:1434] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:15:33.281749  5567 tablet_bootstrap.cc:492] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:33.289109  5567 tablet_bootstrap.cc:654] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.291421  5568 tablet_bootstrap.cc:654] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.315276  5570 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:33.315810  5570 ts_tablet_manager.cc:1403] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.006s
I20260709 13:15:33.318779  5570 raft_consensus.cc:359] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.319484  5570 raft_consensus.cc:385] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.319744  5570 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.320771  5935 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.321038  5570 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.321256  5935 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.324134  5570 ts_tablet_manager.cc:1434] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:33.325130  5570 tablet_bootstrap.cc:492] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:33.325789  5935 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:33.327018  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:33.336755  5489 leader_election.cc:343] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.332249  5570 tablet_bootstrap.cc:654] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.333400  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:33.334777  5375 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.338060  5373 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:33.343600  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.344550  5932 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.344921  5932 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.345304  5932 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.362075  5848 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:33.368017  5570 tablet_bootstrap.cc:492] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:33.368542  5570 ts_tablet_manager.cc:1403] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.006s
I20260709 13:15:33.371357  5570 raft_consensus.cc:359] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.372344  5570 raft_consensus.cc:385] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.372635  5570 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.373361  5570 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.376984  5570 ts_tablet_manager.cc:1434] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:33.381122  5627 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.381632  5627 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.380061  5570 tablet_bootstrap.cc:492] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:33.386754  5627 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.388532  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:33.390161  5340 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:33.391803  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:33.392494  5523 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:33.393299  5570 tablet_bootstrap.cc:654] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.394104  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.395118  5627 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:33.395550  5627 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.395941  5627 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.400075  5832 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:33.394834  5568 tablet_bootstrap.cc:492] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:33.401700  5826 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:33.408582  5568 ts_tablet_manager.cc:1403] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.161s	user 0.010s	sys 0.006s
I20260709 13:15:33.412638  5932 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.416422  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:33.417047  5372 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.424189  5372 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:33.428726  5627 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.432351  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:33.433393  5935 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.434020  5935 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:33.434499  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:33.434868  5935 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.437266  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:33.438911  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.439648  5375 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:33.440754  5848 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:33.441262  5627 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.442369  5568 raft_consensus.cc:359] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.443223  5568 raft_consensus.cc:385] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.443519  5568 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.443410  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:33.444615  5568 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:33.446117  5489 leader_election.cc:343] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.428747  5567 tablet_bootstrap.cc:492] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:33.447602  5567 ts_tablet_manager.cc:1403] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.166s	user 0.038s	sys 0.054s
I20260709 13:15:33.451972  5832 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:33.452916  5832 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:33.453267  5832 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:33.454823  5832 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.456005  5832 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.456405  5568 ts_tablet_manager.cc:1434] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.003s
I20260709 13:15:33.457531  5568 tablet_bootstrap.cc:492] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:33.458910  5567 raft_consensus.cc:359] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.462978  5567 raft_consensus.cc:385] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.463264  5570 tablet_bootstrap.cc:492] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:33.463843  5570 ts_tablet_manager.cc:1403] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.009s
I20260709 13:15:33.463358  5567 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.464836  5567 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.466792  5570 raft_consensus.cc:359] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.467502  5570 raft_consensus.cc:385] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.467778  5570 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.468397  5570 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.467151  5567 ts_tablet_manager.cc:1434] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:15:33.470728  5567 tablet_bootstrap.cc:492] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:33.476332  5848 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.476893  5848 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.479202  5848 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.487547  5570 ts_tablet_manager.cc:1434] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:15:33.488626  5570 tablet_bootstrap.cc:492] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:33.489506  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:33.490190  5445 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:33.492962  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:33.489748  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:33.494288  5777 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.496080  5777 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.496419  5777 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.506691  5570 tablet_bootstrap.cc:654] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.507220  5524 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:33.509343  5932 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:33.526134  5955 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.526798  5955 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.529227  5955 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.530117  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:33.531085  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:33.534885  5524 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 1: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:33.536442  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.537547  5848 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.513295  5567 tablet_bootstrap.cc:654] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.553960  5826 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.533905  5777 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.557058  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:33.557823  5521 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.559389  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:33.560029  5445 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.566128  5570 tablet_bootstrap.cc:492] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:33.567011  5570 ts_tablet_manager.cc:1403] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.003s
I20260709 13:15:33.570993  5570 raft_consensus.cc:359] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.571728  5570 raft_consensus.cc:385] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.572095  5570 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.572315  5848 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.573287  5570 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:33.575707  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:33.591132  5570 ts_tablet_manager.cc:1434] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:15:33.592152  5570 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:33.571602  5445 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:33.579423  5568 tablet_bootstrap.cc:654] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.582835  5269 catalog_manager.cc:5697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:33.586524  5449 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:33.587919  5777 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.588591  5448 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.602151  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:33.604355  5932 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.604967  5932 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.612746  5568 tablet_bootstrap.cc:492] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:33.613314  5568 ts_tablet_manager.cc:1403] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.001s
I20260709 13:15:33.615381  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:33.615978  5568 raft_consensus.cc:359] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.616676  5568 raft_consensus.cc:385] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:33.616853  5490 leader_election.cc:343] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.617789  5932 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:33.618093  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:33.618583  5777 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:33.619313  5489 leader_election.cc:343] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.619745  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.620776  5932 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.616951  5568 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.621250  5777 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.623258  5568 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.625787  5826 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.606220  5848 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.626355  5826 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.601444  5521 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:33.627622  5848 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:33.629371  5848 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.629748  5826 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.630554  5826 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.631379  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:33.631996  5521 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:33.633077  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:33.633875  5931 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.634040  5570 tablet_bootstrap.cc:654] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.634243  5931 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.634656  5931 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.636878  5567 tablet_bootstrap.cc:492] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:33.637439  5567 ts_tablet_manager.cc:1403] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.167s	user 0.011s	sys 0.001s
I20260709 13:15:33.650727  5568 ts_tablet_manager.cc:1434] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.001s
I20260709 13:15:33.652200  5568 tablet_bootstrap.cc:492] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:33.649288  5567 raft_consensus.cc:359] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.655009  5567 raft_consensus.cc:385] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.655350  5567 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.656134  5567 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.659536  5570 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:33.660105  5570 ts_tablet_manager.cc:1403] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.001s
I20260709 13:15:33.664775  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:33.648244  5931 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.670889  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:33.671542  5521 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.687579  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:15:33.689603  5416 leader_election.cc:343] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.691020  5524 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:33.692428  5837 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.688381  5931 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.692943  5837 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:33.693357  5416 leader_election.cc:343] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.695314  5777 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.694864  5521 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:33.698383  5570 raft_consensus.cc:359] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.699120  5570 raft_consensus.cc:385] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.699406  5570 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.700752  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:33.700047  5570 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.704211  5931 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.704730  5931 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:33.706884  5931 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.707923  5837 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.708796  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:33.709635  5372 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 1: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:33.711342  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:33.712926  5567 ts_tablet_manager.cc:1434] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:15:33.714699  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:33.715369  5570 ts_tablet_manager.cc:1434] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 13:15:33.716033  5832 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.719424  5270 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.723901  5568 tablet_bootstrap.cc:654] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.730144  5848 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:33.739526  5567 tablet_bootstrap.cc:492] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:33.740455  5570 tablet_bootstrap.cc:492] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:33.752143  5837 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.752889  5837 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.757786  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:33.759610  5414 leader_election.cc:343] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:33.784269  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57760.5us
I20260709 13:15:33.787485  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:33.788164  5372 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:33.763101  5837 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.792977  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:33.793485  5567 tablet_bootstrap.cc:654] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.797464  5837 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.802788  5837 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.803275  5837 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.824920  5273 catalog_manager.cc:5697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.824077  5832 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.830264  5570 tablet_bootstrap.cc:654] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.850345  5568 tablet_bootstrap.cc:492] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:33.850874  5568 ts_tablet_manager.cc:1403] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.199s	user 0.020s	sys 0.001s
I20260709 13:15:33.877225  5837 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.886432  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:33.886718  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:33.887014  5372 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:33.888726  5414 leader_election.cc:343] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.887665  5568 raft_consensus.cc:359] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.893570  5568 raft_consensus.cc:385] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.893986  5568 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.895452  5837 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.896364  5568 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.899950  5445 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.900315  5372 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:33.900682  5567 tablet_bootstrap.cc:492] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:33.901257  5567 ts_tablet_manager.cc:1403] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.175s	user 0.020s	sys 0.027s
I20260709 13:15:33.901400  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:33.906512  5826 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:33.909096  5826 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:33.904239  5567 raft_consensus.cc:359] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.914036  5567 raft_consensus.cc:385] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.914772  5567 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.916018  5570 tablet_bootstrap.cc:492] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:33.919229  5568 ts_tablet_manager.cc:1434] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:15:33.916759  5935 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:15:33.916538  5570 ts_tablet_manager.cc:1403] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.176s	user 0.017s	sys 0.004s
I20260709 13:15:33.916467  5567 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.922904  5567 ts_tablet_manager.cc:1434] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:15:33.923904  5570 raft_consensus.cc:359] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.924647  5570 raft_consensus.cc:385] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.924932  5570 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.917029  5826 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.925868  5777 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.926317  5777 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.927371  5568 tablet_bootstrap.cc:492] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Bootstrap starting.
I20260709 13:15:33.930711  5777 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.930020  5570 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.932907  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:33.934441  5340 leader_election.cc:343] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.939342  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:33.940182  5524 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 0.
I20260709 13:15:33.942091  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:33.948529  5848 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:33.949055  5848 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.949494  5848 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.981741  5567 tablet_bootstrap.cc:492] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:33.989270  5848 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:33.992935  5848 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:33.993532  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:33.994148  5523 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:33.999358  5523 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:34.001001  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:34.001802  5848 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.003034  5848 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:15:34.004397  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 59574.4us
I20260709 13:15:34.004112  5848 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.013870  5570 ts_tablet_manager.cc:1434] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.011s
I20260709 13:15:34.027143  5570 tablet_bootstrap.cc:492] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
I20260709 13:15:34.029790  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:34.034960  5340 leader_election.cc:343] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.043704  5677 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.061985  5270 catalog_manager.cc:5697] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.064621  5568 tablet_bootstrap.cc:654] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.065076  5567 tablet_bootstrap.cc:654] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.082728  5990 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:34.091238  5273 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.098137  5570 tablet_bootstrap.cc:654] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:34.108071  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53671.4us
I20260709 13:15:34.161772  5677 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:34.167011  5568 tablet_bootstrap.cc:492] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: No bootstrap required, opened a new log
I20260709 13:15:34.167578  5568 ts_tablet_manager.cc:1403] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Time spent bootstrapping tablet: real 0.246s	user 0.025s	sys 0.004s
I20260709 13:15:34.170231  5567 tablet_bootstrap.cc:492] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:34.171386  5567 ts_tablet_manager.cc:1403] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.211s	user 0.013s	sys 0.004s
I20260709 13:15:34.176985  5989 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 13:15:34.255654  5570 tablet_bootstrap.cc:492] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:34.256166  5570 ts_tablet_manager.cc:1403] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.229s	user 0.011s	sys 0.010s
I20260709 13:15:34.260702  5567 raft_consensus.cc:359] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.261736  5567 raft_consensus.cc:385] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.265269  5567 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.264475  5570 raft_consensus.cc:359] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.271750  5570 raft_consensus.cc:385] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.272078  5570 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.272408  5567 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.273106  5570 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.275432  5567 ts_tablet_manager.cc:1434] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.104s	user 0.021s	sys 0.020s
I20260709 13:15:34.278025  5568 raft_consensus.cc:359] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.278769  5568 raft_consensus.cc:385] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.279050  5568 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.279686  5568 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.276530  5567 tablet_bootstrap.cc:492] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:34.283843  5568 ts_tablet_manager.cc:1434] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.004s
I20260709 13:15:34.290518  5567 tablet_bootstrap.cc:654] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.296723  5570 ts_tablet_manager.cc:1434] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:15:34.305456  5570 tablet_bootstrap.cc:492] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
W20260709 13:15:34.334337  5416 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.343926  5891 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.344568  5891 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.355093  5567 tablet_bootstrap.cc:492] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:34.355736  5567 ts_tablet_manager.cc:1403] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.047s
I20260709 13:15:34.358536  5567 raft_consensus.cc:359] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.359369  5567 raft_consensus.cc:385] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.359720  5567 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.360903  5567 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.364543  5567 ts_tablet_manager.cc:1434] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:34.365687  5567 tablet_bootstrap.cc:492] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
I20260709 13:15:34.370389  5891 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:34.371868  5567 tablet_bootstrap.cc:654] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.372149  5933 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.372687  5933 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.373044  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:34.374859  5933 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:34.380082  5489 leader_election.cc:343] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.383018  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:34.395875  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:34.396531  5375 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 0.
I20260709 13:15:34.400430  5987 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.401643  5677 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.402222  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:34.402113  5677 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.404546  5372 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 1: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:34.401010  5987 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.409968  5677 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:34.410737  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:34.411490  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:34.413880  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:34.415520  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:34.416764  5933 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.418521  5891 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.419831  5891 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.420164  5891 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.424882  5570 tablet_bootstrap.cc:654] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.438491  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:34.444648  5933 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.445955  5931 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.446729  5931 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.448267  5987 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:34.454785  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:34.453482  5627 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.455690  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:34.455864  5521 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
W20260709 13:15:34.460379  5416 leader_election.cc:343] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.477456  5567 tablet_bootstrap.cc:492] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:34.478173  5567 ts_tablet_manager.cc:1403] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.113s	user 0.036s	sys 0.034s
I20260709 13:15:34.487409  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:34.488456  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:34.489804  5999 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:34.493232  5891 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.485515  5931 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:34.494223  5570 tablet_bootstrap.cc:492] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:34.496407  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:34.500607  5523 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:34.500648  5570 ts_tablet_manager.cc:1403] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.196s	user 0.016s	sys 0.004s
I20260709 13:15:34.499845  5980 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.502388  5980 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.502751  5980 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.503242  5837 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:34.514163  5891 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:34.514837  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:34.515316  5375 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.510759  5567 raft_consensus.cc:359] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.515694  5567 raft_consensus.cc:385] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.515985  5567 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.521112  5570 raft_consensus.cc:359] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.528352  5375 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:34.529610  5570 raft_consensus.cc:385] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.538434  5570 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.539268  5570 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.539770  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:34.541003  5980 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.541848  5570 ts_tablet_manager.cc:1434] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 13:15:34.541877  5567 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.545799  5372 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 0.
I20260709 13:15:34.545928  6006 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.549130  5777 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.554023  6006 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:34.555619  5570 tablet_bootstrap.cc:492] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Bootstrap starting.
W20260709 13:15:34.557312  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45053us
I20260709 13:15:34.558571  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:34.556623  6006 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.561617  5931 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.562050  5931 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.562407  5931 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.563783  5567 ts_tablet_manager.cc:1434] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:15:34.568271  5567 tablet_bootstrap.cc:492] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Bootstrap starting.
W20260709 13:15:34.582413  5340 consensus_peers.cc:597] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.581390  5931 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.594889  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:34.595538  5521 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.596624  5931 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:34.589255  5980 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:34.586660  5570 tablet_bootstrap.cc:654] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.597919  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:34.600276  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:34.606453  5445 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.611164  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:34.611552  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:34.611917  5524 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.612203  5374 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.619619  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
W20260709 13:15:34.609079  5416 leader_election.cc:343] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.628410  5374 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:34.631973  5837 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.634786  5837 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.633057  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:34.636168  5987 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.637106  5837 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:34.650046  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:34.653946  5372 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:34.656445  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:34.654207  5524 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:34.660076  5837 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:34.660583  5837 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.660945  5837 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.668941  5521 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:34.671998  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:34.648384  5987 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:34.689980  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:34.681607  5980 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.691177  5980 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:15:34.697410  5321 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:34.701164  5837 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.701737  5987 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.717371  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:34.718400  5374 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.732110  5837 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:34.735206  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:34.740851  5374 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:34.742229  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:34.743433  5837 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:34.753363  5980 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.768797  5567 tablet_bootstrap.cc:654] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.771633  5570 tablet_bootstrap.cc:492] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: No bootstrap required, opened a new log
I20260709 13:15:34.772284  5570 ts_tablet_manager.cc:1403] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Time spent bootstrapping tablet: real 0.217s	user 0.020s	sys 0.024s
I20260709 13:15:34.782121  5570 raft_consensus.cc:359] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.782725  5570 raft_consensus.cc:385] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.782968  5570 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.783490  5570 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.785005  5270 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:34.776981  5837 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:34.788750  5837 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.802722  5570 ts_tablet_manager.cc:1434] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 13:15:34.819931  5567 tablet_bootstrap.cc:492] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: No bootstrap required, opened a new log
I20260709 13:15:34.820684  5567 ts_tablet_manager.cc:1403] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.015s
I20260709 13:15:34.828258  5567 raft_consensus.cc:359] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.828994  5567 raft_consensus.cc:385] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.829298  5567 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.828670  5273 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.830026  5567 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.832602  5567 ts_tablet_manager.cc:1434] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:15:34.841116  5987 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.841743  5987 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.845089  5987 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:34.853411  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:34.862201  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:34.864991  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:34.865898  5987 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.867152  5270 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.869138  5270 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.915541  5374 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.916621  5996 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:34.917174  5996 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:34.920804  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:34.921551  5375 raft_consensus.cc:2368] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:34.924623  5490 leader_election.cc:400] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:34.925025  5490 leader_election.cc:403] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:34.925936  5891 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:34.919409  5996 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:34.932269  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:34.936170  5891 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:34.985612  5449 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.055426  5996 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.070642  6004 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.206087  5677 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.206712  5677 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:35.210278  5677 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:35.210913  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:35.211882  5522 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 1: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:35.212366  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:35.215474  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:35.216671  5677 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.220144  5980 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.236229  5677 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.236948  5980 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.284499  5519 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:35.286151  5837 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.295406  5374 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:35.297317  5837 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.325853  5837 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.327796  5987 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.512280  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:35.549189  6031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:35.553596  6032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:35.560798  4246 server_base.cc:1061] running on GCE node
W20260709 13:15:35.561451  6034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:35.562980  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:35.563331  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:35.563611  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783602935563589 us; error 0 us; skew 500 ppm
I20260709 13:15:35.564891  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:35.569064  4246 webserver.cc:533] Webserver started at http://127.4.37.132:37581/ using document root <none> and password file <none>
I20260709 13:15:35.569787  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:35.570056  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:35.570417  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:35.571844  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-3-root/instance:
uuid: "53eb858bdf82438d83f1be6a01da2e0e"
format_stamp: "Formatted at 2026-07-09 13:15:35 on dist-test-slave-jk05"
I20260709 13:15:35.577831  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:15:35.585012  6039 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:35.587244  4246 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:15:35.587910  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-3-root
uuid: "53eb858bdf82438d83f1be6a01da2e0e"
format_stamp: "Formatted at 2026-07-09 13:15:35 on dist-test-slave-jk05"
I20260709 13:15:35.588380  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:35.631460  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:35.633684  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:35.659024  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:35.663144  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:35.663583  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:15:35.664072  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:35.664453  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:35.882308  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.132:42599
I20260709 13:15:35.882426  6101 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.132:42599 every 8 connection(s)
I20260709 13:15:35.928478  4246 auto_leader_rebalancer-test.cc:384] add a tserver: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:35.943434  6102 heartbeater.cc:344] Connected to a master server at 127.4.37.190:41135
I20260709 13:15:35.943991  6102 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:35.944977  6102 heartbeater.cc:507] Master 127.4.37.190:41135 requested a full tablet report, sending...
I20260709 13:15:35.947676  5269 ts_manager.cc:194] Registered new tserver with Master: 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:35.949949  5269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39748
I20260709 13:15:36.937681  5445 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:36.954510  6102 heartbeater.cc:499] Master 127.4.37.190:41135 was elected leader, sending a full tablet report...
I20260709 13:15:36.960880  5375 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:36.962633  5523 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:36.962656  6107 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:36.964725  5837 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:36.998673  5837 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.002131  5374 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.026541  5523 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
W20260709 13:15:37.047539  5415 consensus_peers.cc:597] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef276ea910334ad38fb1112a61709988. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:37.049503  5269 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.077894  5523 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:37.105497  5374 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:37.107583  5891 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:37.109064  5445 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:37.117991  6108 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:37.126242  5489 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82b92e5b61b340dc9b480b452ceee4a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:37.128923  6004 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.133193  5375 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.143285  5448 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.193324  5273 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 reported cstate change: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.223392  5372 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:37.247282  5519 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:37.250267  6120 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:37.257861  5449 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:37.261307  6120 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:37.274969  5519 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.273617  5677 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.303697  5270 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.300729  5448 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
W20260709 13:15:37.319782  5340 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98e834db0dd44fe4a118d1b82fb1ff47. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:37.332039  5449 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
W20260709 13:15:37.348668  5415 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efe06c4beff94d32a1cfc10e6b7cacb8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:37.356849  5519 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:37.358825  5931 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:37.377043  5375 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:37.378825  5931 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.381618  5837 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:37.386592  5519 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.398705  5375 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.423157  5269 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 reported cstate change: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:37.457036  6137 ts_tablet_manager.cc:933] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:37.467418  6137 tablet_copy_client.cc:323] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.130:36703
I20260709 13:15:37.551684  5460 tablet_copy_service.cc:140] P b781c7e31b7145aea647a7ff649e6ac7: Received BeginTabletCopySession request for tablet ef276ea910334ad38fb1112a61709988 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:39322)
I20260709 13:15:37.552714  6141 ts_tablet_manager.cc:933] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:37.552516  5460 tablet_copy_service.cc:161] P b781c7e31b7145aea647a7ff649e6ac7: Beginning new tablet copy session on tablet ef276ea910334ad38fb1112a61709988 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:39322: session id = 53eb858bdf82438d83f1be6a01da2e0e-ef276ea910334ad38fb1112a61709988
I20260709 13:15:37.563683  5460 tablet_copy_source_session.cc:215] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:37.566411  6141 tablet_copy_client.cc:323] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.131:36363
I20260709 13:15:37.577122  6137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef276ea910334ad38fb1112a61709988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.601172  5534 tablet_copy_service.cc:140] P 544c82a50cc4477886bb6f7d58f455ca: Received BeginTabletCopySession request for tablet 82b92e5b61b340dc9b480b452ceee4a0 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:34858)
I20260709 13:15:37.601930  5534 tablet_copy_service.cc:161] P 544c82a50cc4477886bb6f7d58f455ca: Beginning new tablet copy session on tablet 82b92e5b61b340dc9b480b452ceee4a0 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:34858: session id = 53eb858bdf82438d83f1be6a01da2e0e-82b92e5b61b340dc9b480b452ceee4a0
I20260709 13:15:37.612239  5534 tablet_copy_source_session.cc:215] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:37.613835  6137 tablet_copy_client.cc:806] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:37.618742  6137 tablet_copy_client.cc:670] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:37.621707  6141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b92e5b61b340dc9b480b452ceee4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.634523  6137 tablet_copy_client.cc:538] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:37.649809  6137 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:15:37.653129  6141 tablet_copy_client.cc:806] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:37.653991  6141 tablet_copy_client.cc:670] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:37.659178  6141 tablet_copy_client.cc:538] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:37.684970  6141 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:15:37.763988  6137 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:37.764133  6141 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:37.765272  6137 tablet_bootstrap.cc:492] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:15:37.766441  6137 ts_tablet_manager.cc:1403] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.117s	user 0.058s	sys 0.017s
I20260709 13:15:37.766844  6141 tablet_bootstrap.cc:492] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:15:37.767704  6141 ts_tablet_manager.cc:1403] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.083s	user 0.033s	sys 0.008s
I20260709 13:15:37.771265  6137 raft_consensus.cc:359] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:37.771571  6141 raft_consensus.cc:359] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:37.772439  6137 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:15:37.772655  6141 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:15:37.773372  6137 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:37.773526  6141 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:37.783177  6141 ts_tablet_manager.cc:1434] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:15:37.790522  5534 tablet_copy_service.cc:342] P 544c82a50cc4477886bb6f7d58f455ca: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-82b92e5b61b340dc9b480b452ceee4a0 received from {username='slave'} at 127.0.0.1:34858
I20260709 13:15:37.791090  5534 tablet_copy_service.cc:434] P 544c82a50cc4477886bb6f7d58f455ca: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-82b92e5b61b340dc9b480b452ceee4a0 on tablet 82b92e5b61b340dc9b480b452ceee4a0 with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:37.821352  6141 ts_tablet_manager.cc:933] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:37.824769  6137 ts_tablet_manager.cc:1434] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.013s
I20260709 13:15:37.835115  6151 ts_tablet_manager.cc:933] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:15:37.845325  6141 tablet_copy_client.cc:323] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.130:36703
I20260709 13:15:37.853904  5460 tablet_copy_service.cc:342] P b781c7e31b7145aea647a7ff649e6ac7: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-ef276ea910334ad38fb1112a61709988 received from {username='slave'} at 127.0.0.1:39322
I20260709 13:15:37.854171  6151 tablet_copy_client.cc:323] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.129:43931
I20260709 13:15:37.854445  5460 tablet_copy_service.cc:434] P b781c7e31b7145aea647a7ff649e6ac7: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-ef276ea910334ad38fb1112a61709988 on tablet ef276ea910334ad38fb1112a61709988 with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:37.856148  5460 tablet_copy_service.cc:140] P b781c7e31b7145aea647a7ff649e6ac7: Received BeginTabletCopySession request for tablet efe06c4beff94d32a1cfc10e6b7cacb8 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:39322)
I20260709 13:15:37.856673  5460 tablet_copy_service.cc:161] P b781c7e31b7145aea647a7ff649e6ac7: Beginning new tablet copy session on tablet efe06c4beff94d32a1cfc10e6b7cacb8 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:39322: session id = 53eb858bdf82438d83f1be6a01da2e0e-efe06c4beff94d32a1cfc10e6b7cacb8
I20260709 13:15:37.888959  5385 tablet_copy_service.cc:140] P 86b410d62f4040c39d33dc0698998562: Received BeginTabletCopySession request for tablet 98e834db0dd44fe4a118d1b82fb1ff47 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:38156)
I20260709 13:15:37.889196  5460 tablet_copy_source_session.cc:215] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:37.889703  5385 tablet_copy_service.cc:161] P 86b410d62f4040c39d33dc0698998562: Beginning new tablet copy session on tablet 98e834db0dd44fe4a118d1b82fb1ff47 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:38156: session id = 53eb858bdf82438d83f1be6a01da2e0e-98e834db0dd44fe4a118d1b82fb1ff47
I20260709 13:15:37.897568  5385 tablet_copy_source_session.cc:215] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:37.909281  6141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe06c4beff94d32a1cfc10e6b7cacb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.914994  6151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e834db0dd44fe4a118d1b82fb1ff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.943570  6141 tablet_copy_client.cc:806] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:37.944303  6141 tablet_copy_client.cc:670] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:37.944576  6151 tablet_copy_client.cc:806] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:37.950045  6151 tablet_copy_client.cc:670] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:37.956234  6151 tablet_copy_client.cc:538] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:37.957342  6141 tablet_copy_client.cc:538] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:37.969513  6141 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:15:37.979758  6151 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:15:37.994366  6077 raft_consensus.cc:1217] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:38.003582  6141 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:38.004871  6141 tablet_bootstrap.cc:492] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:15:38.005771  6141 ts_tablet_manager.cc:1403] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.017s
I20260709 13:15:38.010511  6141 raft_consensus.cc:359] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:38.013155  6141 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:15:38.014302  6141 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:38.019502  6141 ts_tablet_manager.cc:1434] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:38.035409  6077 raft_consensus.cc:1217] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:38.050122  5460 tablet_copy_service.cc:342] P b781c7e31b7145aea647a7ff649e6ac7: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-efe06c4beff94d32a1cfc10e6b7cacb8 received from {username='slave'} at 127.0.0.1:39322
I20260709 13:15:38.050652  5460 tablet_copy_service.cc:434] P b781c7e31b7145aea647a7ff649e6ac7: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-efe06c4beff94d32a1cfc10e6b7cacb8 on tablet efe06c4beff94d32a1cfc10e6b7cacb8 with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:38.119139  6151 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:38.120391  6151 tablet_bootstrap.cc:492] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:15:38.121287  6151 ts_tablet_manager.cc:1403] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.142s	user 0.021s	sys 0.005s
I20260709 13:15:38.126283  6151 raft_consensus.cc:359] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:38.127323  6151 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:15:38.129719  6151 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:38.138921  6151 ts_tablet_manager.cc:1434] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:38.141633  5385 tablet_copy_service.cc:342] P 86b410d62f4040c39d33dc0698998562: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-98e834db0dd44fe4a118d1b82fb1ff47 received from {username='slave'} at 127.0.0.1:38156
I20260709 13:15:38.142133  5385 tablet_copy_service.cc:434] P 86b410d62f4040c39d33dc0698998562: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-98e834db0dd44fe4a118d1b82fb1ff47 on tablet 98e834db0dd44fe4a118d1b82fb1ff47 with peer 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:15:38.325850  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45797.5us
I20260709 13:15:38.388132  6077 raft_consensus.cc:1217] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:38.428874  6077 raft_consensus.cc:1217] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:38.474404  6148 raft_consensus.cc:1064] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:38.490648  6148 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:38.594247  6077 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.596905  6147 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:38.602770  5523 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.612557  6148 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:38.631695  5373 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.645572  6148 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:38.651890  6159 raft_consensus.cc:1064] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:38.659158  6159 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:38.712478  6147 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:38.715148  6077 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:38.769901  5269 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:38.777741  5523 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:38.780362  5373 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.792707  6126 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:38.793285  5374 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:38.822816  6077 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.825178  5449 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.841524  5449 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:38.869335  6158 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:38.877807  6108 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:38.883069  6161 raft_consensus.cc:1064] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:38.885969  6161 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:38.900981  5521 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:38.903769  6077 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:38.905759  6160 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:38.917964  5837 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:38.919703  6076 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:38.949244  5259 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef276ea910334ad38fb1112a61709988 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:38.960537  5273 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: config changed from index 3 to 4, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:38.976527  5362 tablet_service.cc:1558] Processing DeleteTablet for tablet ef276ea910334ad38fb1112a61709988 with delete_type TABLET_DATA_TOMBSTONED (TS 86b410d62f4040c39d33dc0698998562 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44078
I20260709 13:15:38.978837  6076 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.992764  6161 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:38.995884  6160 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:38.996353  5373 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.004703  6161 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:39.006580  6175 tablet_replica.cc:333] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:15:39.008076  6175 raft_consensus.cc:2243] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:39.009203  6120 raft_consensus.cc:1064] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:39.012154  6120 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:39.013139  6159 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.025976  6175 raft_consensus.cc:2272] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:39.032397  6175 ts_tablet_manager.cc:1916] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:39.035378  5445 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.043186  5521 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.047751  5522 raft_consensus.cc:2955] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.051265  6076 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.067742  5372 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.065116  5273 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.074160  5523 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.104409  6130 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:39.075409  6075 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.078860  5449 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.112803  6157 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:39.115636  6157 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:39.116830  5521 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:39.160051  6161 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:39.160188  6130 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.167903  5374 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:39.181542  6076 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:39.182031  6075 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.209775  6159 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:39.218117  5837 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.232149  6077 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.255690  5273 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.233738  5445 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.243625  5522 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.258275  6159 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.271780  5272 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.273665  5258 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 82b92e5b61b340dc9b480b452ceee4a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:39.288314  5449 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:39.295429  5270 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index 3 to 4, VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) evicted. New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.302942  6077 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:39.304692  5837 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:39.314545  6175 ts_tablet_manager.cc:1929] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:39.314826  6160 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.315902  5372 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.317215  6077 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.327771  5438 tablet_service.cc:1558] Processing DeleteTablet for tablet 82b92e5b61b340dc9b480b452ceee4a0 with delete_type TABLET_DATA_TOMBSTONED (TS b781c7e31b7145aea647a7ff649e6ac7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58804
I20260709 13:15:39.356923  5375 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:39.360154  5259 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efe06c4beff94d32a1cfc10e6b7cacb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:39.328544  6159 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:39.368048  6184 tablet_replica.cc:333] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:15:39.369359  6184 raft_consensus.cc:2243] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:39.370263  6184 raft_consensus.cc:2272] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:39.371203  5372 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.373730  5837 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:39.373864  6075 raft_consensus.cc:2955] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.389621  6175 log.cc:1199] T ef276ea910334ad38fb1112a61709988 P 86b410d62f4040c39d33dc0698998562: Deleting WAL directory at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-0-root/wals/ef276ea910334ad38fb1112a61709988
I20260709 13:15:39.392364  5260 catalog_manager.cc:5028] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): tablet ef276ea910334ad38fb1112a61709988 (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:15:39.395026  6184 ts_tablet_manager.cc:1916] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:39.395092  5375 raft_consensus.cc:2955] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.408998  5273 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: config changed from index 3 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New cstate: current_term: 1 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:39.485978  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62458.5us
I20260709 13:15:39.499496  6184 ts_tablet_manager.cc:1929] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:39.502944  5373 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:39.515954  6184 log.cc:1199] T 82b92e5b61b340dc9b480b452ceee4a0 P b781c7e31b7145aea647a7ff649e6ac7: Deleting WAL directory at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-1-root/wals/82b92e5b61b340dc9b480b452ceee4a0
I20260709 13:15:39.517535  6076 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:39.522168  5259 catalog_manager.cc:5028] TS b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): tablet 82b92e5b61b340dc9b480b452ceee4a0 (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:15:39.522217  6157 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:39.525636  5508 tablet_service.cc:1558] Processing DeleteTablet for tablet efe06c4beff94d32a1cfc10e6b7cacb8 with delete_type TABLET_DATA_TOMBSTONED (TS 544c82a50cc4477886bb6f7d58f455ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36782
I20260709 13:15:39.531391  5449 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:39.532579  6130 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.541572  6185 tablet_replica.cc:333] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:15:39.542773  6185 raft_consensus.cc:2243] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:39.543498  6185 pending_rounds.cc:70] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: Trying to abort 1 pending ops.
I20260709 13:15:39.543872  6185 pending_rounds.cc:77] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305637637671010304 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } } }
I20260709 13:15:39.544198  6076 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.548404  6183 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:39.545222  6185 raft_consensus.cc:2917] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:15:39.560535  6185 raft_consensus.cc:2889] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:15:39.561447  5449 raft_consensus.cc:2955] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:39.569654  5260 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 98e834db0dd44fe4a118d1b82fb1ff47 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:39.569697  6185 raft_consensus.cc:2272] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:39.583619  5260 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 98e834db0dd44fe4a118d1b82fb1ff47 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:15:39.592689  5272 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 reported cstate change: config changed from index 3 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.598984  6185 ts_tablet_manager.cc:1916] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:39.606803  5508 tablet_service.cc:1558] Processing DeleteTablet for tablet 98e834db0dd44fe4a118d1b82fb1ff47 with delete_type TABLET_DATA_TOMBSTONED (TS 544c82a50cc4477886bb6f7d58f455ca not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36782
I20260709 13:15:39.625013  6185 ts_tablet_manager.cc:1929] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:39.625602  6185 log.cc:1199] T efe06c4beff94d32a1cfc10e6b7cacb8 P 544c82a50cc4477886bb6f7d58f455ca: Deleting WAL directory at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-2-root/wals/efe06c4beff94d32a1cfc10e6b7cacb8
I20260709 13:15:39.627552  6185 tablet_replica.cc:333] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:15:39.627439  5258 catalog_manager.cc:5028] TS 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): tablet efe06c4beff94d32a1cfc10e6b7cacb8 (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:15:39.628748  6185 raft_consensus.cc:2243] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:39.629402  6185 raft_consensus.cc:2272] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:39.632699  6185 ts_tablet_manager.cc:1916] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:39.651347  6185 ts_tablet_manager.cc:1929] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:39.651834  6185 log.cc:1199] T 98e834db0dd44fe4a118d1b82fb1ff47 P 544c82a50cc4477886bb6f7d58f455ca: Deleting WAL directory at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-2-root/wals/98e834db0dd44fe4a118d1b82fb1ff47
I20260709 13:15:39.653554  5258 catalog_manager.cc:5028] TS 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): tablet 98e834db0dd44fe4a118d1b82fb1ff47 (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:15:41.362413  6187 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:41.363334  6187 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.367314  6187 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:41.484485  6194 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:41.493602  6194 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.495559  6186 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:41.496248  6186 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.496799  6194 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:41.492266  5338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.002s	sys 0.004s
W20260709 13:15:41.497524  5338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.003s	sys 0.004s
I20260709 13:15:41.498462  6186 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:41.501727  5415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.009s
W20260709 13:15:41.502336  5415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.009s
I20260709 13:15:41.505044  6194 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:41.505604  6196 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:41.505939  6194 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.508378  6196 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.520942  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.523114  6194 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:41.525372  6201 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:41.526087  6201 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:41.532055  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.533515  6201 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:41.534876  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.537655  6202 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:41.538436  6202 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.539465  6186 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:41.540122  6186 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.542240  6202 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:41.543044  6202 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:41.543642  6202 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.544281  6196 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:41.536149  6203 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:41.563943  6203 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.564430  6202 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:41.566265  6203 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:41.542294  6186 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:41.572427  6203 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:41.573213  6203 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:41.577638  6203 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:41.579674  6186 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:41.580303  6186 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:41.582499  6186 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:41.614104  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:41.615469  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:41.616230  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:41.618485  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:41.620024  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:41.620328  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:41.625785  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:41.626442  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:41.630548  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:41.631549  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 63232.7us
I20260709 13:15:41.631592  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:41.636415  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:41.636483  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:41.638768  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:41.647733  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:41.648649  6186 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.651046  5416 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:41.651708  6186 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.657524  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.660086  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.663964  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.672798  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:41.674074  6194 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.674531  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:41.676206  6194 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.679195  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:41.679755  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:41.684158  5837 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.684566  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:41.684569  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.685678  6201 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.687069  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.684201  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.690414  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:41.705878  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:41.706851  6202 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.708408  5489 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:41.709282  6202 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.709759  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:41.710852  6202 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.711256  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:41.712328  6202 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.713611  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:41.714797  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:41.715039  5522 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:41.716569  6149 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.716616  6160 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.730211  5449 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:41.730099  5372 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:41.731195  5489 consensus_peers.cc:597] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd246431fed24a99b47e2ccdf988b1ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.732412  6202 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.733417  6207 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.763774  6207 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.769390  5445 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.768198  5372 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.804379  5374 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:41.812273  5273 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
W20260709 13:15:41.820348  5340 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b301483f19c4d508e00d917819ac039. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.821389  5524 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:41.823123  6194 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.833412  5445 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:41.835266  6194 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.848616  6198 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.851423  5522 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.867293  5374 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:41.879834  5445 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.885871  5443 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:41.889317  5340 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0276d804ade348368656bbe6805214df. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.893800  6199 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.895145  5524 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:41.902192  6195 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.917665  5272 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 reported cstate change: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.936121  6195 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.942477  5447 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.983292  5524 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:41.999330  5520 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.001502  5273 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 reported cstate change: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.030754  5374 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.034943  6202 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:42.054875  5489 consensus_peers.cc:597] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23048b90f57d48a4be8be78bc78d9204. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:42.083209  5448 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:42.085109  6202 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:42.088020  5372 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:42.117444  5273 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.133844  6202 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:42.152887  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9560 after lost signal to thread 4249
W20260709 13:15:42.154052  5471 debug-util.cc:398] Leaking SignalData structure 0x7b0800195680 after lost signal to thread 5307
W20260709 13:15:42.155370  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08002c91a0 after lost signal to thread 5399
W20260709 13:15:42.156435  5471 debug-util.cc:398] Leaking SignalData structure 0x7b080023ab40 after lost signal to thread 5474
W20260709 13:15:42.157565  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08002f73e0 after lost signal to thread 5548
W20260709 13:15:42.158792  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08002eea20 after lost signal to thread 6101
I20260709 13:15:42.183525  5448 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:15:42.310953  6226 ts_tablet_manager.cc:933] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:42.358958  6227 ts_tablet_manager.cc:933] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:15:42.370838  6226 tablet_copy_client.cc:323] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.131:36363
I20260709 13:15:42.371260  6227 tablet_copy_client.cc:323] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.129:43931
I20260709 13:15:42.373232  5385 tablet_copy_service.cc:140] P 86b410d62f4040c39d33dc0698998562: Received BeginTabletCopySession request for tablet 7b301483f19c4d508e00d917819ac039 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:38156)
I20260709 13:15:42.373361  5534 tablet_copy_service.cc:140] P 544c82a50cc4477886bb6f7d58f455ca: Received BeginTabletCopySession request for tablet fd246431fed24a99b47e2ccdf988b1ff from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:34858)
I20260709 13:15:42.373870  5385 tablet_copy_service.cc:161] P 86b410d62f4040c39d33dc0698998562: Beginning new tablet copy session on tablet 7b301483f19c4d508e00d917819ac039 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:38156: session id = 53eb858bdf82438d83f1be6a01da2e0e-7b301483f19c4d508e00d917819ac039
I20260709 13:15:42.373989  5534 tablet_copy_service.cc:161] P 544c82a50cc4477886bb6f7d58f455ca: Beginning new tablet copy session on tablet fd246431fed24a99b47e2ccdf988b1ff from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:34858: session id = 53eb858bdf82438d83f1be6a01da2e0e-fd246431fed24a99b47e2ccdf988b1ff
I20260709 13:15:42.383456  5385 tablet_copy_source_session.cc:215] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.387393  6227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b301483f19c4d508e00d917819ac039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.396322  5534 tablet_copy_source_session.cc:215] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.406443  6226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd246431fed24a99b47e2ccdf988b1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.461947  6227 tablet_copy_client.cc:806] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.462845  6227 tablet_copy_client.cc:670] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.463979  6230 ts_tablet_manager.cc:933] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:42.477051  6227 tablet_copy_client.cc:538] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.507372  6230 tablet_copy_client.cc:323] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.131:36363
I20260709 13:15:42.509267  5534 tablet_copy_service.cc:140] P 544c82a50cc4477886bb6f7d58f455ca: Received BeginTabletCopySession request for tablet 23048b90f57d48a4be8be78bc78d9204 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:34858)
I20260709 13:15:42.510010  5534 tablet_copy_service.cc:161] P 544c82a50cc4477886bb6f7d58f455ca: Beginning new tablet copy session on tablet 23048b90f57d48a4be8be78bc78d9204 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:34858: session id = 53eb858bdf82438d83f1be6a01da2e0e-23048b90f57d48a4be8be78bc78d9204
I20260709 13:15:42.513271  6231 ts_tablet_manager.cc:933] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:15:42.539189  5534 tablet_copy_source_session.cc:215] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.562671  6231 tablet_copy_client.cc:323] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.129:43931
I20260709 13:15:42.594785  5385 tablet_copy_service.cc:140] P 86b410d62f4040c39d33dc0698998562: Received BeginTabletCopySession request for tablet 0276d804ade348368656bbe6805214df from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:38156)
I20260709 13:15:42.474175  6226 tablet_copy_client.cc:806] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.595399  5385 tablet_copy_service.cc:161] P 86b410d62f4040c39d33dc0698998562: Beginning new tablet copy session on tablet 0276d804ade348368656bbe6805214df from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:38156: session id = 53eb858bdf82438d83f1be6a01da2e0e-0276d804ade348368656bbe6805214df
I20260709 13:15:42.595721  6226 tablet_copy_client.cc:670] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.604803  5385 tablet_copy_source_session.cc:215] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:42.607079  6230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23048b90f57d48a4be8be78bc78d9204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.608536  6226 tablet_copy_client.cc:538] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.651561  6227 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:15:42.655422  6231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0276d804ade348368656bbe6805214df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.671682  6226 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:15:42.666780  6230 tablet_copy_client.cc:806] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.690150  6230 tablet_copy_client.cc:670] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.695190  6230 tablet_copy_client.cc:538] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.703423  6231 tablet_copy_client.cc:806] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:42.704133  6231 tablet_copy_client.cc:670] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:42.709251  6231 tablet_copy_client.cc:538] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:42.725616  6231 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:15:42.728950  6230 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:15:42.755895  6227 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.757153  6227 tablet_bootstrap.cc:492] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:15:42.761579  6227 ts_tablet_manager.cc:1403] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.110s	user 0.023s	sys 0.005s
I20260709 13:15:42.772289  6227 raft_consensus.cc:359] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.781458  6227 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:15:42.782392  6227 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.791971  6227 ts_tablet_manager.cc:1434] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:15:42.792390  6226 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.804382  5385 tablet_copy_service.cc:342] P 86b410d62f4040c39d33dc0698998562: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-7b301483f19c4d508e00d917819ac039 received from {username='slave'} at 127.0.0.1:38156
I20260709 13:15:42.804937  5385 tablet_copy_service.cc:434] P 86b410d62f4040c39d33dc0698998562: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-7b301483f19c4d508e00d917819ac039 on tablet 7b301483f19c4d508e00d917819ac039 with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:42.804491  6226 tablet_bootstrap.cc:492] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:15:42.816758  6230 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.825925  6226 ts_tablet_manager.cc:1403] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.154s	user 0.031s	sys 0.005s
I20260709 13:15:42.841275  6231 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:42.844954  6231 tablet_bootstrap.cc:492] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:15:42.845566  6230 tablet_bootstrap.cc:492] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:15:42.852880  6230 ts_tablet_manager.cc:1403] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.018s
I20260709 13:15:42.850232  6226 raft_consensus.cc:359] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.855590  6226 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:15:42.861233  6076 raft_consensus.cc:1217] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:42.851883  6231 ts_tablet_manager.cc:1403] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.127s	user 0.019s	sys 0.008s
I20260709 13:15:42.879417  6230 raft_consensus.cc:359] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.882476  6230 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:15:42.883428  6230 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.881772  6231 raft_consensus.cc:359] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.885035  6231 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:15:42.886188  6231 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.889653  6230 ts_tablet_manager.cc:1434] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 13:15:42.894133  5534 tablet_copy_service.cc:342] P 544c82a50cc4477886bb6f7d58f455ca: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-23048b90f57d48a4be8be78bc78d9204 received from {username='slave'} at 127.0.0.1:34858
I20260709 13:15:42.894654  5534 tablet_copy_service.cc:434] P 544c82a50cc4477886bb6f7d58f455ca: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-23048b90f57d48a4be8be78bc78d9204 on tablet 23048b90f57d48a4be8be78bc78d9204 with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:42.906848  6226 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:42.915593  6226 ts_tablet_manager.cc:1434] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.003s
I20260709 13:15:42.943738  5534 tablet_copy_service.cc:342] P 544c82a50cc4477886bb6f7d58f455ca: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-fd246431fed24a99b47e2ccdf988b1ff received from {username='slave'} at 127.0.0.1:34858
I20260709 13:15:42.944442  5534 tablet_copy_service.cc:434] P 544c82a50cc4477886bb6f7d58f455ca: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-fd246431fed24a99b47e2ccdf988b1ff on tablet fd246431fed24a99b47e2ccdf988b1ff with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:42.909328  6231 ts_tablet_manager.cc:1434] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:15:42.978502  6076 raft_consensus.cc:1217] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:44.043921  6240 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.044413  6240 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.045636  6241 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.046334  6240 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.046219  6241 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.048323  6241 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.075416  6241 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.076128  6241 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:44.079099  6241 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:44.093730  6241 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.094444  6241 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.096649  6241 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.100319  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 549) took 1109 ms. Trace:
I20260709 13:15:44.100915  5372 rpcz_store.cc:276] 0709 13:15:42.990378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.099650 (+1109272us) service_pool.cc:224] Handling call
0709 13:15:44.099939 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.100068 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.100082 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.100111 (+    29us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:44.100128 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.100160 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.100237 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:44.110113  6244 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.110996  6243 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.110423  6242 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.116422  6244 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.116500  6243 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.117000  6242 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.120282  6243 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.120959  6243 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.121529  6218 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.121937  6244 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.121012  6242 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.122098  6218 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.121778  6243 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.124650  6218 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.125125  6243 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.129055  6243 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.129753  6243 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.132345  6243 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.136656  6243 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.137392  6243 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:44.139950  6243 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.142936  6240 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.143437  6245 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.143579  6240 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.144038  6245 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.145367  6240 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.147467  6202 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.147804  6245 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.148020  6202 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.150470  6202 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.162458  6243 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.163147  6243 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.165488  6243 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.186339  6218 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.187011  6218 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:44.188438  6242 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.188488  6244 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.189698  6243 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.189229  6244 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.190321  6243 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.191974  6244 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.192288  6243 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.189172  6242 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.194020  6075 raft_consensus.cc:1217] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:44.194980  6242 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.195379  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:44.198607  6072 raft_consensus.cc:1217] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:44.202314  6218 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.203919  6218 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.205798  6244 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.208266  6218 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.208359  6244 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.209396  6243 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.210050  6243 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.210652  6218 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.210668  6244 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.211599  6203 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.212177  6243 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.212232  6203 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.214563  6203 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.226137  6204 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.226701  6204 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.237064  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:44.245800  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:44.245879  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:44.246922  5371 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:44.247182  6242 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.247653  6246 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.247889  6242 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.237797  5374 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:44.254284  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:44.256098  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:44.255950  5374 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:44.257158  5373 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:44.235394  6203 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.248529  6246 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.268630  6247 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.263239  6202 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.264734  6244 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.279186  6204 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.284775  6242 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.287072  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:44.272526  6207 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.291177  6245 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.276590  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:44.292876  6246 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.295193  6239 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.271005  6203 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.288296  6244 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.296748  6207 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.283537  6202 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.270581  6247 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.299706  5368 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
W20260709 13:15:44.317808  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44824us
I20260709 13:15:44.299624  6245 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.318668  5490 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:44.324241  6203 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.327314  6244 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.324241  6202 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.328459  6203 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:44.328914  6203 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.329465  6207 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.329833  6202 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.330502  6255 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.332022  6247 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.330556  6202 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.334175  6202 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.334229  6218 raft_consensus.cc:1064] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:44.331132  6203 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.334987  6245 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.342955  6194 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.347131  6194 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.357893  6249 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.331713  6255 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.319056  6239 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.363373  6250 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.364091  6250 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.364665  6239 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.358726  6249 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:44.366369  6250 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.366885  6250 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.367817  6249 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.367321  6250 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.368911  5385 tablet_copy_service.cc:342] P 86b410d62f4040c39d33dc0698998562: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-0276d804ade348368656bbe6805214df received from {username='slave'} at 127.0.0.1:38156
I20260709 13:15:44.369675  5385 tablet_copy_service.cc:434] P 86b410d62f4040c39d33dc0698998562: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-0276d804ade348368656bbe6805214df on tablet 0276d804ade348368656bbe6805214df with peer 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:15:44.362325  5304 debug-util.cc:398] Leaking SignalData structure 0x7b080003bf60 after lost signal to thread 4249
I20260709 13:15:44.373782  6194 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:44.376315  5304 debug-util.cc:398] Leaking SignalData structure 0x7b0800040f00 after lost signal to thread 5307
I20260709 13:15:44.376879  6218 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:44.378495  6250 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.379947  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:44.381305  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62694.4us
I20260709 13:15:44.382936  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:44.390182  6250 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.390650  6252 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.389454  6186 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.398478  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.391410  6251 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.391732  6259 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.388800  6245 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.397312  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.399351  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.405603  5524 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:44.402024  6186 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.399049  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.405727  5523 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:44.403082  6251 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.454345  6248 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.407725  6241 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:44.403754  6207 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.456416  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.405290  6246 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.410930  6202 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.454977  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.469594  6258 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.472679  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.449293  6247 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.406423  6250 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.470017  5520 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:44.470511  6241 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.482122  6253 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.403028  6252 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.409735  6245 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.481933  6254 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.490901  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.469771  6202 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.420095  6259 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:44.473016  6246 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.493664  6241 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:44.498459  5304 debug-util.cc:398] Leaking SignalData structure 0x7b08002cf540 after lost signal to thread 5399
I20260709 13:15:44.512720  6251 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.494243  6244 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.478220  6207 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.489348  6255 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.482024  6256 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.497699  6239 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.458568  6248 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:44.492916  6247 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.498042  6240 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.499832  6249 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.488319  6257 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.538230  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.527026  6186 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.473831  6258 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.530910  6260 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.531623  6244 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:44.562549  5304 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee200 after lost signal to thread 5474
I20260709 13:15:44.510419  6253 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.529393  6254 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.564307  6186 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.591806  6258 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.539640  6239 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.553823  6240 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.559661  6249 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:44.596745  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.602190  5522 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:44.582230  6251 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.574412  6260 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.610102  6252 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.595672  6186 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:44.612851  5304 debug-util.cc:398] Leaking SignalData structure 0x7b08001d36c0 after lost signal to thread 5548
I20260709 13:15:44.606690  6259 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.555150  6256 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.625384  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.628144  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.588801  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:44.565016  6257 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:44.615051  6252 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.648912  6248 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.630807  6258 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.616614  6261 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.650581  6245 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.652789  5520 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:44.656706  6245 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:15:44.632017  5304 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee8c0 after lost signal to thread 5549
I20260709 13:15:44.620450  6250 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.655754  6262 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.630837  6204 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.631593  6255 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.659825  6241 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.646242  6259 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.663038  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.667034  6264 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.616792  6251 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.657708  6246 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.656549  6261 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.676867  6259 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.658794  6207 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.670070  6248 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:44.658257  6252 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.677928  6247 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.687597  6186 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.687132  6265 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.684851  6244 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.671187  6204 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.664656  6258 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:44.674311  6255 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.662475  6245 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
W20260709 13:15:44.722719  5304 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccee0 after lost signal to thread 6101
W20260709 13:15:44.711333  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.708268  6250 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.701138  6242 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.706548  6253 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.744328  6239 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:44.739249  5304 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccf20 after lost signal to thread 6102
I20260709 13:15:44.692867  6262 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.756683  6262 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.735296  6218 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.757838  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:44.736223  6260 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.735944  6244 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:44.759348  6263 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:15:44.748463  6249 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.750279  6186 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.752529  6259 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.697471  6264 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:44.775604  6204 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.781366  6268 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.757335  6250 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.770665  6254 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.761610  6242 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.776921  6260 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.775892  6186 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.797264  6260 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.797894  6256 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.799192  6186 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.799468  6260 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.761961  6218 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:44.771288  6244 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:44.801684  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 267127us
I20260709 13:15:44.801770  6259 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.806203  6202 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.805960  6259 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.807098  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.807771  5515 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
I20260709 13:15:44.808272  6259 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.786007  6271 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.809358  6274 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.737495  6265 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:44.816411  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 433520us
I20260709 13:15:44.818228  5374 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
I20260709 13:15:44.819054  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:44.820350  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:44.826617  6265 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:44.831107  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.833688  6261 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.816442  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.810688  6241 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.835615  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.816372  6252 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.823210  6251 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.782027  6268 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.861616  5270 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 31) took 1905 ms. Trace:
I20260709 13:15:44.837966  6256 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:44.868000  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:44.839315  6202 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:44.833003  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.834933  6257 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.816090  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:15:44.855132  6259 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.856827  6258 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:44.882316  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52358.1us
I20260709 13:15:44.860165  6186 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.871192  6256 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.889693  5273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 149) took 1905 ms. Trace:
I20260709 13:15:44.900413  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.901080  5273 rpcz_store.cc:276] 0709 13:15:42.981402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.985890 (+  4488us) service_pool.cc:224] Handling call
0709 13:15:44.886638 (+1900748us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":673695,"reported_tablets":1}
I20260709 13:15:44.890631  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.867247  5270 rpcz_store.cc:276] 0709 13:15:42.953882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.113666 (+1159784us) service_pool.cc:224] Handling call
0709 13:15:44.858882 (+745216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342635,"reported_tablets":1}
I20260709 13:15:44.900692  6262 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.881687  6259 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.914026  5519 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:44.914695  5524 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:44.876427  6254 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:44.873872  6264 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.882695  6240 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.881942  6252 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.918522  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.877084  6255 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.816488  6274 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.881803  6260 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:44.889609  6245 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:44.901026  6251 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:44.860419  6271 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.910211  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.873464  6202 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:44.924647  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.944545  6252 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.066147  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.918998  6186 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.067480  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.067637  6251 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.910290  6262 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.068570  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.932646  6043 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:44.924757  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.071076  6249 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.071511  6249 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:45.071907  6249 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.072117  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.072353  6195 raft_consensus.cc:1064] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:45.070240  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.957840  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.931972  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.911732  6256 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.069155  5524 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
W20260709 13:15:44.887791  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 78005.2us
I20260709 13:15:45.092751  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.083359  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:45.113670  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:44.917737  6254 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:15:45.083063  6203 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.731s	user 0.013s	sys 0.013s
I20260709 13:15:44.953291  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.932039  6275 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:45.118098  5518 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:45.117352  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.934055  6259 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.036489  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:45.080331  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.080498  6202 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.118933  6268 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.119490  5522 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:45.121732  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.118454  6275 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:45.124408  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:44.920522  6218 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:45.033795  6242 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:45.080374  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 213826us
I20260709 13:15:45.081218  6244 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.021646  6073 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.135695  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:45.116101  6243 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.116446  6254 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.082799  6260 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.144023  6271 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.142728  6243 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:45.137773  6194 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.119832  6250 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:44.963740  6273 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.120882  6203 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:44.930660  6264 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:45.149140  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:45.156957  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:45.154769  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 286778us
I20260709 13:15:45.135206  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.145836  6243 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.147962  6194 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:45.148157  6244 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:44.932451  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.181852  6274 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.183432  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.167768  6186 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.195765  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.185463  6246 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:45.195158  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 311835us
I20260709 13:15:45.186472  6194 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.186065  6244 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:45.185957  6273 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:45.202328  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.206456  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.185475  6271 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:15:45.145064  6195 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:45.188946  6264 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.213598  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:45.378252  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.210239  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:45.354486  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.198262  6246 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:45.576035  6246 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.391646  6275 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:45.402886  6260 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.580602  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.330245  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.203037  6244 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.476182  6249 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:45.584350  6076 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:15:45.586421  6249 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:45.208961  6273 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.224967  5517 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:45.225256  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.530616  6203 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:45.594898  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 549) took 1186 ms. Trace:
I20260709 13:15:45.634063  5517 rpcz_store.cc:276] 0709 13:15:44.408374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.470108 (+ 61734us) service_pool.cc:224] Handling call
0709 13:15:44.837849 (+367741us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67f8c 00007fc1d0c67ef6 0000000000375939 00007fc1d8cdb1e0 00007fc1d8da40c4 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:15:45.594802 (+756953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5913984}
W20260709 13:15:45.600616  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 390410us
I20260709 13:15:45.589382  6264 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.636610  6262 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.600869  6278 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.637393  6278 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.637848  6278 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.642364  6203 raft_consensus.cc:1064] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:45.601600  6250 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.601821  6274 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.642968  6250 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.643268  6274 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:45.602047  6255 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.646445  6255 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.648967  6255 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.602303  6279 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.645594  6250 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.595872  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.612985  5516 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.602517  6268 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:45.656986  6268 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.610195  6246 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.658017  6076 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.659030  6268 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.602726  6259 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.659940  6259 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:45.661137  6246 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.609755  6244 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.663753  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:45.565281  6254 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.651684  6279 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.666209  6257 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.672909  6257 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.675341  6257 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:45.675469  6240 raft_consensus.cc:1064] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:45.666411  6271 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.676505  6203 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:45.668850  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.669512  6274 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.671176  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:45.677872  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.668427  6259 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:45.678423  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.702401  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.706372  5375 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:45.707207  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.707489  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:45.708189  5375 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:45.710186  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.607282  6204 raft_consensus.cc:1064] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:15:45.633220  6243 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.679457  6268 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.713546  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.713681  6268 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.714221  6268 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.605080  6251 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.654729  6255 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:45.712325  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.705237  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.712800  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.715510  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:45.715857  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:45.716356  5523 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:45.603937  6260 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:45.609313  6252 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.704511  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.704404  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:45.719611  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:45.702396  6240 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:45.613015  6202 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.618327  6256 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.719132  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:45.725746  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.001s	sys 0.021s
W20260709 13:15:45.838289  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.003s	sys 0.029s
W20260709 13:15:45.838800  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 645631us
I20260709 13:15:45.741272  5374 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:15:45.763012  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.715291  6250 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.703655  6279 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.850095  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:45.841600  5339 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:45.854797  5448 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:45.851032  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:45.853626  5340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.516s (SENT) [suppressed 7 similar messages]
I20260709 13:15:45.859458  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:45.833860  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.836714  6244 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:45.763335  6195 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:45.746330  5368 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:45.848825  6250 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:45.745143  5366 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:45.745100  5516 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:45.860630  6246 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.907184  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 564) took 1007 ms. Trace:
I20260709 13:15:45.837235  6273 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:45.849344  6260 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:45.946853  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.950053  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:45.939393  6245 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:15:45.951326  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56849.7us
I20260709 13:15:45.911177  5523 rpcz_store.cc:276] 0709 13:15:44.888975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.903977 (+ 15002us) service_pool.cc:224] Handling call
0709 13:15:44.925288 (+ 21311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.842602 (+917314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.896235 (+ 53633us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b5400154354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:45.896402 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818861824}
W20260709 13:15:45.958546  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 104531us
W20260709 13:15:45.966331  6194 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.763s	user 0.002s	sys 0.012s
I20260709 13:15:45.966881  6194 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.969993  5370 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:45.899139  6250 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.937917  6246 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:15:45.979171  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 125557us
I20260709 13:15:45.979781  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:45.983258  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:45.984722  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.966349  6075 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:45.971639  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:45.996598  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:45.983592  6246 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.896680  6195 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:45.984900  6076 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:45.977829  6278 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.957756  6245 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.995996  6254 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:46.001588  6271 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:46.010887  6195 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:46.025270  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.025713  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.026405  5446 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:46.026652  6278 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.026721  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.007638  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.027590  5516 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:46.027930  5520 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:46.028921  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.013953  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.031445  6245 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:45.985275  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:46.024448  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.036885  6256 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:46.027508  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:45.971290  6268 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:45.989998  6194 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.030423  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.038703  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.069213  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.068899  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.071431  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.072320  5445 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:46.034307  5517 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.028824  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.073709  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.074729  5441 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:46.075924  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.065991  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:46.066941  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.040732  6271 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.070385  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.063092  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.022382  6244 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:15:46.067691  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.033936  6273 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.069766  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.017180  6243 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.097049  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.097831  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.098488  5450 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:46.066541  6268 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.080682  6271 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.103385  6246 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.108036  6247 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.109210  6247 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:46.111299  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:46.113220  6247 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:46.120424  5520 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.122268  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.122711  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.123358  5519 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.124099  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:46.124397  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:46.129267  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:46.128764  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 140966us
I20260709 13:15:46.110071  6202 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:46.133606  5370 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:46.133977  5523 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:46.138922  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.120483  6260 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.124121  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.147975  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.147718  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.151023  5449 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.151513  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.152149  5445 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:46.155064  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:46.155608  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.156745  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.157305  5521 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:46.162649  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:46.163175  5372 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.149631  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:46.151954  6251 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.179548  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.180859  5522 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
W20260709 13:15:46.231936  6288 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:15:46.231705  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.161880  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.235678  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.236586  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:46.239301  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.241011  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:46.226984  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.181773  6251 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:46.246402  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.244228  5372 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:46.247550  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.249876  5524 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.257159  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.262555  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.269881  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.271466  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.275940  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:46.276530  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:46.277140  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.277271  6260 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:46.278330  6260 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.278690  6260 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:46.279455  6260 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.280632  6260 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.282529  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:46.283527  6279 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.283995  6279 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.284406  6279 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:46.286255  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.290868  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:46.292367  6204 raft_consensus.cc:1068] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Unable to promote non-voter 53eb858bdf82438d83f1be6a01da2e0e: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }.
  Pending config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:46.298911  6246 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.299981  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.330996  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.332194  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.304939  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.333850  5515 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:46.336839  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.312645  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:46.315940  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.317157  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.317941  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.242048  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:46.324169  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.325894  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.326296  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:46.327404  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.341733  6250 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.346921  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:46.347838  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.348701  6250 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.339373  6277 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:46.348845  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.349874  6277 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.350385  6277 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.350579  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:15:46.322176  6292 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:15:46.343343  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.339464  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.338063  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.344774  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.343375  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:46.339550  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.292567  6251 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.354471  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.354761  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.355895  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.338289  5414 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:46.359172  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.346095  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:46.360190  5366 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.369606  6250 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.370126  6250 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.370337  6072 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.370492  6250 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.364364  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.371747  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.372599  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.373049  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.339208  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.384019  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.389879  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.391242  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.398677  5445 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.392961  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.389278  6240 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:46.373225  6244 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:15:46.383281  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.395280  6268 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:46.397478  5367 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.366392  6266 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.416491  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.403100  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.403195  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.403986  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.404596  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.373766  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.406291  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.387588  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.376235  5518 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:46.414902  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:46.418228  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 158226us
I20260709 13:15:46.421617  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.411316  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.423906  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.424425  6268 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.432569  6268 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:46.433612  6268 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.425565  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.427485  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.428483  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.401697  6251 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.432646  5446 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
W20260709 13:15:46.444608  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.445667  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.451637  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.445240  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.434938  6268 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.447938  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.450170  6072 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 LEARNER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.446722  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.474943  5370 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.456135  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.457553  5443 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:46.476719  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.477685  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.478852  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.480017  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.457281  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.458379  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.433193  6260 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:46.496304  6260 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.496675  6260 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:46.497537  6260 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.498797  6260 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.498538  6279 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.500769  6279 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.501515  5520 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:46.462070  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.463373  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.463922  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.506531  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:46.508342  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:46.464533  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.466313  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:46.467482  6277 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.468127  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:46.470181  5366 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:46.490571  5450 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.489681  6290 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:46.495465  5441 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.454115  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:46.540401  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86369us
I20260709 13:15:46.540936  6255 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:46.541244  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:46.542063  6255 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:46.543157  6278 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.543455  6247 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.543521  6278 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:46.544014  6247 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:46.544440  6247 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.544551  6278 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:46.473156  5449 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:46.545641  6245 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.545885  6278 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.546027  6245 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:46.546420  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.546852  6245 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.548030  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.549296  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.550592  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.551263  5449 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:46.461045  6250 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:46.506244  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.465233  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.510217  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:46.511444  6204 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.511915  6240 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.516961  6202 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:46.517886  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51668us
I20260709 13:15:46.522835  5447 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.518397  5443 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:46.555295  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45190.6us
I20260709 13:15:46.555543  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:46.537227  6277 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.518999  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.521214  6268 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.565160  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.558123  6256 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.567859  6294 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.588382  6294 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:46.588806  6294 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.591133  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.592448  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.563407  6279 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:46.567842  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.570642  6072 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:46.599388  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.563479  6296 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.574990  6250 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.557245  6204 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.560010  6043 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:46.584780  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.604607  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.593196  6268 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.601792  5414 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:46.608888  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.606765  6268 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.610492  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.615002  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.611027  6076 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.616233  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.604238  5442 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.605727  6204 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.601264  6296 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:46.618607  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.616174  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.626211  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:46.611366  6298 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.628137  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.629412  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.627281  5448 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:46.633123  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.634562  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.635831  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.626230  6277 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:15:46.636590  5443 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:46.637253  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.638510  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.639508  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.640437  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.614789  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:46.642356  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.643154  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.617938  6250 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.663012  6250 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.664498  6250 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.645357  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.668853  5449 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:46.670394  5516 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:15:46.674252  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48114.7us
I20260709 13:15:46.685954  6251 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.682343  6294 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.686542  6251 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.689688  6251 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.691248  6294 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:46.696692  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.686678  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:46.660343  6266 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:46.631276  6298 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:46.715940  5447 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:46.721007  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 165512us
I20260709 13:15:46.721839  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:46.722659  6294 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.723259  6294 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:46.723814  6294 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.703171  6256 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:46.729977  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 167454us
I20260709 13:15:46.733445  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:15:46.717825  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 164635us
I20260709 13:15:46.739632  6298 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:46.737944  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66537.9us
I20260709 13:15:46.750576  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:46.757436  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:46.751655  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77993.4us
I20260709 13:15:46.762882  6254 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:46.763644  6254 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.765153  5519 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.737004  6302 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:46.758920  6298 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.755450  6299 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.791978  5518 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:46.789098  6244 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:15:46.751578  6247 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:46.804625  6294 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.762017  6301 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:15:46.785517  6204 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.805110  6250 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:46.820232  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:46.823619  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:46.827750  6246 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:46.828390  6246 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:46.828805  5446 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:46.796871  6299 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:46.829512  6246 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.833289  6240 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:46.839859  6250 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:46.845482  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84892.4us
I20260709 13:15:46.845981  5371 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.855286  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.856909  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:46.844602  6302 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:15:46.847447  5368 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:46.858938  6247 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:46.761546  6296 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:46.860148  6250 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.860476  6296 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.844621  6299 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.850999  6240 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:46.851367  6271 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.857290  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.850270  6278 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.874779  6278 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:46.873844  6240 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.825042  6245 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.876312  5518 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.878707  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.883169  6260 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.881668  6250 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:46.875772  6278 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.886786  6278 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.889724  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.869884  6271 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:46.893149  6302 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:46.894188  6239 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:46.896528  6239 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:46.896937  6239 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:46.897825  6239 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.899008  6239 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.900581  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:46.902374  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:46.909212  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 158693us
I20260709 13:15:46.910806  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:46.907256  6294 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:46.903053  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.901255  6250 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.919261  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.915498  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:46.904474  6260 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:46.929175  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.929661  6245 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:46.935491  6268 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:46.939949  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.927501  6251 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.919112  6256 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.943583  6251 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:46.924602  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.925570  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:46.926301  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:46.922648  6279 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.927692  6301 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.927476  6203 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.950941  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.951823  6279 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.955673  5416 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.963402  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.969543  6251 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.982455  6251 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.968812  5270 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.983165  6204 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:46.971549  6271 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.984934  6271 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.961210  6301 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.974190  6254 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.991587  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.998769  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.000504  5416 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.001727  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.006737  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:46.999713  6301 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.010768  6251 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.015322  6308 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.015759  6299 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:46.999975  6279 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.017629  5519 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:46.992686  6278 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:15:47.022094  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.025660  6298 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.026786  6268 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:47.034520  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:47.036262  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 114573us
I20260709 13:15:47.040166  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:47.041316  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.047960  6279 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.049057  6279 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.048687  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.050249  6260 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.050045  6254 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.050800  6260 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:47.051854  6260 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.054462  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.063963  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.063886  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.037866  6243 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:15:47.066324  6254 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.053367  6260 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.068023  6243 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.068414  6243 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:47.069221  6243 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.070399  6243 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.042388  6251 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.060683  6072 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:15:47.077464  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 160319us
I20260709 13:15:47.077310  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.078820  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.079032  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.080355  6268 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.081154  6204 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.083745  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.084466  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.084861  6268 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.085201  6204 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.085937  5416 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.086622  6268 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.087060  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.087750  6202 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.088922  5489 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.089701  6202 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.090142  6254 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.065363  6313 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.082957  6251 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.091184  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.091952  6313 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.093327  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.096948  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.097043  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.098680  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.098573  6204 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:47.099627  6254 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:47.099906  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.100677  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.101186  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.101716  6244 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:47.102205  6244 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.098567  6202 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.102921  6202 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:47.103332  6202 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.099990  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.075659  6299 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:47.104607  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.104991  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.097141  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.109356  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:47.110422  5516 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:47.107580  6245 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.112083  6244 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:47.107297  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.132359  6245 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.135254  6202 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.136250  6204 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.137588  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.137827  6202 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:47.137699  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.141870  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.143466  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.144018  5370 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.146250  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.146518  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.147429  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.148763  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.159610  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.163862  6313 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:47.164536  6313 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:47.165552  6313 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.149641  6204 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.179000  6294 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:47.178342  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.161991  6245 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.183229  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.185657  6246 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:47.188745  6245 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.187227  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.196414  5372 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:47.199779  5370 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:47.200953  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:47.195338  6299 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:15:47.198740  6266 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.206274  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:47.199077  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.208169  6290 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.200872  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.201830  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.210850  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.213621  6202 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:47.214233  6202 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:47.207177  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.218776  5370 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.219183  5373 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:47.219462  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.201768  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:47.220652  6266 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:47.220542  6202 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.221968  5370 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.223826  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.225028  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.225221  6271 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.222841  6290 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:15:47.254264  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:47.256247  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:47.222234  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:47.332275  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.342123  5371 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.342895  6290 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.332577  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:47.347041  6320 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:15:47.356168  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.358451  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.359149  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.360106  5442 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:47.363785  5369 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:47.368109  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:47.376432  5519 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.377259  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:47.378392  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:47.378703  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:47.379834  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.378397  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.381104  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.383985  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.391760  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:47.393106  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:47.397121  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.397715  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:47.397826  5450 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:47.396111  5273 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:47.404920  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:47.405036  5273 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.406380  5521 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.408097  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:47.410801  6244 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.411381  6244 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:47.406456  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.417251  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.418269  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:47.419152  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.419487  5521 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.413858  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:47.422180  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.412405  6244 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.425495  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.421170  6251 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.425770  6260 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.432549  6239 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.433053  6239 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:47.415963  6277 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.434278  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:47.434022  6239 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.427603  6296 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.440584  6244 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.435405  6239 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.437937  6310 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:47.439234  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:47.458817  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.468482  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.471858  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.473157  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.474421  6260 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.475582  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.477356  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.461701  6308 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.480060  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.457329  5444 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:47.500725  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.475117  6310 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.502952  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.503417  6301 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.480643  6298 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.481509  6279 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:47.480633  6240 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.481644  6251 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.511557  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.478799  6296 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.476447  6277 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:15:47.513149  6256 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.519615  6301 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:47.518915  6240 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.507730  6308 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.521268  6268 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:15:47.560063  5516 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.560669  6296 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.561057  6296 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:15:47.566733  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 86655us
W20260709 13:15:47.569593  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 347394us
I20260709 13:15:47.570758  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.566401  6250 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.581848  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:47.590603  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 79607.7us
I20260709 13:15:47.614059  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.614379  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.583035  5517 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.618602  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.565407  6296 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.641453  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.582683  6250 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:47.642675  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:47.643055  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:47.617808  6310 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:47.615461  6289 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.640735  6298 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.642367  6312 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:47.660950  5518 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.661525  6246 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.685825  6326 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.661932  6266 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:47.685971  6331 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.739162  5370 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:47.684921  6312 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:47.736315  5366 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:47.720753  6324 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260709 13:15:47.784307  6302 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:47.744462  6244 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:15:47.786649  6325 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:47.787273  6325 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:47.793192  6321 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:15:47.801052  6333 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:47.802011  6333 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:47.806314  6333 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.696020  6298 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:15:47.821703  6322 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:47.860255  6322 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.852022  5447 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:47.870772  6322 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:47.871667  6308 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.872466  6260 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.874224  5414 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.876420  6296 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.697700  6250 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.740497  6266 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:47.887605  6308 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:47.881906  6310 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:47.888249  6260 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:15:47.960985  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 314142us
I20260709 13:15:47.962397  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:47.888049  6277 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.970712  6250 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:47.883116  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 241988us
I20260709 13:15:47.897641  6251 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:15:47.973567  6325 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:47.893044  6331 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:15:47.997202  6332 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:48.000633  6251 consensus_queue.cc:1243] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:15:48.069204  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 422588us
I20260709 13:15:48.055405  6301 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.070487  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:48.057376  6279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.011s
I20260709 13:15:48.000327  6308 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:48.068286  6331 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:48.084023  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:48.077832  6279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.009s	sys 0.012s
I20260709 13:15:48.092325  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.077752  6326 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.094363  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:48.097234  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 426777us
I20260709 13:15:48.090832  6331 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:48.106547  5375 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:48.063505  6310 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.094740  6246 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.106088  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.105472  6289 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.114778  6266 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.109727  6326 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.057611  6299 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:48.056072  6312 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:48.175046  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 210153us
I20260709 13:15:48.172885  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.142758  6336 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:48.176321  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59221.5us
I20260709 13:15:48.177942  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.178171  6339 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.188351  5447 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:48.189077  6278 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:48.189496  6278 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:48.180558  6243 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.200266  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:48.200995  5447 raft_consensus.cc:2376] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2. Re-sending same reply.
W20260709 13:15:48.200506  6345 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.107s	user 0.000s	sys 0.004s
I20260709 13:15:48.202724  5370 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:48.191857  5371 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:48.195928  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:48.211618  6243 raft_consensus.cc:2764] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:48.211699  6239 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:48.212337  6239 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:48.217723  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.219908  5340 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.221355  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:48.224436  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.191500  6331 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.190339  6278 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.209363  5273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 151) took 1068 ms. Trace:
I20260709 13:15:48.196606  6339 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:48.251339  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 351003us
I20260709 13:15:48.252125  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.254251  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.245775  6326 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.248636  6289 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.225662  6243 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.278620  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.293918  5447 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:48.225360  6302 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:15:48.250943  6336 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.257587  6246 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.256448  6266 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.213348  6239 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.215083  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:48.311506  6239 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.312901  5340 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.281711  6294 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:15:48.321938  5446 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:48.301056  6325 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:48.329731  6346 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.307202  6278 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.249060  5273 rpcz_store.cc:276] 0709 13:15:47.141393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.141564 (+   171us) service_pool.cc:224] Handling call
0709 13:15:47.393307 (+251743us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf6090 00007fc1d3d94f3a 00007fc1d9b4b1cc 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:48.209297 (+815990us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:47.409092 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:47.409684 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:47.409717 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:15:47.409739 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:47.410352 (+   613us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:47.410402 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:47.410436 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:15:47.410698 (+   262us) tablet.cc:701] Row locks acquired
0709 13:15:47.410717 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:15:47.410866 (+   149us) write_op.cc:270] Start()
0709 13:15:47.410972 (+   106us) write_op.cc:276] Timestamp: P: 1783602947410819 usec, L: 0
0709 13:15:47.410993 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:15:47.434973 (+ 23980us) log.cc:844] Serialized 979 byte log entry
0709 13:15:47.441108 (+  6135us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d87e28 00007fc1d77c2581 00007fc1d77c1d58 00007fc1d77c69f1 00007fc1d77c69a9 00007fc1d77c6939 00007fc1d77c6901 00007fc1d77c5b2d 000000000038f354 000000000038f199
0709 13:15:47.690251 (+249143us) op_driver.cc:464] REPLICATION: finished
0709 13:15:47.812651 (+122400us) write_op.cc:301] APPLY: starting
0709 13:15:47.812743 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:47.812889 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:47.812921 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:47.813276 (+   355us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:47.881756 (+ 68480us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:15:47.890253 (+  8497us) write_op.cc:312] APPLY: finished
0709 13:15:47.970223 (+ 79970us) log.cc:844] Serialized 28 byte log entry
0709 13:15:47.980522 (+ 10299us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.988257 (+  7735us) write_op.cc:454] Released schema lock
0709 13:15:47.996941 (+  8684us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:48.061094 (+ 64153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:48.062383 (+  1289us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":429791104,"child_traces":[["op",{"apply.queue_time_us":119789,"apply.run_cpu_time_us":6352,"apply.run_wall_time_us":225278,"num_ops":2,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":5521,"prepare.run_wall_time_us":32164,"replication_time_us":263128,"spinlock_wait_cycles":33978240,"thread_start_us":261651,"threads_started":1}]]}
I20260709 13:15:48.316463  6266 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:48.342696  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.345822  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.330447  6346 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.297770  6326 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.359191  6326 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:48.351183  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.352344  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:48.380956  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.347623  6243 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:15:48.350653  6266 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.341017  6325 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:48.391003  6336 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.431752  6331 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.419924  6260 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.447309  6308 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.452806  6346 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.432677  6325 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:15:48.496351  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 143869us
I20260709 13:15:48.497179  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.510459  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:48.514396  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:48.517001  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:48.517197  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:48.521075  6194 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.513258  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:48.539177  6243 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:48.540071  6243 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:48.551944  6338 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.501566  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.554641  6338 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.561103  6335 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.562186  6335 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.567312  6352 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:15:48.570654  6204 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:48.572121  6278 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.573338  6278 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.572216  6254 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:48.578119  6254 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.601286  6278 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.601511  5515 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:48.610338  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 109002us
I20260709 13:15:48.611953  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.613611  6326 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.580899  5269 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 2 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.617112  6254 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.616091  6300 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:48.621821  6335 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.620210  5269 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:48.616317  6194 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:48.619041  6260 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.559412  6243 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:48.639678  6204 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:48.653407  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:48.672355  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 60628.9us
I20260709 13:15:48.695972  6358 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.696978  6358 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.697652  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.698580  5369 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:48.660749  6300 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.700625  6278 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:48.713945  6278 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.715783  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:48.718384  6246 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.718472  6346 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:48.719131  6300 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.720073  6338 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.720250  6243 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.720541  6204 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.721588  6333 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.723275  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.700945  6335 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.743834  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.717291  6278 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:48.752310  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 440364us
I20260709 13:15:48.754302  6204 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.755057  6333 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.725340  6359 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:48.762959  6358 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.764671  6256 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:48.769805  6254 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:48.769965  6336 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:48.770970  6360 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:15:48.790391  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 533087us
I20260709 13:15:48.771365  6326 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.734424  6346 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:48.772465  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70039.6us
I20260709 13:15:48.793802  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:48.794821  6325 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.796881  6302 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:48.773087  6194 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:48.726536  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 511333us
I20260709 13:15:48.796640  6335 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.802740  5368 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:48.804183  6335 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.783048  5369 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:48.798905  6346 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.790879  6360 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:48.811519  5449 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:48.810249  5367 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:48.812522  6302 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:48.814242  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:48.814636  6333 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.815593  6256 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.815999  6203 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.816378  6256 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.816715  6203 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.819212  6203 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.821956  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:48.823858  5516 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
I20260709 13:15:48.826704  6302 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.827363  6302 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:48.828048  6302 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:48.828876  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:48.829581  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:48.830623  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:48.831604  5450 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:48.830641  5441 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:48.833736  6326 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.835333  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:48.836374  5450 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:48.837018  6326 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.837641  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:48.838670  5450 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
I20260709 13:15:48.837705  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:48.839133  6302 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.841262  6302 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:48.829731  5448 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:48.796717  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:48.807504  6076 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:48.812587  6360 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.841917  6302 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:48.864940  6359 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:15:48.882314  6250 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:48.883170  6250 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.885229  6308 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.886837  6308 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.888085  6346 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.891323  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.892900  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.893790  6346 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.895279  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.896073  5375 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:48.898535  6254 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:48.845167  6343 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:48.910866  6300 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:48.917812  6300 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:48.918179  6254 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.920272  6300 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:48.920742  6254 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.923477  5273 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 1 to 2, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.925730  6194 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:48.926277  6194 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:48.926719  6256 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.927623  6251 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:48.931859  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:48.880722  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:48.928504  6251 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.933993  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.945506  6240 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.946255  6240 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.948666  6240 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:48.926709  6194 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.950418  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.951246  5374 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:48.953905  5368 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:48.954721  5444 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.955969  6251 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.956807  6250 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:48.956893  6308 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:48.959683  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.961915  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.963266  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.879352  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:48.955140  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.976922  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.977823  5373 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:48.978611  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:48.979022  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.979454  6250 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:48.979943  6250 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.979993  5373 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:48.980437  6250 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.981241  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.982311  5373 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:48.983398  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:48.983517  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:48.983955  5373 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:48.985041  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 188532us
I20260709 13:15:48.986645  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:48.984476  6251 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:48.985697  6308 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:48.917832  6359 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:48.989293  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 115573us
W20260709 13:15:49.005631  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.007048  6350 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:49.007732  6350 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:48.997951  6251 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.004673  5441 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:49.017002  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.017767  6365 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.017884  5371 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.018664  6365 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:49.019224  6365 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.018085  5366 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:49.041929  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.033108  6302 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.050076  6346 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:49.052205  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:49.052901  6335 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.016186  6251 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.053544  6335 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.056807  6302 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:49.061049  6369 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:49.057263  6302 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:49.062309  6302 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.062760  6308 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.067777  6326 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.068545  6326 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.068773  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:15:49.069630  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48586.3us
I20260709 13:15:49.069743  6254 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.070171  6254 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:49.070582  6254 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.072050  6333 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.072786  6333 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.076457  6350 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.085541  5375 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:49.019775  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.089520  5371 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:49.070393  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:49.096652  6350 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.097215  6350 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:49.097702  6350 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.111761  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:49.055533  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.050765  6346 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.083065  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:49.115271  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 63193.6us
I20260709 13:15:49.134295  6352 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.086402  5366 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:49.155146  6326 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.155377  6333 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.159284  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.145244  6256 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.149788  6352 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:49.171061  5449 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:49.167992  5368 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:49.152416  6335 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.162370  5441 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260709 13:15:49.184682  6318 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:15:49.177562  6352 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.179219  5444 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:49.195890  5524 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.195904  6239 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.162465  6042 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:49.202466  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:49.208931  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83650.2us
I20260709 13:15:49.212631  6346 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.213398  6202 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.213445  6366 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.218258  6250 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.190196  6256 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.226092  6365 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:49.214028  6202 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.212096  6239 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.229987  6308 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:49.230214  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 94492.6us
W20260709 13:15:49.261694  6371 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:15:49.263703  6204 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:49.265810  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.266561  5441 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:49.266465  6204 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:49.229048  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47410.5us
W20260709 13:15:49.271728  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 121485us
I20260709 13:15:49.274400  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:49.277750  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.243803  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:49.182670  6194 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.246498  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.245020  6202 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.248454  6256 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.250443  6239 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.255406  6302 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:49.259375  6254 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.280727  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.307025  5373 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:49.316676  6075 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.302657  6256 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.314843  6246 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:49.321084  6256 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.322865  5516 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.322603  6365 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.341562  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.319998  6350 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:49.351222  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 87985.4us
I20260709 13:15:49.338778  6256 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.334596  6346 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.344098  6335 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.365260  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.366060  5449 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:49.348044  6243 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:49.362253  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.377992  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.378407  6194 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.379103  6072 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.379635  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.380450  5447 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.381615  6335 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:49.382772  6302 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.384093  6335 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:49.385958  5443 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.386188  6250 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.387650  6341 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.388530  6341 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.389536  6346 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.391239  6341 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.392087  6346 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.393392  6294 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:15:49.356305  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:49.397343  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49858.2us
W20260709 13:15:49.398010  6380 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:49.398162  6250 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.398994  6250 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.399729  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:49.399871  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.380486  5442 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:49.400588  5450 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:49.379128  5445 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:49.391824  6251 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.371321  6300 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.415887  6300 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.420068  5522 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:49.367152  6333 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:49.426376  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.431576  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:49.419327  6300 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.422183  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.439640  5446 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:15:49.441807  5449 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:49.412130  5448 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:49.446197  6268 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.446834  6268 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.424110  6294 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:49.448544  6294 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.452211  6346 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.453032  6346 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:49.453603  6243 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.435673  6335 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:15:49.455682  6387 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:49.460067  6076 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:49.461596  6368 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.464349  6350 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.466473  5447 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:49.470566  6381 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:49.471334  6250 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.408181  6279 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.479614  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:49.472677  6246 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:49.489291  5522 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.434674  6325 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:49.491851  6325 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.456956  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.482208  6254 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.473222  6260 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.465206  6202 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.478499  6308 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:49.484853  6387 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:49.537310  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 257720us
I20260709 13:15:49.490816  6279 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.494670  6325 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:49.558230  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.490391  6251 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.560410  5519 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.560669  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.490728  6333 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.568472  6333 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.572242  5524 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.572810  5522 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:49.573699  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:49.532982  6260 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.576822  6260 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.581110  5524 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:49.581765  6346 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:15:49.585772  6268 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.591377  6387 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.594317  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:49.598086  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.588860  6202 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.556288  6194 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.601336  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.601831  6300 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:15:49.540247  6250 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.605902  6250 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.608072  6250 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.559689  6279 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.608837  6243 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.601565  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:49.497375  6352 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.614037  6387 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.634389  5522 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.541998  6308 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:49.536557  6246 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:49.601691  6194 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.636732  6387 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.641662  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.642640  5372 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:49.635782  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.537170  6256 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.630580  6335 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.643306  5519 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.660357  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.645634  6387 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.645076  5515 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.641830  6366 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.667133  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.647496  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.675733  6326 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:49.676276  6326 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:49.675201  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.677336  6326 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.678424  5369 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:49.679167  6326 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.679533  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.674798  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.659785  6254 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.681332  5519 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:49.681542  6254 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.673033  5370 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:49.683001  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.685272  5370 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.670768  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.694201  6254 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.694556  6294 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.695813  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.698652  6256 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.698907  6194 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.685145  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.674364  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.699987  5340 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:49.701145  6243 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.702862  6246 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:49.705339  5269 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 33) took 2268 ms. Trace:
I20260709 13:15:49.711124  5520 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:49.711634  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:49.712231  5524 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.712636  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.713740  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.720348  5524 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:49.698836  6279 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.722823  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.715245  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.726087  6279 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:49.727792  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 304085us
I20260709 13:15:49.740769  5370 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:49.657233  6335 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:49.755422  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.756136  5524 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:49.757721  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.758373  5370 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.705816  5269 rpcz_store.cc:276] 0709 13:15:47.436749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.436909 (+   160us) service_pool.cc:224] Handling call
0709 13:15:49.705256 (+2268347us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.748279 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:48.750816 (+  2537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:48.780018 (+ 29202us) write_op.cc:435] Acquired schema lock
0709 13:15:48.799798 (+ 19780us) tablet.cc:662] Decoding operations
0709 13:15:48.917407 (+117609us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:48.917552 (+   145us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:48.917602 (+    50us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:15:48.918141 (+   539us) tablet.cc:701] Row locks acquired
0709 13:15:48.918195 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:15:48.918385 (+   190us) write_op.cc:270] Start()
0709 13:15:48.918533 (+   148us) write_op.cc:276] Timestamp: P: 1783602948918312 usec, L: 0
0709 13:15:48.918570 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.919325 (+   755us) log.cc:844] Serialized 974 byte log entry
0709 13:15:49.165629 (+246304us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.455682 (+290053us) write_op.cc:301] APPLY: starting
0709 13:15:49.455781 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.455932 (+   151us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.459384 (+  3452us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:49.459951 (+   567us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:49.460338 (+   387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:15:49.460425 (+    87us) write_op.cc:312] APPLY: finished
0709 13:15:49.460784 (+   359us) log.cc:844] Serialized 28 byte log entry
0709 13:15:49.461160 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.461280 (+   120us) write_op.cc:454] Released schema lock
0709 13:15:49.461356 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:49.567401 (+106045us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.567444 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":286376,"apply.run_cpu_time_us":3589,"apply.run_wall_time_us":101056,"num_ops":2,"prepare.queue_time_us":25333,"prepare.run_cpu_time_us":4966,"prepare.run_wall_time_us":171467,"replication_time_us":220818,"thread_start_us":166220,"threads_started":2}]]}
I20260709 13:15:49.752928  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:49.770401  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:49.771265  5524 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:49.772608  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.773453  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.775344  6243 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:15:49.779173  5524 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.783526  5450 raft_consensus.cc:2368] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:49.740705  6308 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.768855  6326 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.801064  6326 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.801575  6326 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.801643  6246 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:49.803702  6382 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:49.804051  6300 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:49.773811  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.804900  6300 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.807605  6335 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.791503  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.793862  6404 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.808532  6404 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.782124  5366 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:49.809875  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:49.810398  6352 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.810976  6404 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.811283  6300 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.794346  6250 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.811995  6250 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.813196  6390 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.813252  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.814244  6250 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.813674  6387 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.815136  5374 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:49.815449  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.816107  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.794459  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.822474  5374 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.822687  5522 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:49.816188  5366 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.795061  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.816365  6387 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:49.818156  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.835686  5521 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:49.836789  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:49.776733  6279 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.838143  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:49.837788  6279 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:15:49.837807  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.824050  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:49.825615  5447 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.828421  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.830569  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.847672  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.846297  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.848659  5449 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:49.848742  5372 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.849910  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.850234  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.832320  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.833339  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.852394  5448 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:49.836802  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.804112  6382 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:49.840487  6279 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.857656  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.858346  5368 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.842549  6250 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:49.842897  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.842787  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.822912  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:49.820552  5370 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:49.861627  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.844048  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:49.851468  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.856851  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.857115  5441 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:49.813678  6390 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.859246  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.864451  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:49.868907  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46116.3us
I20260709 13:15:49.869035  6390 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.870038  5450 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:49.858197  6382 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:49.871869  6382 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.873471  6256 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:49.874302  5443 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:49.875969  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:49.876629  5520 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.877624  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:49.877930  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:49.878201  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.878767  5521 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.879109  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:49.879622  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.880359  5521 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.861037  5366 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.882004  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.881633  6398 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:49.883754  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:49.884610  5517 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:49.884068  6398 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.885598  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.886509  6398 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.886868  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.884125  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.887745  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.888338  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.888602  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.888368  5523 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.889534  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.890278  5518 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.890434  6256 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:49.889043  5368 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.891698  6256 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.892652  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.893290  5368 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:49.893574  6404 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:49.894160  6404 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.894636  5368 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:49.896296  6404 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.879947  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:49.882939  5521 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.889185  5524 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:49.899856  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:49.898484  6246 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.902637  6194 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.905929  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:49.906740  5522 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:49.907600  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.913841  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.915385  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.877486  6250 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:49.921264  5372 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:49.922039  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.923127  6326 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.902933  6246 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:49.922224  6250 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:15:49.925716  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46312us
I20260709 13:15:49.889146  5444 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:49.932054  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.901414  6308 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.941917  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:49.949189  6279 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:49.949935  6279 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.950989  5520 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:49.952275  6279 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:49.953707  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:49.953004  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:49.956000  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:49.957706  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:49.961071  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:49.924341  6404 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.963299  6404 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.963690  6404 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.965246  5367 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:15:49.966558  6394 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.345s	user 0.004s	sys 0.000s
I20260709 13:15:49.931802  5369 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:49.967840  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.968698  5450 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
W20260709 13:15:49.970026  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92484.3us
I20260709 13:15:49.971129  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:49.972784  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:49.973553  6325 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.973618  6243 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.974124  6243 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.974478  6243 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.978688  5273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 152) took 1105 ms. Trace:
I20260709 13:15:49.982632  5366 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:49.983376  6243 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:49.987411  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:49.961189  5521 raft_consensus.cc:2410] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:49.961199  5374 raft_consensus.cc:2410] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:49.985602  6243 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:49.986502  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47231.4us
I20260709 13:15:49.979168  5273 rpcz_store.cc:276] 0709 13:15:48.880181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.881574 (+  1393us) service_pool.cc:224] Handling call
0709 13:15:49.978570 (+1096996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.957589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:48.958129 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:48.958158 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:15:48.958176 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:48.958531 (+   355us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:48.958578 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:48.958614 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:48.958797 (+   183us) tablet.cc:701] Row locks acquired
0709 13:15:48.958814 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:15:48.958960 (+   146us) write_op.cc:270] Start()
0709 13:15:48.959083 (+   123us) write_op.cc:276] Timestamp: P: 1783602948958910 usec, L: 0
0709 13:15:48.959106 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.959801 (+   695us) log.cc:844] Serialized 537 byte log entry
0709 13:15:49.410977 (+451176us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.567971 (+156994us) write_op.cc:301] APPLY: starting
0709 13:15:49.568065 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.568204 (+   139us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.568325 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:49.568646 (+   321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:49.568855 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:49.568937 (+    82us) write_op.cc:312] APPLY: finished
0709 13:15:49.569183 (+   246us) log.cc:844] Serialized 22 byte log entry
0709 13:15:49.569367 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.598469 (+ 29102us) write_op.cc:454] Released schema lock
0709 13:15:49.600397 (+  1928us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":86814,"reported_tablets":1,"spinlock_wait_cycles":285952,"child_traces":[["op",{"apply.queue_time_us":152609,"apply.run_cpu_time_us":2066,"apply.run_wall_time_us":55911,"num_ops":1,"prepare.queue_time_us":15283,"prepare.run_cpu_time_us":2491,"prepare.run_wall_time_us":2491,"replication_time_us":404555,"thread_start_us":202850,"threads_started":1}]]}
I20260709 13:15:50.011399  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:49.930606  6246 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.938513  6239 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.945586  6335 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.063397  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:50.049691  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62349.6us
W20260709 13:15:50.075222  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.085688  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 132767us
I20260709 13:15:50.092410  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.093571  5375 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:50.096276  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:50.096534  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.097215  5443 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:50.099663  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:50.100504  5524 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.101910  6268 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.102869  6268 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.048983  6250 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.109674  6250 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:50.110226  6250 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:50.111266  6250 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.112711  6336 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.114708  6326 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.031451  6390 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.136507  6390 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:50.137704  5519 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:50.029932  6279 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.062554  6243 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.150484  6335 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.151289  6335 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.159248  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:50.064036  6041 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:50.164641  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 100874us
I20260709 13:15:50.164785  6366 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:50.166884  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 86738.1us
I20260709 13:15:50.169911  6336 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:50.170491  6336 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:50.171521  6336 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.144894  6279 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.180456  5449 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:50.188220  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:50.238438  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50329.1us
I20260709 13:15:50.239112  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:50.194445  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:50.240439  5523 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.211360  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.241355  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:50.221244  5270 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 147) took 1973 ms. Trace:
I20260709 13:15:50.197790  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:50.243786  5521 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:50.228886  5269 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 2 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.242305  5270 rpcz_store.cc:276] 0709 13:15:48.247882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.248043 (+   161us) service_pool.cc:224] Handling call
0709 13:15:50.220892 (+1972849us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254422,"reported_tablets":2}
I20260709 13:15:50.258675  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.260571  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:15:50.262946  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51688us
I20260709 13:15:50.265252  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:50.266180  5369 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:50.266569  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:50.267136  5374 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.265252  6204 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.269675  6204 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.270059  6204 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.273777  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.274873  5370 raft_consensus.cc:2368] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:50.277700  6243 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.281684  6326 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.282366  6326 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.282850  6326 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.960959  6308 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.289233  5269 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:15:50.307513  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47048.1us
I20260709 13:15:50.310596  5524 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:50.292481  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.191468  6194 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.173378  6336 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.216689  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 665) took 1024 ms. Trace:
I20260709 13:15:50.183009  6279 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.318732  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:50.346065  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:50.293906  6398 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.348203  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:50.309073  6202 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:50.355290  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 257517us
I20260709 13:15:50.189103  6239 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 13:15:50.317035  6308 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:50.367949  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.313257  6246 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.326845  6194 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.326998  5516 rpcz_store.cc:276] 0709 13:15:49.191867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.192653 (+   786us) service_pool.cc:224] Handling call
0709 13:15:49.203920 (+ 11267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.344928 (+141008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.216305 (+871377us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002b98d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:50.216585 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256164096}
I20260709 13:15:50.370479  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:50.371260  6251 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:50.371208  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:50.381970  6254 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.326521  6390 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.261907  6404 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:50.379364  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 213661us
I20260709 13:15:50.388911  5374 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:50.390307  6398 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.395365  6325 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:50.395802  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:50.366612  6202 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:50.356863  6240 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:15:50.401489  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.409569  6204 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.374462  6279 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.372848  6392 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:15:50.446488  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 45780.3us
I20260709 13:15:50.452922  6391 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:50.403986  6366 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:15:50.444865  6382 consensus_meta.cc:287] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.008s
W20260709 13:15:50.470059  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 236133us
I20260709 13:15:50.447449  6254 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.449205  6390 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.446831  6076 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:50.448984  6251 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:50.494289  6246 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.494673  6404 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.475539  6392 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:50.457248  6202 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.494923  6204 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:50.495283  6404 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.495777  6392 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.497047  6392 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.455003  6325 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:50.497318  6194 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.481455  6391 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:15:50.490157  6412 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:15:50.485555  6279 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.493227  6390 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.494246  6251 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.481863  5441 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:50.498354  6391 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.513967  5523 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:50.495815  6404 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.486599  5446 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:50.488912  6254 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.498104  6325 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.490223  6366 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:50.548576  6308 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.550345  6404 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.551620  6250 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.501312  6326 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:50.557874  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 199963us
I20260709 13:15:50.565697  5445 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:50.551877  6404 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.543452  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:50.553567  6279 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.591361  5489 leader_election.cc:400] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:50.593924  5489 leader_election.cc:403] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.599648  6335 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.595268  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.591269  5369 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:50.591038  6415 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:50.564302  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 217795us
W20260709 13:15:50.613562  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 294914us
I20260709 13:15:50.622208  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:50.608624  6325 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.607826  6387 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:50.608152  6243 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.586671  6416 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:15:50.626012  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.636390  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:50.633693  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 319622us
I20260709 13:15:50.593461  6202 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.639245  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:15:50.641319  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.644685  6239 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:50.646948  6239 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.648598  6387 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.649847  6279 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:50.650513  6279 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.650804  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.642719  6414 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.652599  6414 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.652926  6279 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.652938  6414 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.653862  6351 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.651022  6404 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.655049  6404 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.655409  6404 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.657961  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.659245  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:15:50.660396  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 259046us
I20260709 13:15:50.652184  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:15:50.662724  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 256083us
I20260709 13:15:50.665100  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.651859  5368 raft_consensus.cc:2410] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:15:50.668684  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.669281  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.671105  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.675807  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:15:50.642483  5260 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7b301483f19c4d508e00d917819ac039 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 86b410d62f4040c39d33dc0698998562 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:50.678285  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:50.679744  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.680579  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.663762  6387 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.663125  6326 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:50.688934  5260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 71575.5us
I20260709 13:15:50.673262  6336 raft_consensus.cc:2764] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:15:50.626526  6415 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:50.696267  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:50.697006  5524 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:50.704380  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:50.704613  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:50.705734  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:50.690127  6350 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:50.709769  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:50.705734  5370 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:50.710512  5366 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.716583  6415 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.725919  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:50.686976  6308 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.684682  6246 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:50.748693  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 49915.4us
I20260709 13:15:50.692175  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.758549  6246 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:50.765837  6308 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.767449  6308 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:50.768237  6308 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.658816  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.770061  6426 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:50.770426  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 130341us
I20260709 13:15:50.710292  6350 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.771317  6432 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.772872  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:50.770617  6426 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.773644  6350 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:50.773962  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69425us
I20260709 13:15:50.774575  6072 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:50.775247  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:50.776197  5375 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:50.776408  6194 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:50.777032  6194 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:50.773656  6076 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:50.778208  6194 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.778764  6325 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.776225  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:50.789973  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 114276us
I20260709 13:15:50.794958  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:50.701630  6430 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:50.816156  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 179867us
W20260709 13:15:50.824618  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 133014us
W20260709 13:15:50.826557  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 70691.6us
I20260709 13:15:50.828132  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.773283  6432 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:50.781394  6336 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:50.849462  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:50.773654  6426 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.852784  6202 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:50.804379  6415 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.854117  6351 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.854439  5445 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:50.855176  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.855273  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:50.856204  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:50.857678  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:50.857897  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:50.858712  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:50.858925  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:50.831334  6421 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.859404  6325 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:50.859547  5490 leader_election.cc:400] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:50.861917  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:50.867311  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:50.756246  6326 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:15:50.869774  5448 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.834085  6246 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:50.834039  6430 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:50.831312  6268 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:15:50.886742  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 209643us
I20260709 13:15:50.883128  5490 leader_election.cc:403] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:50.888020  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.893766  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.896021  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.898677  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.867720  6335 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.869824  5446 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:50.900693  6423 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.897639  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.885903  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:50.891252  6414 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.874219  6440 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.882992  6325 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.870399  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:50.906983  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.882009  6421 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.886327  6326 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:50.888533  6336 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:50.888777  6279 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:50.878532  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:50.871698  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:50.885531  6042 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.890718  6300 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.922960  5449 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:50.917675  6341 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:50.886112  6366 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:15:50.907568  6246 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.894318  6390 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.919998  6325 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.955386  5448 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:50.892953  6254 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.970348  6254 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:50.919696  6440 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.979262  5366 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:50.981227  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.932706  6336 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.918916  6438 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.916100  6437 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.982395  6438 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:50.983960  5442 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:50.902143  6268 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:50.947553  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49997.6us
I20260709 13:15:50.985311  6243 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.985569  6424 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.985882  6243 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.986009  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:50.986904  6268 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.987013  6350 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.926265  6326 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:50.989019  6326 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:50.932699  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:50.990597  5367 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.991365  6414 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.973162  6440 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.869021  6432 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.991986  6268 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:50.992574  6268 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.993680  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.994920  6391 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.995323  6390 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:50.926637  6421 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:50.953619  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68196.3us
I20260709 13:15:50.943614  6435 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.961925  6335 raft_consensus.cc:2764] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:51.015308  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:51.016248  5447 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:50.918678  6430 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:50.967799  6308 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:50.937088  5444 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:50.968199  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.024673  5447 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:51.025141  5447 pending_rounds.cc:85] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 1
I20260709 13:15:51.025552  5370 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:50.979028  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:50.924327  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:51.027372  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 103134us
I20260709 13:15:51.028232  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:50.994884  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:50.942236  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:51.030036  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:15:51.030507  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 88349us
I20260709 13:15:50.963248  6422 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.943399  6279 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:51.033483  5340 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:51.025389  5447 pending_rounds.cc:107] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:51.085126  5447 raft_consensus.cc:2889] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.039628  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:51.086758  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47243.1us
I20260709 13:15:51.033705  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.051339  6268 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.025796  6326 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.047468  6308 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:51.032251  6433 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.209s	user 0.004s	sys 0.001s
I20260709 13:15:51.088960  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.090934  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:51.035073  6440 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.117539  5373 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:51.108059  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.050010  6250 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.038000  6398 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:51.093297  5369 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:15:51.093243  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 60012us
I20260709 13:15:51.119277  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:51.092957  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154919us
I20260709 13:15:51.119449  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:51.126533  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:51.126219  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:51.088471  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.132861  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.133179  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:51.118031  6194 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.125748  6250 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.127898  5450 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:51.125914  6398 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:51.139695  6436 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.130584  6246 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.133512  6256 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:51.123014  6404 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.132213  6438 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:51.140888  6250 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.162284  6256 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:51.141701  6279 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.178129  6256 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.171957  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:51.179442  6075 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:51.165325  6434 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:51.166285  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:51.143496  6398 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.147807  6432 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.141181  6440 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.179328  6240 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:51.195590  6240 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:51.196107  6240 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:51.165977  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:51.180653  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:51.198803  6424 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:51.199631  6424 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:51.170773  6419 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.145015  6426 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:51.187855  6445 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.194226  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:51.212893  6426 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:15:51.201865  6350 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:15:51.206629  6419 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:51.229296  6404 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.237250  5450 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:51.197283  6240 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.244974  6240 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.248214  5367 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:51.240037  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:51.229276  6421 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.200989  6424 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.254058  6419 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.266343  6419 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.262835  6243 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.292661  6239 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.251245  6325 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:51.300594  6325 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:51.294144  6243 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.313349  6420 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:51.304807  6417 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.333998  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.335968  5519 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:51.340742  6387 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:51.341564  6387 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:51.314306  6420 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.330211  6435 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:51.347918  6425 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:15:51.346591  6268 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.333164  6417 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:51.364081  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 244686us
I20260709 13:15:51.365190  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:51.354173  6366 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:15:51.369562  5414 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:51.369686  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.372076  5414 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:51.376242  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:51.372114  6387 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:51.374650  6414 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.372825  6251 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.352064  6435 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:51.395604  6420 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.378422  6430 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.379181  6279 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.408701  6351 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:51.409857  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:51.409551  6250 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:51.416570  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.418195  5523 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.407843  6421 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.428215  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:51.431151  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.415977  6445 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:51.436728  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:51.437527  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.438196  5374 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:51.439029  5374 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.441080  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:51.436369  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:51.443771  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:51.444550  5522 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.445662  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.453287  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:51.437857  6251 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:51.465735  6251 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:51.466220  6251 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.453351  5446 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:51.459720  6203 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:51.487180  6203 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.487654  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.488306  5367 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.462738  5450 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:51.462924  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.490422  5368 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:15:51.490315  6459 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:15:51.491199  6268 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:51.459931  5371 raft_consensus.cc:2368] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:51.491856  6268 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.492534  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.420949  6351 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.457998  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:15:51.457172  6458 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:51.488126  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:51.464792  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.549630  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:51.549850  5372 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:51.550374  5515 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
I20260709 13:15:51.440801  6445 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:51.520665  6415 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.007s
I20260709 13:15:51.521257  6350 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:51.522169  5490 leader_election.cc:400] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:51.555318  5490 leader_election.cc:403] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.528942  6435 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:51.530279  6351 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:51.530279  6442 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.576s	user 0.004s	sys 0.000s
I20260709 13:15:51.535319  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:51.538666  6417 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.539804  6203 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:51.541977  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:51.473657  6279 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:51.553763  6415 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.008s	sys 0.008s
I20260709 13:15:51.549292  5366 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:51.554431  6336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.010s
I20260709 13:15:51.566581  5522 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:51.566761  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.563622  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:51.568107  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:51.570076  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.570778  5372 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:51.571807  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.572991  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.568005  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:51.665198  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 97278.7us
W20260709 13:15:51.670187  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.659s (SENT) [suppressed 34 similar messages]
I20260709 13:15:51.662936  6398 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.676321  6398 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.584719  6424 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:51.696063  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:51.665180  6335 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:51.697595  5522 raft_consensus.cc:2368] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3.
I20260709 13:15:51.665992  6436 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.565882  5443 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:51.662273  6250 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.694110  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:51.677590  6392 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:51.683743  6421 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.665604  6279 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:15:51.663993  6336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.016s	sys 0.010s
I20260709 13:15:51.690411  5369 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.716655  5339 leader_election.cc:400] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3.
I20260709 13:15:51.722621  5339 leader_election.cc:403] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:51.702582  6436 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.699390  6335 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:51.731168  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:51.713001  5371 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:51.712112  6350 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:51.717377  6392 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:51.733124  6436 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.736146  6335 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.716811  6421 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.739097  6350 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:51.745069  6250 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.759167  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.749042  6445 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:51.752303  6465 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:15:51.757067  6351 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:15:51.753688  6350 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.771267  5372 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:51.772240  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:51.775514  5269 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 34) took 1979 ms. Trace:
I20260709 13:15:51.775642  5375 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:51.775998  5269 rpcz_store.cc:276] 0709 13:15:49.796554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.796757 (+   203us) service_pool.cc:224] Handling call
0709 13:15:51.775444 (+1978687us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:50.758566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:50.759235 (+   669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:50.759282 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:15:50.759301 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:50.759778 (+   477us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:50.759843 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:50.759876 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:15:50.760234 (+   358us) tablet.cc:701] Row locks acquired
0709 13:15:50.760252 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:15:50.760407 (+   155us) write_op.cc:270] Start()
0709 13:15:50.760536 (+   129us) write_op.cc:276] Timestamp: P: 1783602950760358 usec, L: 0
0709 13:15:50.760557 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:15:50.761313 (+   756us) log.cc:844] Serialized 974 byte log entry
0709 13:15:51.018797 (+257484us) op_driver.cc:464] REPLICATION: finished
0709 13:15:51.135900 (+117103us) write_op.cc:301] APPLY: starting
0709 13:15:51.135988 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:51.136115 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:51.162770 (+ 26655us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:51.178808 (+ 16038us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:51.179006 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:15:51.179056 (+    50us) write_op.cc:312] APPLY: finished
0709 13:15:51.179326 (+   270us) log.cc:844] Serialized 28 byte log entry
0709 13:15:51.179529 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:51.179631 (+   102us) write_op.cc:454] Released schema lock
0709 13:15:51.179680 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:51.180106 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:51.180136 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":414656,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":116853,"apply.run_cpu_time_us":3988,"apply.run_wall_time_us":44189,"num_ops":2,"prepare.queue_time_us":403961,"prepare.run_cpu_time_us":39506,"prepare.run_wall_time_us":138611,"raft.queue_time_us":64286,"raft.run_cpu_time_us":28027,"raft.run_wall_time_us":106127,"replication_time_us":258088,"thread_start_us":629741,"threads_started":4,"wal-append.queue_time_us":140017}]]}
I20260709 13:15:51.750694  6042 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:51.787230  6419 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:51.785109  5367 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:51.757311  6430 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:15:51.799119  6425 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 13:15:51.801473  6462 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.282s	user 0.000s	sys 0.003s
I20260709 13:15:51.796221  6398 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:51.781333  6268 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:51.811883  6422 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.800979  6392 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.820015  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:51.778540  6279 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.814293  6419 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:51.830201  5260 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7b301483f19c4d508e00d917819ac039 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 86b410d62f4040c39d33dc0698998562 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:51.831012  5446 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.832129  6268 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:51.831844  6436 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.835217  5449 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
W20260709 13:15:51.810391  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 64168.4us
I20260709 13:15:51.820168  6398 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.820511  6422 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.849921  5369 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
W20260709 13:15:51.850322  6464 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:15:51.849572  6422 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.856396  6246 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3.
I20260709 13:15:51.845268  6398 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.868721  6420 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.874240  6420 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.876413  6420 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.868686  6444 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:51.864612  6436 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.883380  6444 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.884485  6421 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:51.892664  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.887351  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:15:51.891358  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:15:51.894409  6350 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.886373  6420 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:51.896056  6420 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.896605  6444 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:51.897033  6445 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.894433  6419 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.891640  6251 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.901937  6421 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.902318  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:51.902690  6421 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.903275  6336 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.904796  6421 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.911379  6420 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.911702  6335 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.889173  5368 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:51.914405  6427 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.915541  6427 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:51.914325  6350 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:51.916437  6427 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.916679  6422 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:51.918902  6335 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.897471  6445 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:51.923524  5270 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.924337  6427 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.923524  6445 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:51.926451  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.926694  6251 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.944641  6422 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:51.948415  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.950206  5375 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:51.951278  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.952651  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:51.953450  5518 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.953799  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:51.954380  5372 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.956508  6445 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.958570  5367 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:51.960318  5371 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:51.960683  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:51.961197  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:51.961650  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:51.962427  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:51.949180  5366 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:51.961920  5448 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:51.967487  5447 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:51.975667  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.977141  6256 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:51.977732  6256 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:51.979806  6256 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:51.981137  5372 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:51.981309  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:51.983697  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:51.986176  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:51.987097  5446 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:51.988739  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:51.990512  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:51.991107  5519 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.944161  5368 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.998935  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:51.944380  5270 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.002521  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:52.003125  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:52.017346  5446 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.017508  6414 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.018199  6414 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:52.004292  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.019163  6251 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.004379  6420 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.020453  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.009752  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.010919  5522 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.038304  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.011555  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.039299  5515 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:52.012277  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.041462  5524 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:52.013685  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.042491  5517 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:52.025710  6420 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.015235  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:52.043838  6076 raft_consensus.cc:2368] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:52.011368  6422 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:52.045754  6420 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.015308  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.046628  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.047356  5366 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:52.045210  6422 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:52.047976  6422 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:15:52.018365  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:52.048956  6422 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:52.049737  6251 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:52.050158  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:52.050411  6422 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.029819  6471 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.031281  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:52.024718  5519 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:51.988171  5375 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:52.038371  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.050287  6251 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:52.050736  6436 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:15:52.050974  6335 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:15:52.027966  5441 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:52.006399  6326 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.051807  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:52.052512  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:52.034695  5372 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.059952  5270 catalog_manager.cc:5697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.063377  5448 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.064092  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.064754  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:52.065052  5519 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:52.066344  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.067655  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:52.068504  5447 raft_consensus.cc:2368] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3.
I20260709 13:15:52.069628  6392 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.070123  6392 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.070466  6392 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.070640  6251 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.071713  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.072891  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.073392  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.069406  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.047528  5518 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:15:52.074136  6419 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.074657  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.074223  5447 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:52.075361  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.075773  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.076449  6419 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.077292  5447 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.063305  6471 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.080230  6471 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.066068  6440 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.081214  6440 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:52.082257  6440 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.084412  5340 leader_election.cc:400] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3.
I20260709 13:15:52.072860  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.075860  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.086839  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:52.091521  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:52.094280  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.089638  5270 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.100594  5446 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:15:52.019164  6414 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:52.088160  6420 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:15:52.087988  6326 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.102526  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.109702  5370 raft_consensus.cc:2368] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:52.090528  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.120352  5448 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:52.110071  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.129941  6392 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.130503  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.130955  6427 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.131366  6421 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.133354  6421 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:52.088475  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:15:52.135250  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44785.8us
I20260709 13:15:52.136865  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.065619  6445 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.133870  6421 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.066560  5368 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:15:52.143136  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.145184  6398 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.153595  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.149559  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.134414  6420 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:52.097301  5270 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.142447  6336 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.141942  6427 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:52.145525  5371 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.155607  6445 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:52.160006  6420 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.181404  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.181404  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.188123  5523 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:52.198026  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.208271  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:52.157073  6042 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:52.224462  5372 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:52.227346  6398 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.228087  6398 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:52.189118  6420 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.211407  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.201362  6246 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.236783  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.238160  5368 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.246516  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.247627  5521 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:52.247700  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:52.256461  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.267958  5490 leader_election.cc:400] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:52.268406  5490 leader_election.cc:403] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:52.265754  6434 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.270041  6434 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:52.215780  6251 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:52.272173  5524 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.273980  6202 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.292451  5489 leader_election.cc:400] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:52.305802  5489 leader_election.cc:403] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:52.294183  6398 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:52.308434  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.270555  6434 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.248422  5366 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:52.189736  6445 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.310324  6415 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.328397  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.335485  5521 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:52.331511  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.336412  5523 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.316845  6202 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
W20260709 13:15:52.267227  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 127065us
I20260709 13:15:52.239284  6427 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.247337  6438 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:15:52.270792  6256 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:15:52.317695  6251 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:52.355284  5522 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.423116  5521 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.315654  6326 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.333496  6424 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:52.418221  5515 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.480499  5522 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.489967  6251 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.434947  6415 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:15:52.548826  6415 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:52.483305  6414 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:52.437402  6392 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.536427  6440 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:52.574446  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.601814  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.553890  6414 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:52.610005  6487 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:15:52.616072  6421 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.580756  6424 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.583820  5523 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:52.580667  6440 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:52.627817  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 459293us
W20260709 13:15:52.625886  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 333699us
I20260709 13:15:52.630772  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.631356  5522 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:52.634647  5441 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.001s
I20260709 13:15:52.635870  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.636531  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.660859  6336 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.661513  6440 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.624044  6424 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:52.696241  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59784us
W20260709 13:15:52.699833  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83645.6us
I20260709 13:15:52.640839  6422 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.635900  6326 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:15:52.696929  5522 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:15:52.715152  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:52.713624  6489 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 13:15:52.717667  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:52.721756  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63883.2us
I20260709 13:15:52.725765  5370 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.720206  5524 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:52.716185  6438 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.707501  6422 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:52.718839  6256 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.734232  6438 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.717986  6246 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:52.736550  6438 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.718187  6500 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.736460  6246 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:52.737265  6500 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.734397  6256 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.739532  6500 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.739912  6256 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:52.733769  6414 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:15:52.739804  5371 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.001s
I20260709 13:15:52.741415  6246 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:15:52.742810  6476 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.431s	user 0.003s	sys 0.008s
I20260709 13:15:52.743373  6246 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.743955  6246 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.748044  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:52.749266  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:52.750090  6246 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.719244  6482 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:52.753458  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.757277  5370 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.724207  6419 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.774391  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:52.775035  5445 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.741278  5371 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:52.776551  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.777184  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.778851  5374 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:52.780519  5373 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.780995  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.782526  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.785473  5374 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:52.772051  6482 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:52.790990  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.791996  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.793483  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.776417  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:52.802685  5515 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:52.803269  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 565840us
W20260709 13:15:52.803830  6420 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.004s
I20260709 13:15:52.804209  6482 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.802541  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.805847  5444 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:52.794883  6428 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.808017  6434 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.802565  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:52.810380  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.811606  6422 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:52.811740  6471 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.813802  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.798277  6076 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:15:52.818156  6445 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.822728  6503 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.825361  6424 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:52.850467  5516 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:52.804225  6420 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.832086  6396 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.829749  6351 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.852805  6268 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.867591  6268 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:52.868599  6268 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.869374  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.872074  6421 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.873749  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:52.875427  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:52.876354  6500 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.877069  6438 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.876930  6500 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.877753  6251 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.879068  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:52.864323  6414 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.879863  6507 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.880151  6414 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.882418  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.864598  5441 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.878283  6251 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.833729  6422 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.883750  6414 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.861075  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:52.867043  6502 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.887470  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.869911  6268 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.888156  5370 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:52.879226  6500 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.852641  6434 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:52.914613  6251 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.916491  6414 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.917040  6414 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.919085  6414 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.823614  6440 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:52.867000  6415 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.896623  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.933578  5370 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:52.897884  6505 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.186s	user 0.003s	sys 0.000s
I20260709 13:15:52.897665  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.940065  5516 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
W20260709 13:15:52.941380  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.003s	sys 0.016s
W20260709 13:15:52.941809  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.003s	sys 0.016s
W20260709 13:15:52.942157  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 628879us
I20260709 13:15:52.898248  6419 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.946980  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.947340  6419 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.947935  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.947914  6203 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:52.949007  6203 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:52.949530  6203 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:52.950047  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.950546  6203 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:52.952708  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 78333.8us
I20260709 13:15:52.871835  6511 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:52.888386  6396 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.900424  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.900911  6420 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:52.901290  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.858826  6503 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.901997  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:52.902441  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:52.902549  6508 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.979753  6508 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:52.980233  6508 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.980978  6444 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.902995  6421 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.903182  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:52.903247  5521 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.902320  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:52.861059  6506 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:15:52.901978  5515 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.903891  6502 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.988821  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:15:52.989074  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 87857.3us
I20260709 13:15:52.989634  5447 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:52.989930  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:52.903788  6335 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.910702  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:52.838656  6496 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:15:52.935189  5520 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.883769  6422 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:52.932997  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.938196  5366 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:52.938723  6251 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.939031  5374 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:52.933656  6415 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:52.972113  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:53.038151  5375 raft_consensus.cc:2368] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:52.985221  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:52.986553  6387 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:53.039822  5373 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:15:52.985563  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 82478.2us
I20260709 13:15:52.985654  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.040601  5370 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:52.988979  6507 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.040733  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:52.993047  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:53.041836  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48904.3us
I20260709 13:15:53.006430  5518 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.998703  6420 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.009560  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.050356  5374 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:52.985910  6501 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.051803  6501 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:52.994745  6434 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.994712  6421 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.060633  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:52.996366  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:52.996374  6494 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:52.987385  6440 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:15:53.007848  6419 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.057354  6482 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.055663  6387 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:53.055186  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.040005  6240 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:15:53.065116  6279 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.075551  6414 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:53.075560  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:53.082849  6482 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.068214  6434 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.076311  5446 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:53.074116  6335 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:15:53.076157  6494 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.109215  6482 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.128368  6503 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.106545  6414 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.138670  6434 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:53.122977  6421 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.142643  6421 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:53.150070  6519 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:15:53.127830  6396 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:53.155517  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:53.156260  5515 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:53.160154  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:53.145229  6421 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.143415  6502 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.171315  6414 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.168910  6419 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.172204  6419 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.162709  6422 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.172580  6419 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.115433  6387 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.181165  6500 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:53.190122  6500 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:53.192866  6500 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.194541  6500 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.197508  6387 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.197371  6508 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:53.199868  6508 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:15:53.204569  6498 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.506s	user 0.000s	sys 0.004s
I20260709 13:15:53.212433  6482 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.166157  5518 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:53.191078  6422 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.214229  6422 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.214628  6422 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.214526  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:53.226001  6421 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:53.228929  6421 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:53.236241  6421 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.237886  6494 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.229954  5444 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:53.261518  6415 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.277794  6482 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.278378  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:53.279138  5515 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.283951  5520 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:15:53.285856  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:53.287375  6482 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.288297  6482 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:53.288719  5515 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:53.288539  6419 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:53.185676  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 195520us
I20260709 13:15:53.303251  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:53.293924  6501 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:53.307664  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 251511us
W20260709 13:15:53.314013  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.306879  6420 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:53.318815  5445 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:53.319165  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:53.301293  6419 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.323082  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:53.324285  6471 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:53.330506  6471 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.328459  6420 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:53.338195  6420 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.322410  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:53.328229  6486 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:53.347283  6486 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.349153  6471 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.338182  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:53.352171  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:53.352496  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:53.352773  6486 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.356037  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:53.362566  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:53.363888  5371 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.366153  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.354225  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:53.370754  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 310219us
I20260709 13:15:53.309303  6482 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.372223  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.354722  5515 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.376716  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:53.363098  6240 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:53.383409  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.379361  5445 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
I20260709 13:15:53.388128  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.388602  5445 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:53.370074  6507 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.345726  6422 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:53.392099  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.374629  6525 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.370010  6436 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:53.381551  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.386698  6240 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.390646  6508 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.375486  5450 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:53.423947  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.426281  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.432188  5370 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:53.434319  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:53.390522  6494 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:15:53.419029  6440 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.423048  6240 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.436352  6502 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.435755  6335 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.447968  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:15:53.454741  6510 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:53.454540  6268 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.478085  5368 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:53.421089  6525 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:53.498960  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 72819.1us
W20260709 13:15:53.532200  5260 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7b301483f19c4d508e00d917819ac039 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 86b410d62f4040c39d33dc0698998562 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:53.534627  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.535379  5370 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
W20260709 13:15:53.538175  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 542868us
I20260709 13:15:53.541075  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.549755  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:53.550990  6076 raft_consensus.cc:2368] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3.
I20260709 13:15:53.551481  6496 raft_consensus.cc:2764] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:15:53.489712  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 587304us
I20260709 13:15:53.528148  6440 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:53.556794  6510 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:53.564424  6420 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:53.570082  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.569957  6440 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.570817  5370 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:53.570672  6420 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:53.572127  6440 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.574759  6525 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.575073  5515 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:53.578069  6444 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:53.578720  6444 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:53.580366  6335 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:53.581804  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:53.582506  5441 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
W20260709 13:15:53.561952  6521 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:15:53.580564  5415 leader_election.cc:400] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3.
I20260709 13:15:53.584841  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.557016  6414 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.499225  6396 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:15:53.563036  6438 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.592358  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:53.580950  6335 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.596961  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.601045  5490 leader_election.cc:400] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:53.601576  5490 leader_election.cc:403] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:53.603776  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:53.604017  6440 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:53.604534  5518 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:53.605361  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:53.606371  5515 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:53.609719  6335 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.615516  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.592207  6513 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.618196  6434 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:15:53.629302  6422 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:53.580950  6425 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:15:53.612257  6532 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.598448  6438 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:53.628168  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.634356  5518 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:53.635612  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.615746  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:53.602448  6420 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:15:53.676184  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48109.1us
I20260709 13:15:53.680689  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.694067  5375 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:53.694537  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.698426  5450 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:53.603001  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:53.705029  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:53.709973  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 76602.8us
I20260709 13:15:53.625558  6335 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:15:53.675454  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:53.704089  6268 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.626502  6440 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:15:53.693308  6494 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.752844  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:53.704448  6436 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.693373  6508 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:53.748016  6422 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:53.746731  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 155006us
W20260709 13:15:53.732976  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 192637us
I20260709 13:15:53.738694  6483 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.769356  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 73607.1us
I20260709 13:15:53.745381  6256 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:53.776564  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:53.775314  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:53.729507  6513 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:15:53.762665  6543 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:53.783131  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:53.783838  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:53.787704  5375 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.776073  6508 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.789153  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:53.790738  6508 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.782181  6256 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.793447  6256 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:53.779852  6483 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.793201  6268 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:53.785527  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:53.795687  6483 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.795367  5375 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:15:53.770915  6422 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.797320  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:53.779525  6500 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.002s
I20260709 13:15:53.775789  6396 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.706844  6510 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:53.796430  6351 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.798975  6533 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.814549  6528 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:53.799456  6420 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.808020  6526 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.833703  6552 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:53.834267  6532 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:53.799875  6422 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.796538  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:53.801072  6469 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:53.786015  6494 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.824573  6421 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:53.839640  6351 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.820358  6396 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.819448  6543 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.865360  6552 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.874312  6552 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.851367  6526 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.878062  6526 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.855947  6532 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.905109  6532 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.864424  6351 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.867205  6421 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:53.844628  6533 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.931792  6396 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:53.933840  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:53.936875  6240 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.939337  6240 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:53.943326  6421 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:53.945850  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:53.918812  6502 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.970498  6533 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:53.976465  6422 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:53.953101  6436 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:53.993101  6422 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:53.998553  6526 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.000756  6526 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:54.001840  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56085.5us
I20260709 13:15:54.003223  6534 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:54.003814  6534 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:15:54.004776  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.007318  6420 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.007776  6527 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.008174  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.008453  6527 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.009709  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.010715  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.011251  5371 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:54.008270  6420 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:53.989061  6351 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.013820  6420 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:54.017462  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:54.017633  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.018162  5450 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.018683  5368 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:54.021601  6415 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:54.021816  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:54.022368  5443 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.022748  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:15:54.024801  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 344291us
I20260709 13:15:54.025246  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.025709  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:54.026386  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:54.027268  6417 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.027662  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.027693  6417 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:54.028738  6417 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.028708  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.029680  6444 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:54.032577  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.033277  5515 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:54.039572  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.040283  5522 raft_consensus.cc:2368] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:15:54.040364  6543 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:54.040663  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.041479  5516 raft_consensus.cc:2368] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3.
I20260709 13:15:54.041867  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.043661  5522 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:54.044158  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.044921  5515 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:54.017654  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:54.046697  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.046756  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.047114  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.032644  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.048601  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:54.050246  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.034263  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.038944  5448 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:54.018332  5445 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:54.049321  5447 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.061794  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.049015  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.020792  6438 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.081967  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.085512  6422 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:54.088510  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 303062us
I20260709 13:15:54.088761  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.137743  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.123553  6438 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:54.191008  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 101172us
I20260709 13:15:54.232349  5447 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:15:54.204101  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:54.254462  5448 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.197374  5450 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:15:54.065126  6534 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:54.272378  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:54.320468  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48164.9us
I20260709 13:15:54.323273  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:54.316490  6549 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.476s	user 0.013s	sys 0.007s
I20260709 13:15:54.324952  6500 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:54.251194  6351 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:54.260032  6545 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.332152  6500 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.325768  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.336397  6485 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.260025  5520 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:54.259650  6486 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.259719  6419 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:54.348362  6546 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.266494  6471 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:54.350760  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.348603  6351 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.333124  6545 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:54.205699  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:54.368471  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.330869  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:54.436156  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 105359us
I20260709 13:15:54.434365  5339 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:54.438930  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:54.440943  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:54.205955  6483 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.396741  5522 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:54.348905  6500 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:54.456200  5375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.009s	sys 0.015s
I20260709 13:15:54.456070  5448 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:54.474861  5448 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:15:54.475384  5448 pending_rounds.cc:85] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 1
I20260709 13:15:54.475689  5448 pending_rounds.cc:107] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:54.475993  5448 raft_consensus.cc:2889] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:54.456087  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.018s	sys 0.024s
I20260709 13:15:54.393404  6527 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:54.380540  6546 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:54.454030  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.478893  5519 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:54.461954  6556 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.462522  6554 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:54.442916  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:54.477031  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.018s	sys 0.024s
W20260709 13:15:54.630342  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 829961us
W20260709 13:15:54.388453  6427 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.025s
W20260709 13:15:54.568428  5375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.009s	sys 0.015s
W20260709 13:15:54.453801  5366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.018s
I20260709 13:15:54.351143  6486 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.463727  6485 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:54.443780  6471 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:54.664933  6555 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 13:15:54.665966  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 122482us
I20260709 13:15:54.668876  5414 leader_election.cc:400] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:15:54.669343  5414 leader_election.cc:403] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:54.670083  6527 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:54.670748  5414 leader_election.cc:400] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3.
I20260709 13:15:54.671123  5414 leader_election.cc:403] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:54.670078  6415 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.672051  6502 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:15:54.672843  6502 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:15:54.676743  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.678449  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:54.678690  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.680367  5520 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:54.682698  6502 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3.
I20260709 13:15:54.684720  6500 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:54.695497  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:54.362226  6419 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:54.706619  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:54.708720  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:54.710211  5523 raft_consensus.cc:2410] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:54.647589  5366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.005s	sys 0.019s
W20260709 13:15:54.696699  5521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.043s
W20260709 13:15:54.657122  6553 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.337s	user 0.000s	sys 0.002s
W20260709 13:15:54.711452  5521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.001s	sys 0.044s
I20260709 13:15:54.723367  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:54.703662  5443 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.001s
I20260709 13:15:54.657621  6414 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.490773  6483 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.696938  6556 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:54.658602  6485 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:54.692838  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 534358us
I20260709 13:15:54.654896  6421 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:54.637570  6427 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.008s	sys 0.025s
I20260709 13:15:54.639317  5522 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:54.734808  5523 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:54.686748  6554 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.762585  6523 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:54.767288  6554 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:54.716696  6502 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:54.769737  6502 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.741508  6414 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.772291  6502 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:54.735613  6527 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.738402  6440 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:15:54.774420  6440 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:54.774888  6440 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:54.775306  6482 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:54.775903  6482 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.776830  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:54.726207  6508 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:54.716264  6500 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:15:54.457779  6351 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.781860  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:54.738111  5443 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:54.752435  6485 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.784868  5522 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:54.739840  6496 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:54.778175  6417 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.749s	user 0.005s	sys 0.006s
I20260709 13:15:54.793176  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:54.787755  6414 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:54.798816  5522 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:15:54.802232  5374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.008s	sys 0.043s
W20260709 13:15:54.802664  5374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.009s	sys 0.043s
I20260709 13:15:54.622763  6546 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:54.799585  5446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.017s	sys 0.050s
I20260709 13:15:54.790225  6421 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:54.758931  6556 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.803892  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 738) took 1166 ms. Trace:
W20260709 13:15:54.803905  6510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.015s	sys 0.058s
I20260709 13:15:54.797711  6496 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:54.763343  6523 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.799322  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 727) took 1434 ms. Trace:
I20260709 13:15:54.833039  5374 rpcz_store.cc:276] 0709 13:15:53.637984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.812208 (+174224us) service_pool.cc:224] Handling call
0709 13:15:53.812674 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:53.812934 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:53.819344 (+  6410us) log.cc:844] Serialized 14 byte log entry
0709 13:15:53.998074 (+178730us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:15:54.803021 (+804947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:54.803080 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:54.803177 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.803264 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.803834 (+   570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11604,"prepare.queue_time_us":10398,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":43573,"raft.run_cpu_time_us":2006,"raft.run_wall_time_us":132978,"spinlock_wait_cycles":10211072,"thread_start_us":983229,"threads_started":1}
I20260709 13:15:54.789767  6508 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:54.832270  5446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.017s	sys 0.051s
I20260709 13:15:54.775923  6440 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.798025  6417 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:54.834227  6510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.016s	sys 0.058s
I20260709 13:15:54.854146  5522 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
W20260709 13:15:54.848986  6513 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.012s	sys 0.049s
W20260709 13:15:54.873047  6513 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.012s	sys 0.049s
I20260709 13:15:54.873672  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:15:54.874425  6417 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:54.875092  6417 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:54.875584  6417 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:15:54.877458  6417 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:54.873948  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.832530  6414 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:54.832541  6527 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:54.882366  6471 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:54.883122  5443 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:54.853209  6532 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:54.887856  6438 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.652s	user 0.013s	sys 0.000s
I20260709 13:15:54.897096  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.837723  6421 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.902300  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:54.904593  5374 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:15:54.909862  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 447795us
I20260709 13:15:54.973381  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.894594  6440 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:54.909250  5367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.013s
I20260709 13:15:54.903914  6545 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:54.990540  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.998726  6421 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:54.918329  6471 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
W20260709 13:15:54.915343  5518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.013s	sys 0.040s
I20260709 13:15:54.990121  5442 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:54.992777  6351 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:54.993619  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:54.986325  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.997148  6508 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:54.997992  6485 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:54.999838  6545 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.003165  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.985718  6500 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:54.916379  6565 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.883013  6496 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.006613  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:54.978659  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 733) took 1383 ms. Trace:
W20260709 13:15:55.008646  5338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.008s	sys 0.010s
I20260709 13:15:54.900274  6527 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:55.000751  5367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.008s	sys 0.013s
W20260709 13:15:55.000341  5518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.014s	sys 0.040s
I20260709 13:15:55.008368  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:55.062454  6545 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.066185  6565 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.074290  6527 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.074512  6545 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.074694  6565 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.074982  6527 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.075570  6527 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:55.078076  6564 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:54.897743  6414 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.062925  6508 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:54.850817  5369 rpcz_store.cc:276] 0709 13:15:53.361303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.369045 (+  7742us) service_pool.cc:224] Handling call
0709 13:15:53.582243 (+213198us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:15:53.595676 (+ 13433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.676240 (+ 80564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.679005 (+  2765us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.763736 (+ 84731us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.855593 (+ 91857us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:53.857373 (+  1780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.868070 (+ 10697us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.777862 (+909792us) raft_consensus.cc:1685] finished
0709 13:15:54.784160 (+  6298us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.795253 (+ 11093us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16132,"raft.queue_time_us":3364,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":63018,"spinlock_wait_cycles":9095424,"thread_start_us":73553,"threads_started":1,"wal-append.queue_time_us":424808}
I20260709 13:15:55.083667  6508 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.062736  6421 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.087020  6572 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.011942  5443 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:55.087857  6572 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:55.089247  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:55.089745  6508 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.089984  5443 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
W20260709 13:15:55.087041  6567 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:15:55.091109  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:54.990731  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 88375.2us
I20260709 13:15:55.068663  6510 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.095808  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:55.096181  6510 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.096608  6072 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:55.093052  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 728) took 1039 ms. Trace:
I20260709 13:15:54.915315  5444 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:54.904194  6532 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.004361  6420 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 13:15:55.153927  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.176651  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.097124  5521 rpcz_store.cc:276] 0709 13:15:54.053937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.054556 (+   619us) service_pool.cc:224] Handling call
0709 13:15:54.054962 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.070027 (+ 15065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.070064 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.070544 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.721647 (+651103us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:54.721712 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.721840 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.092779 (+370939us) raft_consensus.cc:1685] finished
0709 13:15:55.092805 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.092982 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14858,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":650064,"threads_started":1,"wal-append.queue_time_us":815325}
I20260709 13:15:55.180491  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.181627  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.177635  5372 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
W20260709 13:15:55.179976  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 484532us
W20260709 13:15:55.185390  5447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.008s	sys 0.007s
W20260709 13:15:55.188679  5447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.008s	sys 0.008s
I20260709 13:15:55.095883  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:15:55.203153  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 571918us
I20260709 13:15:55.065275  6500 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.138118  6572 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.210597  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:15:55.212001  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 478151us
I20260709 13:15:55.166116  6545 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.241206  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:55.241099  6545 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.242699  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:55.243458  6545 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.210026  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:55.183630  6565 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.188483  6557 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:55.215008  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.274286  6510 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.278611  6510 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.064925  5366 rpcz_store.cc:276] 0709 13:15:53.591384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.790275 (+198891us) service_pool.cc:224] Handling call
0709 13:15:53.790633 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.816066 (+ 25433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.819140 (+  3074us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.865944 (+ 46804us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.672174 (+806230us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:15:54.736395 (+ 64221us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:54.738748 (+  2353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.758245 (+ 19497us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.892509 (+134264us) raft_consensus.cc:1685] finished
0709 13:15:54.893873 (+  1364us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.975069 (+ 81196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9108,"raft.queue_time_us":54166,"raft.run_cpu_time_us":19505,"raft.run_wall_time_us":818310,"spinlock_wait_cycles":13685632,"thread_start_us":848727,"threads_started":1,"wal-append.queue_time_us":920873}
I20260709 13:15:55.274045  5368 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:55.280665  6485 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.218155  6527 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.274957  6436 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.281666  6527 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.282100  6527 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.281054  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:55.278707  6532 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.276342  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.166204  6421 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.292994  5370 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
W20260709 13:15:55.271211  6566 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:55.275288  6414 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.291922  6527 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.268795  6575 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.257503  6545 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.276872  6500 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.273877  6546 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:55.270576  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 36) took 1216 ms. Trace:
I20260709 13:15:55.334426  6471 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.335212  6576 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.335773  6485 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.336346  6557 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:15:55.352510  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 109880us
I20260709 13:15:55.297695  5441 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
W20260709 13:15:55.348137  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 141413us
I20260709 13:15:55.268301  6565 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.331552  5521 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:55.298151  6574 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.353597  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:55.345697  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 130720us
W20260709 13:15:55.354081  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 143535us
I20260709 13:15:55.362931  6574 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.350477  6546 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:55.371245  6546 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.371789  6574 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.377720  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 705) took 1347 ms. Trace:
I20260709 13:15:55.379096  6581 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.385902  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:55.382015  5449 rpcz_store.cc:276] 0709 13:15:54.030082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.905957 (+875875us) service_pool.cc:224] Handling call
0709 13:15:54.906900 (+   943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.907210 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:55.290570 (+383360us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.377221 (+ 86651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.377311 (+    90us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:55.377401 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.377506 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.377655 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14331,"prepare.queue_time_us":281351,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4125,"thread_start_us":380814,"threads_started":2}
I20260709 13:15:55.387096  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:55.388007  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:55.388847  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:55.389678  6581 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:55.390661  6550 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.537s	user 0.009s	sys 0.017s
I20260709 13:15:55.348950  6545 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.392797  6595 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.393065  6545 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.393677  6595 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.393860  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 725) took 1345 ms. Trace:
I20260709 13:15:55.397586  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 891) took 1373 ms. Trace:
I20260709 13:15:55.394039  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 754) took 1254 ms. Trace:
I20260709 13:15:55.394335  6573 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.394083  6590 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.394713  6486 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.395696  5370 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:55.399668  5524 rpcz_store.cc:276] 0709 13:15:54.139617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.393097 (+1253480us) service_pool.cc:224] Handling call
0709 13:15:55.393517 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.393707 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.393733 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.393780 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:55.393808 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.393874 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.393982 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:55.398017  5447 rpcz_store.cc:276] 0709 13:15:54.023696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.262422 (+238726us) service_pool.cc:224] Handling call
0709 13:15:54.331976 (+ 69554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.333977 (+  2001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.334021 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.334487 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.213795 (+879308us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:55.213854 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.213955 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.397323 (+183368us) raft_consensus.cc:1685] finished
0709 13:15:55.397342 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.397501 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1536,"raft.queue_time_us":1651,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":876750,"threads_started":1,"wal-append.queue_time_us":971081}
I20260709 13:15:55.407276  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.442780  5521 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:55.409344  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.418506  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:55.451761  5372 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:55.420125  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 41) took 1404 ms. Trace:
I20260709 13:15:55.420768  6595 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.437316  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:55.452981  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:55.492547  5372 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.376262  6532 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:55.485385  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.348915  6575 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.365654  6471 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.503556  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 902) took 1432 ms. Trace:
I20260709 13:15:55.503806  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.521467  5370 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:55.357678  6485 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.399592  6513 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.400317  6546 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.393260  6556 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.517165  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.398880  6436 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.363328  6557 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.520182  5445 rpcz_store.cc:276] 0709 13:15:54.071543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.437020 (+1365477us) service_pool.cc:224] Handling call
0709 13:15:55.503481 (+ 66461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:55.532411  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.475245  6203 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.354723  6576 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.517387  6532 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.482414  6590 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.503782  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:55.600513  5521 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:55.675576  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.698237  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:55.701782  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 312936us
I20260709 13:15:55.707746  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.713060  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.654600  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:55.863752  5449 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:55.864043  6508 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:55.864367  6510 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.864650  6508 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:55.731930  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 761) took 1459 ms. Trace:
I20260709 13:15:55.865103  6595 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:55.865185  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 905) took 1147 ms. Trace:
I20260709 13:15:55.865828  5449 rpcz_store.cc:276] 0709 13:15:54.717545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.864438 (+1146893us) service_pool.cc:224] Handling call
0709 13:15:55.864730 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.864882 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.864907 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.864947 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:55.864979 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.865031 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.865131 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:55.345604  5367 rpcz_store.cc:276] 0709 13:15:54.054335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.061896 (+  7561us) service_pool.cc:224] Handling call
0709 13:15:54.136853 (+ 74957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.233120 (+ 96267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.234734 (+  1614us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.345343 (+110609us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.165956 (+820613us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:55.180358 (+ 14402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.195018 (+ 14660us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.270331 (+ 75313us) raft_consensus.cc:1685] finished
0709 13:15:55.270358 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.270508 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7440,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":22396,"thread_start_us":687161,"threads_started":1,"wal-append.queue_time_us":840617}
I20260709 13:15:55.701313  6565 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.865762  6595 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.869675  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.868207  6414 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:55.868221  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 906) took 1150 ms. Trace:
I20260709 13:15:55.769515  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.870466  5449 rpcz_store.cc:276] 0709 13:15:54.717895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.867352 (+1149457us) service_pool.cc:224] Handling call
0709 13:15:55.867659 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.867915 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.867943 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.867984 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:55.868016 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.868072 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.868172 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:55.871495  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:55.871655  6595 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:55.841442  6602 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:55.872272  5449 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:55.842249  6578 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:15:55.842656  6583 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
W20260709 13:15:55.842900  6597 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:15:55.872856  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 908) took 1154 ms. Trace:
I20260709 13:15:55.870474  6414 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:55.873878  5449 rpcz_store.cc:276] 0709 13:15:54.718500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.871472 (+1152972us) service_pool.cc:224] Handling call
0709 13:15:55.871986 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.872633 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.872801 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:55.850432  6596 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:15:55.432175  6573 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.875730  6414 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:55.745065  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.876830  6573 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.877300  5373 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:55.841807  6579 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:55.861358  6557 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.431180  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:15:55.863247  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.886799  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 766) took 1539 ms. Trace:
W20260709 13:15:55.653903  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 235541us
I20260709 13:15:55.864856  6510 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.656888  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:55.865568  5519 rpcz_store.cc:276] 0709 13:15:54.272352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.631788 (+359436us) service_pool.cc:224] Handling call
0709 13:15:54.632133 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.763775 (+131642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.763810 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:54.763852 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:54.763878 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.731299 (+967421us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540018f6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:55.731375 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.731830 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302241024}
I20260709 13:15:55.867475  6508 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:55.887450  5523 rpcz_store.cc:276] 0709 13:15:54.347182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.784977 (+437795us) service_pool.cc:224] Handling call
0709 13:15:54.785289 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.881892 (+ 96603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.881922 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:54.881962 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:54.882002 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.886540 (+1004538us) spinlock_profiling.cc:243] Waited 96.4 ms on lock 0x7b540025d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:55.886586 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.886725 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221666176}
I20260709 13:15:55.887485  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 899) took 1852 ms. Trace:
I20260709 13:15:55.900264  5445 rpcz_store.cc:276] 0709 13:15:54.034964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.720384 (+1685420us) service_pool.cc:224] Handling call
0709 13:15:55.886749 (+166365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.886947 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.886971 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.887011 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:55.887175 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.887276 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.887414 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:55.904553  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.905488  6545 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.906047  6545 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.906723  6420 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:55.758306  6440 consensus_meta.cc:287] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.770s	user 0.012s	sys 0.000s
I20260709 13:15:55.907536  6420 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.908038  5448 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:55.908510  6471 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.908759  6545 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.872784  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.480931  5444 rpcz_store.cc:276] 0709 13:15:54.015368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.042627 (+ 27259us) service_pool.cc:224] Handling call
0709 13:15:54.043187 (+   560us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:54.171617 (+128430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.189470 (+ 17853us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:54.456959 (+267489us) log.cc:844] Serialized 582 byte log entry
0709 13:15:54.903700 (+446741us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:55.385749 (+482049us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.419725 (+ 33976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.419819 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.419871 (+    52us) raft_consensus.cc:1685] finished
0709 13:15:55.419882 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.420054 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47344,"raft.queue_time_us":133170,"raft.run_cpu_time_us":501,"raft.run_wall_time_us":60828,"spinlock_wait_cycles":809856,"thread_start_us":221501,"threads_started":1,"wal-append.queue_time_us":640170}
I20260709 13:15:55.862270  5370 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:55.911610  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 43) took 1046 ms. Trace:
I20260709 13:15:55.912052  5444 rpcz_store.cc:276] 0709 13:15:54.864868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.910371 (+1045503us) service_pool.cc:224] Handling call
0709 13:15:55.910801 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.911027 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.911066 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.911128 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:55.911200 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.911424 (+   224us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.911549 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:55.913727  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 692) took 1897 ms. Trace:
W20260709 13:15:55.868547  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 165609us
I20260709 13:15:55.906853  6591 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:55.917546  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:55.922201  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.863281  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 707) took 1832 ms. Trace:
I20260709 13:15:55.923768  5447 rpcz_store.cc:276] 0709 13:15:54.030687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.438691 (+1408004us) service_pool.cc:224] Handling call
0709 13:15:55.439050 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.862948 (+423898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.862977 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.863033 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:55.863064 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.863123 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.863229 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64375,"raft.queue_time_us":423654,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93}
I20260709 13:15:55.862663  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 904) took 1172 ms. Trace:
I20260709 13:15:55.928097  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:55.923269  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:55.926069  6532 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.974452  6420 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:55.878547  6579 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:55.931427  6574 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:55.927830  6573 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.900256  6414 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:55.932117  6502 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.928171  6557 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:56.003259  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 35) took 1224 ms. Trace:
W20260709 13:15:56.003201  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 75241.7us
I20260709 13:15:56.004693  5372 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:15:55.931986  6591 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:56.007427  6573 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.007829  6076 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:56.008402  6527 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.005s
I20260709 13:15:56.011893  5522 rpcz_store.cc:276] 0709 13:15:54.779093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.870435 (+ 91342us) service_pool.cc:224] Handling call
0709 13:15:54.870906 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.885133 (+ 14227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.885167 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.886509 (+  1342us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.292469 (+405960us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:55.292511 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.292629 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.003042 (+710413us) raft_consensus.cc:1685] finished
0709 13:15:56.003062 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.003202 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14328,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":13593,"thread_start_us":314206,"threads_started":1,"wal-append.queue_time_us":608672}
I20260709 13:15:56.002429  6595 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.016966  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 711) took 1038 ms. Trace:
I20260709 13:15:56.018123  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:56.004607  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.005116  6545 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:56.067094  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49808.8us
I20260709 13:15:56.001827  6425 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.021209  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.069116  6425 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:15:56.069656  6510 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.006486  6508 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:15:56.071074  6508 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:56.071468  6508 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:56.015524  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:55.914177  5446 rpcz_store.cc:276] 0709 13:15:54.016594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.027264 (+ 10670us) service_pool.cc:224] Handling call
0709 13:15:54.027590 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.190463 (+162873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.205480 (+ 15017us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.235069 (+ 29589us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.866534 (+631465us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:54.887248 (+ 20714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.913243 (+1025995us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b540032fad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:55.913296 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.913356 (+    60us) raft_consensus.cc:1685] finished
0709 13:15:55.913372 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.913653 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34732,"raft.queue_time_us":54187,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":42335,"spinlock_wait_cycles":106609536,"thread_start_us":594229,"threads_started":1,"wal-append.queue_time_us":657699}
I20260709 13:15:56.026088  6590 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:56.072167  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56733.9us
I20260709 13:15:56.072674  6590 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.072921  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:56.073105  6590 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:56.073637  6590 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.026854  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:55.938572  5441 rpcz_store.cc:276] 0709 13:15:54.690580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.707932 (+1017352us) service_pool.cc:224] Handling call
0709 13:15:55.862057 (+154125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.862273 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.862312 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.862362 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:55.862403 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.862469 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.862597 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:56.010281  6485 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.034497  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 909) took 1315 ms. Trace:
I20260709 13:15:56.035279  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 887) took 2476 ms. Trace:
I20260709 13:15:56.036001  6579 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:56.013176  6414 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:56.041306  5260 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7b301483f19c4d508e00d917819ac039 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 86b410d62f4040c39d33dc0698998562 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:15:56.041852  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:15:56.008952  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 623961us
I20260709 13:15:56.045159  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:56.046103  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:56.046937  6573 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.034126  6532 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.018460  6557 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:56.034386  6575 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.009001  6574 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.030294  6527 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.049136  6591 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:55.397637  5518 rpcz_store.cc:276] 0709 13:15:54.047979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.049389 (+  1410us) service_pool.cc:224] Handling call
0709 13:15:54.049758 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.050157 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.050192 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.050742 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.075498 (+1024756us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:55.075886 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.076177 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.076286 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.393592 (+317306us) raft_consensus.cc:1685] finished
0709 13:15:55.393618 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.393776 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":972,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":24575,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":45168,"spinlock_wait_cycles":13696,"thread_start_us":1018054,"threads_started":1,"wal-append.queue_time_us":1013991}
I20260709 13:15:56.052500  6593 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.055656  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:56.059134  6419 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:56.062731  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 710) took 1084 ms. Trace:
I20260709 13:15:56.062438  6502 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:56.064124  5447 rpcz_store.cc:276] 0709 13:15:54.978618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.931304 (+952686us) service_pool.cc:224] Handling call
0709 13:15:56.016297 (+ 84993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.016623 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.016652 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.016695 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:56.016725 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.016794 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.016909 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":9588}
I20260709 13:15:56.070561  6425 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:56.016122  6420 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:15:56.102162  5449 rpcz_store.cc:276] 0709 13:15:54.718802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.875134 (+1156332us) service_pool.cc:224] Handling call
0709 13:15:55.875409 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.875615 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:55.875917 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:15:56.033992 (+158075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.034070 (+    78us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:56.034139 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.034235 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.034402 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":470,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":116,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":157681,"threads_started":1}
I20260709 13:15:56.074188  6545 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.053015  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 709) took 1138 ms. Trace:
W20260709 13:15:56.369549  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 313929us
I20260709 13:15:56.074471  6440 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.151556  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:56.368763  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 268374us
I20260709 13:15:56.370128  5445 rpcz_store.cc:276] 0709 13:15:54.978291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.061776 (+1083485us) service_pool.cc:224] Handling call
0709 13:15:56.062146 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.062348 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.062376 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.062426 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:56.062455 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.062522 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.062671 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:56.403995  5260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 362705us
I20260709 13:15:56.134150  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 907) took 1390 ms. Trace:
I20260709 13:15:56.437223  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 912) took 1054 ms. Trace:
W20260709 13:15:56.256399  6417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.260s	user 0.012s	sys 0.027s
I20260709 13:15:56.434226  5448 rpcz_store.cc:276] 0709 13:15:54.718194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.781232 (+ 63038us) service_pool.cc:224] Handling call
0709 13:15:56.108761 (+1327529us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003098d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:56.108921 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569411840}
I20260709 13:15:56.438161  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:15:56.131207  6562 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.258s	user 0.011s	sys 0.007s
I20260709 13:15:56.323961  6595 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.450536  5449 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:56.130820  6605 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:56.102638  6471 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.432093  6482 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.407070  6545 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.440498  6591 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:56.443514  6417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.448s	user 0.014s	sys 0.028s
I20260709 13:15:56.439558  6510 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:56.459261  6604 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:15:56.454305  6496 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:56.106258  5442 rpcz_store.cc:276] 0709 13:15:53.559011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.560885 (+  1874us) service_pool.cc:224] Handling call
0709 13:15:53.992819 (+431934us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5800018998. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:15:53.993053 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.000415 (+1007362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.033642 (+1033227us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54003bc754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:56.035180 (+  1538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148201088}
I20260709 13:15:56.432713  6532 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.459532  6551 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:56.478273  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:56.433178  6593 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.463670  6552 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:56.468276  6591 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:56.352471  6508 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:56.522229  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.478509  6557 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:56.566233  6551 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:56.582988  6609 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:56.584722  6551 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.435067  5444 rpcz_store.cc:276] 0709 13:15:54.913724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.929737 (+1016013us) service_pool.cc:224] Handling call
0709 13:15:56.001468 (+ 71731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.013385 (+ 11917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.019542 (+  6157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.023369 (+  3827us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:56.028441 (+  5072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.033242 (+  4801us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.051881 (+ 18639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:56.587987  6593 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:56.576090  6075 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:56.578008  6565 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:56.591387  6565 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:56.593688  6563 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.744s	user 0.014s	sys 0.009s
I20260709 13:15:56.578492  6591 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.595252  6436 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.595775  6436 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:56.596276  6436 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.510311  6510 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.608619  6414 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.607486  6508 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.610198  6574 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.617969  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 734) took 2988 ms. Trace:
I20260709 13:15:56.618700  5375 rpcz_store.cc:276] 0709 13:15:53.593581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.796675 (+203094us) service_pool.cc:224] Handling call
0709 13:15:53.816610 (+ 19935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.817004 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.817046 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.817707 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.638119 (+820412us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:54.638180 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.638282 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.130478 (+1492196us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:15:56.514328 (+383850us) raft_consensus.cc:1685] finished
0709 13:15:56.514360 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.580182 (+ 65822us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32349,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":9146,"spinlock_wait_cycles":76817152,"thread_start_us":785167,"threads_started":1,"wal-append.queue_time_us":1013585}
I20260709 13:15:56.466449  6605 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.662528  6605 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:56.508051  6482 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:56.663487  6482 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.664829  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:56.463551  6595 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:56.623117  6590 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.003s
I20260709 13:15:56.665470  5373 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.665889  6590 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.666949  6595 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:56.668751  6482 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.669083  5366 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.670806  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.671509  5442 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:56.672771  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.673477  5442 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:56.674887  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.668813  6590 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.631348  6527 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.637959  6414 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.675704  5442 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:56.676355  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.677098  5444 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:56.676905  6414 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.677459  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.678210  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.679514  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.679661  6414 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.680500  5441 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:56.464855  6471 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:56.639912  6532 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.609269  6510 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.620692  6579 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:15:56.556401  6485 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:56.681797  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.682157  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.682075  6485 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:56.682933  5447 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:56.681772  6471 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.655134  6565 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.658761  6576 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.580058  6552 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.687568  6523 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:56.689021  6552 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.683985  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:56.693215  5370 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:56.691169  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:56.693303  5448 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.696688  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 752) took 1717 ms. Trace:
I20260709 13:15:56.700517  5373 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:56.706379  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 264533us
I20260709 13:15:56.707350  5448 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:15:56.710335  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.711254  5448 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:56.518229  6496 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.685348  6485 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:15:56.713618  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 275553us
I20260709 13:15:56.729990  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:56.755084  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 312467us
I20260709 13:15:56.715197  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:56.797380  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:56.508198  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:56.798923  5269 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 1 to 2, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 2 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:56.843513  6590 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:15:56.712534  6502 consensus_queue.cc:1243] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 53eb858bdf82438d83f1be6a01da2e0e log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:15:56.851011  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53718us
I20260709 13:15:56.726995  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.756438  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 756) took 2596 ms. Trace:
I20260709 13:15:56.801468  6419 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:15:56.794108  6436 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.856864  6565 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.885777  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.888639  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.896106  5522 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:56.885785  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:56.897678  5339 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:56.898455  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.899217  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.900548  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.854314  6576 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:15:56.912195  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.008s	sys 0.023s
W20260709 13:15:56.912704  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.008s	sys 0.023s
I20260709 13:15:56.908092  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.915169  5270 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 152) took 5691 ms. Trace:
I20260709 13:15:56.917908  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.878234  6414 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:56.920746  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.921732  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:56.697240  5371 rpcz_store.cc:276] 0709 13:15:54.979496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.979640 (+   144us) service_pool.cc:224] Handling call
0709 13:15:56.695709 (+1716069us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:15:56.695993 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.696252 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.696291 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.696350 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:56.696398 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.696473 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.696610 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15482240}
I20260709 13:15:56.869005  6606 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:15:56.945542  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.940392  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:56.897231  6510 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:56.865252  6043 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:56.913565  6615 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:56.978302  6615 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.932768  6603 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:56.937170  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:56.937582  6414 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.936544  6523 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.904057  6532 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:56.915586  5270 rpcz_store.cc:276] 0709 13:15:51.208979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.213574 (+  4595us) service_pool.cc:224] Handling call
0709 13:15:56.900460 (+5686886us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:52.534962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:52.535623 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:52.535656 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:15:52.535673 (+    17us) tablet.cc:662] Decoding operations
0709 13:15:52.536367 (+   694us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:52.536446 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:52.536473 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:15:52.536979 (+   506us) tablet.cc:701] Row locks acquired
0709 13:15:52.537010 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:15:52.537148 (+   138us) write_op.cc:270] Start()
0709 13:15:52.537261 (+   113us) write_op.cc:276] Timestamp: P: 1783602952537109 usec, L: 0
0709 13:15:52.537284 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:52.607929 (+ 70645us) log.cc:844] Serialized 2135 byte log entry
0709 13:15:52.884267 (+276338us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:15:53.172155 (+287888us) op_driver.cc:464] REPLICATION: finished
0709 13:15:53.484926 (+312771us) write_op.cc:301] APPLY: starting
0709 13:15:53.485024 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:53.485214 (+   190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:53.485240 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:53.529079 (+ 43839us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:53.583980 (+ 54901us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:15:53.589171 (+  5191us) write_op.cc:312] APPLY: finished
0709 13:15:53.618339 (+ 29168us) log.cc:844] Serialized 46 byte log entry
0709 13:15:53.631660 (+ 13321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:53.631802 (+   142us) write_op.cc:454] Released schema lock
0709 13:15:53.631868 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:53.633835 (+  1967us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:53.633893 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":734446,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":312532,"apply.run_cpu_time_us":3434,"apply.run_wall_time_us":147363,"num_ops":5,"prepare.queue_time_us":315489,"prepare.run_cpu_time_us":6690,"prepare.run_wall_time_us":100143,"raft.queue_time_us":231274,"raft.run_cpu_time_us":22697,"raft.run_wall_time_us":219231,"replication_time_us":634702,"spinlock_wait_cycles":8830080,"thread_start_us":619353,"threads_started":4,"wal-append.queue_time_us":41404,"wal-append.run_cpu_time_us":80418,"wal-append.run_wall_time_us":1943896}]]}
I20260709 13:15:56.951125  6590 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.966544  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 729) took 2896 ms. Trace:
I20260709 13:15:56.967550  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:56.921393  6574 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.919865  6420 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:56.946784  6623 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.984484  6615 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:56.896171  6545 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:56.903724  6496 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:56.912232  6610 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.971345  6551 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.950659  6591 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.986920  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.019102  6420 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.992880  6573 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:57.009773  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:57.034343  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:56.982018  6510 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.016603  6421 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:57.032035  6612 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.093184  6612 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:56.998452  6603 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.054886  6591 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:57.057971  5442 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:57.052246  6621 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:57.062318  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.046541  6574 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:57.066087  6436 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:57.066165  6414 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:57.069958  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:56.861141  5517 rpcz_store.cc:276] 0709 13:15:54.160220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.169830 (+  9610us) service_pool.cc:224] Handling call
0709 13:15:56.052332 (+1882502us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:15:56.054673 (+  2341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.054923 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:56.323908 (+268985us) log.cc:844] Serialized 14 byte log entry
0709 13:15:56.752909 (+429001us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.755948 (+  3039us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:56.756024 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.756122 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.756318 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":524693,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":145682,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":30913792,"thread_start_us":528315,"threads_started":3,"wal-append.queue_time_us":147213}
I20260709 13:15:57.027312  6623 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.073933  6627 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:57.075181  6496 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:57.075306  6554 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:57.075734  6581 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:57.078836  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.077028  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:57.083801  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.086565  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.088286  6483 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:57.089063  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:57.089843  6624 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.047466  6573 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.092571  5441 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.033799  6551 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:57.009479  6523 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.119352  6627 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.017241  6532 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:57.224817  6623 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:57.105058  5516 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:57.105676  6576 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.107478  6545 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:57.238592  5521 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:57.045850  6613 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:15:56.438411  5450 rpcz_store.cc:276] 0709 13:15:55.382438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.050513 (+668075us) service_pool.cc:224] Handling call
0709 13:15:56.065250 (+ 14737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.065474 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:56.068485 (+  3011us) log.cc:844] Serialized 14 byte log entry
0709 13:15:56.436837 (+368352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.436900 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:56.436948 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.437031 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.437156 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67434,"prepare.queue_time_us":2855,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":67668,"spinlock_wait_cycles":23936,"thread_start_us":300476,"threads_started":1}
I20260709 13:15:57.118391  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:57.033617  6610 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.103348  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.245879  5518 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:57.247157  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.247642  6610 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:57.248519  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.139846  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.249150  6613 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:57.141047  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:57.249804  6613 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:57.250469  5372 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:57.251587  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:57.251224  6613 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.252295  5372 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:57.120882  6591 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:57.028527  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 160713us
I20260709 13:15:57.136905  6624 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:57.216859  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.104139  6471 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.221949  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.222823  6573 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:57.223181  6603 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:57.128604  6496 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.231209  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:57.215830  6551 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.242908  6623 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:57.244349  6523 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:57.139190  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.278004  5524 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:15:57.156410  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.217794  6606 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:57.116569  6574 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:57.253193  6613 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.298946  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.131125  6554 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.220832  5367 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:57.412009  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:57.411618  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 293303us
I20260709 13:15:57.328430  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.430577  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.430580  5374 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:57.437513  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.433054  5371 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.438405  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:57.412127  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:57.434300  5340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.527s (SENT) [suppressed 1 similar messages]
I20260709 13:15:57.440605  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:15:57.440830  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 212416us
W20260709 13:15:57.367770  6631 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:15:57.443789  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.292328  6624 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.446063  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:57.411736  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.255148  6576 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.406457  6471 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:57.388494  6630 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:57.400872  6627 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:57.449833  5522 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.348320  6612 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:57.005949  5515 rpcz_store.cc:276] 0709 13:15:54.070654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.081488 (+ 10834us) service_pool.cc:224] Handling call
0709 13:15:54.133491 (+ 52003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.133916 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.133953 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.141670 (+2007717us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b2c00108f48. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:15:56.406442 (+264772us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.787925 (+381483us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:56.865748 (+ 77823us) log.cc:844] Serialized 14 byte log entry
0709 13:15:56.883496 (+ 17748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.888745 (+  5249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.947446 (+ 58701us) raft_consensus.cc:1685] finished
0709 13:15:56.966296 (+ 18850us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.966469 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6112,"prepare.queue_time_us":54952,"prepare.run_wall_time_us":72,"raft.queue_time_us":2490,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":7997,"spinlock_wait_cycles":8763136,"thread_start_us":248946,"threads_started":1,"wal-append.queue_time_us":431559}
I20260709 13:15:57.448321  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.452659  6482 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.445286  6573 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:57.465591  5516 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:57.439749  6606 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.538507  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.441676  5517 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:57.539274  5373 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.540313  6630 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:57.546690  6532 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:57.553678  5522 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:57.555101  6573 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:15:57.560983  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 113626us
I20260709 13:15:57.569057  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:57.569576  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:57.570993  5448 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:15:57.573453  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:57.570086  6601 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:15:57.574285  5450 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:15:57.570122  6573 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:57.567111  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 102143us
I20260709 13:15:57.575860  6482 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:57.576306  6482 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:57.576673  6482 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.578155  6554 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:57.578308  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.578951  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.579618  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.580179  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.580863  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.564378  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:57.582312  5519 raft_consensus.cc:2410] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:57.585178  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:57.583957  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:58.009835  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.675016  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.336833  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.338128  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:57.585179  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.339336  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:57.598891  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:58.339339  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.344408  5448 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
W20260709 13:15:58.330758  5443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.001s	sys 0.015s
I20260709 13:15:57.599725  6559 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.756s
I20260709 13:15:57.571959  6417 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:57.678809  5446 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:58.356721  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:57.930330  6639 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.359s	user 0.002s	sys 0.000s
I20260709 13:15:58.358047  5447 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.624137  6601 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:58.356721  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:57.640014  6496 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:58.363217  5450 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:57.686913  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:57.680603  6576 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:57.785153  6558 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.346025  5367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.024s	sys 0.031s
I20260709 13:15:57.926261  6630 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:57.581374  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.640127  6606 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:58.098264  6613 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:57.606815  5441 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
W20260709 13:15:58.366762  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 767929us
I20260709 13:15:58.364270  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 760) took 1275 ms. Trace:
I20260709 13:15:58.381256  5520 rpcz_store.cc:276] 0709 13:15:57.088780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.640219 (+551439us) service_pool.cc:224] Handling call
0709 13:15:58.364195 (+723976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.382531  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.362674  6601 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:15:58.383716  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.384593  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 755) took 1297 ms. Trace:
I20260709 13:15:58.384260  6601 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:58.384927  5520 rpcz_store.cc:276] 0709 13:15:57.087221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.383446 (+1296225us) service_pool.cc:224] Handling call
0709 13:15:58.384535 (+  1089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.385919  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.386022  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 743) took 1308 ms. Trace:
I20260709 13:15:58.386785  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 816) took 1159 ms. Trace:
I20260709 13:15:58.386642  5516 rpcz_store.cc:276] 0709 13:15:57.077924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.581111 (+503187us) service_pool.cc:224] Handling call
0709 13:15:58.385933 (+804822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.388186  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:57.614192  6621 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.754s
I20260709 13:15:57.803326  6482 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:57.648432  6573 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:58.375702  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.377178  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.389045  5516 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:15:58.369232  5367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.025s	sys 0.032s
I20260709 13:15:58.389195  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:58.385265  6601 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.393462  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:57.679971  6624 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:58.361832  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.387228  5520 rpcz_store.cc:276] 0709 13:15:57.227811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.385687 (+1157876us) service_pool.cc:224] Handling call
0709 13:15:58.386724 (+  1037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.375029  6576 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:58.363454  5446 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:58.380641  6606 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.385206  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.380245  6574 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:58.401461  5450 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:58.408636  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.402455  5371 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:58.396629  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 757) took 1307 ms. Trace:
I20260709 13:15:58.403084  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 752) took 1314 ms. Trace:
I20260709 13:15:58.404266  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:58.371044  6558 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:58.396435  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.407122  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.363850  6417 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:58.402148  6640 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.001s	sys 0.057s
I20260709 13:15:58.412611  5372 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:58.418154  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:58.417294  6417 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:58.419143  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:58.420382  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.411005  6554 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.422289  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.423656  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:58.418531  6640 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.001s	sys 0.058s
I20260709 13:15:58.415645  5368 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:58.425582  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.426334  5368 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:58.427570  6573 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:58.417026  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.429342  5367 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:15:58.411135  5516 rpcz_store.cc:276] 0709 13:15:57.086284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.387744 (+1301460us) service_pool.cc:224] Handling call
0709 13:15:58.400380 (+ 12636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.432644  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:58.433295  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.433409  6574 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:58.434226  5516 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:58.434248  6574 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:58.434999  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 754) took 1348 ms. Trace:
I20260709 13:15:58.435590  5516 rpcz_store.cc:276] 0709 13:15:57.086911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.432983 (+1346072us) service_pool.cc:224] Handling call
0709 13:15:58.434923 (+  1940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.426983  5372 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:58.436800  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.438058  6574 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:58.438243  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.437733  5446 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:58.438933  6574 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:58.439235  5446 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.439592  6574 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:58.440521  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:58.441305  6554 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:58.441723  6554 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:58.442106  6554 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.442344  6574 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:58.431068  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.411512  5517 rpcz_store.cc:276] 0709 13:15:57.087833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.581704 (+493871us) service_pool.cc:224] Handling call
0709 13:15:58.395326 (+813622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.448079  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.448490  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.450949  5515 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.451797  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:58.415467  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.402058  6576 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:58.439538  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.411767  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 753) took 1325 ms. Trace:
I20260709 13:15:58.468557  5520 rpcz_store.cc:276] 0709 13:15:57.086605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.407707 (+1321102us) service_pool.cc:224] Handling call
0709 13:15:58.411695 (+  3988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.466251  5372 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:15:58.471055  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.471851  5520 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:58.472692  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 814) took 1374 ms. Trace:
I20260709 13:15:58.473162  5520 rpcz_store.cc:276] 0709 13:15:57.098556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.470741 (+1372185us) service_pool.cc:224] Handling call
0709 13:15:58.472618 (+  1877us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:58.455420  6551 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.015s	user 0.009s	sys 0.005s
I20260709 13:15:58.380795  6613 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:58.466848  6627 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:58.467399  6576 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.510268  5520 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:58.483908  5366 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:15:58.521715  6558 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:58.525563  5516 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:58.525449  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 794) took 1624 ms. Trace:
I20260709 13:15:58.527560  6420 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:58.510454  6482 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:58.530332  5446 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:15:58.519290  6627 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:58.536130  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.504444  6551 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:58.530156  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.540512  5521 rpcz_store.cc:276] 0709 13:15:56.901205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.926965 (+ 25760us) service_pool.cc:224] Handling call
0709 13:15:57.085494 (+158529us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:15:57.085734 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.239088 (+153354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.525097 (+1286009us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400369554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:58.525345 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366967424}
I20260709 13:15:58.547305  5449 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:58.544595  5446 pending_rounds.cc:85] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 4
W20260709 13:15:58.547887  5449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 735) took 1595 ms (client timeout 1610 ms). Trace:
I20260709 13:15:58.571641  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:58.572698  5523 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:15:58.553969  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.574112  5444 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
W20260709 13:15:58.568420  5449 rpcz_store.cc:269] 0709 13:15:56.951991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.529550 (+1577559us) service_pool.cc:224] Handling call
0709 13:15:58.547805 (+ 18255us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:58.579272  5444 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 731) took 1806 ms (client timeout 1527 ms). Trace:
W20260709 13:15:58.579891  5444 rpcz_store.cc:269] 0709 13:15:56.768589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.788604 (+ 20015us) service_pool.cc:224] Handling call
0709 13:15:58.553740 (+1765136us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b5800018998. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:15:58.574746 (+ 21006us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4464512}
W20260709 13:15:58.547600  6572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.005s	sys 0.009s
W20260709 13:15:58.591645  5523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 742) took 1495 ms (client timeout 1851 ms). Trace:
I20260709 13:15:58.546864  6627 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.546142  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 748) took 1466 ms. Trace:
I20260709 13:15:58.576265  5446 pending_rounds.cc:107] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:15:58.646495  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.647346  5370 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:15:58.637749  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.542120  5517 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
W20260709 13:15:58.641623  5523 rpcz_store.cc:269] 0709 13:15:57.077629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.447656 (+370027us) service_pool.cc:224] Handling call
0709 13:15:58.571368 (+1123712us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:15:58.573292 (+  1924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576128}
I20260709 13:15:58.649541  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:58.636087  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.654160  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 957) took 1807 ms. Trace:
I20260709 13:15:58.654769  5370 rpcz_store.cc:276] 0709 13:15:56.840616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.840808 (+   192us) service_pool.cc:224] Handling call
0709 13:15:58.646334 (+1805526us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:15:58.647768 (+  1434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9965440}
I20260709 13:15:58.657511  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 801) took 1673 ms. Trace:
I20260709 13:15:58.658046  5523 rpcz_store.cc:276] 0709 13:15:56.983759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.656685 (+1672926us) service_pool.cc:224] Handling call
0709 13:15:58.657005 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.657170 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.657193 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.657238 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:58.657273 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.657325 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.657444 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:58.642753  6572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.007s	sys 0.011s
I20260709 13:15:58.649129  5446 raft_consensus.cc:2889] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:58.679137  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 176315us
I20260709 13:15:58.679533  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:58.680912  5370 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.687222  5490 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:58.693034  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:15:58.673621  5416 connection.cc:256] RPC call timeout handler was delayed by -1.5086825980001777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:15:58.695400  5416 connection.cc:256] RPC call timeout handler was delayed by -1.2971825980000631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:15:58.696118  5416 connection.cc:256] RPC call timeout handler was delayed by -1.28602611600013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
W20260709 13:15:58.696554  5416 connection.cc:256] RPC call timeout handler was delayed by -1.126182598000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 13:15:58.697986  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:58.699296  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:58.700920  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:58.646415  5516 rpcz_store.cc:276] 0709 13:15:57.083671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.436441 (+1352770us) service_pool.cc:224] Handling call
0709 13:15:58.544780 (+108339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.702499  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.716595  5445 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:58.716741  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.703320  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.705174  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:58.717846  5449 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
W20260709 13:15:58.717914  5375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 955) took 1948 ms (client timeout 1513 ms). Trace:
W20260709 13:15:58.718518  5375 rpcz_store.cc:269] 0709 13:15:56.769074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.769350 (+   276us) service_pool.cc:224] Handling call
0709 13:15:58.716530 (+1947180us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:15:58.717834 (+  1304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10424704}
W20260709 13:15:58.758687  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 1.28059e+06us
W20260709 13:15:58.764189  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.702050  6440 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260709 13:15:58.676816  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 295590us
I20260709 13:15:58.684825  6551 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:58.691690  6595 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:58.715988  6610 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:58.803979  6613 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:58.692868  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:58.715626  6606 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:58.715363  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 46) took 2824 ms. Trace:
W20260709 13:15:58.829700  6647 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:15:58.832273  6624 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:58.836668  6648 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:15:58.720359  6591 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
W20260709 13:15:58.816273  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 111214us
W20260709 13:15:58.870481  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.872947  6657 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:58.873705  6657 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:58.874235  6657 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.838413  6579 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.841413  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:58.840471  6610 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:58.880057  6624 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.851747  6654 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:58.850914  6606 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:58.844594  6595 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:58.892565  6610 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:58.879307  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 206036us
I20260709 13:15:58.882205  6658 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:58.939224  5515 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:58.909302  6593 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.906117  6606 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.916268  6658 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:58.950083  6593 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:58.907361  6654 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:58.968472  6601 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.002s
I20260709 13:15:58.957733  6658 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.974502  6595 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:58.980417  6657 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:58.981303  6593 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:59.017773  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.009s	sys 0.017s
I20260709 13:15:58.779603  5370 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
W20260709 13:15:59.029534  5340 connection.cc:256] RPC call timeout handler was delayed by -1.2750791579999259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 13:15:59.040174  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 42) took 2123 ms. Trace:
I20260709 13:15:59.040597  5374 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:15:59.042110  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.054266  5373 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:58.841240  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 140440us
I20260709 13:15:59.087234  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:15:59.085155  5369 rpcz_store.cc:276] 0709 13:15:56.916169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.922016 (+  5847us) service_pool.cc:224] Handling call
0709 13:15:56.983031 (+ 61015us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.047339 (+ 64308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.049992 (+  2653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.095228 (+ 45236us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:57.096886 (+  1658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.039384 (+1942498us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b54002ff3d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:15:59.039505 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.039874 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120220416}
I20260709 13:15:59.089125  6075 raft_consensus.cc:2410] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:59.058635  5442 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:15:59.090600  6671 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:15:59.059337  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.060026  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:58.849913  5446 rpcz_store.cc:276] 0709 13:15:55.887602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.073937 (+186335us) service_pool.cc:224] Handling call
0709 13:15:56.148109 (+ 74172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.678675 (+1530566us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540002d3a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d03dc0 00007fc1d3d8e1c0 00007fc1d3d8f231 00007fc1d3d8bd8f 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c
0709 13:15:58.677749 (+999074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.712142 (+ 34393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413720448}
I20260709 13:15:59.047662  5273 catalog_manager.cc:5697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:59.062004  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:59.056418  5269 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 35) took 7060 ms. Trace:
I20260709 13:15:59.064085  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:59.066274  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 141236us
W20260709 13:15:59.070125  5519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 740) took 1993 ms (client timeout 1805 ms). Trace:
I20260709 13:15:59.072714  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:59.074363  6072 raft_consensus.cc:1217] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 13:15:59.095824  6072 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:59.075412  6510 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.097458  6510 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:59.097704  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.098237  6510 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.067888  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:58.982947  6654 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.101600  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:59.094990  5519 rpcz_store.cc:269] 0709 13:15:57.076996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.437211 (+360215us) service_pool.cc:224] Handling call
0709 13:15:59.069412 (+1632201us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003782d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:59.069805 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330469632}
I20260709 13:15:59.102789  6654 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:59.103958  6654 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:58.920997  6576 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.108202  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:59.108572  6576 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:59.111519  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.112030  6558 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:59.113602  5368 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.114449  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 759) took 2025 ms. Trace:
I20260709 13:15:59.114902  5517 rpcz_store.cc:276] 0709 13:15:57.088434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.448048 (+1359614us) service_pool.cc:224] Handling call
0709 13:15:59.113944 (+665896us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b540025c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:59.114234 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176293760}
I20260709 13:15:59.115749  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.116154  5517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:15:59.117497  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.117806  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:59.081243  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.080853  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:15:59.084187  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.011s	sys 0.018s
W20260709 13:15:59.120874  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 1.53699e+06us
I20260709 13:15:59.122282  6657 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:58.984449  6667 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.126271  6667 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.126967  6667 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.128841  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.057900  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 744) took 1381 ms. Trace:
I20260709 13:15:59.092772  5441 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.131377  5443 rpcz_store.cc:276] 0709 13:15:57.675917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.684168 (+  8251us) service_pool.cc:224] Handling call
0709 13:15:57.684581 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.689524 (+  4943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.716241 (+ 26717us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.718665 (+  2424us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.370422 (+651757us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:58.377488 (+  7066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.401160 (+ 23672us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.057169 (+656009us) raft_consensus.cc:1685] finished
0709 13:15:59.057212 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.057605 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":429,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":171,"thread_start_us":640431,"threads_started":1,"wal-append.queue_time_us":819839}
I20260709 13:15:59.134351  6666 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:59.135900  6496 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:59.120080  6595 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.136390  6496 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:15:59.136574  6595 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:59.136934  5339 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:59.130092  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:59.085222  5340 connection.cc:256] RPC call timeout handler was delayed by -1.2377883229999043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:15:58.986444  6670 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:15:59.135411  6666 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:59.139050  5340 connection.cc:256] RPC call timeout handler was delayed by -1.2147791580000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:15:59.140692  5340 connection.cc:256] RPC call timeout handler was delayed by -1.2089883230000851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:15:59.142014  6666 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:59.137185  6595 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:59.142294  5340 connection.cc:256] RPC call timeout handler was delayed by -1.1355791579999277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:15:59.142338  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:59.143890  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 744) took 2065 ms (client timeout 1674 ms). Trace:
W20260709 13:15:59.144107  5340 connection.cc:256] RPC call timeout handler was delayed by -1.0536791580000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:15:59.144352  5518 rpcz_store.cc:269] 0709 13:15:57.078301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.426366 (+348065us) service_pool.cc:224] Handling call
0709 13:15:59.142052 (+1715686us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67eee 0000000000375939 00007fc1d8cdb1e0 00007fc1d8da40c4 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:15:59.143815 (+  1763us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6854912}
W20260709 13:15:59.145702  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.146067  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:59.147158  5518 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:15:59.104538  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:15:59.147986  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46671.1us
I20260709 13:15:59.149283  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:59.117210  5517 raft_consensus.cc:606] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:59.138163  5369 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:59.150173  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 808) took 2162 ms. Trace:
I20260709 13:15:59.150628  5523 rpcz_store.cc:276] 0709 13:15:56.987935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.659927 (+1671992us) service_pool.cc:224] Handling call
0709 13:15:58.660520 (+   593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.665872 (+  5352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.665925 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.673884 (+  7959us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.915957 (+242073us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:58.916034 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.916134 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.149493 (+233359us) raft_consensus.cc:1685] finished
0709 13:15:59.149529 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.149847 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5379,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":9379,"thread_start_us":194317,"threads_started":1,"wal-append.queue_time_us":292272}
I20260709 13:15:59.151793  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:59.101053  6510 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.156311  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.138139  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:15:59.144642  5340 connection.cc:256] RPC call timeout handler was delayed by -1.0338791579999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 13:15:59.078332  6627 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.154680  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:15:59.155270  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.164065  5367 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:59.165773  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:59.167572  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:15:59.160159  5340 connection.cc:256] RPC call timeout handler was delayed by -1.016779157999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 13:15:59.150173  5519 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:59.172852  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.113651  5273 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:59.174213  5522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 764) took 2079 ms (client timeout 1796 ms). Trace:
W20260709 13:15:59.174748  5522 rpcz_store.cc:269] 0709 13:15:57.095017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.438168 (+343151us) service_pool.cc:224] Handling call
0709 13:15:59.173812 (+1735644us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54002dad54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:59.174023 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24396672}
I20260709 13:15:59.176118  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:59.178409  5516 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.179024  6672 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.181699  5524 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:59.182979  6627 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:15:59.183806  5524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 805) took 2198 ms (client timeout 2164 ms). Trace:
W20260709 13:15:59.184430  5524 rpcz_store.cc:269] 0709 13:15:56.984983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.535666 (+1550683us) service_pool.cc:224] Handling call
0709 13:15:59.183419 (+647753us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54001662d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:59.183698 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460979456}
I20260709 13:15:59.185232  6496 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.187439  6496 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.188218  6621 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:59.188640  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 810) took 2187 ms. Trace:
I20260709 13:15:59.189134  6621 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.192457  6621 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:59.132815  6654 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:59.094697  5269 rpcz_store.cc:276] 0709 13:15:51.995311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.995730 (+   419us) service_pool.cc:224] Handling call
0709 13:15:59.056081 (+7060351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:56.968222 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:56.978424 (+ 10202us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:56.978467 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:15:56.978490 (+    23us) tablet.cc:662] Decoding operations
0709 13:15:56.978908 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:56.978973 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:56.979005 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:56.979205 (+   200us) tablet.cc:701] Row locks acquired
0709 13:15:56.979224 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:15:56.979376 (+   152us) write_op.cc:270] Start()
0709 13:15:56.979503 (+   127us) write_op.cc:276] Timestamp: P: 1783602956979328 usec, L: 0
0709 13:15:56.979526 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:56.980322 (+   796us) log.cc:844] Serialized 594 byte log entry
0709 13:15:58.521374 (+1541052us) op_driver.cc:464] REPLICATION: finished
0709 13:15:58.850011 (+328637us) write_op.cc:301] APPLY: starting
0709 13:15:58.862511 (+ 12500us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:58.876778 (+ 14267us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:58.877022 (+   244us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:58.877371 (+   349us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:58.877621 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:58.877698 (+    77us) write_op.cc:312] APPLY: finished
0709 13:15:58.880464 (+  2766us) log.cc:844] Serialized 22 byte log entry
0709 13:15:58.949085 (+ 68621us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.949204 (+   119us) write_op.cc:454] Released schema lock
0709 13:15:58.949297 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:58.951439 (+  2142us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.951480 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2633772,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":304819,"apply.run_cpu_time_us":15062,"apply.run_wall_time_us":110445,"num_ops":1,"prepare.queue_time_us":117004,"prepare.run_cpu_time_us":31454,"prepare.run_wall_time_us":66759,"raft.queue_time_us":885000,"raft.run_cpu_time_us":9787,"raft.run_wall_time_us":227761,"replication_time_us":1522315,"thread_start_us":508568,"threads_started":5,"wal-append.queue_time_us":253421,"wal-append.run_cpu_time_us":28392,"wal-append.run_wall_time_us":1687146}]]}
W20260709 13:15:59.198834  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 815) took 2077 ms (client timeout 2729 ms). Trace:
I20260709 13:15:59.199841  6559 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:15:59.189071  5516 rpcz_store.cc:276] 0709 13:15:57.001256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.815672 (+1814416us) service_pool.cc:224] Handling call
0709 13:15:59.177882 (+362210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.179024 (+  1142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.188359 (+  9335us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54002dad50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:59.188550 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769447808}
I20260709 13:15:59.201992  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:15:59.199590  5515 rpcz_store.cc:269] 0709 13:15:57.121576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.417814 (+1296238us) service_pool.cc:224] Handling call
0709 13:15:59.198236 (+780422us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b540025cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:59.198573 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73269120}
I20260709 13:15:59.205731  6654 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.157413  5368 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:15:59.206311  5521 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:59.167207  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:59.205036  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:59.151594  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:15:59.223223  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.224287  5375 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:15:59.214378  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44736.2us
I20260709 13:15:59.113022  6558 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.213892  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:59.229843  6654 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:59.231685  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 68732.4us
I20260709 13:15:59.232781  6672 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.233332  6672 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.233812  6672 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:59.234557  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 97891us
I20260709 13:15:59.247499  6576 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.250502  6657 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:59.251371  6657 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.253005  6510 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:59.256354  6559 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:59.259811  6579 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:59.260146  5441 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:59.261484  6510 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.247588  5368 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.238826  6654 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:59.230262  6595 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.279920  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.280699  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:59.280962  5375 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:15:59.285573  5523 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:15:59.279956  6606 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.305038  6657 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.299409  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:15:59.342597  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 95733.1us
I20260709 13:15:59.344195  5520 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:59.344627  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 813) took 2275 ms. Trace:
I20260709 13:15:59.345028  5524 rpcz_store.cc:276] 0709 13:15:57.069155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.203980 (+2134825us) service_pool.cc:224] Handling call
0709 13:15:59.204516 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.205318 (+   802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.205346 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.205975 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.241894 (+ 35919us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.241932 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.241977 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.344386 (+102409us) raft_consensus.cc:1685] finished
0709 13:15:59.344405 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.344540 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":444,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":131,"thread_start_us":34892,"threads_started":1,"wal-append.queue_time_us":136253}
I20260709 13:15:59.345875  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 741) took 2268 ms. Trace:
I20260709 13:15:59.346491  5520 rpcz_store.cc:276] 0709 13:15:57.077308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.210318 (+2133010us) service_pool.cc:224] Handling call
0709 13:15:59.343795 (+133477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.344780 (+   985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.345626 (+   846us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400277ed0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:59.345802 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244489472}
I20260709 13:15:59.347441  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 762) took 2258 ms. Trace:
I20260709 13:15:59.347901  5523 rpcz_store.cc:276] 0709 13:15:57.094100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.346309 (+2252209us) service_pool.cc:224] Handling call
0709 13:15:59.346709 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.347101 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.347129 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.347190 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.347217 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.347266 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.347371 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.284384  6595 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.370132  6551 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.370606  6551 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.370915  6551 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.354396  6654 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.365197  6510 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:15:59.391826  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 111254us
W20260709 13:15:59.392496  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 158415us
I20260709 13:15:59.394534  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 812) took 2383 ms. Trace:
I20260709 13:15:59.405045  5523 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.407572  5521 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:59.406172  6559 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:15:59.408308  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 817) took 2180 ms. Trace:
I20260709 13:15:59.408917  6510 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:59.409564  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.409811  6510 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:59.410802  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 54201.8us
I20260709 13:15:59.408705  5521 rpcz_store.cc:276] 0709 13:15:57.228112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.406855 (+2178743us) service_pool.cc:224] Handling call
0709 13:15:59.407265 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.408060 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.408249 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.412252  6510 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.409847  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.414964  6510 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:59.425457  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 768) took 2294 ms. Trace:
I20260709 13:15:59.426626  5523 rpcz_store.cc:276] 0709 13:15:57.111871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.355031 (+2243160us) service_pool.cc:224] Handling call
0709 13:15:59.391716 (+ 36685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.405780 (+ 14064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.406007 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.387223  6657 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:59.433147  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68782.6us
I20260709 13:15:59.405592  5367 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:59.441515  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 120643us
I20260709 13:15:59.437455  6657 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.456154  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:59.460076  6657 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:59.472187  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.468636  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:59.475015  6658 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.004s
I20260709 13:15:59.475384  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:15:59.476050  6554 consensus_meta.cc:287] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.947s	user 0.023s	sys 0.007s
I20260709 13:15:59.450909  6558 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:59.493137  5370 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.439070  6510 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.458350  6654 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.499732  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 42) took 2091 ms. Trace:
I20260709 13:15:59.500386  5523 rpcz_store.cc:276] 0709 13:15:57.402816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.438394 (+2035578us) service_pool.cc:224] Handling call
0709 13:15:59.470210 (+ 31816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.487977 (+ 17767us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:59.488006 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.493712 (+  5706us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:59.493756 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.493829 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.493972 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.502842  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 43) took 2093 ms. Trace:
I20260709 13:15:59.503352  5521 rpcz_store.cc:276] 0709 13:15:57.403170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.446192 (+2043022us) service_pool.cc:224] Handling call
0709 13:15:59.471551 (+ 25359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.489923 (+ 18372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.490093 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.496515 (+  6422us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:59.496558 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.496617 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.496733 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.509676  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:59.511916  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 811) took 2501 ms. Trace:
I20260709 13:15:59.512524  5522 rpcz_store.cc:276] 0709 13:15:57.010775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.181008 (+2170233us) service_pool.cc:224] Handling call
0709 13:15:59.186174 (+  5166us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:59.201605 (+ 15431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.201636 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:59.202478 (+   842us) log.cc:844] Serialized 52 byte log entry
0709 13:15:59.241674 (+ 39196us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.241717 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.241810 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.511600 (+269790us) raft_consensus.cc:1685] finished
0709 13:15:59.511630 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.511837 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5208,"raft.queue_time_us":11222,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":186,"thread_start_us":32705,"threads_started":1,"wal-append.queue_time_us":196565}
I20260709 13:15:59.514890  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.515314  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:59.496553  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.516263  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 818) took 2073 ms. Trace:
I20260709 13:15:59.516522  6076 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:15:59.472863  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.516851  5522 rpcz_store.cc:276] 0709 13:15:57.442441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.514649 (+2072208us) service_pool.cc:224] Handling call
0709 13:15:59.515475 (+   826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.515802 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.515836 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.515920 (+    84us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.515979 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.516049 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.516185 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.516270  5445 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:15:59.519737  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50331.4us
I20260709 13:15:59.522760  5442 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:59.533730  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 94376.4us
W20260709 13:15:59.534015  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 61160.9us
I20260709 13:15:59.554845  5447 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:59.496973  5441 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:15:59.505239  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.505245  6687 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:15:59.574275  5519 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:15:59.576470  6510 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.542689  6654 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.577440  5370 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:15:59.577312  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.496841  6554 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:59.583447  5445 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
W20260709 13:15:59.589109  6610 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.555s	user 0.014s	sys 0.009s
I20260709 13:15:59.588884  6482 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 13:15:59.497323  6658 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.571204  6606 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:59.594070  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:59.593330  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 820) took 2150 ms. Trace:
I20260709 13:15:59.595274  5523 rpcz_store.cc:276] 0709 13:15:57.443341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.540189 (+2096848us) service_pool.cc:224] Handling call
0709 13:15:59.586100 (+ 45911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.593102 (+  7002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.593120 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.593150 (+    30us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.593166 (+    16us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.593209 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.593289 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.397078  5516 rpcz_store.cc:276] 0709 13:15:57.011148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.201930 (+2190782us) service_pool.cc:224] Handling call
0709 13:15:59.202431 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.202898 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:59.238724 (+ 35826us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.392386 (+153662us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.392595 (+   209us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:59.392861 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.393267 (+   406us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.394247 (+   980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22360,"prepare.queue_time_us":60995,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":36042,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":108289,"threads_started":2,"wal-append.queue_time_us":138518}
I20260709 13:15:59.600298  6667 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.601783  5448 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:59.604221  6554 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:59.605016  6658 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.605408  5518 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:15:59.589947  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.607108  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.607853  5449 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:15:59.589581  6686 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:15:59.610481  6686 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:59.610881  6686 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:15:59.612371  6682 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.106s	user 0.004s	sys 0.000s
I20260709 13:15:59.589628  6610 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.540198  6558 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:15:59.614209  6667 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.614931  6610 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:15:59.615167  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:59.584551  6654 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:59.616073  6654 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.616642  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.619163  5443 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.612458  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 821) took 2027 ms. Trace:
I20260709 13:15:59.620116  5519 rpcz_store.cc:276] 0709 13:15:57.584811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.577211 (+1992400us) service_pool.cc:224] Handling call
0709 13:15:59.588177 (+ 10966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.611762 (+ 23585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.611801 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.612199 (+   398us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.612234 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.612290 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.612404 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.616765  5522 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.597350  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 822) took 2012 ms. Trace:
I20260709 13:15:59.625000  5523 rpcz_store.cc:276] 0709 13:15:57.585158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.596245 (+2011087us) service_pool.cc:224] Handling call
0709 13:15:59.596712 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.597008 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.597032 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.597089 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:59.597121 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.597182 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.597292 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.594430  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:59.627628  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 44) took 2054 ms. Trace:
I20260709 13:15:59.628302  5522 rpcz_store.cc:276] 0709 13:15:57.573352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.544881 (+1971529us) service_pool.cc:224] Handling call
0709 13:15:59.616489 (+ 71608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.627355 (+ 10866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.627559 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.630381  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:59.634620  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 41) took 2544 ms. Trace:
I20260709 13:15:59.635108  5524 rpcz_store.cc:276] 0709 13:15:57.089779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.347021 (+2257242us) service_pool.cc:224] Handling call
0709 13:15:59.347418 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.347707 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.347733 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.348418 (+   685us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.369519 (+ 21101us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:59.369573 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.369901 (+   328us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.611577 (+241676us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:15:59.631843 (+ 20266us) raft_consensus.cc:1685] finished
0709 13:15:59.631870 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.634546 (+  2676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28109568,"thread_start_us":20521,"threads_started":1,"wal-append.queue_time_us":157582}
W20260709 13:15:59.638965  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84592.3us
I20260709 13:15:59.639909  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:59.640997  6658 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.641240  6576 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:59.641551  6658 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:59.641966  6576 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:59.642903  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:59.643180  6576 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:15:59.644162  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:15:59.642042  6658 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.640872  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:59.644423  6667 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.630455  5517 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.651861  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.651300  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:59.656065  5370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:33046
I20260709 13:15:59.654878  6685 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:59.658484  6595 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.658855  6685 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:15:59.659006  6595 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:15:59.659459  6595 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.660112  6685 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.661083  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.662007  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:15:59.663439  6076 raft_consensus.cc:2410] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:59.669548  5445 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:15:59.664682  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.674522  5450 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:15:59.676018  5450 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:59.645215  6482 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.662035  5448 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:15:59.679999  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:15:59.682420  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 126656us
I20260709 13:15:59.648329  6667 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:59.656728  5370 raft_consensus.cc:606] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:59.612172  6686 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.687301  5370 raft_consensus.cc:614] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:59.692893  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47840.8us
I20260709 13:15:59.681949  6482 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:59.697481  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49531.9us
I20260709 13:15:59.686975  6667 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.700655  6440 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.700805  6627 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.704877  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:15:59.703008  5416 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:59.713415  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:59.698262  6482 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.685796  6672 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:59.724383  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.685624  6658 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.688015  6654 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.691857  6551 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.706379  6627 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.704567  6440 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:59.737336  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:59.750121  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:15:59.736742  6510 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:59.740720  6627 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.742923  6440 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.762423  5445 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:59.751082  5522 raft_consensus.cc:606] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:15:59.765584  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62609.7us
I20260709 13:15:59.758459  6496 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:59.776136  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 83026.6us
I20260709 13:15:59.781383  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:15:59.779980  6685 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.783181  6685 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:15:59.784240  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 70987.8us
I20260709 13:15:59.786739  5520 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:59.786446  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66020.9us
I20260709 13:15:59.791218  6510 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:59.791908  6672 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.792317  6510 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.792747  6510 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.793125  6510 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.787293  6657 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.780258  6496 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:15:59.793375  6672 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:15:59.794852  6551 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.799049  6657 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.799511  5446 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:15:59.800324  6496 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.783721  6685 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.767287  6576 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:15:59.783726  6658 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.813371  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:15:59.814462  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:15:59.795893  6654 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.819098  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:15:59.856130  6482 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:15:59.861720  6690 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:15:59.862918  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:15:59.867854  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49178.6us
W20260709 13:15:59.869400  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56059.7us
I20260709 13:15:59.873708  6654 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:59.874825  6654 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.881621  6697 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:59.882102  6697 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:59.877200  6440 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.884290  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:15:59.897217  6697 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:15:59.897787  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:15:59.898314  6510 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.898653  5449 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:59.899468  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82784.9us
I20260709 13:15:59.900558  6510 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.906284  6683 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.906737  6683 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:15:59.907207  6683 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.897270  6440 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.905207  6559 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:15:59.876781  6657 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:59.909695  6657 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:15:59.910398  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 766) took 2807 ms. Trace:
I20260709 13:15:59.911096  6657 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.910812  5520 rpcz_store.cc:276] 0709 13:15:57.102915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.347860 (+2244945us) service_pool.cc:224] Handling call
0709 13:15:59.786546 (+438686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.787145 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.910192 (+123047us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400368b50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:15:59.910322 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006382976}
W20260709 13:15:59.919605  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.898784  6697 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:59.928197  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.929023  5449 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 2.
I20260709 13:15:59.933593  5519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:15:59.934355  5519 raft_consensus.cc:606] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:59.919077  6482 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.918732  6657 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.938203  6627 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.938818  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:15:59.939625  5518 raft_consensus.cc:606] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:15:59.944258  6667 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.946843  6667 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:15:59.952854  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:15:59.953670  5518 raft_consensus.cc:606] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Received request to transfer leadership to TS 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:15:59.953750  6696 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:59.955592  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:15:59.957243  6601 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.958609  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:59.958256  6601 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:15:59.959599  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 148004us
I20260709 13:15:59.960696  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:15:59.985378  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.989934  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:15:59.936287  6595 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.991555  5374 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:15:59.979276  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 738) took 2903 ms. Trace:
I20260709 13:15:59.929141  6606 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:15:59.980223  6696 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:00.000451  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.002544  6595 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.021116  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:00.023910  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:15:59.999115  6627 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:00.027606  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.030427  6601 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.032418  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:00.033311  6696 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.037467  6641 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.025971  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 751) took 2940 ms. Trace:
I20260709 13:16:00.038008  6641 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.038633  6641 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.038511  5517 rpcz_store.cc:276] 0709 13:15:57.085986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.244793 (+2158807us) service_pool.cc:224] Handling call
0709 13:15:59.337044 (+ 92251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.650932 (+313888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.004085 (+353153us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540016cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:00.020042 (+ 15957us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659532032}
I20260709 13:16:00.036298  6496 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:15:59.997566  5515 rpcz_store.cc:276] 0709 13:15:57.076245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.206093 (+2129848us) service_pool.cc:224] Handling call
0709 13:15:59.206847 (+   754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.240913 (+ 34066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.242878 (+  1965us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.366337 (+123459us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.592629 (+226292us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:59.646719 (+ 54090us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.653569 (+  6850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.658163 (+  4594us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.930651 (+272488us) raft_consensus.cc:1685] finished
0709 13:15:59.932319 (+  1668us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.968497 (+ 36178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9731,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":11060,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":13223,"thread_start_us":197971,"threads_started":1,"wal-append.queue_time_us":298853}
I20260709 13:16:00.043184  6551 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.043769  6551 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:00.044654  6551 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.046442  6636 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:00.046705  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:00.048286  6686 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.049033  6694 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.070977  6694 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.049602  6700 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:00.071725  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:00.071931  6700 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.072773  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.072935  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:00.073673  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.077817  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.077838  6705 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:00.078624  6705 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.079087  6705 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.079351  6551 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.026024  6685 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.049926  6554 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.054574  6559 raft_consensus.cc:993] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:00.082074  5371 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:00.054813  5373 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:00.055531  6496 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:00.056576  6558 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.084309  6685 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.084527  6558 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:00.057366  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52154.8us
I20260709 13:16:00.085096  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.085794  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:00.059511  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.086879  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.069269  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.087361  6579 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.087585  5366 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.069977  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.087826  6579 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:00.088953  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:00.068481  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 255009us
I20260709 13:16:00.090646  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.091607  5367 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:00.084103  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.085362  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.061906  5370 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.084970  6558 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.107302  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.107946  5371 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.111119  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:00.111945  5515 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:16:00.112948  6621 raft_consensus.cc:1081] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:00.113505  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:00.113911  6621 raft_consensus.cc:993] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower 86b410d62f4040c39d33dc0698998562 to start an election
I20260709 13:16:00.113826  6627 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.115792  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:00.114521  6627 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:00.077031  6641 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.114662  6711 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.114521  6621 raft_consensus.cc:1081] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Signalling peer 86b410d62f4040c39d33dc0698998562 to start an election
I20260709 13:16:00.130131  5273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 148) took 8123 ms. Trace:
I20260709 13:16:00.088850  6579 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.130645  5273 rpcz_store.cc:276] 0709 13:15:52.006355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.006506 (+   151us) service_pool.cc:224] Handling call
0709 13:16:00.129941 (+8123435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:59.324995 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:59.414657 (+ 89662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:59.414739 (+    82us) write_op.cc:435] Acquired schema lock
0709 13:15:59.414762 (+    23us) tablet.cc:662] Decoding operations
0709 13:15:59.415322 (+   560us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:59.415466 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:59.415513 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:15:59.556326 (+140813us) tablet.cc:701] Row locks acquired
0709 13:15:59.569550 (+ 13224us) write_op.cc:260] PREPARE: finished
0709 13:15:59.569821 (+   271us) write_op.cc:270] Start()
0709 13:15:59.570213 (+   392us) write_op.cc:276] Timestamp: P: 1783602959569742 usec, L: 0
0709 13:15:59.570272 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 13:15:59.667403 (+ 97131us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b5400351720. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d09520 00007fc1d3d92b42 00007fc1d3d87f67 00007fc1d3d87da4 00007fc1d77c2581 00007fc1d77c1d58 00007fc1d77c69f1 00007fc1d77c69a9 00007fc1d77c6939 00007fc1d77c6901
0709 13:15:59.694591 (+ 27188us) log.cc:844] Serialized 922 byte log entry
0709 13:15:59.874874 (+180283us) op_driver.cc:464] REPLICATION: finished
0709 13:16:00.050540 (+175666us) write_op.cc:301] APPLY: starting
0709 13:16:00.050642 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:00.050777 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:00.050818 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:00.051399 (+   581us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:00.051675 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:00.051743 (+    68us) write_op.cc:312] APPLY: finished
0709 13:16:00.052021 (+   278us) log.cc:844] Serialized 28 byte log entry
0709 13:16:00.052210 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:00.052300 (+    90us) write_op.cc:454] Released schema lock
0709 13:16:00.052360 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:00.052755 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:00.052781 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3973,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":175237,"apply.run_cpu_time_us":2320,"apply.run_wall_time_us":2321,"num_ops":2,"prepare.queue_time_us":148064,"prepare.run_cpu_time_us":10195,"prepare.run_wall_time_us":391061,"replication_time_us":304406,"spinlock_wait_cycles":3110272,"thread_start_us":158010,"threads_started":2}]]}
I20260709 13:16:00.117692  6627 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.118646  6496 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:00.124030  6711 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:00.150787  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77924.6us
I20260709 13:16:00.125998  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.153168  6711 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:00.170826  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154553us
I20260709 13:16:00.161936  6657 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.179260  5272 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.166704  6579 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.151927  6683 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:00.190153  6709 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:16:00.167469  6697 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.205070  6697 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.205359  6705 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.205649  6627 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.211268  6627 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:00.182541  5272 catalog_manager.cc:5697] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 1 to 3, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.215118  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:00.220065  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.220921  6657 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.221623  5272 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.223187  6657 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.208416  6716 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:00.208106  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:00.223875  6716 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.224300  6716 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.224455  6666 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.227761  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:00.177251  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51586.3us
I20260709 13:16:00.230813  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.231737  6696 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.233345  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:00.235263  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.235965  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.236625  5373 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.237962  6696 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.239737  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:00.241219  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.247225  5370 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:00.243424  5367 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:00.251365  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 107689us
I20260709 13:16:00.244127  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.253146  5375 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.255330  5366 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:00.257588  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.258468  5367 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:00.259254  6696 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:00.259716  6696 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.260190  6696 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.260916  6606 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.246255  5371 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:00.261399  6606 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:00.262779  5369 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:00.263171  6606 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.264590  6606 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.267428  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.268441  5370 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:00.272116  6712 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.004s
W20260709 13:16:00.276065  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.261647  6657 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.280972  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:00.297942  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:00.299072  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:00.300084  5523 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:00.318545  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.320201  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:00.318643  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.333691  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81594.9us
I20260709 13:16:00.332297  5370 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:00.345379  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:00.346210  6700 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.346769  6654 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.329068  5371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:44090
I20260709 13:16:00.378823  5371 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:00.379249  5371 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.348022  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:00.351246  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75285.8us
I20260709 13:16:00.327401  6496 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:00.347328  6667 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.394537  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:00.394826  6667 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.395893  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:00.396458  5448 raft_consensus.cc:2376] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4. Re-sending same reply.
I20260709 13:16:00.364468  5367 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.398128  6641 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:00.398888  6042 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:00.399114  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.400590  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.400861  6713 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:00.401711  6713 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:00.397408  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:00.401661  5372 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.383656  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:00.365579  6558 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.385751  6654 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.386864  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:00.387540  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:00.388731  6697 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.390163  6705 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:00.566150  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 79742.6us
I20260709 13:16:00.390744  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:00.391206  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:00.393786  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:00.394170  6683 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.475414  5416 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:00.571409  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 96103.6us
I20260709 13:16:00.571779  5522 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:00.529021  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.380801  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51958.1us
I20260709 13:16:00.337716  6657 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:00.460659  5444 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:16:00.401110  6711 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:00.496884  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.588127  5447 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:00.453274  6694 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.397256  6667 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:00.517700  6677 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:00.452980  5518 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.456821  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:00.536194  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.548811  5369 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:00.600682  6595 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.601390  6595 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.602408  5369 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.603768  6595 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.397307  5375 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:00.548957  6713 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:00.604475  6595 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.605580  6510 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.606171  6510 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.550606  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.608590  6510 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.494411  5367 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.557492  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:00.609822  5260 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7b301483f19c4d508e00d917819ac039 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 86b410d62f4040c39d33dc0698998562 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:00.564829  5445 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:00.586243  6496 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.625921  5369 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.577956  5446 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:00.577708  5441 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:00.578559  5442 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:00.581634  6654 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.583374  6558 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:00.555691  6700 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.649950  6700 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.651635  6711 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.651978  6700 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.591218  6697 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.591548  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:00.652611  6716 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:00.653400  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 61917us
I20260709 13:16:00.654130  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:00.654989  6716 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.661350  5368 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.661718  6667 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:00.669577  5368 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.633332  5374 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.670552  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.637045  5373 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:00.605321  6595 consensus_queue.cc:1243] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:00.639587  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.642491  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.545192  5371 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.598587  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:00.669234  6697 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:00.684367  5372 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:00.685107  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 350666us
I20260709 13:16:00.701323  5374 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:00.703696  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:00.710322  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.713665  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.716998  5371 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:00.734457  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 147713us
I20260709 13:16:00.709075  5367 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.702308  6654 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:00.702642  6700 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:00.718348  6716 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.751183  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:00.753876  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.703609  6595 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:16:00.757902  5340 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:00.736522  6667 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:00.753726  6697 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:00.710079  6718 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:00.744900  6482 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:00.769721  5522 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:00.777050  5523 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.777107  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:00.755992  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:00.737501  6696 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.756676  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:00.781867  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:00.782716  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.783082  6685 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.790283  5490 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:00.859280  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.917078  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:00.917285  6482 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:00.996675  6510 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:00.755349  6719 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:00.794381  6711 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:01.005860  5368 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:16:00.958887  6732 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
W20260709 13:16:01.006613  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 211989us
I20260709 13:16:00.969687  6736 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
W20260709 13:16:01.011709  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 257416us
I20260709 13:16:01.006767  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:00.772750  6657 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:01.019289  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:00.962134  6729 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 13:16:01.028899  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 242867us
I20260709 13:16:00.991351  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:01.031451  6738 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:00.961030  6696 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:00.794772  5517 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.034969  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:01.035238  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.789723  6621 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:01.039655  6721 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:01.031963  6738 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:01.044221  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:00.794914  6579 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.250s
I20260709 13:16:01.045645  6697 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.036338  6711 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:01.048686  5367 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:00.925753  6667 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.051120  6731 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:01.051995  6696 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.052476  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:01.010535  6510 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:01.054898  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:01.076771  5524 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.056576  6719 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:00.794642  6698 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.235s
I20260709 13:16:01.064462  5522 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:01.065363  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 305392us
I20260709 13:16:01.056090  6554 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.079185  5524 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.063395  6621 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.068239  6705 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:01.089962  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.060954  6606 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:16:01.087587  6554 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.101678  6727 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:01.098274  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.088640  6740 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:01.099372  6621 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.107347  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.107625  6740 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.109766  6738 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.110483  6510 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.111096  6738 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.111905  6510 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.112597  6740 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:01.113148  6740 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.086259  6721 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.114560  6721 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.092970  6731 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.083727  6627 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:16:01.086853  6551 raft_consensus.cc:2764] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:01.118507  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:01.105134  6711 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:01.078037  6726 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:01.106354  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.113495  6740 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:01.126415  6740 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:01.102881  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51197.1us
I20260709 13:16:01.127754  6740 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.127931  6686 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.128311  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:01.120857  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:01.123004  6606 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.123260  6705 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:01.082266  6719 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.126946  6627 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.105588  6554 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.128954  6686 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:01.131240  6595 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:01.109201  6482 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:01.137240  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:01.134864  5524 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.107327  6725 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:16:01.149111  5524 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.154834  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:01.133364  6606 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.134899  6627 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.149610  6579 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.157676  6558 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:01.162624  6705 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:01.157521  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:01.164121  6551 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:01.167567  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:01.134539  6685 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.168219  6685 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:01.169551  6685 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.170780  6685 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.173312  5521 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:01.175271  6683 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:01.176323  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.176692  6510 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.177414  5517 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:16:01.186188  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:01.187496  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:01.189975  6745 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:01.191498  6745 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:01.192199  6745 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:01.136119  6698 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:01.198350  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.178776  6727 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:01.216545  6700 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:01.216892  5369 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:01.217089  6700 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.178258  6595 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.177213  6510 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.162878  6558 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:01.201097  6554 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.160423  6726 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.160209  6718 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.218430  5371 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:01.218549  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70956.7us
I20260709 13:16:01.197211  6724 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:01.200807  6698 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:01.161594  6725 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:16:01.242610  6558 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.250044  6724 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:01.250555  6724 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.253300  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.253925  6510 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:01.254951  6595 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:01.254987  6551 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.255596  6698 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.259271  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.260757  6551 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.270674  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:01.267390  6558 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:01.237236  6720 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:01.272053  6720 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.272014  6726 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.218057  6705 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:01.281950  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 116522us
I20260709 13:16:01.219425  6700 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.240414  6496 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:01.219322  6731 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:01.288862  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.158736  6606 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.237118  6742 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.159821  6627 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.248528  6579 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:01.245836  6718 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:01.239686  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 141128us
I20260709 13:16:01.288767  6551 raft_consensus.cc:2764] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:16:01.158121  6719 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.322299  6719 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:01.311859  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:01.313560  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.314785  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:01.315701  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:01.311576  6496 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.278959  6705 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:01.326359  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:01.334200  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.346474  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.346963  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.348905  5450 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:16:01.349520  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.290887  6610 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:01.370976  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 172823us
I20260709 13:16:01.372254  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:01.377588  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 88786.6us
I20260709 13:16:01.379276  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:01.383919  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.352732  6705 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.393172  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:01.374606  6686 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.306538  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:01.402923  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 116381us
I20260709 13:16:01.367626  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:01.397130  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:01.328723  6579 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.380270  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:01.317317  6745 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:01.404083  6713 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:01.381932  6727 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.391955  6694 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:01.406160  6076 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
W20260709 13:16:01.454162  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 105890us
W20260709 13:16:01.480335  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 83326.6us
I20260709 13:16:01.481678  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.483896  5524 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:01.486498  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.487812  6686 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.488101  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:01.484459  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.489270  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.491283  6687 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.491677  6687 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:01.492025  6687 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.493338  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:01.494976  6696 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.485536  6683 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.445655  6755 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:01.443539  6724 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.497875  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:01.498553  5446 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:16:01.499811  6724 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:01.499815  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:01.501258  6724 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:01.502665  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:01.504781  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:01.505609  5450 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:16:01.492038  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.501258  5441 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:01.521605  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.522598  5447 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:01.413160  6742 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:01.531453  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77071.2us
I20260709 13:16:01.544458  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:01.444696  6753 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:16:01.532130  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50278.4us
W20260709 13:16:01.551802  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.552291  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.535825  5448 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
W20260709 13:16:01.546881  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.422243  6741 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.447489  6554 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.416340  6694 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:01.425655  5442 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
I20260709 13:16:01.439126  6579 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:01.484118  6551 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:01.438736  6720 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:01.418669  5367 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:16:01.438265  5366 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:16:01.563262  5414 leader_election.cc:336] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.674s (SENT)
I20260709 13:16:01.578547  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.587320  5444 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:01.407757  6748 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.140s
I20260709 13:16:01.578765  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.590461  5447 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:01.591295  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:01.531491  6496 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.583063  6686 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.563023  6741 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:01.566869  6554 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:01.575587  6694 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.441262  6698 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:01.613607  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58449.2us
I20260709 13:16:01.589212  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:01.618280  6752 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.618968  6761 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:01.619863  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.621798  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.630167  5448 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.622350  6741 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.599745  6554 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.598344  6551 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:01.646176  6760 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:01.646826  6760 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.646364  6551 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:01.647611  6621 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.648025  6621 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.647928  6760 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.574361  6742 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.603505  6745 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.653004  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.654594  5442 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:01.654497  6687 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.655690  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.656258  5442 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.656867  6687 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:01.637910  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 156349us
I20260709 13:16:01.629662  6713 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:01.669946  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:01.671128  5371 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:01.672678  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:01.631748  6761 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:01.644680  6683 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.649294  6760 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:01.661363  5414 leader_election.cc:336] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.734s (SENT)
I20260709 13:16:01.636370  6072 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:16:01.721313  5518 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:01.725050  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 180668us
I20260709 13:16:01.727988  5523 raft_consensus.cc:3055] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:01.652694  6696 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:01.744140  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 82802.4us
I20260709 13:16:01.745651  5448 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
W20260709 13:16:01.754235  5414 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.796s (SENT)
I20260709 13:16:01.754407  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.754676  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:01.755014  5448 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.744450  5523 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.698863  6741 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.649144  6621 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.678915  6761 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:01.757823  6641 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:16:01.731809  6740 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.010s
W20260709 13:16:01.765154  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.769655  5414 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.805s (SENT)
I20260709 13:16:01.770185  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:01.771881  5524 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:01.738849  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:01.600960  6727 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.754500  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:01.779935  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:01.776607  5523 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:01.785681  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:01.786103  5340 connection.cc:256] RPC call timeout handler was delayed by -1.2934982239999044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:16:01.787359  5448 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:01.788733  5523 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.759984  6641 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:01.794143  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:01.766659  6738 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.795079  5448 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:16:01.795266  5414 leader_election.cc:336] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.851s (SENT)
W20260709 13:16:01.829581  6769 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:01.883119  6554 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.856317  6636 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:16:01.839728  6719 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.003s
I20260709 13:16:01.830564  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:01.862990  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:01.651552  6752 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.842108  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:01.889755  6698 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:01.831914  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46337us
I20260709 13:16:01.767974  6694 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.833549  6654 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.829682  6558 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:01.791474  6740 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:01.885718  6641 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.793675  6610 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.796094  6721 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:01.881278  6606 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.738198  6713 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:01.911576  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:01.944901  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 149683us
I20260709 13:16:01.939401  6721 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:01.945930  6721 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:01.947441  5414 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.898s (SENT)
W20260709 13:16:01.841706  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50475.3us
I20260709 13:16:01.950538  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.950804  5522 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:01.950958  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:01.951637  5447 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.952400  6738 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.952957  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.953593  5522 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:01.953879  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.954470  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.955148  5444 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:01.956005  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:01.959687  6768 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.341s	user 0.002s	sys 0.001s
I20260709 13:16:01.960469  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.961143  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:01.962891  6694 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:01.930634  6654 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:01.963724  6621 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.917881  5448 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:01.868423  6685 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.697s	user 0.016s	sys 0.008s
I20260709 13:16:01.924520  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:01.869630  6718 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:01.930352  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 67488.1us
W20260709 13:16:01.934250  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.975075  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:01.927650  6705 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.001s
I20260709 13:16:01.937805  5450 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:01.935211  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:01.983480  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.940896  6774 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.937117  6719 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:16:01.967044  5414 leader_election.cc:336] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.999s (SENT)
I20260709 13:16:01.965263  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.964452  6654 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:01.967957  6641 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.968216  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:01.968722  6554 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:01.926666  5443 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:16:01.932731  6683 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.984290  5374 raft_consensus.cc:2410] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:01.988392  6684 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.992787  5371 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:02.021847  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.997717  5414 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.088s (SENT)
I20260709 13:16:02.001310  6685 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.970695  6752 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.001358  6774 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.014496  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.016610  5447 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:02.019418  5522 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:02.039731  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:02.020561  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85441.2us
I20260709 13:16:01.940002  6742 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.025434  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:02.021201  6718 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:02.032232  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.031498  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:02.026530  5416 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:02.023347  6654 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.984071  6705 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:02.047844  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.051394  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.028617  6771 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:02.031189  6076 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:02.022457  6684 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:02.060357  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.028550  5442 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:02.060539  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:02.080772  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.066545  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:02.097155  5447 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:02.097718  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.097664  5519 raft_consensus.cc:2376] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3. Re-sending same reply.
I20260709 13:16:02.078572  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:02.099467  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68071.1us
I20260709 13:16:02.099426  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:02.099323  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.100474  5519 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
W20260709 13:16:02.100580  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.100399  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:02.104534  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:02.045854  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:02.061508  6765 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:16:02.106226  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:02.037370  6761 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.099201  5372 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:02.097853  6551 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.057952  6742 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.121877  5519 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.120128  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:02.126310  5372 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:02.127089  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:02.085923  6771 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:02.141278  5445 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:02.133988  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.143446  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.143872  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.144263  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.144650  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.145051  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.067288  6774 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.117990  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:02.157702  5414 leader_election.cc:336] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.113s (SENT)
I20260709 13:16:02.120625  5368 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:01.790551  6726 consensus_queue.cc:1175] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b781c7e31b7145aea647a7ff649e6ac7" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)" } } last_received_current_leader { term: 1 index: 3 } }
I20260709 13:16:02.146984  6657 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:02.166018  5447 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:02.142654  6742 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:02.160573  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 73957.9us
W20260709 13:16:02.179600  5414 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.167s (SENT)
I20260709 13:16:02.185376  5447 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:02.157348  6694 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.131690  6551 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:02.148569  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.189915  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:02.204905  5372 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:02.163142  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:02.181536  6774 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.145642  6713 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:16:02.238907  6558 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:02.239648  6636 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:02.240033  6636 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:16:02.241048  6783 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:16:02.242736  6782 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:02.184167  6657 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:16:02.253051  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 152746us
I20260709 13:16:02.240077  6558 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:02.149089  6781 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.205361  6551 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:02.247543  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 67998.1us
W20260709 13:16:02.249912  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.259841  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.202152  6742 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.254130  5519 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:02.254010  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:02.139102  6684 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:02.260232  5414 leader_election.cc:336] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.207s (SENT)
I20260709 13:16:02.247409  5442 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.234268  6774 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:02.264364  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.265244  6705 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.309355  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.250773  6744 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.312305  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.309288  6684 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.216629  6694 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.254375  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.241099  6636 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:02.257997  6781 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.255316  6558 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:02.328317  6791 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.348877  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 88662.9us
W20260709 13:16:02.363363  5414 leader_election.cc:336] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.207s (SENT)
I20260709 13:16:02.364063  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:02.354190  6785 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:16:02.355074  6786 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:16:02.339444  6774 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.345891  5519 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
W20260709 13:16:02.310827  6482 consensus_queue.cc:1175] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:16:02.383309  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 129383us
I20260709 13:16:02.384773  5372 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.405053  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:02.406821  5414 leader_election.cc:336] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.252s (SENT)
I20260709 13:16:02.409988  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:02.412842  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:02.413899  5515 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.418937  6694 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.419994  6792 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.442320  6738 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.442911  6738 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.443501  6787 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.363245  6781 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.265472  6771 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.407717  6636 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.453372  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.422073  6744 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.445288  6685 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:02.493152  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.495584  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.402647  6558 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.514252  6558 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.446980  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:02.533731  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 775) took 1015 ms. Trace:
W20260709 13:16:02.545931  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.453450  6761 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:02.556981  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.534646  5450 rpcz_store.cc:276] 0709 13:16:01.518548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.518712 (+   164us) service_pool.cc:224] Handling call
0709 13:16:01.519027 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.982207 (+463180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.529342 (+547135us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54003cd054. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:02.533598 (+  4256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962580736}
W20260709 13:16:02.588527  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 183586us
I20260709 13:16:02.486505  6685 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:02.588735  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 181979us
I20260709 13:16:02.596376  5445 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:02.593183  5442 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:02.593446  6738 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.379771  6657 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.385776  6791 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.589967  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:02.597013  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.681s (SENT) [suppressed 44 similar messages]
W20260709 13:16:02.605914  5414 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.358s (SENT)
I20260709 13:16:02.606706  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:02.590911  5269 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 1 to 3, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 3 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:02.616134  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.589097  6744 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.617056  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.618475  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:02.623466  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.600447  6641 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.590s	user 0.018s	sys 0.016s
I20260709 13:16:02.624501  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:02.599650  6685 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.619324  6789 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.630721  5519 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:02.607625  6738 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.612143  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:02.625815  6657 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.645633  5369 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 1.
I20260709 13:16:02.629701  6694 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:02.656867  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.657600  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.662585  5489 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:02.639549  6789 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.663038  5489 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
I20260709 13:16:02.647089  6716 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.629388  6744 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:02.657521  6721 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.012s
I20260709 13:16:02.637714  6738 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:16:02.692199  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67248.1us
I20260709 13:16:02.683898  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38156 (request call id 67) took 1242 ms. Trace:
I20260709 13:16:02.704322  6738 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:02.715130  6738 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:02.689394  6789 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.720114  6789 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:02.710729  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.722473  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1046) took 1509 ms. Trace:
I20260709 13:16:02.723032  5368 rpcz_store.cc:276] 0709 13:16:01.213189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.218336 (+  5147us) service_pool.cc:224] Handling call
0709 13:16:01.288352 (+ 70016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.175658 (+887306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.722093 (+546435us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54000d1454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:02.722357 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868167424}
I20260709 13:16:02.686240  6694 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:02.688537  6610 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:02.733652  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.747371  6791 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.749708  5366 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:02.750810  5374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 825) took 1439 ms (client timeout 1680 ms). Trace:
I20260709 13:16:02.698495  6721 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:02.751192  5374 rpcz_store.cc:269] 0709 13:16:01.311277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.311587 (+   310us) service_pool.cc:224] Handling call
0709 13:16:02.750574 (+1438987us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b5400144954. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:02.750756 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512678784}
I20260709 13:16:02.753000  6721 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:02.754101  6784 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.677s	user 0.003s	sys 0.007s
I20260709 13:16:02.748219  5489 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
I20260709 13:16:02.790549  5374 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:02.760336  6654 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.001s
I20260709 13:16:02.765520  6792 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:02.770370  6718 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.713s	user 0.011s	sys 0.000s
I20260709 13:16:02.771384  6076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59510 (request call id 57) took 1239 ms. Trace:
W20260709 13:16:02.797734  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 173348us
I20260709 13:16:02.771667  5372 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.737928  6610 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:02.733042  6606 consensus_meta.cc:287] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.792s	user 0.008s	sys 0.016s
I20260709 13:16:02.713469  5369 rpcz_store.cc:276] 0709 13:16:01.413852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.416034 (+  2182us) service_pool.cc:224] Handling call
0709 13:16:02.602465 (+1186431us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:02.656014 (+ 53549us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35757952}
I20260709 13:16:02.778965  5373 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.780681  5517 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:02.783215  6760 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.083s	user 0.009s	sys 0.006s
I20260709 13:16:02.724197  5515 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:02.793954  5269 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 1 to 3, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 3 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.730427  6797 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.802860  5489 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
I20260709 13:16:02.817538  5272 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 153) took 8813 ms. Trace:
I20260709 13:16:02.802855  6076 rpcz_store.cc:276] 0709 13:16:01.531745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.561952 (+ 30207us) service_pool.cc:224] Handling call
0709 13:16:01.596335 (+ 34383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.061871 (+465536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.771051 (+709180us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b540049d9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:02.771267 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974868864}
I20260709 13:16:02.819837  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:02.822605  5374 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:02.828761  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:02.852624  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1056) took 1177 ms. Trace:
W20260709 13:16:02.804080  6700 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.462s	user 0.015s	sys 0.001s
W20260709 13:16:02.810740  6741 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.044s	user 0.012s	sys 0.002s
W20260709 13:16:02.803646  6788 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.011s	sys 0.023s
I20260709 13:16:02.860852  5522 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:02.866276  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46555.9us
I20260709 13:16:02.859262  5269 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:02.878090  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:02.866926  5373 rpcz_store.cc:276] 0709 13:16:01.676344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.677706 (+  1362us) service_pool.cc:224] Handling call
0709 13:16:02.778556 (+1100850us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:02.778778 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.852335 (+ 73557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.852553 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96033152}
I20260709 13:16:02.871703  5374 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:02.755177  6694 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.871845  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:02.855772  6654 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.821211  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.868108  5367 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:02.871425  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 80508.8us
I20260709 13:16:02.853863  6641 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.887255  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:02.811158  6781 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.864600  6791 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.873806  6716 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:16:02.876528  6788 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.011s	sys 0.024s
I20260709 13:16:02.894364  6771 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.894706  6801 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:02.896374  5414 leader_election.cc:336] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.565s (SENT)
I20260709 13:16:02.810161  6742 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:02.888028  6683 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:02.891790  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 869) took 1110 ms. Trace:
I20260709 13:16:02.913164  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:02.891181  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:02.875883  6700 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.893605  5367 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:02.925004  5489 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
I20260709 13:16:02.937613  6787 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.937923  6579 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:02.938416  6579 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:02.938213  6787 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.939733  6579 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.940536  6787 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.940855  6579 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.913164  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.892534  6654 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.865200  5272 rpcz_store.cc:276] 0709 13:15:54.004529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.004851 (+   322us) service_pool.cc:224] Handling call
0709 13:16:02.817409 (+8812558us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:00.387799 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:00.388371 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:00.403697 (+ 15326us) write_op.cc:435] Acquired schema lock
0709 13:16:00.451179 (+ 47482us) tablet.cc:662] Decoding operations
0709 13:16:00.565166 (+113987us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:00.570248 (+  5082us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:00.573004 (+  2756us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:00.621762 (+ 48758us) tablet.cc:701] Row locks acquired
0709 13:16:00.621789 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:16:00.621964 (+   175us) write_op.cc:270] Start()
0709 13:16:00.622116 (+   152us) write_op.cc:276] Timestamp: P: 1783602960621909 usec, L: 0
0709 13:16:00.622144 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:16:00.622919 (+   775us) log.cc:844] Serialized 1303 byte log entry
0709 13:16:00.794183 (+171264us) op_driver.cc:464] REPLICATION: finished
0709 13:16:01.236525 (+442342us) write_op.cc:301] APPLY: starting
0709 13:16:01.241122 (+  4597us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:01.289945 (+ 48823us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:01.325687 (+ 35742us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:01.444346 (+118659us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:01.444607 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:16:01.444677 (+    70us) write_op.cc:312] APPLY: finished
0709 13:16:01.444967 (+   290us) log.cc:844] Serialized 34 byte log entry
0709 13:16:01.445201 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:01.445296 (+    95us) write_op.cc:454] Released schema lock
0709 13:16:01.445341 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:01.445769 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:01.445806 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1874187,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":220940,"apply.run_cpu_time_us":3577,"apply.run_wall_time_us":209227,"num_ops":3,"prepare.queue_time_us":132281,"prepare.run_cpu_time_us":4509,"prepare.run_wall_time_us":235513,"replication_time_us":148211,"thread_start_us":252296,"threads_started":2}]]}
W20260709 13:16:02.951140  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.944370  5487 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36792 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
I20260709 13:16:02.949290  6558 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.982719  6558 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.984169  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.985021  5515 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:02.928790  5517 rpcz_store.cc:276] 0709 13:16:01.771027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.773404 (+  2377us) service_pool.cc:224] Handling call
0709 13:16:02.124245 (+350841us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:02.780298 (+656053us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67eee 0000000000375939 00007fc1d8cdb1e0 00007fc1d8da40c4 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:02.780483 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.856629 (+ 76146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.881658 (+ 25029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17138816}
I20260709 13:16:02.962831  6694 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:02.963645  6551 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.027s
I20260709 13:16:02.949549  6657 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.967425  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 72) took 1015 ms. Trace:
I20260709 13:16:02.970114  6744 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:02.935868  6621 consensus_meta.cc:287] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.972s	user 0.012s	sys 0.007s
W20260709 13:16:02.978868  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 82525.4us
I20260709 13:16:02.900029  6641 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.923523  6716 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:02.984926  6558 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:02.911140  6741 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:16:02.908751  6791 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.953055  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 70) took 1184 ms. Trace:
W20260709 13:16:02.988575  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.945089  6774 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
W20260709 13:16:02.990130  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.991195  5340 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:02.993610  5370 rpcz_store.cc:276] 0709 13:16:01.951885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.023944 (+ 72059us) service_pool.cc:224] Handling call
0709 13:16:02.715244 (+691300us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:02.715459 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.715844 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.715872 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.716387 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:16:02.823577 (+107190us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:02.823621 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.823845 (+   224us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:02.967023 (+143178us) raft_consensus.cc:1685] finished
0709 13:16:02.967049 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.967338 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5110,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"spinlock_wait_cycles":3673856,"thread_start_us":106631,"threads_started":1,"wal-append.queue_time_us":173957}
I20260709 13:16:02.998767  6551 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:02.949744  5369 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:02.977792  6797 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.022138  5523 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 4. (term mismatch)
I20260709 13:16:03.022554  5523 pending_rounds.cc:85] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 3
I20260709 13:16:03.022796  5523 pending_rounds.cc:107] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
I20260709 13:16:03.023087  5523 raft_consensus.cc:2917] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 13:16:03.023486  5523 raft_consensus.cc:2889] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.023582  6791 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.024063  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36782 (request call id 62) took 6118 ms. Trace:
I20260709 13:16:03.022130  6797 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.024808  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 873) took 1173 ms. Trace:
I20260709 13:16:03.025223  5524 rpcz_store.cc:276] 0709 13:16:01.851328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.851597 (+   269us) service_pool.cc:224] Handling call
0709 13:16:01.857639 (+  6042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.942128 (+ 84489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.942161 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:01.942202 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:01.942230 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.024597 (+1082367us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b5400378cd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:03.024641 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.024756 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193783168}
I20260709 13:16:03.026593  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:02.990289  5487 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36792 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 792)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 814)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
W20260709 13:16:03.002864  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.980814  6683 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:03.005297  6716 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.006834  6700 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.012018  6654 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.033460  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:03.008648  6636 consensus_meta.cc:287] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.000s
I20260709 13:16:03.009208  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:03.010111  6610 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:03.015986  5521 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:03.012440  5375 rpcz_store.cc:276] 0709 13:16:01.768923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.990952 (+222029us) service_pool.cc:224] Handling call
0709 13:16:01.991259 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.039095 (+ 47836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.039145 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.039210 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:02.039261 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.952812 (+913551us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b54001e8a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:02.952860 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.952997 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109379840}
I20260709 13:16:02.945801  6799 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:16:03.020541  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:03.027587  5524 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:03.028836  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.042174  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:03.042147  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.024257  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.029220  5489 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 63)
I20260709 13:16:03.024469  5523 rpcz_store.cc:276] 0709 13:15:56.933843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.490788 (+1556945us) service_pool.cc:224] Handling call
0709 13:15:58.544136 (+ 53348us) log.cc:844] Serialized 494 byte log entry
0709 13:15:59.110343 (+566207us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18000edee0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:15:59.164801 (+ 54458us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b18000edee0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d3ce5b0b 00007fc1d3d6ab63 00007fc1d3d92752
0709 13:16:03.023973 (+3859172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86703,"raft.run_cpu_time_us":2682,"raft.run_wall_time_us":84496,"spinlock_wait_cycles":34501888,"thread_start_us":307862,"threads_started":2,"wal-append.queue_time_us":333602,"wal-append.run_cpu_time_us":2631,"wal-append.run_wall_time_us":1056093}
I20260709 13:16:03.048866  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:03.051342  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:03.052064  5375 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:03.053102  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:03.054167  5375 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:03.058245  6684 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.001s
I20260709 13:16:03.026568  6781 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.061268  6801 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.061983  6683 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.062558  6801 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:03.063010  6801 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:03.022215  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:03.070499  6742 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:03.070648  5366 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.026525  6797 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:02.993734  6043 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:03.032667  6687 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:03.073132  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 91120.6us
I20260709 13:16:03.073619  6687 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:03.073688  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.074144  6687 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.074666  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 792) took 1004 ms. Trace:
I20260709 13:16:03.075232  5515 rpcz_store.cc:276] 0709 13:16:02.069862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.027967 (+958105us) service_pool.cc:224] Handling call
0709 13:16:03.074599 (+ 46632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.076440  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.074687  6748 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:03.077668  6748 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:03.063810  6801 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.078068  6748 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.011934  6685 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.018505  5516 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:03.013371  5367 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:03.094825  5367 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.098287  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 73) took 1146 ms. Trace:
I20260709 13:16:03.098776  5371 rpcz_store.cc:276] 0709 13:16:01.952192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.023955 (+ 71763us) service_pool.cc:224] Handling call
0709 13:16:02.024253 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.046512 (+ 22259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.046543 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.046700 (+   157us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:02.046747 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.098021 (+1051274us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b54002ff3d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:03.098073 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.098224 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50775936}
I20260709 13:16:03.064340  6792 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.100386  6792 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:03.101413  6792 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.048661  6791 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:03.106335  6791 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:03.107604  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.069919  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.065805  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.080174  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:03.081398  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:03.082374  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:03.082465  6698 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:03.084081  6627 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.027539  6774 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.078645  6801 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.086555  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.087664  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 60) took 1360 ms. Trace:
I20260709 13:16:03.088923  5366 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:03.091391  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.154003  5524 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
W20260709 13:16:03.092549  5414 leader_election.cc:336] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.606s (SENT)
I20260709 13:16:03.155030  5447 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:03.155514  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 63002.4us
W20260709 13:16:03.105717  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.114671  5367 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:03.115986  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.116847  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:03.160463  5445 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:03.117100  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:03.162154  5450 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:03.117853  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:03.126528  5375 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:03.127808  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:03.139827  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:03.164314  5448 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.142725  5373 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:03.144281  5487 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36792 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 834)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 832)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 888)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 893)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 63)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 889)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 891)
I20260709 13:16:03.151154  5523 rpcz_store.cc:276] 0709 13:16:01.727233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.727412 (+   179us) service_pool.cc:224] Handling call
0709 13:16:01.727854 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.021870 (+1294016us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54001fd9a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d03dc0 00007fc1d3d8ed87 00007fc1d3d8f470 00007fc1d3d8bd8f 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c
0709 13:16:03.086999 (+ 65129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.087285 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666087680}
W20260709 13:16:03.168000  5414 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.696s (SENT)
I20260709 13:16:03.168789  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:03.110118  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 782) took 1088 ms. Trace:
I20260709 13:16:03.167763  5517 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:03.179688  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:03.179899  5258 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23048b90f57d48a4be8be78bc78d9204 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:16:03.180320  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 790) took 1111 ms. Trace:
I20260709 13:16:03.180729  5443 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:03.181102  6685 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.182123  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.182960  5523 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:03.183964  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.184695  5523 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:03.151120  6698 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:03.185990  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.186275  6698 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.185694  6696 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.155007  5515 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:03.124773  6684 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:03.176705  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:03.197062  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:03.199734  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.195015  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:03.200489  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.200610  5523 raft_consensus.cc:2376] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2. Re-sending same reply.
W20260709 13:16:03.200989  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.201449  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 796) took 1130 ms. Trace:
I20260709 13:16:03.201870  5523 rpcz_store.cc:276] 0709 13:16:02.071212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.185202 (+1113990us) service_pool.cc:224] Handling call
0709 13:16:03.201367 (+ 16165us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.203065  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.204428  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:03.204972  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.205276  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 794) took 1134 ms. Trace:
I20260709 13:16:03.206072  5524 rpcz_store.cc:276] 0709 13:16:02.070521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.174051 (+1103530us) service_pool.cc:224] Handling call
0709 13:16:03.205207 (+ 31156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.209354  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.203727  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:03.211733  5447 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:16:03.189558  6780 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.176819  6799 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.170008  6686 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.211107  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:03.214408  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:03.212743  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:03.173799  5518 rpcz_store.cc:276] 0709 13:16:02.021572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.069578 (+1048006us) service_pool.cc:224] Handling call
0709 13:16:03.110043 (+ 40465us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.218003  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.220322  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.107753  6791 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.189810  6788 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.221134  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.210618  6559 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.244963  5524 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:03.247164  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 797) took 1175 ms. Trace:
I20260709 13:16:03.203951  6742 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.247848  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.247704  5524 rpcz_store.cc:276] 0709 13:16:02.071527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.206929 (+1135402us) service_pool.cc:224] Handling call
0709 13:16:03.247104 (+ 40175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.212702  6685 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.211380  6789 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.217792  6579 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.257575  5522 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:16:03.258025  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.271576  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 789) took 1202 ms. Trace:
I20260709 13:16:03.180740  5517 rpcz_store.cc:276] 0709 13:16:02.069124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.086109 (+1016985us) service_pool.cc:224] Handling call
0709 13:16:03.180256 (+ 94147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.259831  5445 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:16:03.213644  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 813) took 1094 ms. Trace:
W20260709 13:16:03.259130  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44800.8us
I20260709 13:16:03.204155  6770 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:16:03.271939  5522 rpcz_store.cc:276] 0709 13:16:02.068739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.044435 (+975696us) service_pool.cc:224] Handling call
0709 13:16:03.271510 (+227075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.190120  6748 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:03.275669  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.294193  5524 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:03.287762  5523 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:03.294759  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 815) took 1114 ms. Trace:
I20260709 13:16:03.295245  5523 rpcz_store.cc:276] 0709 13:16:02.180648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.202607 (+1021959us) service_pool.cc:224] Handling call
0709 13:16:03.294685 (+ 92078us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.258354  6685 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.294021  5448 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:03.255167  6684 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:03.285185  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.297616  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:03.298391  5448 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.268785  6694 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.318717  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:03.316249  5414 leader_election.cc:336] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.597s (SENT)
I20260709 13:16:03.322882  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:03.268467  6789 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:03.314175  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 140914us
I20260709 13:16:03.243772  6686 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.281661  6696 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.329027  6696 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.328024  6076 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:03.255914  6559 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.331857  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.258550  6742 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:03.334704  5414 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.674s (SENT)
W20260709 13:16:03.343890  5414 leader_election.cc:336] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.831s (SENT)
I20260709 13:16:03.344374  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:03.337888  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 798) took 1266 ms. Trace:
I20260709 13:16:03.344957  5523 rpcz_store.cc:276] 0709 13:16:02.071896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.302272 (+1230376us) service_pool.cc:224] Handling call
0709 13:16:03.337816 (+ 35544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.300760  6685 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.340039  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.274118  6579 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:03.363438  5414 leader_election.cc:336] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 3.126s (SENT)
I20260709 13:16:03.322228  6694 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.277042  5515 rpcz_store.cc:276] 0709 13:16:02.119507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.076145 (+956638us) service_pool.cc:224] Handling call
0709 13:16:03.211033 (+134888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.366626  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:03.376508  5524 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:03.320881  6551 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.381614  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 795) took 1310 ms. Trace:
I20260709 13:16:03.382151  5524 rpcz_store.cc:276] 0709 13:16:02.070882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.320091 (+1249209us) service_pool.cc:224] Handling call
0709 13:16:03.381536 (+ 61445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.328307  6789 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.247313  6799 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.364727  5448 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:03.250849  6788 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.340845  6797 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.430877  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:03.431618  5448 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.338546  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.461764  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.375891  6694 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.452328  6727 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:03.464126  6774 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.341346  6790 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:16:03.377707  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.470724  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.472832  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 800) took 1400 ms. Trace:
W20260709 13:16:03.485672  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.473253  5524 rpcz_store.cc:276] 0709 13:16:02.072545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.441400 (+1368855us) service_pool.cc:224] Handling call
0709 13:16:03.472765 (+ 31365us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.503207  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.386744  6740 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:03.528227  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.504515  5414 leader_election.cc:336] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.530s (SENT)
I20260709 13:16:03.466570  6687 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:03.543767  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:03.554212  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:03.555305  5449 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:03.572985  5448 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:03.572880  5523 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:03.575030  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.579346  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 799) took 1507 ms. Trace:
I20260709 13:16:03.579840  5523 rpcz_store.cc:276] 0709 13:16:02.072209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.379504 (+1307295us) service_pool.cc:224] Handling call
0709 13:16:03.579287 (+199783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.580961  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.578329  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 875) took 1369 ms. Trace:
I20260709 13:16:03.582237  5524 rpcz_store.cc:276] 0709 13:16:02.208557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.539866 (+1331309us) service_pool.cc:224] Handling call
0709 13:16:03.578141 (+ 38275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.583170  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.583765  5524 raft_consensus.cc:2376] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2. Re-sending same reply.
I20260709 13:16:03.542666  6683 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.542634  6797 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:03.589151  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:03.582767  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 818) took 1227 ms. Trace:
W20260709 13:16:03.584017  6657 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 13:16:03.577544  6741 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:03.476171  6727 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.583600  6700 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:03.595213  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.619638  5524 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:03.562911  6781 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:03.594460  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 816) took 1367 ms. Trace:
I20260709 13:16:03.620347  5523 rpcz_store.cc:276] 0709 13:16:02.237316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.580709 (+1343393us) service_pool.cc:224] Handling call
0709 13:16:03.594404 (+ 13695us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.539774  6684 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.633085  5449 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:03.608433  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.589406  6780 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:03.612198  5446 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:03.602111  5517 rpcz_store.cc:276] 0709 13:16:02.352522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.297966 (+945444us) service_pool.cc:224] Handling call
0709 13:16:03.579844 (+281878us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.627187  5516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 811) took 1546 ms (client timeout 1681 ms). Trace:
I20260709 13:16:03.652431  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.653147  5523 raft_consensus.cc:2376] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4. Re-sending same reply.
W20260709 13:16:03.629070  6771 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.001s
I20260709 13:16:03.615028  5368 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:03.630192  6579 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:03.635545  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 801) took 1562 ms. Trace:
I20260709 13:16:03.644177  6788 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:03.644829  6815 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:16:03.613289  6482 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.646858  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:03.616469  6657 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.599015  6683 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:03.665073  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 160602us
I20260709 13:16:03.669157  5524 rpcz_store.cc:276] 0709 13:16:02.072885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.594936 (+1522051us) service_pool.cc:224] Handling call
0709 13:16:03.635467 (+ 40531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.633344  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.605562  6797 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:03.679726  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:03.654040  6698 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:03.681329  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.709563  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.709497  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:03.639206  6781 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.685057  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.707255  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.717931  5524 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:03.671548  6771 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:03.731905  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.640095  6700 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:03.733860  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 804) took 1654 ms. Trace:
I20260709 13:16:03.734314  5524 rpcz_store.cc:276] 0709 13:16:02.079253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.706700 (+1627447us) service_pool.cc:224] Handling call
0709 13:16:03.733797 (+ 27097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.713193  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:03.666146  6559 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:03.717020  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 879) took 1387 ms. Trace:
I20260709 13:16:03.783142  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:03.783403  6551 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:03.786372  6551 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:03.714171  6627 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 13:16:03.720644  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:03.726300  6818 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:03.728149  6727 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:03.729161  6657 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.790364  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 802) took 1717 ms. Trace:
I20260709 13:16:03.729099  6826 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.790805  5517 rpcz_store.cc:276] 0709 13:16:02.073203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.677211 (+1604008us) service_pool.cc:224] Handling call
0709 13:16:03.790288 (+113077us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.791275  6826 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.791904  6826 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.792239  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.792888  5517 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:16:03.711509  6799 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.730386  6748 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.731048  6683 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.676192  6579 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.731850  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.802735  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.802454  6579 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.804977  6579 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:03.793769  6788 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:03.806072  6788 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.771443  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.808393  6788 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.809128  5524 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:03.809710  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 824) took 1182 ms. Trace:
I20260709 13:16:03.784751  5523 rpcz_store.cc:276] 0709 13:16:02.329953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.653785 (+1323832us) service_pool.cc:224] Handling call
0709 13:16:03.716923 (+ 63138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.810215  5524 rpcz_store.cc:276] 0709 13:16:02.627738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.735038 (+1107300us) service_pool.cc:224] Handling call
0709 13:16:03.809636 (+ 74598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.717839  6698 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.810874  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.811474  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.811720  5523 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:03.812062  5524 raft_consensus.cc:2376] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4. Re-sending same reply.
I20260709 13:16:03.812288  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 827) took 1171 ms. Trace:
I20260709 13:16:03.780333  6790 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:03.676468  6805 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.790081  6820 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:16:03.731539  6797 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:03.705807  6482 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:03.652431  5516 rpcz_store.cc:269] 0709 13:16:02.081200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.259523 (+178323us) service_pool.cc:224] Handling call
0709 13:16:03.626933 (+1367410us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54002788d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:03.627089 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543235840}
W20260709 13:16:03.796980  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.798784  6781 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.789193  6551 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:03.793372  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 820) took 1350 ms. Trace:
I20260709 13:16:03.809638  6687 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:03.778942  6742 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.817703  6827 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:03.812747  5523 rpcz_store.cc:276] 0709 13:16:02.640621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.810563 (+1169942us) service_pool.cc:224] Handling call
0709 13:16:03.812199 (+  1636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.816239  6748 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:16:03.888857  6748 consensus_queue.cc:1243] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:03.888749  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.812760  6698 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.890018  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 881) took 1465 ms. Trace:
W20260709 13:16:03.828922  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.890417  5366 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:03.833640  6685 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.891837  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:03.892568  5366 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:03.881443  5517 rpcz_store.cc:276] 0709 13:16:02.442904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.791827 (+1348923us) service_pool.cc:224] Handling call
0709 13:16:03.793319 (+  1492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.895713  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:03.896540  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 830) took 1236 ms. Trace:
I20260709 13:16:03.896911  5517 rpcz_store.cc:276] 0709 13:16:02.660306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.895424 (+1235118us) service_pool.cc:224] Handling call
0709 13:16:03.896482 (+  1058us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.898983  6774 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:03.899638  6774 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:03.874199  6787 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:03.813194  6790 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:03.901070  6787 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:03.903224  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:03.903963  6787 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:03.904363  6641 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:03.905076  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.903972  5366 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:03.908192  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.843699  6579 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:03.815191  6700 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:03.847013  5374 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:03.822885  5519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 808) took 1742 ms (client timeout 1773 ms). Trace:
W20260709 13:16:03.914840  5519 rpcz_store.cc:269] 0709 13:16:02.080386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.452852 (+372466us) service_pool.cc:224] Handling call
0709 13:16:03.822682 (+1369830us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002db254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:03.822821 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347570048}
I20260709 13:16:03.847878  5372 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:03.858251  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.708019  6740 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:03.815387  5520 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
W20260709 13:16:03.847615  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.795457  6801 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.012s
W20260709 13:16:03.844292  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.845682  5370 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:03.871153  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:03.924538  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.819473  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:03.872567  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:03.872610  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:03.931367  5367 pending_rounds.cc:85] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 4
I20260709 13:16:03.931802  5367 pending_rounds.cc:107] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:16:03.932119  5367 raft_consensus.cc:2889] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.813031  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:03.836848  6686 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:04.192720  5524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 825) took 1561 ms (client timeout 2066 ms). Trace:
W20260709 13:16:04.193264  5524 rpcz_store.cc:269] 0709 13:16:02.631605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.812772 (+1181167us) service_pool.cc:224] Handling call
0709 13:16:04.192630 (+379858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.909447  5522 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:04.195233  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 826) took 1558 ms. Trace:
I20260709 13:16:04.195698  5522 rpcz_store.cc:276] 0709 13:16:02.638056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.907815 (+1269759us) service_pool.cc:224] Handling call
0709 13:16:04.195156 (+287341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.910502  5523 rpcz_store.cc:276] 0709 13:16:02.424606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.888336 (+1463730us) service_pool.cc:224] Handling call
0709 13:16:03.889936 (+  1600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.908351  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:03.925055  5375 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
W20260709 13:16:03.925055  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.015194  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.924417  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.770867  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.089175  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.772722  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.773180  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.773510  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.774048  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.774483  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.249562  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.035009  5518 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:04.033519  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.018297  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.806129  5519 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:04.469388  5447 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.806649  6844 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.807197  6844 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.808581  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.469844  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.472075  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.809808  5445 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:16:04.810914  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.811581  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:04.812496  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.812984  5445 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.476370  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.814412  5516 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
W20260709 13:16:04.814934  5516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 829) took 2173 ms (client timeout 2072 ms). Trace:
W20260709 13:16:04.815330  5516 rpcz_store.cc:269] 0709 13:16:02.641339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.882013 (+1240674us) service_pool.cc:224] Handling call
0709 13:16:04.476171 (+594158us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67e9c 00007fc1d0c67a5b 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:04.814870 (+338699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90751744}
I20260709 13:16:04.816491  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.817095  5516 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
W20260709 13:16:04.525097  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.821926  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.821943  5516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 893) took 1678 ms (client timeout 2065 ms). Trace:
I20260709 13:16:04.540668  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.830013  5523 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:04.830504  5523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 807) took 2750 ms (client timeout 3126 ms). Trace:
W20260709 13:16:04.831005  5523 rpcz_store.cc:269] 0709 13:16:02.080121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.196850 (+2116729us) service_pool.cc:224] Handling call
0709 13:16:04.830442 (+633592us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.831964  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.832549  5523 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
W20260709 13:16:04.832988  5523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 890) took 1721 ms (client timeout 2107 ms). Trace:
I20260709 13:16:04.066608  6075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:04.122229  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:04.833287  5523 rpcz_store.cc:269] 0709 13:16:03.111806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.831722 (+1719916us) service_pool.cc:224] Handling call
0709 13:16:04.832927 (+  1205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.068737  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:04.837579  5516 rpcz_store.cc:269] 0709 13:16:03.143766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.816212 (+1672446us) service_pool.cc:224] Handling call
0709 13:16:04.821870 (+  5658us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.389629  6071 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:04.028352  6482 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.012305  6579 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.847752  6579 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:04.516564  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:04.851164  5517 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:04.511051  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:04.829329  5445 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:04.058326  6685 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.878325  6694 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.863637  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:04.864775  6694 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.136914  6740 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.900821  6774 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.486764  6787 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.136265  6789 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.008s
I20260709 13:16:04.879899  6789 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.050349  6790 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:04.382349  6791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.028s	sys 0.005s
W20260709 13:16:04.885048  6791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.031s	sys 0.005s
I20260709 13:16:04.527222  6801 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.886747  6801 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.888903  6801 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.870952  6805 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:04.067638  6822 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.284s	user 0.004s	sys 0.000s
I20260709 13:16:04.031235  6826 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.893915  5446 raft_consensus.cc:2368] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:16:04.894819  6826 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:03.928685  6827 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:04.898077  6827 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.582778  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.902041  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.902737  5450 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.606678  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:04.905951  5372 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:04.624840  5521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 775) took 2669 ms (client timeout 2075 ms). Trace:
I20260709 13:16:04.906432  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38156 (request call id 78) took 1001 ms. Trace:
I20260709 13:16:04.906760  5372 rpcz_store.cc:276] 0709 13:16:03.904885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.934777 (+ 29892us) service_pool.cc:224] Handling call
0709 13:16:04.906367 (+971590us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:04.906628  5521 rpcz_store.cc:269] 0709 13:16:01.955666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.955772 (+   106us) service_pool.cc:224] Handling call
0709 13:16:04.624650 (+2668878us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400313654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:04.624775 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405553024}
I20260709 13:16:04.907857  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:04.908308  5521 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.908731  6774 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:04.637091  5369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.013s	sys 0.038s
W20260709 13:16:04.909693  5369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.014s	sys 0.038s
I20260709 13:16:04.910576  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1072) took 1065 ms. Trace:
I20260709 13:16:04.910930  5369 rpcz_store.cc:276] 0709 13:16:03.845386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.862463 (+ 17077us) service_pool.cc:224] Handling call
0709 13:16:03.898895 (+ 36432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.899174 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:03.899506 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:16:04.910201 (+1010695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:04.910262 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:04.910306 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.910384 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.910518 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":643,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":1010312,"threads_started":1,"wal-append.queue_time_us":480294}
I20260709 13:16:04.911834  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.651904  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.912606  5446 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.912994  5449 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 1.
I20260709 13:16:04.913930  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.914466  5449 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.915081  5521 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:04.915618  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 855) took 1127 ms. Trace:
I20260709 13:16:04.915906  5521 rpcz_store.cc:276] 0709 13:16:03.787701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.907593 (+1119892us) service_pool.cc:224] Handling call
0709 13:16:04.915541 (+  7948us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.916800  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:04.651893  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.917513  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 859) took 1128 ms. Trace:
I20260709 13:16:04.917769  5441 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:04.917891  5521 rpcz_store.cc:276] 0709 13:16:03.788895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.916529 (+1127634us) service_pool.cc:224] Handling call
0709 13:16:04.917455 (+   926us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:04.660068  5448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.039s	sys 0.092s
W20260709 13:16:04.919817  5448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.040s	sys 0.092s
I20260709 13:16:04.921567  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 813) took 1720 ms. Trace:
I20260709 13:16:04.677647  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:03.867439  5414 leader_election.cc:336] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.923s (SENT)
I20260709 13:16:04.717757  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:04.924906  6827 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:04.722754  5443 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:04.925604  6827 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.926663  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.927400  5443 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.928030  6827 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.918871  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:04.723816  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.929317  5441 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
W20260709 13:16:04.929785  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.930508  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.931437  5441 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:04.932488  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:04.743167  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.743413  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.008s	sys 0.043s
W20260709 13:16:04.936929  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.008s	sys 0.043s
I20260709 13:16:04.937726  6774 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.938339  6791 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:04.938464  6801 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:04.938980  6791 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.939052  6801 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.940023  5450 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:04.940995  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.941457  6790 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.941615  5450 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:04.942142  6791 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.744277  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 788) took 3122 ms. Trace:
I20260709 13:16:04.750384  5269 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 36) took 5498 ms. Trace:
I20260709 13:16:04.754575  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.945930  5446 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
W20260709 13:16:04.946815  5522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 841) took 1757 ms (client timeout 1910 ms). Trace:
W20260709 13:16:04.947273  5522 rpcz_store.cc:269] 0709 13:16:03.194313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.196505 (+1002192us) service_pool.cc:224] Handling call
0709 13:16:04.946723 (+750218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.948464  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:04.775494  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.938333  6774 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:04.777402  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 805) took 2697 ms (client timeout 2225 ms). Trace:
W20260709 13:16:04.950627  5518 rpcz_store.cc:269] 0709 13:16:02.079536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.582297 (+1502761us) service_pool.cc:224] Handling call
0709 13:16:04.777325 (+1195028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.952119  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.789979  6705 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.796298  6829 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.805439  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 888) took 1762 ms (client timeout 1867 ms). Trace:
W20260709 13:16:04.517814  5520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 783) took 2492 ms (client timeout 1597 ms). Trace:
W20260709 13:16:04.806684  5519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 843) took 1523 ms (client timeout 1500 ms). Trace:
W20260709 13:16:04.820613  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65550.5us
I20260709 13:16:04.952807  6827 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:04.955024  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.955364  6827 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:04.956460  6774 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:04.822443  5489 connection.cc:256] RPC call timeout handler was delayed by -3.2821241369999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:16:04.957620  5489 connection.cc:256] RPC call timeout handler was delayed by -3.0571241370000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:16:04.957963  5489 connection.cc:256] RPC call timeout handler was delayed by -3.0031241369999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 13:16:04.958153  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.958720  5450 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.959703  5489 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:04.960893  5489 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:04.528358  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.821201  5273 catalog_manager.cc:5697] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 4, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 4 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.964318  5273 catalog_manager.cc:5697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.965826  5273 catalog_manager.cc:5697] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.968441  5450 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:04.968264  5273 catalog_manager.cc:5697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:04.828117  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43973.1us
I20260709 13:16:04.969389  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.970037  5450 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
W20260709 13:16:04.970499  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.971343  5441 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:04.059969  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:04.922060  5448 rpcz_store.cc:276] 0709 13:16:03.199884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.575994 (+376110us) service_pool.cc:224] Handling call
0709 13:16:03.576447 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.676491 (+100044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.676529 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.707171 (+ 30642us) log.cc:844] Serialized 26 byte log entry
0709 13:16:04.920211 (+1213040us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:04.920256 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.920330 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.920378 (+    48us) raft_consensus.cc:1685] finished
0709 13:16:04.920392 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.920537 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11443,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7886,"thread_start_us":1222633,"threads_started":2,"wal-append.queue_time_us":666174}
I20260709 13:16:04.980803  6076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 59) took 1003 ms. Trace:
I20260709 13:16:04.981151  6076 rpcz_store.cc:276] 0709 13:16:04.015822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.059679 (+ 43857us) service_pool.cc:224] Handling call
0709 13:16:04.980743 (+921064us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.981565  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:04.835960  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.836150  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.070261  6077 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:04.830690  6844 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:04.840396  5447 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:04.986294  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:04.986879  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.987615  5447 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:04.988677  5447 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:04.841921  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:04.989744  5516 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
W20260709 13:16:04.990278  5516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 846) took 1337 ms (client timeout 1666 ms). Trace:
W20260709 13:16:04.990631  5516 rpcz_store.cc:269] 0709 13:16:03.653274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.841615 (+1188341us) service_pool.cc:224] Handling call
0709 13:16:04.990219 (+148604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.991299  5442 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:04.859709  6069 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:04.524663  6684 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.408661  6696 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.866510  6740 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:05.034933  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.028537  6684 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.876415  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:04.869382  6787 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.037744  5445 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.039515  6787 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.890542  6072 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:04.893867  6805 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:04.577477  6657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.021s	sys 0.007s
W20260709 13:16:05.042377  6657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.022s	sys 0.007s
I20260709 13:16:05.042707  6657 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:05.042969  6072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59492 (request call id 54) took 1309 ms. Trace:
I20260709 13:16:05.043387  6072 rpcz_store.cc:276] 0709 13:16:03.733811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.734693 (+   882us) service_pool.cc:224] Handling call
0709 13:16:05.042760 (+1308067us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54005f23d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:05.042886 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2540430080}
I20260709 13:16:05.043704  6657 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:04.895589  6789 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.918871  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.045958  5521 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:05.046480  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 850) took 1260 ms. Trace:
I20260709 13:16:05.046764  5521 rpcz_store.cc:276] 0709 13:16:03.786245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.918618 (+1132373us) service_pool.cc:224] Handling call
0709 13:16:05.046420 (+127802us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.047664  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.048187  5521 raft_consensus.cc:2376] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3. Re-sending same reply.
I20260709 13:16:05.048614  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 844) took 1421 ms. Trace:
I20260709 13:16:05.048884  5521 rpcz_store.cc:276] 0709 13:16:03.627652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.047405 (+1419753us) service_pool.cc:224] Handling call
0709 13:16:05.048563 (+  1158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.922446  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1083) took 1018 ms. Trace:
I20260709 13:16:05.049582  5374 rpcz_store.cc:276] 0709 13:16:03.904346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.935482 (+ 31136us) service_pool.cc:224] Handling call
0709 13:16:04.922385 (+986903us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:04.703464  5368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 842) took 1621 ms (client timeout 1567 ms). Trace:
W20260709 13:16:05.050366  5368 rpcz_store.cc:269] 0709 13:16:03.081934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.082085 (+   151us) service_pool.cc:224] Handling call
0709 13:16:04.703168 (+1621083us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54001216d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:04.703370 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055331584}
I20260709 13:16:04.973896  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:05.051991  5441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
W20260709 13:16:04.953534  5515 rpcz_store.cc:269] 0709 13:16:03.042800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.033154 (+990354us) service_pool.cc:224] Handling call
0709 13:16:04.805349 (+772195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:04.953668  5520 rpcz_store.cc:269] 0709 13:16:02.024997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.025121 (+   124us) service_pool.cc:224] Handling call
0709 13:16:04.517604 (+2492483us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54001536d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:04.517719 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4025951488}
I20260709 13:16:04.957625  6827 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:05.053026  5445 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:04.952525  5449 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:05.054262  5445 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.055409  5445 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.056542  5445 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.057915  6740 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.059156  5446 raft_consensus.cc:2368] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5.
I20260709 13:16:05.059259  5449 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.060436  5449 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.061453  5446 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:04.953770  5524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 840) took 1828 ms (client timeout 1870 ms). Trace:
W20260709 13:16:05.062042  5524 rpcz_store.cc:269] 0709 13:16:03.125603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.194247 (+1068644us) service_pool.cc:224] Handling call
0709 13:16:04.953705 (+759458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.953533  6829 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.062604  5446 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.063681  5446 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.064380  6829 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.064677  5446 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:04.953785  5519 rpcz_store.cc:269] 0709 13:16:03.283033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.916088 (+633055us) service_pool.cc:224] Handling call
0709 13:16:04.806618 (+890530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12032}
I20260709 13:16:04.977020  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:05.065745  5450 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:05.066519  5446 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.066706  5450 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:05.067653  5446 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.067739  5450 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.953265  6705 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.068888  5446 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.070807  6705 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.945672  5269 rpcz_store.cc:276] 0709 13:15:59.252079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.252486 (+   407us) service_pool.cc:224] Handling call
0709 13:16:04.750314 (+5497828us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:03.138505 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:03.297017 (+158512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:03.301624 (+  4607us) write_op.cc:435] Acquired schema lock
0709 13:16:03.316207 (+ 14583us) tablet.cc:662] Decoding operations
0709 13:16:03.469631 (+153424us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:03.539130 (+ 69499us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:03.543009 (+  3879us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:03.615382 (+ 72373us) tablet.cc:701] Row locks acquired
0709 13:16:03.617557 (+  2175us) write_op.cc:260] PREPARE: finished
0709 13:16:03.645963 (+ 28406us) write_op.cc:270] Start()
0709 13:16:03.658244 (+ 12281us) write_op.cc:276] Timestamp: P: 1783602963641268 usec, L: 0
0709 13:16:03.667340 (+  9096us) op_driver.cc:348] REPLICATION: starting
0709 13:16:03.783906 (+116566us) log.cc:844] Serialized 1354 byte log entry
0709 13:16:04.396787 (+612881us) op_driver.cc:464] REPLICATION: finished
0709 13:16:04.401409 (+  4622us) write_op.cc:301] APPLY: starting
0709 13:16:04.410534 (+  9125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:04.410656 (+   122us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:04.410756 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:04.411302 (+   546us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:04.411478 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:16:04.411533 (+    55us) write_op.cc:312] APPLY: finished
0709 13:16:04.411737 (+   204us) log.cc:844] Serialized 34 byte log entry
0709 13:16:04.411915 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:04.412011 (+    96us) write_op.cc:454] Released schema lock
0709 13:16:04.412050 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:04.413680 (+  1630us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:04.413712 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":436,"mutex_wait_us":729515,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":4188,"apply.run_cpu_time_us":2064,"apply.run_wall_time_us":10993,"num_ops":3,"prepare.queue_time_us":174758,"prepare.run_cpu_time_us":20212,"prepare.run_wall_time_us":965220,"raft.queue_time_us":464911,"raft.run_cpu_time_us":4146,"raft.run_wall_time_us":8167,"replication_time_us":728494,"thread_start_us":476841,"threads_started":4,"wal-append.queue_time_us":131950}]]}
I20260709 13:16:04.925016  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:05.072458  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 1.20498e+06us
I20260709 13:16:05.072773  6740 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:05.073123  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.073557  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.982725  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:04.983042  5523 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
W20260709 13:16:05.073984  5414 leader_election.cc:336] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.717s (SENT)
I20260709 13:16:05.074282  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
W20260709 13:16:05.074352  5523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 842) took 1828 ms (client timeout 1999 ms). Trace:
I20260709 13:16:05.074417  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:05.074928  5523 rpcz_store.cc:269] 0709 13:16:03.246103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.835904 (+1589801us) service_pool.cc:224] Handling call
0709 13:16:05.074294 (+238390us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:04.937278  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 1.22417e+06us
I20260709 13:16:04.941969  6790 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.084930  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.085666  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:04.857882  5517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 831) took 2197 ms (client timeout 2083 ms). Trace:
I20260709 13:16:05.086511  5519 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:05.086292  5517 rpcz_store.cc:269] 0709 13:16:02.660699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.904792 (+1244093us) service_pool.cc:224] Handling call
0709 13:16:04.857629 (+952837us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540016c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:04.857798 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173244672}
I20260709 13:16:05.087044  6790 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:04.991655  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.087682  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.088276  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 861) took 1298 ms. Trace:
I20260709 13:16:05.088424  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 854) took 1301 ms. Trace:
I20260709 13:16:05.088670  5516 rpcz_store.cc:276] 0709 13:16:03.789408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.991332 (+1201924us) service_pool.cc:224] Handling call
0709 13:16:05.088216 (+ 96884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.088816  5517 rpcz_store.cc:276] 0709 13:16:03.787431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.087414 (+1299983us) service_pool.cc:224] Handling call
0709 13:16:05.088368 (+   954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.089896  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.090322  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.090732  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 867) took 1053 ms. Trace:
I20260709 13:16:05.090973  5517 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:05.091126  5516 rpcz_store.cc:276] 0709 13:16:04.037054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.089562 (+1052508us) service_pool.cc:224] Handling call
0709 13:16:05.090672 (+  1110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.091540  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 848) took 1308 ms. Trace:
W20260709 13:16:05.076545  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66062us
I20260709 13:16:05.092216  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:04.943496  5444 rpcz_store.cc:276] 0709 13:16:01.621869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.955855 (+333986us) service_pool.cc:224] Handling call
0709 13:16:01.956151 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.210865 (+1254714us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:03.377753 (+166888us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.612343 (+234590us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:03.612394 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:03.612449 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.063223 (+450774us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b1800388540. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c6d2a6 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419
0709 13:16:04.744010 (+680787us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540032f0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:04.744060 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.744198 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6552,"prepare.queue_time_us":357501,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":79,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":8183,"spinlock_wait_cycles":2887603840,"thread_start_us":282440,"threads_started":2,"wal-append.queue_time_us":232134,"wal-append.run_cpu_time_us":3513,"wal-append.run_wall_time_us":1058202}
I20260709 13:16:04.992619  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:04.952996  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 853) took 1165 ms. Trace:
I20260709 13:16:05.093053  6853 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:05.087015  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 845) took 1459 ms. Trace:
I20260709 13:16:05.093592  5518 rpcz_store.cc:276] 0709 13:16:03.787141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.951830 (+1164689us) service_pool.cc:224] Handling call
0709 13:16:04.952934 (+  1104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.093866  5519 rpcz_store.cc:276] 0709 13:16:03.628011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.085390 (+1457379us) service_pool.cc:224] Handling call
0709 13:16:05.086939 (+  1549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.095026  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.095095  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.093047  5516 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:05.095606  5519 raft_consensus.cc:2376] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2. Re-sending same reply.
I20260709 13:16:05.095960  5518 raft_consensus.cc:2376] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4. Re-sending same reply.
I20260709 13:16:05.096246  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 851) took 1309 ms. Trace:
I20260709 13:16:05.096555  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 863) took 1084 ms. Trace:
I20260709 13:16:04.993986  5447 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:04.949245  5522 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
W20260709 13:16:05.097935  5522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 847) took 1391 ms (client timeout 1773 ms). Trace:
I20260709 13:16:04.994175  6801 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:05.098292  5522 rpcz_store.cc:269] 0709 13:16:03.706354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.948082 (+1241728us) service_pool.cc:224] Handling call
0709 13:16:05.097875 (+149793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.099251  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.099687  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.099857  5522 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 1.
I20260709 13:16:05.100461  5520 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:05.100754  5441 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:05.100960  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 865) took 1064 ms. Trace:
I20260709 13:16:05.011157  6848 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.011945  6847 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:05.012970  6844 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:05.014175  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 53359.3us
I20260709 13:16:05.016631  5273 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.019587  6716 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.061698  5449 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.076617  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.083889  6684 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.085886  5524 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:05.133080  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 864) took 1097 ms. Trace:
I20260709 13:16:05.128881  6826 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.133489  5524 rpcz_store.cc:276] 0709 13:16:04.036040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.084697 (+1048657us) service_pool.cc:224] Handling call
0709 13:16:05.133014 (+ 48317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29312}
I20260709 13:16:05.134645  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.134677  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:05.101891  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60769.7us
I20260709 13:16:05.135433  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 866) took 1098 ms. Trace:
I20260709 13:16:05.135788  5524 rpcz_store.cc:276] 0709 13:16:04.036768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.134349 (+1097581us) service_pool.cc:224] Handling call
0709 13:16:05.135378 (+  1029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.136770  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.100351  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 868) took 1063 ms. Trace:
I20260709 13:16:05.009402  6579 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.008601  5487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 894) took 1837 ms. Trace:
I20260709 13:16:05.096797  5519 rpcz_store.cc:276] 0709 13:16:03.786541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.094764 (+1308223us) service_pool.cc:224] Handling call
0709 13:16:05.096190 (+  1426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.138207  5524 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:05.084905  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.101208  5441 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.123384  5446 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:05.137843  5487 rpcz_store.cc:276] 0709 13:16:03.170947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.008502 (+1837555us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:05.101372  5520 rpcz_store.cc:276] 0709 13:16:04.036438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.099469 (+1063031us) service_pool.cc:224] Handling call
0709 13:16:05.100905 (+  1436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.106823  5372 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:16:05.096230  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 849) took 1310 ms. Trace:
I20260709 13:16:05.141961  5516 rpcz_store.cc:276] 0709 13:16:03.785957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.091916 (+1305959us) service_pool.cc:224] Handling call
0709 13:16:05.096160 (+  4244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.125842  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.143141  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 857) took 1354 ms. Trace:
I20260709 13:16:05.143525  5521 rpcz_store.cc:276] 0709 13:16:03.788328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.076251 (+1287923us) service_pool.cc:224] Handling call
0709 13:16:05.143078 (+ 66827us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.144464  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.145015  5521 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:05.146471  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.147456  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34858 (request call id 65) took 1255 ms. Trace:
W20260709 13:16:05.126708  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52750.8us
W20260709 13:16:05.148280  5414 leader_election.cc:336] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.066s (SENT)
I20260709 13:16:05.148741  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.148871  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.149693  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 858) took 1361 ms. Trace:
W20260709 13:16:05.149783  5414 leader_election.cc:336] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.072s (SENT)
I20260709 13:16:05.150061  5519 rpcz_store.cc:276] 0709 13:16:03.788610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.138638 (+1350028us) service_pool.cc:224] Handling call
0709 13:16:05.149631 (+ 10993us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:05.127252  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51302.2us
I20260709 13:16:05.151087  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.151648  5416 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.130204  5523 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:05.152168  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.152709  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 862) took 1268 ms. Trace:
I20260709 13:16:05.129396  5273 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 2 to 3, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:05.130692  6716 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.131503  6840 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.137571  5522 rpcz_store.cc:276] 0709 13:16:04.037384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.098961 (+1061577us) service_pool.cc:224] Handling call
0709 13:16:05.100297 (+  1336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.156217  5273 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 4, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 4 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.140342  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 852) took 1353 ms. Trace:
W20260709 13:16:05.141405  5487 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36792 dropped due to backpressure: service queue is full with 50 items [suppressed 7 similar messages]
I20260709 13:16:05.147621  5515 raft_consensus.cc:2410] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:16:05.160959  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.153039  5523 rpcz_store.cc:276] 0709 13:16:03.884589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.076371 (+1191782us) service_pool.cc:224] Handling call
0709 13:16:05.152654 (+ 76283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.091917  5517 rpcz_store.cc:276] 0709 13:16:03.785575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.090067 (+1304492us) service_pool.cc:224] Handling call
0709 13:16:05.091480 (+  1413us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:05.153820  5414 leader_election.cc:336] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.075s (SENT)
I20260709 13:16:05.162274  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.143023  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.127960  6740 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.154448  5521 rpcz_store.cc:276] 0709 13:16:03.892014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.146225 (+1254211us) service_pool.cc:224] Handling call
0709 13:16:05.147397 (+  1172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.158787  5524 rpcz_store.cc:276] 0709 13:16:03.786855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.136461 (+1349606us) service_pool.cc:224] Handling call
0709 13:16:05.140281 (+  3820us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.158535  5273 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:05.170624  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.155869  6827 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.160521  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.171067  5273 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:05.148115  6579 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:05.172744  5516 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:05.173002  6579 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.173055  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.173987  6740 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.174521  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.096890  5518 rpcz_store.cc:276] 0709 13:16:04.012220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.094640 (+1082420us) service_pool.cc:224] Handling call
0709 13:16:05.096496 (+  1856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36096}
I20260709 13:16:05.175184  5517 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.175815  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.176153  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.176780  5517 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
W20260709 13:16:05.177199  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.161312  5443 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:05.177848  6827 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.175139  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.172142  5519 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.173259  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 887) took 2134 ms. Trace:
I20260709 13:16:05.172926  5273 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 3 to 4, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 4 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.179324  5516 rpcz_store.cc:276] 0709 13:16:03.038887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.142716 (+2103829us) service_pool.cc:224] Handling call
0709 13:16:05.173198 (+ 30482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.170145  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.163456  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.180941  5523 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:05.158390  5487 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36792 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 898)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 908)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 907)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 910)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51720 (request call id 5)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 63)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 889)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 891)
Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36782 (request call id 64)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 860)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 64)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 897)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 901)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 902)
I20260709 13:16:05.182322  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.183314  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.181216  5520 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:16:05.176715  5518 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.186838  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:05.189548  5523 raft_consensus.cc:606] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:05.189941  5523 raft_consensus.cc:614] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.190088  5521 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.190876  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 877) took 2981 ms. Trace:
I20260709 13:16:05.191231  5521 rpcz_store.cc:276] 0709 13:16:02.209137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.189494 (+2980357us) service_pool.cc:224] Handling call
0709 13:16:05.189853 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.190622 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.190828 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.193735  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 62) took 3077 ms. Trace:
I20260709 13:16:05.180225  5273 catalog_manager.cc:5697] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:05.194286  5520 rpcz_store.cc:276] 0709 13:16:02.116510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.192671 (+3076161us) service_pool.cc:224] Handling call
0709 13:16:05.193052 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.193280 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.193317 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.193375 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:05.193441 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.193515 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.193664 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.198400  5273 catalog_manager.cc:5697] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:05.202419  5524 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:05.203243  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51677.3us
I20260709 13:16:05.203433  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 61) took 3101 ms. Trace:
I20260709 13:16:05.204097  5524 rpcz_store.cc:276] 0709 13:16:02.102376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.201814 (+3099438us) service_pool.cc:224] Handling call
0709 13:16:05.202189 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.203131 (+   942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.203363 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.204952  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:05.200161  5519 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:05.207398  5273 catalog_manager.cc:5697] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:05.208562  5521 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:05.209169  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 882) took 2784 ms. Trace:
I20260709 13:16:05.208870  5273 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:05.209579  5521 rpcz_store.cc:276] 0709 13:16:02.425001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.208126 (+2783125us) service_pool.cc:224] Handling call
0709 13:16:05.208391 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.208948 (+   557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.209120 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.211243  5521 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.211455  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:05.212879  5524 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:05.208881  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:05.206436  5519 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.214233  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 884) took 2625 ms. Trace:
I20260709 13:16:05.214463  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 889) took 2159 ms. Trace:
W20260709 13:16:05.214898  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.215235  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 63) took 2224 ms. Trace:
W20260709 13:16:05.229332  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.237182  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:05.224176  5414 leader_election.cc:336] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.083s (SENT)
I20260709 13:16:05.243742  5524 rpcz_store.cc:276] 0709 13:16:02.991131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.205596 (+2214465us) service_pool.cc:224] Handling call
0709 13:16:05.206108 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.213256 (+  7148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.215186 (+  1930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.244525  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.214473  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:05.181178  6684 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.253808  6684 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.214929  5519 rpcz_store.cc:276] 0709 13:16:03.065133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.205992 (+2140859us) service_pool.cc:224] Handling call
0709 13:16:05.206258 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.214242 (+  7984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.214410 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.250329  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:05.255906  5517 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:05.256304  5524 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:05.214637  5522 rpcz_store.cc:276] 0709 13:16:02.588501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.213450 (+2624949us) service_pool.cc:224] Handling call
0709 13:16:05.213733 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.213884 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.213907 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.213947 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:05.213976 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.214026 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.214179 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.256659  5524 pending_rounds.cc:85] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 2
I20260709 13:16:05.257238  5524 pending_rounds.cc:107] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:05.180487  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.213464  6801 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:05.244921  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:05.246701  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.246191  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 891) took 2126 ms. Trace:
I20260709 13:16:05.246817  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:05.222323  6827 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:05.223572  6846 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.252519  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:05.256587  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 878) took 3009 ms. Trace:
I20260709 13:16:05.181299  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 856) took 1392 ms. Trace:
I20260709 13:16:05.257539  5524 raft_consensus.cc:2889] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:05.259903  5450 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.257525  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.292171  5522 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:05.218544  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 83924.1us
W20260709 13:16:05.292214  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.262138  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:05.293960  5367 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:05.285653  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.285835  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.302779  5414 leader_election.cc:336] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.145s (SENT)
I20260709 13:16:05.303138  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.251518  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:05.234722  6705 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.306454  6705 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.306895  6705 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.258423  6829 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:05.312956  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.314667  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.315368  5522 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
W20260709 13:16:05.316224  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.320721  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.322800  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 860) took 1533 ms. Trace:
I20260709 13:16:05.323401  5524 rpcz_store.cc:276] 0709 13:16:03.789159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.245719 (+1456560us) service_pool.cc:224] Handling call
0709 13:16:05.246015 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.317900 (+ 71885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.322740 (+  4840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.280169  5521 rpcz_store.cc:276] 0709 13:16:03.119903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.210669 (+2090766us) service_pool.cc:224] Handling call
0709 13:16:05.211015 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.211700 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.246121 (+ 34421us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:05.344515  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.346354  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 112845us
I20260709 13:16:05.290469  6657 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.346791  5522 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:05.319376  6858 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:05.317090  6696 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.280887  6801 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:05.355859  5367 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:05.280697  6859 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:05.361044  5522 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:05.262586  6789 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:16:05.321074  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:05.325299  6791 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.354900  5369 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:05.313651  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51977.3us
I20260709 13:16:05.376323  5521 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:05.404970  5521 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:05.405704  5521 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:05.376283  5522 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:05.312071  5515 rpcz_store.cc:276] 0709 13:16:03.788071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.084598 (+1296527us) service_pool.cc:224] Handling call
0709 13:16:05.180494 (+ 95896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.348774  6829 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:05.318138  6827 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:05.407655  5522 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:05.356482  6858 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:05.374133  6696 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.413407  5522 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.373696  6790 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:05.406445  5521 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.379238  6801 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.311908  5517 rpcz_store.cc:276] 0709 13:16:02.247227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.201488 (+2954261us) service_pool.cc:224] Handling call
0709 13:16:05.249663 (+ 48175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.256314 (+  6651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.256527 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:05.376966  6860 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:05.347707  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:05.427974  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 107597us
I20260709 13:16:05.428298  6684 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.428999  6862 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.429486  6862 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.429896  6862 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.432164  6790 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.435854  6790 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.439410  5367 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:05.406545  6791 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.406164  5368 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:05.471091  5521 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:05.487777  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 185020us
W20260709 13:16:05.488490  5414 connection.cc:256] RPC call timeout handler was delayed by -1.0630457849999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:16:05.488858  5414 connection.cc:256] RPC call timeout handler was delayed by -1.0219177989999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:16:05.423398  6696 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.373481  6657 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:05.498327  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.494745  5521 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:05.479199  6859 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.486768  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62010.6us
I20260709 13:16:05.499257  6846 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:05.502480  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.503211  6805 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:05.503706  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.503863  6846 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:05.504263  6805 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:05.504802  6805 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:05.505749  6805 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:05.507212  6805 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.504341  5521 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.509172  6848 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:05.509630  6848 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:05.512122  6657 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.413975  5441 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.515745  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.477892  6865 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:05.519310  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.516445  5446 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:05.520066  5443 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:05.521440  6829 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.509647  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.529687  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.534895  5521 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:05.539336  5521 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:05.549369  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.500643  6859 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.514748  6657 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.519972  6716 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.427361  6860 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:05.526589  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:05.567531  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08001cc840 after lost signal to thread 4249
I20260709 13:16:05.564914  6840 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.588442  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.572615  5516 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.431246  6858 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:05.598424  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.599900  5449 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:05.589380  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.556317  6867 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.518993  6865 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:05.590394  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 447186us
W20260709 13:16:05.589473  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08001de560 after lost signal to thread 5307
I20260709 13:16:05.510824  6848 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.603174  5521 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
W20260709 13:16:05.610546  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08001551e0 after lost signal to thread 5399
W20260709 13:16:05.611018  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2960 after lost signal to thread 5400
W20260709 13:16:05.612478  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe9a0 after lost signal to thread 5474
I20260709 13:16:05.614293  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:05.615353  5445 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:16:05.617578  5545 debug-util.cc:398] Leaking SignalData structure 0x7b080031a040 after lost signal to thread 5548
W20260709 13:16:05.619468  5545 debug-util.cc:398] Leaking SignalData structure 0x7b0800395480 after lost signal to thread 6101
I20260709 13:16:05.589781  6871 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.621335  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.622599  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.623762  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.624502  5521 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:05.626510  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.627667  5521 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.629047  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:05.630252  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.633213  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.634294  5448 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:05.635329  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.594560  6868 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.638876  5448 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:05.632788  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:05.640466  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.633257  6871 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.670631  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:05.631542  6791 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:05.724608  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.667098  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 880) took 3243 ms. Trace:
I20260709 13:16:05.725260  5523 rpcz_store.cc:276] 0709 13:16:02.424167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.206737 (+2782570us) service_pool.cc:224] Handling call
0709 13:16:05.207080 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.207316 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:05.361744 (+154428us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.666679 (+304935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.666751 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:05.666798 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.666885 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.667028 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4017,"prepare.queue_time_us":209488,"prepare.run_cpu_time_us":5048,"prepare.run_wall_time_us":35467,"raft.queue_time_us":95721,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":9297,"thread_start_us":447503,"threads_started":3,"wal-append.queue_time_us":248234}
I20260709 13:16:05.650171  6848 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.601886  6840 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:05.681504  4251 debug-util.cc:398] Leaking SignalData structure 0x7b080000fc80 after lost signal to thread 5414
I20260709 13:16:05.627075  6858 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:05.741950  6870 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:05.742676  6860 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:05.742247  6871 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.748030  6069 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:05.650283  6827 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:05.749703  6865 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:05.750196  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:05.755286  6840 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.757635  6847 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.758234  6847 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.760632  6847 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:05.760772  5516 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:05.659387  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.655253  6868 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.706806  6705 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.715659  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:05.768338  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 116024us
I20260709 13:16:05.709695  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:05.769328  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.770025  5445 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
W20260709 13:16:05.770198  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60626.8us
I20260709 13:16:05.770895  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:05.771162  5339 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:05.771436  5445 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.622241  6867 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.641196  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.728967  5521 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:05.729583  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 64) took 1838 ms. Trace:
I20260709 13:16:05.729684  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.773819  5523 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:05.731287  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.706904  6801 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.774714  5448 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:05.774861  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.775730  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.775991  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.776382  5448 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.734395  6859 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:05.734122  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.777900  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.735677  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 883) took 3220 ms. Trace:
I20260709 13:16:05.738869  6862 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:05.740487  6878 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 13:16:05.699856  6856 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:16:05.704668  6869 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.784013  6482 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:05.784126  6869 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.785224  6716 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:05.785622  6716 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:05.785952  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:05.786546  6869 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.786660  5368 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.786473  6716 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.761209  6847 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.788045  6847 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.790165  6847 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:05.768862  6876 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:05.777791  5519 rpcz_store.cc:276] 0709 13:16:03.891625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.258008 (+1366383us) service_pool.cc:224] Handling call
0709 13:16:05.296038 (+ 38030us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.296535 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.296688 (+   153us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.297336 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:16:05.362196 (+ 64860us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:05.696633 (+334437us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.729164 (+ 32531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.729270 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:05.729316 (+    46us) raft_consensus.cc:1685] finished
0709 13:16:05.729328 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.729518 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31290,"prepare.queue_time_us":137177,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1292,"raft.queue_time_us":35359,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":244,"thread_start_us":371977,"threads_started":2,"wal-append.queue_time_us":190282}
I20260709 13:16:05.791568  6876 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.792004  6876 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:05.778762  5523 raft_consensus.cc:2376] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5. Re-sending same reply.
I20260709 13:16:05.794059  6716 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.767340  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.795272  5447 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:05.795934  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.796195  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.796958  5447 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:05.797187  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:05.772953  6791 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:05.798005  5445 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:05.777889  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.781724  6801 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.782158  6862 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.782153  6705 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.772858  6829 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.782776  5372 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:05.800196  6859 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:05.800441  6482 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.801120  6482 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.784188  6867 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.787292  5446 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.801743  6482 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.783073  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:05.803423  5446 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.805078  5445 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:05.765635  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.779431  5520 rpcz_store.cc:276] 0709 13:16:02.515678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.212096 (+2696418us) service_pool.cc:224] Handling call
0709 13:16:05.212419 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.212668 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:05.373725 (+161057us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.735207 (+361482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:05.735292 (+    85us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:05.735351 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.735486 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.735618 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":282135,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":42630,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5632,"thread_start_us":454974,"threads_started":3,"wal-append.queue_time_us":281906}
I20260709 13:16:05.806248  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:05.798074  5447 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.801074  6859 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:05.748172  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.806788  5445 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:05.807240  6856 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:05.807708  6856 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:05.808106  6856 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.804505  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.808311  5449 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:05.626813  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.808921  6867 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.809401  5443 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:05.809839  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.810371  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.792994  6876 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.811385  6867 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:05.811972  6867 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:05.811723  6859 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.812389  6867 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.816016  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.816738  5521 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:05.817623  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:05.817997  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.818209  5521 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.818495  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.819092  6829 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.819921  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.820286  6705 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.820819  5516 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:05.820860  6705 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:05.777829  5442 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.822072  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.822265  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:05.822085  6705 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.822978  5519 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:16:05.823431  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.823120  6867 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.825085  6705 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:05.767681  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 140847us
I20260709 13:16:05.825619  6867 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.826028  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:05.826305  6840 raft_consensus.cc:2764] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:05.827589  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.828644  6840 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.829164  6840 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:05.830061  5446 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:05.830650  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.830271  6840 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.807732  6868 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.812301  6876 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.832567  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.833649  6872 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.833752  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.834151  6872 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.835414  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.830693  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:05.836714  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:05.837519  5448 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.835882  5519 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:05.838758  5489 leader_election.cc:400] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3.
I20260709 13:16:05.841493  5521 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
I20260709 13:16:05.842293  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.834539  6872 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.844287  6889 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.844179  6867 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.844908  6889 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.845314  6889 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.805291  5368 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
I20260709 13:16:05.840865  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.848905  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:05.838662  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.854012  5519 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:05.855456  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:05.764829  6696 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.857414  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.838570  6847 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:05.840070  6829 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.856045  6791 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:05.870366  6579 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:16:05.862286  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:05.874750  6844 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:16:05.875025  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.861537  6848 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:05.875778  6847 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:05.875854  6848 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:05.876448  6848 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.876827  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.879169  6827 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:05.870653  6865 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.879786  6865 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:05.879974  6827 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.880191  6865 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.880704  6740 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:05.881610  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.882541  6827 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.857115  6867 raft_consensus.cc:2764] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:05.882948  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:05.889979  5524 raft_consensus.cc:606] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.890595  5524 raft_consensus.cc:614] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.865331  5441 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:05.857051  6884 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.860147  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:05.869328  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:05.876714  6847 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.877651  6868 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.863101  5448 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:05.864023  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.900429  6855 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.900738  5447 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.883682  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.902405  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.871322  6829 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.887964  6579 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:05.898751  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.899827  6801 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:05.867352  6858 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.900947  6855 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.905063  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.896755  6884 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.906998  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:05.902992  6885 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.909790  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.881354  6740 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:05.909896  5524 raft_consensus.cc:606] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.914171  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.913918  6867 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.906885  6579 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:05.906215  6868 raft_consensus.cc:2764] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:16:05.922678  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.906493  6829 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.923148  6579 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:05.925179  6579 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:05.925076  6856 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:05.963019  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 64214.7us
I20260709 13:16:05.949098  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.966989  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:05.980406  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81783us
I20260709 13:16:05.981230  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.981462  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:05.937290  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:05.982715  5447 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.983188  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.908406  6859 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.909507  6858 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:05.985369  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:05.960496  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:05.987190  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.987861  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:05.911235  6885 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.993482  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:05.910951  6855 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.010531  5374 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.011018  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.011819  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.012439  5367 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:06.012991  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:05.910348  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58818 (request call id 978) took 1395 ms. Trace:
I20260709 13:16:06.015133  5367 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:05.970350  6872 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.015825  6696 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.016386  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.016924  6869 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:06.017515  6872 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.018710  5369 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.019213  6790 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.019624  6790 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.019987  6790 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.995741  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.021020  5372 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.990615  6867 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.997114  6684 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.992843  6840 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.997536  6827 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:05.992657  6853 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.022680  5515 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:06.022892  6827 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:06.022987  6853 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:05.991034  6740 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.023438  6827 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:06.023530  6853 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.024019  6740 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.997943  6844 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.002826  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.022616  6684 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.025950  5522 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:06.026153  6684 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.028718  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1004) took 1511 ms. Trace:
I20260709 13:16:05.993386  6858 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.029337  5450 rpcz_store.cc:276] 0709 13:16:04.517528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.068434 (+550906us) service_pool.cc:224] Handling call
0709 13:16:05.068730 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.291436 (+222706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.028410 (+736974us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54003cd054. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:06.028645 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439283968}
I20260709 13:16:05.910557  6884 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.003744  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.032267  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.032778  5442 raft_consensus.cc:2376] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4. Re-sending same reply.
I20260709 13:16:06.033111  5444 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:06.002127  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.035200  5415 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:06.035200  5447 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:06.037160  6840 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.037631  6840 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:06.038000  6840 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.003957  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.004169  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:05.994520  6885 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.041811  5523 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:06.005812  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.005460  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.046183  5448 raft_consensus.cc:2376] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2. Re-sending same reply.
I20260709 13:16:06.007393  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.007314  6856 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.016561  6696 raft_consensus.cc:2764] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:06.020036  6801 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.021903  6859 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:06.022313  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.061306  5372 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:06.063760  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.933316  6579 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.962841  6868 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:06.003430  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36782 (request call id 64) took 2759 ms. Trace:
I20260709 13:16:05.995404  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:06.040388  5371 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.917528  6789 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 13:16:05.909708  6716 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:16:05.933149  6865 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:05.996878  6883 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.081957  6883 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:06.082918  6883 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.084398  6858 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.068950  6867 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.085721  6867 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:06.085839  5445 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:06.086163  6867 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.060901  6801 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.067071  6889 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.089987  6801 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.092418  6889 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.047133  5449 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:05.962651  6791 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:16:06.093670  6829 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.065006  5370 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:06.070444  5522 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:06.070268  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.070135  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.096048  5448 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:06.096525  6848 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.049022  6482 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:06.071919  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.076720  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81383.5us
I20260709 13:16:06.107841  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:06.077649  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.109071  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.080554  6872 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.081213  6865 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
W20260709 13:16:06.115602  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.114899  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.118146  6844 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.121006  6684 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.125638  5489 leader_election.cc:400] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5.
I20260709 13:16:06.126169  5489 leader_election.cc:403] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:06.073339  6579 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:06.131459  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 118509us
I20260709 13:16:06.137748  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.078704  6868 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:06.145052  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:06.146062  5521 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.146580  5521 raft_consensus.cc:614] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.142678  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.039157  5441 rpcz_store.cc:276] 0709 13:16:04.506373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.051844 (+545471us) service_pool.cc:224] Handling call
0709 13:16:05.860799 (+808955us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b540033c2d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d83a3d 00007fc1d8d53cd0 00007fc1d22d8254 00007fc1d22d81e2 00007fc1d22d8111 00007fc1d22d808c 00007fc1d22d7342 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:05.901327 (+ 40528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110854400}
I20260709 13:16:06.148066  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.148626  5448 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:06.095976  6829 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.150422  5339 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:06.155689  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.156160  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.145447  6791 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:06.158718  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.126336  6898 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.136337  6872 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5.
I20260709 13:16:06.163643  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.157752  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.071151  5518 rpcz_store.cc:276] 0709 13:16:03.244603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.244644 (+2000041us) service_pool.cc:224] Handling call
0709 13:16:06.003100 (+758456us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540016c1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d92735 00007fc1d3d8a9fa 00007fc1d8d524c9 00007fc1d22cec54 00007fc1d22cebe2 00007fc1d22ceb11 00007fc1d22cea8c 00007fc1d22cdd42 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:06.003334 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886345472}
I20260709 13:16:06.160392  6685 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.157256  6716 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.158215  6696 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.183104  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.160480  6482 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.188769  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:06.160952  6791 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.178452  6829 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.186064  6716 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.175376  6898 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:06.179337  6685 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.195771  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:06.208984  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.209954  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:06.210106  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:06.210841  5520 raft_consensus.cc:606] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.211259  5520 raft_consensus.cc:614] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.197763  6791 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.197255  6696 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:06.199759  6705 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.221514  5449 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:06.197029  6872 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.216553  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.198408  6716 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.207469  6869 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.191416  6876 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:16:06.221480  5258 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23048b90f57d48a4be8be78bc78d9204 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 544c82a50cc4477886bb6f7d58f455ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:06.202684  6685 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.226107  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.207604  6844 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:06.248821  6696 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.219717  6482 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:06.247774  6899 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:16:06.252821  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:16:06.232815  6891 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.327s	user 0.001s	sys 0.003s
I20260709 13:16:06.200932  6579 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.233889  6848 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.245046  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.258935  6884 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.245995  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.246232  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.260862  5374 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.246891  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.200057  6883 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:06.252487  6789 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:06.266028  6789 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.266510  6789 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.266770  6885 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.268630  6827 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.235013  6858 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.311986  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.223028  6705 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.256692  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.254868  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:06.247735  6684 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.273023  6885 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.216050  6829 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:06.278273  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.281548  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.334004  5521 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:06.282496  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.283254  5374 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:06.284655  5524 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:06.336719  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.292428  6898 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:06.294140  6900 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:16:06.294775  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 87796us
I20260709 13:16:06.320680  6482 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.328954  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.332816  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.337630  5448 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:06.294787  6872 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:06.340612  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.232995  6790 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.276880  5369 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:06.327476  6705 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.380168  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.381176  5445 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:06.389112  5449 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.330852  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.345918  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.385893  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.295126  6896 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 13:16:06.388463  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.346074  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.339150  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.398202  5446 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:06.434638  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 94113.7us
W20260709 13:16:06.435360  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.435492  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:06.344409  6884 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.226469  6868 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.441007  5523 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:06.432307  5522 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.433514  5524 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:06.390249  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.343896  6848 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:16:06.441737  5521 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.431806  5448 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.443835  5449 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:06.436805  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.445885  5520 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:06.456856  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.457633  5442 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.458043  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:06.459674  6844 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.460088  6844 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:06.460454  6844 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.461601  6858 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.462026  6858 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.462381  6858 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.465116  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.465760  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.466032  5447 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:06.466657  5444 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:06.394802  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46558.6us
I20260709 13:16:06.379184  6872 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:06.448495  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62758.3us
I20260709 13:16:06.473177  5447 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:06.475870  5450 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.493168  5521 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:06.493530  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.494671  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.495301  5450 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:06.496162  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.479125  5414 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:06.479815  5522 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:06.480940  5445 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:06.482107  5449 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.446041  6847 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.446929  5523 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:06.500689  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.486666  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.386940  6482 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.500072  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:06.509110  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:06.443181  5441 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:06.510743  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.500113  5448 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:06.512944  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.501839  5516 raft_consensus.cc:2368] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:06.519290  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.466681  6827 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.516132  6847 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:06.492928  6685 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.548599  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.527104  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.504102  6826 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.449502  6840 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:06.554529  5444 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:06.555438  5446 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:06.500272  6740 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:06.582669  6840 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:06.514647  6860 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.558781  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.583528  6860 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:06.583981  5447 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.584396  6860 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.584924  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:06.586498  6895 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:06.586905  6895 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:06.587664  6895 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.588608  6895 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.468636  6867 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.561528  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.562057  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.562304  6482 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.562659  5368 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:06.563323  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:06.565073  6902 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:16:06.535002  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.546917  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.630686  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.631343  5370 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:06.631634  5370 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:06.566545  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.567234  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.568401  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.633279  5367 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:06.493322  6856 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:06.570119  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.633891  5373 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:06.572053  6789 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.575423  6790 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.514797  6865 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.575644  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:06.576835  6705 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.579993  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.512327  6829 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.560376  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:06.564009  6685 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.616338  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.597049  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.662551  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.663213  5450 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:06.621110  5448 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:06.598378  5447 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
W20260709 13:16:06.599910  5340 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.564s (SENT)
I20260709 13:16:06.564846  5442 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
W20260709 13:16:06.615003  6853 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.004s
I20260709 13:16:06.635288  5371 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:06.638073  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:06.649045  6069 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260709 13:16:06.649523  5518 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:06.590026  6855 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 13:16:06.657502  5367 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:06.658867  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.650771  6865 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:06.664914  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65054.9us
I20260709 13:16:06.683784  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.680459  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.656533  5370 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.686120  5370 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.690773  6705 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.687711  6685 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:16:06.694258  6872 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.695607  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.696802  6858 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.667201  6791 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.698997  6897 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:06.699095  6858 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.699606  6897 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:06.700105  5369 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:06.673007  6853 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.700593  6897 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.702075  6853 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:06.703071  6897 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:06.704425  6072 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:06.705403  5445 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:06.706555  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.707141  5449 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:06.708364  6801 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:16:06.708788  6801 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.713325  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.699338  6791 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.709780  5524 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.710413  6844 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.711323  6826 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.649991  6847 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:06.730398  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50009.8us
I20260709 13:16:06.671375  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.685616  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.731271  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.716718  5370 raft_consensus.cc:2410] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:06.637130  6716 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.696816  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:06.733321  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50570.7us
I20260709 13:16:06.682328  6862 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.688086  6865 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.744527  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:06.740384  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54838.6us
I20260709 13:16:06.669766  6856 consensus_queue.cc:1243] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:06.741372  5415 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:06.675683  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 151460us
I20260709 13:16:06.750938  5416 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:06.752553  5519 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:06.754267  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.765964  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.794129  6826 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.794945  6826 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:06.795907  6685 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.796711  6685 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:06.796020  6826 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:06.687366  6790 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:16:06.798044  6790 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:06.797642  6685 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.798411  6790 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:06.793908  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62698.5us
I20260709 13:16:06.799309  6790 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.800581  6790 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.801759  5339 leader_election.cc:400] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:06.802268  5339 leader_election.cc:403] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:06.802747  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 549328us
W20260709 13:16:06.805011  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73141.1us
I20260709 13:16:06.806165  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:06.808836  5449 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:16:06.811334  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60438.9us
I20260709 13:16:06.812832  5448 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:06.707150  5518 raft_consensus.cc:2376] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5. Re-sending same reply.
I20260709 13:16:06.832597  5519 raft_consensus.cc:2410] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:06.812517  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:06.822949  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:06.742446  6840 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.743908  6789 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.837327  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.839838  5519 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.687515  6855 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.823983  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:06.751096  6914 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.802840  6716 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.817931  6740 raft_consensus.cc:2764] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:06.826279  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:06.879356  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.866707  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.903024  5522 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.892895  6868 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.825207  6869 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:06.909614  5521 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:06.912624  5519 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:06.819769  6884 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:16:06.849835  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:06.849543  6856 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.919551  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.845126  6827 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.851125  6696 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:06.924889  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:06.892436  6914 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:06.931800  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.860397  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:06.850782  6705 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:16:06.935197  5519 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.914753  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:06.944621  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84306.1us
I20260709 13:16:06.860451  6858 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.873167  6867 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:06.844576  6896 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:16:06.850173  6853 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:16:06.929253  5522 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:06.901165  6889 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 13:16:06.969743  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 163671us
I20260709 13:16:06.957168  5519 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:06.933385  6869 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.933041  6862 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:06.973887  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:06.976039  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.978286  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.978240  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:06.977655  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.977989  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:06.982529  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.985970  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:06.948231  6858 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:06.934208  6856 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:06.984167  5519 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:16:06.992727  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.953045  6884 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:06.939267  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 117638us
I20260709 13:16:06.951855  6915 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:06.994517  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:06.951165  6883 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:06.988451  6789 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:07.003720  5519 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:06.974778  6685 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:06.988936  6869 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:06.993158  6858 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.947198  6876 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:16:06.994982  5515 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:06.990051  6716 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.990375  6909 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.003989  6853 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:07.031800  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:07.066247  5519 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.986426  6482 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.030524  5522 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:07.076884  5519 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:07.078848  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:07.080809  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:07.007455  6801 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:07.043151  6913 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.249s	user 0.004s	sys 0.000s
W20260709 13:16:07.046084  6920 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:07.094307  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 237569us
I20260709 13:16:07.033138  6867 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.002802  6915 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:07.044646  6916 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:16:07.042801  6897 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.046613  6855 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:07.065140  6716 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:07.065886  6853 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:07.036219  6685 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:07.116269  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 87210.4us
W20260709 13:16:07.112938  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 139971us
W20260709 13:16:07.121711  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 298796us
I20260709 13:16:07.124686  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:07.137502  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.137501  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:07.045859  6924 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:16:07.113966  6801 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.113834  6716 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.040000  6869 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.115634  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:07.150395  6847 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.150558  6853 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.151301  6896 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:07.036526  6914 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.152601  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:07.112380  6904 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:16:07.105388  6867 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.114220  6897 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.170038  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:07.187068  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:07.141953  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:07.128433  6789 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:07.179313  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 366899us
I20260709 13:16:07.102191  6862 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:07.153088  6934 raft_consensus.cc:993] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower 86b410d62f4040c39d33dc0698998562 to start an election
W20260709 13:16:07.191676  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.195596  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 58333.6us
I20260709 13:16:07.168685  5517 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:07.198781  5519 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:07.199134  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:07.163000  6801 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.196952  5370 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:07.210136  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:07.203261  5441 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.000s
I20260709 13:16:07.215700  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:07.167506  6847 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:07.222687  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:07.217033  5515 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:07.204219  6855 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.149703  6915 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.194936  6935 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:07.214745  6934 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.238894  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:07.219316  6826 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:07.217602  6856 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:07.214023  6946 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.224099  6883 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:07.249207  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:07.251863  6829 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.254125  6789 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.189457  6936 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:16:07.257965  6867 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:07.258047  6883 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:07.258775  6867 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.259147  6883 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.260232  6801 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:07.260771  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:07.245903  6924 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:07.261350  5517 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.221953  5441 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:07.236706  6860 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:07.263803  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.237458  6948 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:07.268289  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:07.267143  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57248.3us
I20260709 13:16:07.270026  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:07.270301  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:07.271087  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:07.275224  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:07.278132  5448 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.277443  5450 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:07.282392  6684 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:07.282879  6847 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:07.258816  6897 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:07.283006  6865 consensus_meta.cc:287] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.004s
I20260709 13:16:07.257911  6685 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:07.250908  6855 raft_consensus.cc:1081] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Signalling peer 86b410d62f4040c39d33dc0698998562 to start an election
I20260709 13:16:07.262324  6840 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.262545  6868 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:16:07.262998  6904 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:07.290676  6829 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:07.272585  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 866) took 1019 ms. Trace:
I20260709 13:16:07.282881  6684 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:07.280030  6915 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.290275  5443 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.304472  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:07.211102  6939 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:16:07.307591  6869 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:07.307578  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:07.329954  6930 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:16:07.330648  6931 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:07.298497  6948 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:07.331256  6931 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:07.331058  6829 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.311174  5441 rpcz_store.cc:276] 0709 13:16:06.253616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.277749 (+ 24133us) service_pool.cc:224] Handling call
0709 13:16:07.266458 (+988709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.335206  6931 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:07.335994  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:07.261967  6924 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:07.333256  5340 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:07.340806  5448 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:07.349710  5367 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:07.294549  6865 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.350528  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:07.351233  5521 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:07.352171  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:07.352768  5367 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:07.318095  6904 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:07.332801  6840 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.358352  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:07.360764  5448 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 2: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:07.361195  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:07.366552  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36782 (request call id 65) took 1059 ms. Trace:
I20260709 13:16:07.349351  6947 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:07.367136  5521 rpcz_store.cc:276] 0709 13:16:06.307254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.351837 (+1044583us) service_pool.cc:224] Handling call
0709 13:16:07.366439 (+ 14602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.375453  5521 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:07.376132  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 961) took 1069 ms. Trace:
W20260709 13:16:07.363099  6895 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.003s
I20260709 13:16:07.371394  6937 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:07.371889  6938 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:16:07.371950  6903 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:07.376472  5521 rpcz_store.cc:276] 0709 13:16:06.306705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.374861 (+1068156us) service_pool.cc:224] Handling call
0709 13:16:07.375225 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.375850 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.376076 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.392168  5521 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.393266  5521 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:07.369837  5517 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:07.379187  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:07.381927  6855 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.353425  6869 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:07.387255  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:07.388700  6941 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.362231  6914 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:07.400934  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 213939us
I20260709 13:16:07.398469  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:07.363826  6840 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.402694  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:07.386938  6937 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:07.403314  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 286920us
I20260709 13:16:07.403748  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:07.387672  6947 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:07.390669  6868 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.411067  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:07.412681  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:07.382536  6926 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:16:07.414415  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:07.422241  6943 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:16:07.425194  6944 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:16:07.399060  6903 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:07.401290  6855 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:07.428125  6868 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:07.502723  5371 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.503923  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:07.504848  5371 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:07.412459  6947 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.405154  6914 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.404834  6941 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.410946  6937 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.391049  6684 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.418671  6790 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.412894  6860 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.403249  5441 raft_consensus.cc:2376] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5. Re-sending same reply.
I20260709 13:16:07.391433  6948 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.426786  6869 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.412637  6685 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.410053  6895 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.414363  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:07.455464  6950 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:07.493762  5258 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23048b90f57d48a4be8be78bc78d9204 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 544c82a50cc4477886bb6f7d58f455ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:16:07.556339  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 142046us
W20260709 13:16:07.556622  5258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62913.4us
W20260709 13:16:07.492784  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 80164.6us
I20260709 13:16:07.557638  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:07.494496  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 957) took 1208 ms. Trace:
I20260709 13:16:07.421610  6945 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.404963  6904 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.390698  6931 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:16:07.495740  5373 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:07.497670  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:07.538578  5517 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:07.509203  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:07.526820  6941 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.537472  6740 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:07.493923  6696 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:07.513387  6858 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.502851  6899 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:07.537215  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:07.508337  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:07.558518  5524 rpcz_store.cc:276] 0709 13:16:06.285630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.445954 (+160324us) service_pool.cc:224] Handling call
0709 13:16:06.446255 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.718363 (+272108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.421251 (+702888us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400378cd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:07.494402 (+ 73151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605572352}
I20260709 13:16:07.616973  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:07.618062  5524 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:07.619422  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:07.559723  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:07.622378  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62738.8us
W20260709 13:16:07.622882  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.528807  6909 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.497998  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:07.574218  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:07.621191  5524 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:07.630400  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:07.577507  5375 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:07.578557  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 74546.1us
I20260709 13:16:07.557948  6853 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:07.596999  6945 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.494004  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:07.578490  6903 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.555626  6790 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:07.556536  6685 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:07.559842  6865 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:07.615185  6955 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:07.627499  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:07.654911  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:07.656176  6942 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:07.656476  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:07.656572  6801 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.586118  6716 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.632431  5375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:44090
I20260709 13:16:07.632004  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:07.632114  5524 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.611267  5368 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.557710  6860 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.643729  5374 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.596276  6696 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:07.646936  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 251590us
I20260709 13:16:07.808931  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:07.612428  6899 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:16:07.651274  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.632499  6931 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:07.817124  5447 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:07.817611  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:07.820861  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:07.646522  6945 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:07.676560  5524 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.642562  6482 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:16:07.831674  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 969) took 1153 ms. Trace:
W20260709 13:16:07.678371  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46431.7us
I20260709 13:16:07.826378  5446 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:07.632685  6069 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:07.805784  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:07.835006  5444 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.837529  5520 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.656759  6942 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.817183  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:07.819792  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:07.843261  5449 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:07.818595  5450 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:07.650796  6685 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.671610  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 888) took 1069 ms. Trace:
W20260709 13:16:07.834229  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 276641us
W20260709 13:16:07.801862  6917 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.702s	user 0.000s	sys 0.005s
I20260709 13:16:07.668284  6924 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:07.671299  6844 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:07.679364  6950 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:07.832986  5524 rpcz_store.cc:276] 0709 13:16:06.677717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.675886 (+998169us) service_pool.cc:224] Handling call
0709 13:16:07.676299 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.831307 (+155008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.831588 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.671352  6856 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:07.671763  6865 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.674806  6876 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.851307  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:07.821534  6801 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:07.821790  6899 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.860170  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:07.861828  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:07.892594  5448 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.537757  6921 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:07.896407  5520 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:07.825276  6931 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:07.870036  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 213636us
W20260709 13:16:07.903357  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 70836.8us
I20260709 13:16:07.843842  6939 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:07.837219  6945 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.881729  6964 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.859521  5517 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:07.831939  6840 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:07.891149  6826 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.009s
W20260709 13:16:07.909896  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 101056us
I20260709 13:16:07.909150  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:07.934623  6956 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.404s	user 0.002s	sys 0.000s
I20260709 13:16:07.949946  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:07.908510  6931 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.953747  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 959) took 1647 ms. Trace:
I20260709 13:16:07.886618  6865 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.942113  5448 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:07.903595  6960 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:07.884829  6950 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:07.890614  6876 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.909569  5441 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.954218  5523 rpcz_store.cc:276] 0709 13:16:06.306223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.502727 (+196504us) service_pool.cc:224] Handling call
0709 13:16:06.503122 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.504169 (+  1047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.504197 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.504679 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.685803 (+181124us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:06.685842 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.685908 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.628376 (+942468us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:07.942798 (+314422us) raft_consensus.cc:1685] finished
0709 13:16:07.942828 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.953683 (+ 10855us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1812,"raft.queue_time_us":1614,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":2982,"spinlock_wait_cycles":28179200,"thread_start_us":67099,"threads_started":1,"wal-append.queue_time_us":372572}
I20260709 13:16:07.913785  6895 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:07.913617  6936 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:07.891253  6868 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:07.904518  6801 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:07.940892  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 976) took 1110 ms. Trace:
I20260709 13:16:07.969568  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:07.937191  6914 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:07.858196  6937 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:07.957491  5443 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.610s	user 0.014s	sys 0.003s
I20260709 13:16:07.850521  5518 rpcz_store.cc:276] 0709 13:16:06.600593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.259573 (+658980us) service_pool.cc:224] Handling call
0709 13:16:07.434441 (+174868us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:07.669620 (+235179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12989824}
W20260709 13:16:08.001765  6959 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.393s	user 0.001s	sys 0.001s
I20260709 13:16:07.888854  6856 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:07.975751  6936 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.003400  6936 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.889461  6941 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:07.960439  6884 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:07.956308  6826 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.960757  6915 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.883239  6790 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.097122  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:08.024256  6855 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:07.994089  5520 rpcz_store.cc:276] 0709 13:16:06.830648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.252904 (+422256us) service_pool.cc:224] Handling call
0709 13:16:07.805542 (+552638us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:07.940825 (+135283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23800064}
I20260709 13:16:08.100520  5518 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.967036  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 968) took 1289 ms. Trace:
I20260709 13:16:07.970124  6858 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:08.073594  6965 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:07.980376  6840 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:08.096022  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 244768us
I20260709 13:16:08.140612  5371 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:08.141185  6884 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.955142  6939 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:08.154168  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 70) took 1295 ms. Trace:
I20260709 13:16:08.184099  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:08.128964  6960 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:08.188278  5520 rpcz_store.cc:276] 0709 13:16:06.858808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.152675 (+1293867us) service_pool.cc:224] Handling call
0709 13:16:08.153189 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.153485 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.153540 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.153653 (+   113us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:08.153717 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.153811 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.154051 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:08.139292  6915 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.107245  5443 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:08.191417  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:08.144958  6844 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:08.195606  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:08.196882  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:08.192812  6801 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.097255  6924 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:16:08.190017  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 977) took 1359 ms. Trace:
I20260709 13:16:08.165911  5517 rpcz_store.cc:276] 0709 13:16:06.677538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.648367 (+970829us) service_pool.cc:224] Handling call
0709 13:16:07.806498 (+158131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.941792 (+135294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.961669 (+ 19877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:08.196153  6860 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.204754  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:08.181687  6964 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.183681  6868 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.188077  6884 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:08.212718  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:08.207222  5442 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:08.218231  5520 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:08.191895  6716 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.198820  6915 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.219223  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 979) took 1345 ms. Trace:
I20260709 13:16:08.227020  5520 rpcz_store.cc:276] 0709 13:16:06.874258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.208538 (+1334280us) service_pool.cc:224] Handling call
0709 13:16:08.217979 (+  9441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.218888 (+   909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.219141 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:08.228817  5520 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:08.199167  6844 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:08.241225  5520 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:08.199324  6965 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.193486  6960 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.245646  6942 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:08.233829  6860 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.219926  6826 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.235234  6868 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:08.183449  6950 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.271971  6937 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.263000  6941 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.274087  5520 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:08.209489  5518 rpcz_store.cc:276] 0709 13:16:06.830929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.099699 (+1268770us) service_pool.cc:224] Handling call
0709 13:16:08.100108 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.165647 (+ 65539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.189939 (+ 24292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:08.273239  6826 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.278035  6865 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.193496  6966 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.321s
I20260709 13:16:08.306283  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:08.312970  6965 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.286223  6860 raft_consensus.cc:2764] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:08.289955  6937 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:08.316241  6961 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.243s	user 0.001s	sys 0.009s
I20260709 13:16:08.303766  6826 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.303473  6942 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:08.303472  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:08.290524  6971 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.326599  6965 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.281926  6939 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.289671  6844 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.332723  6876 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:08.356063  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 878) took 1845 ms. Trace:
I20260709 13:16:08.355405  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 973) took 1677 ms. Trace:
I20260709 13:16:08.369341  5524 rpcz_store.cc:276] 0709 13:16:06.678330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.868164 (+1189834us) service_pool.cc:224] Handling call
0709 13:16:07.868571 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.874631 (+  6060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.874669 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.874729 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:07.874773 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.355048 (+480275us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b5400277ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:08.355125 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.355320 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13404032}
I20260709 13:16:08.367849  5522 rpcz_store.cc:276] 0709 13:16:06.510475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.977385 (+466910us) service_pool.cc:224] Handling call
0709 13:16:08.355836 (+1378451us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b54002dbc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:08.355981 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110320896}
W20260709 13:16:08.336295  6853 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.005s
I20260709 13:16:08.238622  6964 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.350879  6856 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:08.352944  6965 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.423197  5373 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:08.342984  6072 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:08.428242  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.364732  6684 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:08.429278  5373 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:08.436451  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.437973  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.439301  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:08.429971  5338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.011s	sys 0.040s
I20260709 13:16:08.350350  6937 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.440665  5338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.012s	sys 0.040s
W20260709 13:16:08.441789  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.002s (SENT) [suppressed 43 similar messages]
I20260709 13:16:08.356320  6974 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:08.469370  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 964) took 1793 ms. Trace:
I20260709 13:16:08.474014  5519 rpcz_store.cc:276] 0709 13:16:06.676173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.493264 (+817091us) service_pool.cc:224] Handling call
0709 13:16:07.493644 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.495348 (+  1704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.495376 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.502058 (+  6682us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.657677 (+155619us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:07.657739 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.657840 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.469043 (+811203us) raft_consensus.cc:1685] finished
0709 13:16:08.469074 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.469278 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22484,"raft.queue_time_us":1453,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":8164,"thread_start_us":131953,"threads_started":1,"wal-append.queue_time_us":340472}
W20260709 13:16:08.463909  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.029s
I20260709 13:16:08.466100  5373 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:08.477008  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.006s	sys 0.030s
W20260709 13:16:08.477454  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 539374us
I20260709 13:16:08.507292  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:08.421988  6876 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:08.541177  5444 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.018s	sys 0.028s
I20260709 13:16:08.543394  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:08.547966  5444 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.018s	sys 0.028s
I20260709 13:16:08.549971  5374 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:08.428570  6844 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:08.555004  5413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.012s	sys 0.035s
W20260709 13:16:08.571671  5413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.013s	sys 0.035s
W20260709 13:16:08.421178  6858 consensus_queue.cc:1175] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "86b410d62f4040c39d33dc0698998562" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:08.341141  6942 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:08.429775  6904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.031s	sys 0.021s
I20260709 13:16:08.360747  6971 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.579671  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:08.541370  6853 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.588742  5374 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:08.362514  6973 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.289s
I20260709 13:16:08.595487  6973 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.596205  6973 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.599915  6973 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.572522  6974 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.554194  6986 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.571539  6856 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.586594  6904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.031s	sys 0.021s
I20260709 13:16:08.579604  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:08.356427  6967 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.276s
I20260709 13:16:08.654495  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.578732  6860 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.612802  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.656028  5373 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:08.540741  6937 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:08.578035  6946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.031s	sys 0.053s
I20260709 13:16:08.658406  5374 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
W20260709 13:16:08.672155  5445 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.026s	sys 0.034s
W20260709 13:16:08.673772  5445 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.026s	sys 0.034s
I20260709 13:16:08.614533  6974 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:08.669122  6860 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.684427  6982 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.684793  6860 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:08.665241  6945 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.005s
W20260709 13:16:08.666785  6946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.032s	sys 0.053s
I20260709 13:16:08.606410  6853 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.707554  6964 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.708334  6853 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:08.708932  6853 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.673771  6790 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:08.738183  6790 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:08.741034  6790 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:08.621995  6856 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.743043  6856 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:08.743289  6958 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.113s	user 0.009s	sys 0.003s
I20260709 13:16:08.744535  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 870) took 1367 ms. Trace:
I20260709 13:16:08.674515  6966 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:08.685117  6982 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:08.715044  6931 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.001s
I20260709 13:16:08.745169  5370 rpcz_store.cc:276] 0709 13:16:07.377395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.377810 (+   415us) service_pool.cc:224] Handling call
0709 13:16:07.378101 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.386789 (+  8688us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:16:07.386822 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.388737 (+  1915us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.449545 (+ 60808us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:16:07.561216 (+111671us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.561261 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.561334 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.742554 (+1181220us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:08.744247 (+  1693us) raft_consensus.cc:1685] finished
0709 13:16:08.744279 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.744463 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8338,"raft.queue_time_us":8772,"raft.run_cpu_time_us":2543,"raft.run_wall_time_us":61121,"spinlock_wait_cycles":38836480,"thread_start_us":171988,"threads_started":1,"wal-append.queue_time_us":172556}
W20260709 13:16:08.745613  6987 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
I20260709 13:16:08.713801  6946 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:08.757889  6962 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.760298  6685 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.899s	user 0.005s	sys 0.005s
I20260709 13:16:08.760658  6931 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.621676  6986 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:08.756420  6915 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.007s
W20260709 13:16:08.766645  6936 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.006s
W20260709 13:16:08.793102  5415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.002s	sys 0.027s
W20260709 13:16:08.793540  5415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.003s	sys 0.027s
W20260709 13:16:08.792860  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.003s	sys 0.041s
W20260709 13:16:08.796038  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.003s	sys 0.041s
W20260709 13:16:08.797005  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 355230us
I20260709 13:16:08.700497  6945 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:08.774201  6946 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:08.800359  6947 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.275s	user 0.013s	sys 0.000s
I20260709 13:16:08.801558  6986 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.807324  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:08.808292  5448 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.811197  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:08.812187  5450 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:08.815346  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:08.816380  5450 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:08.820060  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:08.821060  5450 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:08.825579  5450 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:08.801841  6826 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.846086  6826 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.792100  6965 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.749605  6966 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.832347  6947 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.855244  5366 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:08.856066  5375 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:08.856593  5375 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.775472  6685 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.784745  6915 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.862226  6965 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:08.869666  6965 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:08.870085  6965 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:08.871101  6965 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:08.872215  6884 consensus_meta.cc:287] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.644s	user 0.006s	sys 0.004s
I20260709 13:16:08.849565  6986 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:08.877851  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.848284  6860 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:08.858738  6975 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.852068  6966 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.852080  6947 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.784621  6962 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:08.885550  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:08.885895  6985 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:16:08.886371  6685 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.894075  6826 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:08.894251  6982 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:08.889506  6884 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.907820  6827 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:08.916347  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 879) took 1647 ms. Trace:
I20260709 13:16:08.916210  6827 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.916777  5442 rpcz_store.cc:276] 0709 13:16:07.269401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.269596 (+   195us) service_pool.cc:224] Handling call
0709 13:16:08.916075 (+1646479us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b540029ead4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:08.916258 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010225024}
I20260709 13:16:08.896391  6940 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:08.872421  6965 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:08.877195  6921 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.817s	user 0.005s	sys 0.003s
I20260709 13:16:08.901088  5370 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:08.903998  6975 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.906682  6915 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:08.878346  6942 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:08.950443  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.887969  5375 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.923846  6884 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:08.897974  6869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.045s	sys 0.112s
I20260709 13:16:08.898455  6860 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.921708  5515 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:08.918486  6840 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.913128  6967 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.979067  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44201.3us
I20260709 13:16:08.791746  6936 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:08.933749  6940 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:08.933911  6964 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.935072  6826 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:08.918512  6827 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:08.929383  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.891685  6986 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:08.913900  6946 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:08.983806  6899 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.072s	user 0.015s	sys 0.000s
I20260709 13:16:08.978745  6840 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.960670  6869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.046s	sys 0.114s
I20260709 13:16:08.954537  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:08.988662  5448 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:08.993737  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:08.995487  6937 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.004328  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1115) took 1506 ms. Trace:
I20260709 13:16:09.036116  5371 rpcz_store.cc:276] 0709 13:16:07.498250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.506441 (+  8191us) service_pool.cc:224] Handling call
0709 13:16:07.506803 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.180360 (+673557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.003923 (+823563us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54000c6554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:09.004240 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456885120}
I20260709 13:16:08.979959  6889 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:09.037882  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.014432  6827 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.043707  6827 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.045886  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.047061  5368 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:09.048131  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.049448  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.946645  6974 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.052335  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:09.053076  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.055243  5448 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:08.984248  6977 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:16:09.058712  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.059479  5370 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:09.096647  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:08.985189  6967 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.100828  6969 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.101967  6969 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:09.106106  6984 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.987737  6975 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:09.115171  6684 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.002s
I20260709 13:16:09.050829  6860 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.039531  6889 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:09.116869  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.003866  6964 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:09.136621  6844 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.000s
I20260709 13:16:09.138442  6696 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.139834  6696 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.138140  6889 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.121093  5371 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:09.039464  6899 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:09.141613  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:09.107031  6984 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:09.151463  5370 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.150805  6899 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:09.155418  5450 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.191948  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.192991  5448 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:09.109531  6962 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:09.204909  5489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.007s	sys 0.021s
I20260709 13:16:09.210433  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.214639  5448 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:09.214825  6975 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:09.215258  6975 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:09.215852  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.216212  6975 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.217833  6975 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:09.219076  5523 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.012s	sys 0.017s
W20260709 13:16:09.220304  5523 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.012s	sys 0.017s
W20260709 13:16:09.217260  5489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.008s	sys 0.022s
I20260709 13:16:09.222172  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 897) took 2433 ms. Trace:
W20260709 13:16:09.218847  5447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.008s	sys 0.021s
W20260709 13:16:09.223980  5447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.009s	sys 0.021s
W20260709 13:16:09.222925  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 636051us
I20260709 13:16:09.194100  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:09.219358  6040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.000s	sys 0.029s
I20260709 13:16:09.228909  6936 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:09.203119  6889 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.103255  6969 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.236507  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.242502  6984 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:09.245878  5522 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:09.229184  6040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.001s	sys 0.029s
I20260709 13:16:09.247445  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:09.248345  5519 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.249025  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1046) took 1420 ms. Trace:
I20260709 13:16:09.250033  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.237571  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.252074  5520 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:09.222846  5523 rpcz_store.cc:276] 0709 13:16:06.788975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.973277 (+1184302us) service_pool.cc:224] Handling call
0709 13:16:07.973696 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.974071 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.974107 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.975712 (+  1605us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.603080 (+627368us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:09.221149 (+618069us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.221765 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.221865 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.221925 (+    60us) raft_consensus.cc:1685] finished
0709 13:16:09.221942 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.222105 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1766,"raft.queue_time_us":2313,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":25970,"thread_start_us":1026624,"threads_started":2,"wal-append.queue_time_us":751332}
W20260709 13:16:09.252777  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.240417  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.231729  6979 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.257625  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.019s	sys 0.015s
W20260709 13:16:09.267488  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.020s	sys 0.015s
I20260709 13:16:09.267831  5450 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
W20260709 13:16:09.268796  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 962520us
I20260709 13:16:09.272679  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.273731  5520 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:09.275033  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.275861  5520 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:09.277025  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.278461  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:09.249555  5447 rpcz_store.cc:276] 0709 13:16:07.828334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.829090 (+   756us) service_pool.cc:224] Handling call
0709 13:16:07.829753 (+   663us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:07.904868 (+ 75115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.904926 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:07.936358 (+ 31432us) log.cc:844] Serialized 52 byte log entry
0709 13:16:08.432134 (+495776us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:09.232171 (+800037us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.247963 (+ 15792us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.248560 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.248670 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.248731 (+    61us) raft_consensus.cc:1685] finished
0709 13:16:09.248752 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.248938 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51995,"raft.queue_time_us":151210,"raft.run_cpu_time_us":12934,"raft.run_wall_time_us":125632,"thread_start_us":1206281,"threads_started":3,"wal-append.queue_time_us":730977}
I20260709 13:16:09.278702  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.280756  5520 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:09.281369  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:09.284143  5524 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:09.285626  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:09.285945  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.286607  5447 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.286834  5523 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:09.234925  6939 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.262290  6960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.013s	sys 0.023s
I20260709 13:16:09.292385  5518 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:09.292276  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.289436  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:09.300292  5522 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:09.264945  6935 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.301860  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.305066  5447 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:09.439121  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.242533  5369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1108) took 1829 ms (client timeout 1595 ms). Trace:
W20260709 13:16:09.452795  5445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.003s	sys 0.033s
W20260709 13:16:09.462503  5445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.003s	sys 0.033s
W20260709 13:16:09.453402  5369 rpcz_store.cc:269] 0709 13:16:07.412786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.413848 (+  1062us) service_pool.cc:224] Handling call
0709 13:16:09.242301 (+1828453us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54001e8f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:09.242453 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421976960}
W20260709 13:16:09.453465  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.466733  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.455396  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.445330  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.469717  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:09.470815  5447 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.471916  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.474892  5369 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:09.476452  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.477290  5369 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:09.479913  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.329730  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:09.360154  5519 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:09.481864  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.482256  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.483734  5518 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:16:09.483805  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154069us
I20260709 13:16:09.484194  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.489467  5519 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:09.490743  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.492103  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.493028  5519 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:09.452312  5442 raft_consensus.cc:2410] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:16:09.452579  5444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.014s	sys 0.027s
W20260709 13:16:09.494132  5444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.014s	sys 0.028s
I20260709 13:16:09.494858  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:09.495151  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1049) took 1656 ms. Trace:
I20260709 13:16:09.496181  5519 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:09.485585  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.495649  5444 rpcz_store.cc:276] 0709 13:16:07.838428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.838686 (+   258us) service_pool.cc:224] Handling call
0709 13:16:07.838994 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.548523 (+709529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.548553 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.549006 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.494639 (+945633us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.494726 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.494842 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.494912 (+    70us) raft_consensus.cc:1685] finished
0709 13:16:09.494922 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.495084 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2384,"raft.queue_time_us":303704,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":24349,"thread_start_us":1651859,"threads_started":2,"wal-append.queue_time_us":836337}
I20260709 13:16:09.493381  5447 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:09.316852  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:09.335721  5523 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:09.498525  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.502578  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:09.503134  5444 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:09.503877  5523 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:09.460744  5370 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:09.502219  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.505699  5523 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:09.506153  5520 raft_consensus.cc:2410] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:09.340289  5524 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:09.283177  6740 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.510573  6740 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.515331  6740 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:09.353827  6043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.008s	sys 0.034s
I20260709 13:16:09.516480  6740 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.517335  6043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.008s	sys 0.034s
I20260709 13:16:09.517724  6740 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:09.363083  6791 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:09.520769  6791 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:09.521382  5369 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:09.522729  6791 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:09.523075  6840 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.523592  5369 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:09.524310  6791 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.524623  5448 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:09.525877  6840 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.527148  6840 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:09.528156  6840 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.531117  6840 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.532226  6848 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.532886  6858 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.533130  6884 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:09.533747  6860 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:09.534075  6885 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.550570  6885 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.536861  6889 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:09.551367  6884 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.537910  6896 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.296036  6936 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:09.297987  6939 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.562817  5370 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:09.564600  6939 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.364629  6921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51142 (request call id 0) took 4502 ms. Trace:
I20260709 13:16:09.565862  6884 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.565721  6921 rpcz_store.cc:276] 0709 13:16:04.857464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.857624 (+   160us) service_pool.cc:224] Handling call
0709 13:16:05.024970 (+167346us) log.cc:844] Serialized 494 byte log entry
0709 13:16:09.359911 (+4334941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41976,"raft.queue_time_us":31327,"raft.run_cpu_time_us":1667,"raft.run_wall_time_us":121915,"thread_start_us":97451,"threads_started":1,"wal-append.queue_time_us":105596,"wal-append.run_cpu_time_us":1746,"wal-append.run_wall_time_us":1005655}
I20260709 13:16:09.567377  5443 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:09.355144  6940 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:09.296809  6960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.013s	sys 0.023s
I20260709 13:16:09.387796  6964 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.288230  6969 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.570989  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:09.571805  5446 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.573191  6965 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.573757  6965 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.574205  6965 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.574436  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:09.575623  5449 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:09.576207  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.577128  5449 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:09.296953  6979 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:09.374058  6980 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.690s	user 0.003s	sys 0.000s
I20260709 13:16:09.351156  6986 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.336169  7001 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.497560  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.500063  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:09.588491  5447 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.590483  6885 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.540742  6848 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.591624  6685 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:09.592727  7012 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:16:09.542380  6858 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.593322  6685 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:09.593703  6903 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.594862  6685 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:09.595366  6685 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:09.595646  6858 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.543519  6975 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:09.543677  6977 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:09.481320  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.596971  6977 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:09.597415  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 116328us
I20260709 13:16:09.599932  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:09.600469  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 108510us
I20260709 13:16:09.542937  6915 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:09.544974  6932 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:09.596688  6482 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:09.602290  6482 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:09.486936  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:09.603899  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 117314us
I20260709 13:16:09.604228  6482 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.558349  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 100) took 2297 ms. Trace:
I20260709 13:16:09.401990  6973 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.292851  6974 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.577291  5450 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:09.615788  6826 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:09.579310  6964 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:09.620432  6964 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:09.623176  6964 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:09.552423  6860 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.618417  6973 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:09.624217  6986 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:09.623847  5258 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23048b90f57d48a4be8be78bc78d9204 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 544c82a50cc4477886bb6f7d58f455ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:09.623970  6860 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.625654  6973 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.584990  6979 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.541136  6740 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:09.552659  6889 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:09.617761  5372 rpcz_store.cc:276] 0709 13:16:07.260977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.261143 (+   166us) service_pool.cc:224] Handling call
0709 13:16:07.261468 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.357670 (+ 96202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.357701 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.357741 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:07.357767 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.557774 (+2200007us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b54001856d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:09.557863 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.558142 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220806528}
I20260709 13:16:09.630311  6889 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.631603  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:09.631876  6986 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.597551  6977 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.596670  6685 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.597123  6975 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.606873  6848 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.557047  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 869) took 2202 ms. Trace:
I20260709 13:16:09.636024  6685 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.635821  5367 rpcz_store.cc:276] 0709 13:16:07.354480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.354616 (+   136us) service_pool.cc:224] Handling call
0709 13:16:07.354970 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.366817 (+ 11847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.366850 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.367422 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.764424 (+1397002us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b180037ef40. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:16:09.261856 (+497432us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.261929 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.262051 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.556491 (+294440us) raft_consensus.cc:1685] finished
0709 13:16:09.556535 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.556859 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11402,"raft.queue_time_us":12442,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":22370,"spinlock_wait_cycles":7730048,"thread_start_us":497119,"threads_started":1,"wal-append.queue_time_us":2002380}
I20260709 13:16:09.638195  5450 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:09.607681  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1122) took 1186 ms. Trace:
I20260709 13:16:09.607590  6960 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:09.504935  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:09.609830  6884 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.611346  6915 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:09.611076  7004 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:09.644255  6915 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:09.645937  6915 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.640230  5366 rpcz_store.cc:276] 0709 13:16:08.421130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.421458 (+   328us) service_pool.cc:224] Handling call
0709 13:16:08.465295 (+ 43837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.855877 (+390582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.557383 (+701506us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400330c54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:09.607482 (+ 50099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896162560}
I20260709 13:16:09.647432  5450 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.642794  6482 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.613724  5447 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:09.614403  5442 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:09.642385  5444 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.545737  6942 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:09.569029  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.627272  6973 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.632686  6986 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.641326  6884 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.638240  6858 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.651638  6931 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.652169  6975 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.653797  6941 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.623818  6827 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.672428  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 101) took 1078 ms. Trace:
I20260709 13:16:09.672941  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.673153  7001 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:09.673821  5371 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:09.673967  7001 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:09.675117  6858 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.676539  7001 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.671638  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:07.323524  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:09.664453  6884 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.640388  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.655124  6927 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:09.691484  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60153.7us
I20260709 13:16:09.612694  5449 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:09.656917  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.664309  5447 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:09.683573  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.686334  5272 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 3 to 4, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 4 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.678406  6982 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.695211  6935 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:09.683073  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.704282  5447 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:09.696131  5446 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:09.709394  5441 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:09.672873  5373 rpcz_store.cc:276] 0709 13:16:08.593649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.677225 (+ 83576us) service_pool.cc:224] Handling call
0709 13:16:08.705788 (+ 28563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.748770 (+ 42982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.748816 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.748874 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:08.748913 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.671789 (+922876us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54001c6bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:09.671858 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.672228 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98128640}
I20260709 13:16:09.711064  5441 pending_rounds.cc:85] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 1
I20260709 13:16:09.690588  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 965) took 3014 ms. Trace:
I20260709 13:16:09.738860  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.739881  5366 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:16:09.736821  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 108938us
I20260709 13:16:09.737001  5444 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:09.741658  5519 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
I20260709 13:16:09.732625  5441 pending_rounds.cc:107] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:09.743387  5441 raft_consensus.cc:2889] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:09.678963  6942 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:09.686395  6941 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:09.748425  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 81772.1us
I20260709 13:16:09.708163  5442 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:09.677373  6858 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.687108  6967 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.758194  6848 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.755049  6579 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:09.760371  6965 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.754969  7001 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:16:09.763226  5375 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.762959  6942 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.763674  6934 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.765280  5518 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:09.786758  7001 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:09.787223  7001 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:09.786779  6934 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.787628  6977 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.765164  6936 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.791736  6936 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.771426  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1042) took 1956 ms. Trace:
I20260709 13:16:09.773729  6954 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:09.783344  6848 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.774835  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.786248  6579 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:09.736222  5515 rpcz_store.cc:276] 0709 13:16:06.676474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.511854 (+835380us) service_pool.cc:224] Handling call
0709 13:16:08.358461 (+846607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.979430 (+620969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.591206 (+611776us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54002dbc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:09.690060 (+ 98854us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54002dbc50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:09.690340 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3129814784}
I20260709 13:16:09.783514  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:09.798377  6927 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:09.756810  6935 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:09.706614  6982 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.709625  6885 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:16:09.795135  6954 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:09.789593  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51249.4us
W20260709 13:16:09.807677  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.808218  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44090 (request call id 1121) took 2231 ms. Trace:
I20260709 13:16:09.799958  6927 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.797210  6858 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.800071  6848 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.812206  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.810501  5375 rpcz_store.cc:276] 0709 13:16:07.566301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.632317 (+ 66016us) service_pool.cc:224] Handling call
0709 13:16:09.761276 (+2128959us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400330c54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d83a3d 00007fc1d8d53cd0 00007fc1d22d8254 00007fc1d22d81e2 00007fc1d22d8111 00007fc1d22d808c 00007fc1d22d7342 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:09.796805 (+ 35529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2726479744}
I20260709 13:16:09.817821  6915 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:09.818701  6915 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:09.793846  5445 rpcz_store.cc:276] 0709 13:16:07.815418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.818715 (+  3297us) service_pool.cc:224] Handling call
0709 13:16:07.819177 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.675434 (+856257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.675483 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.680562 (+  5079us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.463206 (+782644us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.463297 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.770697 (+307400us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540029e5d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:09.770770 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.770841 (+    71us) raft_consensus.cc:1685] finished
0709 13:16:09.770860 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.771338 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174929,"raft.queue_time_us":219106,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":9372,"spinlock_wait_cycles":360105728,"thread_start_us":1302972,"threads_started":2,"wal-append.queue_time_us":693279}
I20260709 13:16:09.807648  6482 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:16:09.821453  6954 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.821717  6931 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:09.822328  6801 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:09.823086  6935 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.824102  6801 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:09.824553  6801 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:09.822981  6579 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.826795  6860 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.827556  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:09.814775  6858 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.830602  6965 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.829905  6984 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:09.832610  6942 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.833171  6984 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:09.833287  6942 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:09.815691  6927 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.844996  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:09.822365  6954 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:09.846987  6801 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.848371  6934 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.848670  6801 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.851042  6982 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.851437  6867 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.851876  6867 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.852192  6867 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.788372  7001 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.854573  7001 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.855185  6945 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:09.848081  6889 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.859476  6954 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:09.862339  6954 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:09.832159  6858 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.849186  6941 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.877170  6941 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.881407  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:09.882220  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.821779  6791 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:16:09.881795  6860 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.886292  6921 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:16:09.889398  6986 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.886380  6936 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.891543  6927 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:09.891187  6926 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:09.892709  6926 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:09.894097  6848 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:09.893940  6926 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:09.895258  6862 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:16:09.896883  6986 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.897162  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.895743  6926 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.897634  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.899108  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.834697  6967 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:09.899801  5367 raft_consensus.cc:1813] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Handling vote request from an unknown peer 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:09.906761  5367 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:09.908596  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.918236  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.918331  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.899796  6889 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.881989  6884 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.922237  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:09.930841  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:09.932272  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:09.914817  6965 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:09.843612  6984 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.936412  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.936977  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:09.916026  6977 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:09.938655  6936 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.938884  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:09.939069  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.939448  6936 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.939883  5442 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:09.920431  6862 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:16:09.947067  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.946878  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:09.948125  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 79634.9us
I20260709 13:16:09.976289  5446 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:09.977824  6847 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:09.978456  5521 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:09.978933  5521 pending_rounds.cc:85] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 1
I20260709 13:16:09.978849  5259 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0276d804ade348368656bbe6805214df with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:09.979339  5521 pending_rounds.cc:107] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:09.979640  5521 raft_consensus.cc:2889] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:09.979825  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:09.942456  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:09.980537  5515 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.980747  6077 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.981262  5272 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 1 to 2, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 2 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.983433  5441 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:09.943246  5373 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:09.983206  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51119.3us
W20260709 13:16:09.990566  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75009.8us
I20260709 13:16:09.991199  6965 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:09.991662  6965 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.992059  6965 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.943778  6896 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:09.993973  6896 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:09.995007  6862 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:09.995494  6862 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:09.995203  6896 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.996631  6896 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.978510  6847 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:09.983168  6858 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.874730  6915 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.999184  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.997632  5447 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:09.931929  6579 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.001165  5446 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 5. Ops: []
I20260709 13:16:09.933631  6860 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.994077  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:09.999249  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.012192  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.000555  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:10.003621  6847 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:09.942672  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.946691  6884 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:09.976722  6927 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.025331  5519 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.941507  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:10.004211  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:09.925586  6967 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:09.942293  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:09.999892  6827 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:16:10.035956  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.050499  5367 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:10.012619  6858 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.036825  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.015102  6975 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.064606  6077 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:10.038451  5442 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:10.041682  5443 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:10.042699  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:10.045079  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.033511  6973 raft_consensus.cc:2764] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:16:10.076061  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.016695  6954 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.997375  6867 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.052932  6991 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.060091  5522 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:10.021994  6862 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:10.028653  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.054258  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:10.074282  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45281.6us
I20260709 13:16:10.078357  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:10.081277  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 81012.8us
W20260709 13:16:10.082190  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 88195.4us
I20260709 13:16:10.084403  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.019380  6579 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.023224  6860 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.096688  5524 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:10.102190  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.103470  5524 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:10.099424  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.106246  6868 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.108932  6868 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.105003  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.110807  5524 raft_consensus.cc:2410] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:10.112121  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.113622  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.115067  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.116150  5524 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:10.118567  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:10.120514  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:10.123162  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.086028  6936 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.117165  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.132989  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:10.138779  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.126965  6847 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.130348  6946 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.143913  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 71) took 2792 ms. Trace:
W20260709 13:16:10.144107  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.135646  6948 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:10.093027  6975 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.086298  6954 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.148846  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.109537  6868 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.145386  6847 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.141470  6936 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:10.185314  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:10.152302  7017 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:16:10.154987  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 896) took 1289 ms. Trace:
W20260709 13:16:10.152009  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.146986  5371 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:10.186143  5524 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:10.187377  5450 rpcz_store.cc:276] 0709 13:16:08.865330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.648432 (+783102us) service_pool.cc:224] Handling call
0709 13:16:09.648933 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.663653 (+ 14720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.663676 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.783972 (+120296us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.917529 (+133557us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.917746 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.917846 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.154705 (+236859us) raft_consensus.cc:1685] finished
0709 13:16:10.154727 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.154880 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35895,"raft.queue_time_us":8173,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":14426,"thread_start_us":101061,"threads_started":1,"wal-append.queue_time_us":266279}
I20260709 13:16:10.198434  6946 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.199858  5523 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:10.200615  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60921.8us
W20260709 13:16:10.201665  7022 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:16:10.202605  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.203070  7018 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.203718  7018 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.204233  7018 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:10.140700  6069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 62) took 2183 ms (client timeout 1634 ms). Trace:
W20260709 13:16:10.212157  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 122018us
I20260709 13:16:10.213238  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:10.213968  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 81067.1us
I20260709 13:16:10.215899  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.216570  5520 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:10.216801  6868 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:10.217316  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44888.7us
I20260709 13:16:10.217500  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.217850  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.218674  5371 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:10.220610  7001 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.201630  6986 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.223285  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.188644  6847 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.225279  5515 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
W20260709 13:16:10.248081  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.248692  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.249900  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.254773  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.256063  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.256867  5515 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.211581  6973 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.259006  6868 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:10.270406  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.271394  5371 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:10.266961  6868 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.266351  5522 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
W20260709 13:16:10.278517  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.280442  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:10.286692  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68327.1us
I20260709 13:16:10.264657  6903 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:10.289722  6895 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:10.276952  6868 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.290385  7001 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.293058  7001 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.290482  6903 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:10.243294  6921 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:16:10.289762  5367 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:10.211796  6948 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.290289  6895 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.281148  6967 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.300930  6895 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.298816  5374 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:10.212941  6069 rpcz_store.cc:269] 0709 13:16:07.951300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.956204 (+  4904us) service_pool.cc:224] Handling call
0709 13:16:10.099037 (+2142833us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b5800004598. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:10.134605 (+ 35568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44433792}
I20260709 13:16:10.299276  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.300712  7020 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.307122  5371 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:10.297672  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.150291  5517 rpcz_store.cc:276] 0709 13:16:07.274437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.221887 (+947450us) service_pool.cc:224] Handling call
0709 13:16:08.247454 (+ 25567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.276013 (+ 28559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.279061 (+  3048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.282732 (+  3671us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:08.282809 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.066007 (+1783198us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b540016c1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:10.066077 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.066351 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40850176}
I20260709 13:16:10.289002  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:10.312795  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.314812  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.316973  5522 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.321774  6929 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.322621  6929 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.312732  6975 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.318068  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.324131  6975 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.324199  6885 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:10.324783  6885 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:10.325742  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.326457  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:10.297243  6903 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:10.333479  5520 raft_consensus.cc:2410] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:10.333653  5522 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:10.307435  7020 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.327389  6867 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.342549  5515 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:10.327870  6971 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.350102  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.351590  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.347847  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.336491  6975 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.341085  7020 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.357208  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:10.357337  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.361591  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:10.362293  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.338568  6946 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.358129  5515 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.366652  6801 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:10.367776  6967 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.367527  6903 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.368172  6801 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:10.369024  6903 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:10.373601  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.361631  7027 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:16:10.382587  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:10.394017  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53353.4us
I20260709 13:16:10.325831  6885 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.399381  5367 raft_consensus.cc:2368] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:10.407622  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:10.408779  6926 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.000s
I20260709 13:16:10.437964  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.438496  5515 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:10.439851  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.416558  6954 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.415505  6069 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:10.438704  5374 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
W20260709 13:16:10.430487  6941 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.002s
I20260709 13:16:10.453698  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.393365  6965 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.458142  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:10.458904  5367 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:10.459897  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.462409  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.447633  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:10.474152  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.475941  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.479252  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:10.480635  6885 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.485134  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:10.470323  6991 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.492292  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.493191  5367 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:10.496434  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:10.497098  7039 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:16:10.497596  5515 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:10.487501  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:10.496809  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:10.501332  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:10.510975  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:10.555599  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:10.512487  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.512758  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:10.553249  6076 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
W20260709 13:16:10.562902  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.570641  5519 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:10.503719  6948 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:10.505456  5340 connection.cc:256] RPC call timeout handler was delayed by -2.0103376179999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 13:16:10.503659  6801 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:10.526381  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:10.544153  6991 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:10.535070  6965 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.535876  6858 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.578558  6991 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:10.580706  6991 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.581581  6903 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.581668  6876 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:10.585786  6903 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.588002  6903 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.574816  6847 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:10.582966  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 77339.3us
I20260709 13:16:10.589592  5515 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.578540  7018 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:10.513302  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.591639  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 121828us
I20260709 13:16:10.563403  6973 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.511850  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:10.590766  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:10.594043  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67767.4us
I20260709 13:16:10.598106  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.603346  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.607996  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.536347  6868 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:10.609881  5416 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.611389  5515 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:10.604203  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.613500  6077 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:10.613583  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:10.614532  7024 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.549s	user 0.004s	sys 0.001s
I20260709 13:16:10.615052  6872 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.615746  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.615784  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.613718  5371 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:10.557392  6895 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.575726  7020 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.620754  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.621095  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.604645  6975 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:10.621825  5449 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:10.624483  5372 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
W20260709 13:16:10.627177  5448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 899) took 1752 ms (client timeout 2203 ms). Trace:
W20260709 13:16:10.628931  5448 rpcz_store.cc:269] 0709 13:16:08.868847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.215489 (+346642us) service_pool.cc:224] Handling call
0709 13:16:10.621231 (+1405742us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54001793d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:10.621402 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707752832}
W20260709 13:16:10.634392  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43717.5us
I20260709 13:16:10.631749  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:10.619185  6885 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.641067  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:10.641538  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.642395  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.642822  5444 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:10.642722  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.643102  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.651760  5441 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:10.643517  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.644325  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.644948  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.645807  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:10.646051  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.646180  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.647301  5490 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.653092  5450 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:10.628672  6867 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:10.629923  6975 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:10.661522  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.671340  6975 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.672752  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.662127  7018 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.674010  5369 raft_consensus.cc:2410] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:10.675172  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:10.676354  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.676561  6909 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:10.677021  5369 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:10.677588  6909 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:10.677973  6909 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:10.664739  7020 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.665627  5517 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:10.639448  6801 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.665742  6696 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:10.688975  6696 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.689577  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.690896  5441 raft_consensus.cc:2410] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:10.691326  6696 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.692591  5441 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:10.666539  5340 connection.cc:256] RPC call timeout handler was delayed by -1.1148376180001378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2944s for a response
I20260709 13:16:10.666867  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 893) took 4015 ms. Trace:
I20260709 13:16:10.667336  6791 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.667635  6868 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:10.639065  6991 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:10.662715  7041 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.679623  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.682229  5447 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:10.683673  5446 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.685127  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:10.685734  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54039.1us
I20260709 13:16:10.702029  5370 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:10.702113  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.686308  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.688287  5443 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:10.688109  6801 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.714928  6801 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.715664  6791 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.718070  6860 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.718173  6791 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.717206  5446 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:10.721486  5444 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:10.722869  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.686894  6973 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:10.694362  5340 connection.cc:256] RPC call timeout handler was delayed by -1.0606111800000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 13:16:10.639551  6948 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:10.693655  5442 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:10.693598  5521 rpcz_store.cc:276] 0709 13:16:06.660512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.393915 (+733403us) service_pool.cc:224] Handling call
0709 13:16:07.394123 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.980181 (+2586058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.666570 (+686389us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b540018f6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:10.666808 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5937963776}
I20260709 13:16:10.738718  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.739559  6965 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.740281  6965 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.740919  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:10.742125  6971 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.744602  6971 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.745378  5415 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.746769  6971 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:10.747184  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.747365  6971 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:10.748312  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.749711  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:10.750196  6967 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:10.750459  6975 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.751142  6967 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:10.751403  7038 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:10.751667  6967 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:10.751889  5445 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:10.751984  7038 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:10.752880  6967 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:10.753057  7038 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:10.754248  6967 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.755311  6975 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.756525  5522 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:10.759116  5522 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:10.761137  5522 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:10.741961  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.761749  6948 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.762894  5416 leader_election.cc:400] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:10.763110  5522 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:10.699347  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.763899  5517 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.764219  6948 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:10.765091  6991 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.765730  6705 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:10.703713  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.698415  6895 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.753265  5366 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:10.705732  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.708859  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:10.769505  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63930.7us
I20260709 13:16:10.768543  5450 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:10.707751  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:10.774498  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.712289  6579 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:10.724926  5340 connection.cc:256] RPC call timeout handler was delayed by -1.0264111799999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 13:16:10.700524  6847 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:10.730206  6862 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.732151  6973 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.678843  6909 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.733000  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.783221  5519 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:10.783488  5524 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:10.736752  6860 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:10.736865  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 881) took 1845 ms. Trace:
W20260709 13:16:10.786363  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 147512us
I20260709 13:16:10.695948  6867 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.737457  6868 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.763190  5416 leader_election.cc:403] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:10.788641  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:10.775444  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.711400  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.776273  5448 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:10.728394  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.789928  5523 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.779446  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:10.789956  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.790683  5446 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.779980  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:10.708251  7018 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.724246  6696 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:10.791265  5441 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:10.785379  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 922) took 1436 ms (client timeout 1742 ms). Trace:
I20260709 13:16:10.795466  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.798965  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:10.794313  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:10.804309  5444 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:10.804448  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.804797  5520 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:10.805070  5445 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:10.799054  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.808584  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.806921  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:10.774715  7041 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:10.810513  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.778292  7001 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:10.786298  5368 rpcz_store.cc:276] 0709 13:16:08.891831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.444429 (+552598us) service_pool.cc:224] Handling call
0709 13:16:09.445095 (+   666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.578215 (+133120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.578272 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.579067 (+   795us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.736226 (+157159us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.736286 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.734683 (+998397us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400259ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:10.734726 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.734771 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:10.734783 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.736686 (+  1903us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2567,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":25554,"spinlock_wait_cycles":304378624,"thread_start_us":156557,"threads_started":1,"wal-append.queue_time_us":234048}
I20260709 13:16:10.814020  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.952487  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:10.949599  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:10.877163  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.957320  5450 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.780665  6975 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:10.949479  5446 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
W20260709 13:16:10.948220  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 149230us
I20260709 13:16:10.809541  5522 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:10.980916  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:10.785581  6973 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.805994  6867 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:10.794620  7025 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.655s	user 0.003s	sys 0.000s
I20260709 13:16:10.980752  5519 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.806571  6960 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:10.990746  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 187374us
W20260709 13:16:10.987607  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.988045  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:10.993022  5515 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:10.794845  6860 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:10.803156  6991 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.813531  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:10.991863  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:10.991182  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 184297us
I20260709 13:16:10.803799  6965 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.801999  6984 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:10.987329  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.814256  7030 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.660s	user 0.005s	sys 0.002s
I20260709 13:16:10.810384  6909 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.905287  6971 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.996326  5371 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:10.944613  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.033787  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:10.818739  6883 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.948870  7001 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.004251  6965 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:10.986141  6929 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:11.047134  6965 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.012588  5515 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:11.047801  5515 pending_rounds.cc:85] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 2
I20260709 13:16:11.048062  5515 pending_rounds.cc:107] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:11.048312  5515 raft_consensus.cc:2889] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.049316  6991 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:10.809963  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:11.050099  6853 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:11.050699  6971 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:11.051122  6971 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:11.049211  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57480.4us
I20260709 13:16:10.820768  6895 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.200s
I20260709 13:16:10.997591  6860 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.052110  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:11.030719  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49899.8us
I20260709 13:16:11.053826  6847 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:11.054647  6847 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.054884  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:11.027820  6954 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.055722  6954 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.050289  6991 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.056320  7018 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:11.056811  7018 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:11.058116  6954 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.057797  7018 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.059415  7018 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.997961  6705 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:11.039628  6935 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.040755  7041 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:11.047179  6929 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.071493  5523 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:11.051494  6971 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.810825  6077 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:11.055702  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:11.067761  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 268844us
I20260709 13:16:11.069139  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:10.814172  6868 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:11.121382  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52356us
I20260709 13:16:11.081295  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:11.060964  7020 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:11.091181  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 295984us
W20260709 13:16:11.092037  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.037144  7001 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:11.061798  6948 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.077068  6975 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:11.066179  6791 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.070276  6705 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:11.102926  5273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 149) took 8239 ms. Trace:
I20260709 13:16:11.105005  6070 raft_consensus.cc:1813] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Handling vote request from an unknown peer 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:11.088568  6935 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:11.055773  6848 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:16:11.115160  6847 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:11.120761  5441 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:11.077441  6929 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:10.807284  5518 rpcz_store.cc:269] 0709 13:16:09.344030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.484999 (+140969us) service_pool.cc:224] Handling call
0709 13:16:10.776875 (+1291876us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54002788d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:10.777045 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615202048}
W20260709 13:16:11.124601  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 320187us
W20260709 13:16:11.126673  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.132292  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 76663.8us
W20260709 13:16:11.134672  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.133023  7041 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:11.133602  7020 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.092940  5519 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:11.186982  5515 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 6. Ops: []
I20260709 13:16:11.187584  5519 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:11.151369  5449 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:11.189173  5519 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:11.071955  6960 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:11.195703  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.084378  6579 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.139535  5523 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:11.072304  6883 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.149994  5272 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 37) took 5132 ms. Trace:
W20260709 13:16:11.172222  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.200785  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.135843  5450 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:11.174257  6868 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:11.174762  6070 raft_consensus.cc:2410] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:16:11.174853  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.177315  6935 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.143540  5273 rpcz_store.cc:276] 0709 13:16:02.863301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.870475 (+  7174us) service_pool.cc:224] Handling call
0709 13:16:11.102685 (+8232210us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:05.670390 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:05.744559 (+ 74169us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:05.744597 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:16:05.744617 (+    20us) tablet.cc:662] Decoding operations
0709 13:16:05.746148 (+  1531us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:05.747501 (+  1353us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:05.753401 (+  5900us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:16:05.754498 (+  1097us) tablet.cc:701] Row locks acquired
0709 13:16:05.754518 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:05.754666 (+   148us) write_op.cc:270] Start()
0709 13:16:05.754795 (+   129us) write_op.cc:276] Timestamp: P: 1783602965754618 usec, L: 0
0709 13:16:05.754816 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:05.755495 (+   679us) log.cc:844] Serialized 5538 byte log entry
0709 13:16:06.231540 (+476045us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:06.689017 (+457477us) op_driver.cc:464] REPLICATION: finished
0709 13:16:06.950423 (+261406us) write_op.cc:301] APPLY: starting
0709 13:16:06.973402 (+ 22979us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:07.034592 (+ 61190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:07.036300 (+  1708us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:07.096571 (+ 60271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:07.096949 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:16:07.097022 (+    73us) write_op.cc:312] APPLY: finished
0709 13:16:07.097497 (+   475us) log.cc:844] Serialized 100 byte log entry
0709 13:16:07.097735 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:07.097938 (+   203us) write_op.cc:454] Released schema lock
0709 13:16:07.098008 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:07.098439 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:07.098480 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":288938,"reported_tablets":25,"spinlock_wait_cycles":3328,"child_traces":[["op",{"apply.queue_time_us":247606,"apply.run_cpu_time_us":5579,"apply.run_wall_time_us":158431,"num_ops":14,"prepare.queue_time_us":311183,"prepare.run_cpu_time_us":8098,"prepare.run_wall_time_us":111961,"raft.queue_time_us":293806,"raft.run_cpu_time_us":73857,"raft.run_wall_time_us":128965,"replication_time_us":934037,"spinlock_wait_cycles":4776320,"thread_start_us":546503,"threads_started":4,"wal-append.queue_time_us":104048,"wal-append.run_cpu_time_us":30004,"wal-append.run_wall_time_us":2294647}]]}
I20260709 13:16:11.165639  6847 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:11.206449  5516 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:11.142452  6948 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.179489  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.208624  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.181519  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:11.209905  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:11.210143  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66494.5us
I20260709 13:16:11.210701  5373 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.210978  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:11.212023  6801 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:11.211583  6948 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:11.212779  6801 raft_consensus.cc:2764] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:11.181921  6705 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:11.213748  6860 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:11.183319  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:11.198956  6579 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.216022  6579 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.202375  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.202893  5515 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:16:11.216777  5366 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:11.217072  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:11.138942  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57730.6us
I20260709 13:16:11.217777  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.218111  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:11.203393  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.218875  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.219010  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.219481  5371 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:11.219605  5366 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.220752  6897 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.220819  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:11.221298  6897 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.206485  6847 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.171697  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:11.182920  6895 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:11.216068  6848 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:11.203327  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.149776  6791 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.237581  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:11.223632  5367 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:11.214895  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59508 (request call id 60) took 1275 ms. Trace:
I20260709 13:16:11.190858  6936 raft_consensus.cc:2764] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:11.198438  5523 pending_rounds.cc:85] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 1
I20260709 13:16:11.143373  6884 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:11.191545  7020 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:11.202735  7049 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:16:11.186741  7041 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:11.225016  5371 pending_rounds.cc:85] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
W20260709 13:16:11.244787  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 78514.9us
I20260709 13:16:11.247234  5523 pending_rounds.cc:107] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:16:11.265815  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 94192.7us
I20260709 13:16:11.267316  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:11.270514  5523 raft_consensus.cc:2889] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.271816  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:11.270123  5371 pending_rounds.cc:107] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:11.274390  5371 raft_consensus.cc:2889] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.275688  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:11.236840  6897 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.278707  5367 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:11.284232  5370 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:11.291975  5370 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:11.239089  6868 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.300985  5269 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 4, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.232930  7054 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.198413  5272 rpcz_store.cc:276] 0709 13:16:06.017764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.017964 (+   200us) service_pool.cc:224] Handling call
0709 13:16:11.149910 (+5131946us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:10.202397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:10.203132 (+   735us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:10.203185 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:16:10.203219 (+    34us) tablet.cc:662] Decoding operations
0709 13:16:10.203723 (+   504us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:10.203818 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:10.203853 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:10.204431 (+   578us) tablet.cc:701] Row locks acquired
0709 13:16:10.204499 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:16:10.204707 (+   208us) write_op.cc:270] Start()
0709 13:16:10.204889 (+   182us) write_op.cc:276] Timestamp: P: 1783602970204626 usec, L: 0
0709 13:16:10.204929 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:16:10.273759 (+ 68830us) log.cc:844] Serialized 974 byte log entry
0709 13:16:10.610358 (+336599us) op_driver.cc:464] REPLICATION: finished
0709 13:16:10.611976 (+  1618us) write_op.cc:301] APPLY: starting
0709 13:16:10.612082 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:10.612240 (+   158us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:10.612366 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:10.612724 (+   358us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:10.612906 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:10.612949 (+    43us) write_op.cc:312] APPLY: finished
0709 13:16:10.616751 (+  3802us) log.cc:844] Serialized 28 byte log entry
0709 13:16:10.616933 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:10.617038 (+   105us) write_op.cc:454] Released schema lock
0709 13:16:10.617088 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:10.633927 (+ 16839us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:10.639082 (+  5155us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2834918,"reported_tablets":4,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":1309,"apply.run_cpu_time_us":2108,"apply.run_wall_time_us":7824,"num_ops":2,"prepare.queue_time_us":209189,"prepare.run_cpu_time_us":32962,"prepare.run_wall_time_us":205902,"raft.queue_time_us":81293,"raft.run_cpu_time_us":1356,"raft.run_wall_time_us":4057,"replication_time_us":405200,"thread_start_us":235406,"threads_started":4,"wal-append.queue_time_us":132373}]]}
I20260709 13:16:11.243034  6070 rpcz_store.cc:276] 0709 13:16:09.939362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.941840 (+  2478us) service_pool.cc:224] Handling call
0709 13:16:11.214570 (+1272730us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54005c1cd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:11.214794 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396284800}
I20260709 13:16:11.305822  6967 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:11.333171  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 61749.9us
I20260709 13:16:11.311532  6972 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.311981  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 937) took 1250 ms. Trace:
I20260709 13:16:11.314603  6965 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:11.315407  6984 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:11.317193  5370 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.319474  6948 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.319923  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:11.321305  6801 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:11.322010  6936 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.324905  6895 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:11.330533  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 119655us
I20260709 13:16:11.272975  7041 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.279261  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.333947  5521 rpcz_store.cc:276] 0709 13:16:10.061231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.738048 (+676817us) service_pool.cc:224] Handling call
0709 13:16:10.757381 (+ 19333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.757786 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.757816 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.758262 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.806256 (+ 47994us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.806298 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.806364 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.311694 (+505330us) raft_consensus.cc:1685] finished
0709 13:16:11.311716 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.311875 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10035,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"thread_start_us":47601,"threads_started":1,"wal-append.queue_time_us":254938}
I20260709 13:16:11.316109  6975 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.296499  6847 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:11.338575  5516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 887) took 4806 ms (client timeout 2002 ms). Trace:
I20260709 13:16:11.306085  6848 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.352790  5269 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 5, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.338129  7051 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:11.395871  5516 rpcz_store.cc:269] 0709 13:16:06.521631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.534575 (+ 12944us) service_pool.cc:224] Handling call
0709 13:16:11.296782 (+4762207us) spinlock_profiling.cc:243] Waited 4.58 s on lock 0x7b540016d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:11.327884 (+ 31102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10522808064}
I20260709 13:16:11.403258  5370 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.401355  5523 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:11.277777  6853 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:16:11.337819  6883 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.407753  5373 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:11.348630  6872 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.414915  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:11.381819  6895 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.328037  6868 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.421912  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:11.426189  5516 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:11.329392  7054 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:11.430639  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.390231  7055 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:11.405853  6967 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:11.409674  6954 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.347244  6972 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:11.427224  6895 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:11.437305  5517 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.673s	user 0.004s	sys 0.008s
W20260709 13:16:11.472736  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 235320us
I20260709 13:16:11.435329  6936 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:11.475203  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 199585us
I20260709 13:16:11.495975  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:11.409258  6991 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:16:11.490797  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:11.335610  6960 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.493515  5523 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:11.467798  5370 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:11.470541  5269 catalog_manager.cc:5697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.455296  6853 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:11.500847  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:11.427443  6883 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.492050  6954 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.514509  6954 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.515131  6954 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:11.515883  7054 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:11.516314  6954 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:11.516767  6909 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.517199  6883 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.413187  7051 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.520113  7051 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:11.508355  6853 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:11.501454  6848 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:11.521265  6848 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.521889  6885 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:11.521998  6848 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.522411  6885 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:11.523379  6885 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.524582  6885 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.521327  6853 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.527156  6853 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.529906  6791 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:11.520128  6883 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.533524  6860 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:11.501873  6936 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.536157  6936 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.536666  6936 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:11.532341  6883 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:16:11.537863  6965 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:11.538767  5258 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 23048b90f57d48a4be8be78bc78d9204 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 544c82a50cc4477886bb6f7d58f455ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:11.540565  6848 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.544090  6872 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.544716  6872 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.518179  5521 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:11.510902  5269 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:11.562268  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.495625  5517 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:11.543996  5366 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:11.573889  5369 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:11.629403  5269 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 4, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.633942  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 950) took 1295 ms. Trace:
I20260709 13:16:11.558697  6909 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:11.546147  6848 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.496034  6967 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:11.635393  5269 catalog_manager.cc:5697] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 2, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 2 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:11.635883  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.665448  6972 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.665751  6579 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.666869  6909 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:11.634799  6867 consensus_meta.cc:287] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.003s
I20260709 13:16:11.541349  7020 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.677310  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.680056  5369 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:16:11.681666  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:11.682559  6972 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.682927  6972 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.683259  6972 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:11.691576  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.698668  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.697642  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 377757us
I20260709 13:16:11.650930  6884 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:11.663546  7001 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.639241  6971 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:11.708156  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.761534  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 356951us
W20260709 13:16:11.762284  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.677572  7066 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.644856  5517 rpcz_store.cc:276] 0709 13:16:10.333623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.699066 (+365443us) service_pool.cc:224] Handling call
0709 13:16:11.628782 (+929716us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:11.716459  7053 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
W20260709 13:16:11.716226  6929 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.000s
W20260709 13:16:11.777020  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 276221us
I20260709 13:16:11.718894  6926 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:16:11.780845  5520 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 1. Current term is 3. Ops: []
I20260709 13:16:11.767350  6991 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.707593  6868 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:11.799600  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.789264  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 292006us
W20260709 13:16:11.814339  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 404721us
I20260709 13:16:11.827503  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.693046  6867 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:11.777097  6929 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.853320  5373 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:11.847715  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.853789  5373 pending_rounds.cc:85] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:11.854084  5373 pending_rounds.cc:107] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:11.854104  5369 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.852234  5449 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:11.854401  5373 raft_consensus.cc:2889] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.798352  6696 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:11.859133  5375 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:11.859117  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.862138  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:11.867555  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 997) took 1608 ms. Trace:
I20260709 13:16:11.775532  6948 consensus_queue.cc:1243] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:11.868172  5520 rpcz_store.cc:276] 0709 13:16:10.259925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.990144 (+730219us) service_pool.cc:224] Handling call
0709 13:16:11.012123 (+ 21979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.781525 (+769402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.867179 (+ 85654us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54000a9bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:11.867460 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1758440832}
I20260709 13:16:11.869553  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.871917  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:11.875571  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.836273  6868 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:11.871309  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 103938us
I20260709 13:16:11.883858  5446 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:11.884539  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:11.870604  7047 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:11.785774  6897 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.773634  7066 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.899346  5444 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:11.900018  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 946) took 1677 ms. Trace:
I20260709 13:16:11.900177  5449 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:11.870870  6973 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.855s	user 0.012s	sys 0.000s
I20260709 13:16:11.917605  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.903015  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.852268  6972 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:11.918298  5366 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
W20260709 13:16:11.907254  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45116.4us
I20260709 13:16:11.859411  6696 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:11.804237  6991 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.869742  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:11.878378  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:11.932283  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:11.914601  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.937181  5368 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:11.916556  5522 rpcz_store.cc:276] 0709 13:16:10.223007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.989941 (+766934us) service_pool.cc:224] Handling call
0709 13:16:10.990316 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.990540 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.990570 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.997876 (+  7306us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.073516 (+ 75640us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:11.073551 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.073620 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.899777 (+826157us) raft_consensus.cc:1685] finished
0709 13:16:11.899799 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.899954 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":61490,"threads_started":1,"wal-append.queue_time_us":187340}
I20260709 13:16:11.918587  5373 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:11.937474  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:11.924207  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:11.923828  5449 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:11.928375  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:11.941840  5374 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:11.938514  5446 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:11.941095  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:11.938966  5444 raft_consensus.cc:2368] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:16:11.940027  5369 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:11.945313  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.948930  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.953626  5441 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
W20260709 13:16:11.933033  7068 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:16:11.922151  6973 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.972263  5443 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:11.972405  6973 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:11.951556  7020 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.974042  6579 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.975929  6991 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:11.934125  7076 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:16:11.978443  6895 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.979866  6972 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.917599  6935 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:16:11.961833  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1106) took 1176 ms. Trace:
I20260709 13:16:11.981874  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:11.931936  5442 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 6. Ops: []
I20260709 13:16:11.982527  5374 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:11.983556  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56203.2us
I20260709 13:16:11.983477  6076 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:11.957352  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:11.962098  7066 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.964357  7001 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:11.921357  6696 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.901275  6884 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:11.967386  6897 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:11.967774  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.968585  6867 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:11.979782  6705 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:11.987705  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 945) took 1764 ms. Trace:
W20260709 13:16:11.988842  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 186423us
W20260709 13:16:12.018518  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.951117  7041 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.552s	user 0.002s	sys 0.008s
I20260709 13:16:12.008038  5444 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:11.982170  5448 rpcz_store.cc:276] 0709 13:16:10.787206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.955112 (+167906us) service_pool.cc:224] Handling call
0709 13:16:11.006261 (+ 51149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.205020 (+198759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.205217 (+   197us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.232858 (+ 27641us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.648726 (+415868us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:11.648778 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.648888 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.961554 (+312666us) raft_consensus.cc:1685] finished
0709 13:16:11.961578 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.961757 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50550,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":48,"thread_start_us":524591,"threads_started":2,"wal-append.queue_time_us":588036}
I20260709 13:16:12.007332  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.018396  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:11.964084  5445 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:11.980559  6895 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:12.025131  5450 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:11.958912  6909 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:12.027168  5374 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:16:12.031000  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.032143  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:11.921141  6868 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.018946  5524 rpcz_store.cc:276] 0709 13:16:10.222790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.990196 (+767406us) service_pool.cc:224] Handling call
0709 13:16:10.990429 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.008177 (+ 17748us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:11.343990 (+335813us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.801199 (+457209us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.973348 (+172149us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b1800202ba0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:16:11.987062 (+ 13714us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.987138 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:11.987198 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.987285 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.987453 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167714,"prepare.queue_time_us":384192,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":2983,"raft.queue_time_us":232833,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":50184,"spinlock_wait_cycles":19720448,"thread_start_us":690593,"threads_started":2,"wal-append.queue_time_us":402304}
I20260709 13:16:12.040453  5441 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:11.994081  6967 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:12.043937  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:12.047726  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 61140.4us
I20260709 13:16:11.982206  6801 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:16:12.054551  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:12.055505  5373 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.020645  6705 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:12.032929  6948 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:12.020927  6929 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:12.057914  5447 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.067629  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:12.068341  5374 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:12.063774  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:12.070804  5369 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:12.066887  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.074205  5370 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:12.074632  5370 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:12.037700  6909 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:12.037619  6860 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.091925  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1010) took 1565 ms. Trace:
W20260709 13:16:12.097829  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 79573.8us
I20260709 13:16:12.098538  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:12.090835  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:12.088269  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.040015  6972 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:12.033521  7041 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.097636  5519 rpcz_store.cc:276] 0709 13:16:10.526369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.192664 (+666295us) service_pool.cc:224] Handling call
0709 13:16:11.192961 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.224498 (+ 31537us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:11.430322 (+205824us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.091527 (+661205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.091595 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:12.091645 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.091727 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.091863 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178020,"prepare.queue_time_us":218124,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":175283,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"thread_start_us":612996,"threads_started":2,"wal-append.queue_time_us":616814}
I20260709 13:16:12.133061  5447 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:12.090811  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1006) took 1602 ms. Trace:
I20260709 13:16:12.147063  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.164628  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.228029  6867 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.228643  6867 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:12.231573  6867 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:12.234295  5450 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:12.235742  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.237545  5450 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:12.237838  6867 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:12.078840  6909 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.175547  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:12.112165  6942 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.168881  5370 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:12.170117  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 97869us
W20260709 13:16:12.170439  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 71978.6us
I20260709 13:16:12.259713  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:12.131129  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:12.260560  5366 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.260692  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:12.079823  7020 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.172466  5441 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:12.268404  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 912) took 1100 ms. Trace:
I20260709 13:16:12.172292  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.177627  5449 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:16:12.214982  5369 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:12.173647  5446 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:12.269991  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82514.5us
I20260709 13:16:12.221748  5373 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:12.039219  6872 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.185952  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:12.274775  5368 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
W20260709 13:16:12.241647  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 257622us
I20260709 13:16:12.168102  5374 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:12.251458  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.253530  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.186745  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.205394  7076 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:12.263948  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 215308us
W20260709 13:16:12.266191  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 90721.9us
I20260709 13:16:12.165256  6848 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:12.268034  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:12.176837  5442 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:12.173002  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.271127  5445 raft_consensus.cc:2410] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:12.309660  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.079983  7072 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.220s
I20260709 13:16:12.043588  6935 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 13:16:12.340420  5441 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:16:12.341499  5441 pending_rounds.cc:85] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 6
I20260709 13:16:12.285800  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:12.177704  6929 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:12.111061  7091 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.163s
I20260709 13:16:12.341760  5441 pending_rounds.cc:107] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:16:12.179996  6579 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:16:12.142902  6860 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:12.280498  7088 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:16:12.256839  6867 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.270565  5372 rpcz_store.cc:276] 0709 13:16:11.168065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.168227 (+   162us) service_pool.cc:224] Handling call
0709 13:16:11.173716 (+  5489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.173896 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:11.348568 (+174672us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.014757 (+666189us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.247655 (+232898us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.267933 (+ 20278us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:12.268010 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.268098 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.268317 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63607,"prepare.queue_time_us":461081,"prepare.run_cpu_time_us":200,"prepare.run_wall_time_us":201,"raft.queue_time_us":147419,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4170,"thread_start_us":897891,"threads_started":4,"wal-append.queue_time_us":652428}
I20260709 13:16:12.423485  5366 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:12.425525  7041 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:12.274047  6967 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:12.451594  5370 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.289631  7076 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:12.455190  6967 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.455639  6967 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.455945  7076 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:12.449304  5443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1103) took 1670 ms (client timeout 1688 ms). Trace:
W20260709 13:16:12.457058  5443 rpcz_store.cc:269] 0709 13:16:10.779340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.780431 (+  1091us) service_pool.cc:224] Handling call
0709 13:16:12.449079 (+1668648us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540033d6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:12.449231 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679489152}
I20260709 13:16:12.286386  7020 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.458002  7091 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:12.458446  7091 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:12.438298  6705 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.459668  7020 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:12.273310  6972 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:12.426607  6942 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:12.460589  6973 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.413795  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:12.461251  6973 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.410737  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:12.462865  6972 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:12.423506  7074 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:12.399807  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 114111us
I20260709 13:16:12.287036  6885 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:12.465955  6885 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:12.466420  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:12.466979  6885 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.467629  6991 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:12.468264  6991 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.273526  6883 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.196s
I20260709 13:16:12.469678  7079 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:12.470265  7079 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.470877  6991 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:12.351917  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.472327  5449 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:12.472967  7079 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:12.341243  6897 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:12.473886  6897 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:12.474172  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.475384  5443 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:12.475191  6897 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.475566  6867 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:12.412930  6971 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:12.416513  7018 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.357s	user 0.011s	sys 0.006s
I20260709 13:16:12.409617  7071 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:12.477129  7071 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.477556  7071 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:12.413911  7090 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:16:12.347426  6848 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:12.479583  6848 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:12.410341  7095 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:16:12.423281  7082 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:16:12.312500  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:12.483681  6971 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:12.398036  6948 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:16:12.442404  6868 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:12.414901  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154799us
W20260709 13:16:12.485678  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 173297us
I20260709 13:16:12.486007  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:12.355180  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.401823  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 93359.6us
I20260709 13:16:12.459870  6705 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.487100  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:12.490049  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:12.385385  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.491520  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.498585  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.449990  5489 connection.cc:256] RPC call timeout handler was delayed by -1.1631318699999156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:16:12.498986  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.499348  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.499864  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.400969  7092 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:16:12.488083  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.472465  6991 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:12.488322  5441 raft_consensus.cc:2889] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.459286  7091 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.486601  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:12.489184  6948 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:12.497198  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:12.509078  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:12.512533  5447 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:12.537992  5370 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:12.538519  5370 pending_rounds.cc:85] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 2
I20260709 13:16:12.538807  5370 pending_rounds.cc:107] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:12.539121  5370 raft_consensus.cc:2889] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.538923  5450 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:12.513762  5489 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:12.407164  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:12.457348  7076 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.542173  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.542922  5449 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:12.543090  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.544358  5445 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.487242  7018 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:12.431989  6872 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:12.544217  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 57662.9us
I20260709 13:16:12.553056  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:12.463901  6973 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:12.536089  5443 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:12.511647  7020 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.512336  6883 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:12.584102  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.587375  5447 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.514602  6579 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:16:12.589646  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.583480  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.590807  6971 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:12.591315  7020 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.597016  7020 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:12.555709  7074 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:12.556083  6791 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:16:12.590801  6991 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:16:12.556340  6929 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:12.518172  7079 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.556710  7092 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.551004  7018 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.583616  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:12.557529  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:12.601164  7091 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.611966  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.635406  5443 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.607571  5447 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:12.600090  6971 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:16:12.641240  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 127551us
I20260709 13:16:12.644090  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.587113  6883 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.536660  6948 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:12.238423  5518 rpcz_store.cc:276] 0709 13:16:10.489693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.184562 (+694869us) service_pool.cc:224] Handling call
0709 13:16:11.184915 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.185149 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:11.675166 (+490017us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.078863 (+403697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.090386 (+ 11523us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:12.090459 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.090552 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.090735 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44836,"prepare.queue_time_us":272756,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":65711,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":642840,"threads_started":2,"wal-append.queue_time_us":652281}
I20260709 13:16:12.654337  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.655082  5521 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:12.656289  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.640076  6867 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:12.625489  7092 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:12.631168  6872 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.631757  7001 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.630504  6929 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:12.635628  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 78219.9us
I20260709 13:16:12.609688  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:12.607203  6868 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:12.621987  7066 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.622354  7018 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.645803  6801 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:12.619397  7079 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.654976  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.630434  5519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:12.679744  5519 raft_consensus.cc:606] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:12.680228  5519 raft_consensus.cc:614] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:12.680351  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.638566  7074 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:12.658749  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.659678  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.684659  5447 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:12.664556  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.664345  6579 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.670284  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.670815  6973 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.665895  6853 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:12.674185  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:12.672930  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:12.650665  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.681066  5520 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:12.664022  6883 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.681906  7020 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:12.687820  5445 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:12.677987  6801 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:12.665342  6872 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.673107  7001 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.716171  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.718137  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.672132  7092 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:12.719166  5515 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:12.720549  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.666456  5441 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:12.755503  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82631.1us
I20260709 13:16:12.758468  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.759472  5447 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.735451  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:12.711963  7074 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:12.752370  5521 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:12.714406  5522 raft_consensus.cc:2376] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5. Re-sending same reply.
I20260709 13:16:12.768005  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.769173  5522 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:12.722285  7084 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:12.770671  5518 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:12.758710  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.733284  7020 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:12.715406  6991 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:12.734334  7093 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.771219  5519 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:12.711853  6579 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.774809  5441 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:12.711180  6909 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:12.776760  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.808272  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:12.803544  5518 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:12.808876  5519 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.718016  6853 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.809069  5445 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
W20260709 13:16:12.804570  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 166710us
I20260709 13:16:12.810700  5445 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:12.810971  5519 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:16:12.812548  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 202965us
I20260709 13:16:12.814154  5518 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:12.820158  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154464us
I20260709 13:16:12.821985  5519 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:16:12.813738  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:12.821484  5447 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:12.823526  5519 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:12.827992  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:12.830487  6960 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.792881  6897 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.860265  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "862a628beec44315b003538bc747056b"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:12.860733  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:12.860927  5518 raft_consensus.cc:606] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:12.833027  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.842275  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 178801us
I20260709 13:16:12.734297  6971 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:12.826201  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.858717  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:12.859529  5372 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:12.863035  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:12.853510  5339 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:12.767683  6948 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.867301  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:12.777064  7084 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.883989  5443 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:12.890823  5448 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:12.899983  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:12.880188  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49393.6us
I20260709 13:16:12.892335  5339 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:12.905687  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.872675  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44700.7us
I20260709 13:16:12.776466  6929 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.839069  6848 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:12.918237  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:12.914772  6867 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:12.932915  6867 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.852031  6884 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:12.940599  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48333.6us
W20260709 13:16:12.890439  7108 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:16:12.892132  6696 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.870s	user 0.008s	sys 0.004s
W20260709 13:16:12.879333  7105 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:16:12.896101  7073 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:12.886301  7107 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:12.887040  7101 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:16:12.959173  7079 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:12.898237  6948 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:12.955454  6975 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:12.892508  7103 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:12.877915  6885 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.900353  7119 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:12.901230  6860 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:12.893923  7001 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:12.895859  6872 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:12.979074  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:12.957106  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:12.901835  6897 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:12.859726  6801 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:12.981912  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 63687.9us
I20260709 13:16:12.983476  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:12.877964  6960 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.985895  7032 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:12.948118  6967 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.049834  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:13.052855  5449 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.007s
W20260709 13:16:12.981348  7071 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
I20260709 13:16:13.058166  5521 raft_consensus.cc:606] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:13.027887  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1012) took 2500 ms. Trace:
I20260709 13:16:12.950501  6884 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.957952  6696 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:12.960021  7100 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:13.070247  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 119221us
I20260709 13:16:13.062628  5521 raft_consensus.cc:614] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.061846  5515 rpcz_store.cc:276] 0709 13:16:10.527097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.217376 (+690279us) service_pool.cc:224] Handling call
0709 13:16:11.217701 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.753626 (+1535925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.027605 (+273979us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400277ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:13.027798 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3452546944}
I20260709 13:16:13.074153  5449 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:13.086627  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 179247us
I20260709 13:16:12.894526  7074 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:13.010123  7118 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.991079  7119 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.003662  7128 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:13.009745  6579 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.010365  6975 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:16:13.077083  7124 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:13.001747  7065 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.003504  7084 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.100045  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:13.101642  5371 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:13.092741  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 229753us
I20260709 13:16:13.180967  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:13.105871  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:13.183578  5370 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:13.181618  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:13.184340  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:13.106860  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.185393  5373 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:13.104962  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.112471  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.186618  5367 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:13.112761  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:12.981734  7073 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:13.077680  7100 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.090014  6801 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.994091  6885 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.236670  5367 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:13.129765  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.099222  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 79) took 1236 ms. Trace:
I20260709 13:16:13.240855  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.241607  5368 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:13.112579  7103 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:13.078099  7071 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.114562  7118 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.114133  7119 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.127398  6909 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:13.131261  7128 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:13.269969  5524 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:13.167645  5442 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:13.124995  7079 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:16:12.960091  7020 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.101050  6791 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:16:13.127015  7062 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:13.193388  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:13.163864  6848 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:13.127399  7018 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.232565  7100 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.180624  6579 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:13.243649  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.228821  6942 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.255961  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 87205.4us
I20260709 13:16:13.253409  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:13.251322  6883 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.000s
W20260709 13:16:13.277784  7114 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:16:13.319087  5373 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:13.240489  5517 rpcz_store.cc:276] 0709 13:16:11.862658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.870665 (+  8007us) service_pool.cc:224] Handling call
0709 13:16:11.911394 (+ 40729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.050295 (+138901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.057232 (+  6937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:12.179426 (+122194us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.556441 (+377015us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:12.582414 (+ 25973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.599472 (+ 17058us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.075857 (+476385us) raft_consensus.cc:1685] finished
0709 13:16:13.080130 (+  4273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.094485 (+ 14355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126173,"raft.queue_time_us":116480,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8427,"thread_start_us":333249,"threads_started":1,"wal-append.queue_time_us":550317}
I20260709 13:16:13.280083  6960 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.282950  7073 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.285135  7118 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.294251  5369 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:13.308079  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.265792  6860 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.310556  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.252847  7131 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:16:13.323429  5523 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:13.337265  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.309052  5448 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:13.340982  5366 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:13.340153  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 290433us
I20260709 13:16:13.349260  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:13.318900  6696 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.350560  5373 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
W20260709 13:16:13.318312  7126 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 13:16:13.322929  6967 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.319696  6897 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:13.342772  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.326102  6884 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.320604  6883 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.293862  6975 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.319599  6942 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.352216  6909 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:16:13.342381  6860 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.389599  7128 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:13.392221  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 210691us
W20260709 13:16:13.392971  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.393847  7084 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.394462  7084 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.396689  7084 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:13.396932  7066 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.002s
I20260709 13:16:13.399528  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:13.397221  7084 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.377650  7103 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:13.393857  7062 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:13.397401  7066 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:13.392166  7001 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.424625  6579 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:13.426204  7142 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:13.426146  6579 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.426090  7119 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.429849  6872 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.430532  6872 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.430949  6872 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.431459  7018 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.432014  7143 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:13.434036  7125 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:16:13.434402  7001 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.434993  7001 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.435276  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:13.436204  7143 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.436780  7143 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:13.445183  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 102647us
I20260709 13:16:13.445734  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:13.438695  6935 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.436412  7103 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:13.441224  7122 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:16:13.456426  6909 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.456933  6909 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:13.437716  7143 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.430966  6860 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.457840  6909 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.459117  6909 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.459645  7119 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.457623  7018 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.455344  6935 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:13.418324  7116 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
W20260709 13:16:13.462853  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 142448us
I20260709 13:16:13.437253  7065 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:13.473212  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.477095  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.478286  7118 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:13.479014  7118 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.415272  6885 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.483325  5450 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:16:13.441190  7076 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.883s	user 0.009s	sys 0.001s
I20260709 13:16:13.484558  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.486819  5450 pending_rounds.cc:85] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:13.485263  5446 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.488907  5447 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:13.493393  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:13.493817  5441 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:13.486059  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:13.494047  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.492980  5449 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:13.493956  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.492981  5450 pending_rounds.cc:107] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:13.495189  5447 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:13.494905  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.495780  5446 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 1.
I20260709 13:16:13.489847  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.496785  5441 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:13.487697  5443 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.495878  5450 raft_consensus.cc:2889] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.462875  7119 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.469326  7071 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.476287  6929 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.504372  5444 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:13.505646  5521 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:13.378726  6848 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.417508  7084 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.491622  7128 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.507527  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:13.518959  5340 connection.cc:256] RPC call timeout handler was delayed by -1.0915887799999382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 13:16:13.519479  5340 connection.cc:256] RPC call timeout handler was delayed by -1.085288779999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 13:16:13.485870  6897 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:13.491425  7062 consensus_queue.cc:1243] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:13.485302  7134 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:13.522872  7128 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.523663  7084 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.524294  7153 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:13.529249  5340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.572s (SENT) [suppressed 9 similar messages]
I20260709 13:16:13.509543  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.520627  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.511261  7140 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:13.546568  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.530280  6897 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:13.549165  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:13.521701  6929 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.514950  7119 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.553612  7140 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:13.555073  7001 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.547560  5444 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:13.547214  7139 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.544003  7091 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.904s	user 0.007s	sys 0.007s
I20260709 13:16:13.550808  6884 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:13.564513  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:13.568480  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 100026us
I20260709 13:16:13.512063  7132 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:16:13.572566  5523 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:13.553040  7041 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.559849  6897 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.575354  5516 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:13.575512  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46308.6us
I20260709 13:16:13.580389  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:13.547047  7076 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:13.585004  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.592125  5450 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:13.539741  7134 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:13.593340  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.581876  6884 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:13.594210  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.594739  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.595481  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.595574  7134 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.595837  6884 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:13.598543  7141 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.593587  7146 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:13.600957  7146 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.602629  5520 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:13.602718  6929 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.603569  7146 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.578685  7139 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.605342  7131 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.606590  7119 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.606748  7139 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.546700  7153 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:13.607862  6948 consensus_meta.cc:287] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.000s
I20260709 13:16:13.607434  7146 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:13.578611  7159 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.609665  7128 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.609990  7159 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.610759  5375 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:13.611171  5375 pending_rounds.cc:85] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 2
I20260709 13:16:13.611413  5375 pending_rounds.cc:107] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:13.611660  5375 raft_consensus.cc:2889] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.612788  7159 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:13.613327  7146 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:13.568727  7118 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.525672  6935 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.591018  7041 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.616876  6935 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.618268  7041 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.619001  6948 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.576606  7084 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:13.615561  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:13.625142  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:13.627065  5518 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:13.644846  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:13.609264  7153 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:13.646054  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:13.586117  5444 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:13.648835  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.647257  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:13.645017  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:13.652976  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:13.655678  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:13.657099  6948 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.657608  6948 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.657964  6948 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.659252  5340 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:13.626087  7159 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.653887  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:13.663911  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:13.673556  5443 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.673840  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.675431  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:13.597313  7140 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:13.662413  7154 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:16:13.674825  7146 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:13.653061  7141 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.644032  6801 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:16:13.650741  6929 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:16:13.667029  6579 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.667315  7159 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.645270  6872 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.672070  7041 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.710253  7041 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:13.711573  6868 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:13.712232  6868 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.720856  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 958) took 1078 ms. Trace:
I20260709 13:16:13.721681  5521 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:13.721343  5524 rpcz_store.cc:276] 0709 13:16:12.642685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.642864 (+   179us) service_pool.cc:224] Handling call
0709 13:16:13.720595 (+1077731us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540025d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:13.720782 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343270784}
I20260709 13:16:13.723992  6696 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:13.717409  6948 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.694310  5444 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.694721  5443 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:13.677969  7032 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:13.698252  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59508 (request call id 64) took 1037 ms. Trace:
I20260709 13:16:13.683876  6862 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:13.650663  7084 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.671844  7139 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:13.706660  7146 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.796541  5520 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:13.646147  7100 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.708355  7140 raft_consensus.cc:993] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:13.724426  6696 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:13.684835  7128 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.692364  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:13.687779  7073 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:16:13.763691  6579 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:13.974771  6579 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.976696  6884 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:13.977501  6884 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:13.727955  6070 rpcz_store.cc:276] 0709 13:16:12.660520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.662047 (+  1527us) service_pool.cc:224] Handling call
0709 13:16:12.766578 (+104531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:12.870533 (+103955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:12.900684 (+ 30151us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:13.230972 (+330288us) log.cc:844] Serialized 520 byte log entry
0709 13:16:13.543880 (+312908us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:13.549285 (+  5405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.549387 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.697982 (+148595us) raft_consensus.cc:1685] finished
0709 13:16:13.698004 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.698168 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22096,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":36460,"thread_start_us":251893,"threads_started":1,"wal-append.queue_time_us":325318}
I20260709 13:16:13.789587  6897 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.794229  6868 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.728915  7159 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:13.971247  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 279000us
I20260709 13:16:13.973508  7143 raft_consensus.cc:1081] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
W20260709 13:16:14.298151  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 604509us
I20260709 13:16:14.300359  5441 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:14.303495  5450 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:14.326481  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.327658  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.327157  5445 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:14.328370  5441 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:14.327857  5446 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:14.332322  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.298656  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.334784  5450 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:14.335393  5443 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:13.977811  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.336650  5444 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:14.337661  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.332340  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.339017  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.340373  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.341156  5445 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:14.342128  5447 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:14.343986  5446 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:14.263073  7074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.019s	sys 0.014s
W20260709 13:16:14.230809  7093 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.424s	user 0.010s	sys 0.004s
I20260709 13:16:14.353519  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.353662  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.354171  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.354691  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:13.991421  7141 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.346395  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.325728  7032 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:14.347945  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.349678  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.366537  5447 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.346500  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.367794  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.368428  5443 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:14.355103  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.369793  5445 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:14.371372  5445 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:14.334494  5517 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.355262  5441 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
W20260709 13:16:14.323918  7138 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.000s	sys 0.010s
I20260709 13:16:14.358489  5515 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:14.071167  7128 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:14.071880  7001 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:14.379055  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.395604  5441 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:14.379938  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.397166  5444 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:14.349081  7074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.019s	sys 0.020s
I20260709 13:16:14.382612  6076 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:13.925333  7146 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:13.990118  6696 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:14.399012  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:14.435529  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1179) took 2558 ms. Trace:
I20260709 13:16:14.436080  5371 rpcz_store.cc:276] 0709 13:16:11.877451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.877641 (+   190us) service_pool.cc:224] Handling call
0709 13:16:11.878056 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.180124 (+1302068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.435173 (+1255049us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400034dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:14.435446 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2813443840}
I20260709 13:16:14.437384  6696 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:14.438148  7172 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:14.442864  7128 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:14.426685  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.399734  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.361606  7093 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.434054  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.463239  5450 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:14.454834  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.365383  7032 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:14.459884  5444 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:14.465090  5441 raft_consensus.cc:2376] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3. Re-sending same reply.
I20260709 13:16:14.427443  7171 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.471148  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.427469  7073 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:14.401036  6872 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:14.476187  6043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.035s	sys 0.039s
W20260709 13:16:14.476723  6043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.035s	sys 0.039s
I20260709 13:16:14.432989  6853 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:14.453236  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:14.482188  6868 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:14.482412  7143 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:14.471179  7171 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:14.482954  7143 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:14.483603  7171 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:14.484870  7171 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.485402  7143 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:14.469290  6884 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:14.500125  6042 leader_election.cc:336] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.742s (SENT)
I20260709 13:16:14.505059  6942 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:14.511432  7032 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:14.512799  7032 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:14.474680  7073 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:14.473374  6848 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:14.375685  7141 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:14.522707  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.534623  5448 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:14.459457  5447 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:14.533639  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:14.542742  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:14.544763  5416 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:14.546098  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:14.557098  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.558130  5449 raft_consensus.cc:2376] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4. Re-sending same reply.
I20260709 13:16:14.558743  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.577821  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.578687  5448 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:14.580435  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.535262  7074 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:14.589779  7074 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:14.591962  7074 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:14.592526  7074 raft_consensus.cc:2764] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:14.554651  7123 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.593951  7073 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:14.595610  7073 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:14.554855  7135 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:14.598227  7084 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:14.554472  6975 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:14.588027  7144 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.613677  5449 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:14.618026  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.619468  5448 raft_consensus.cc:2368] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:16:14.620877  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.621510  5448 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.535518  6848 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:14.606822  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.629201  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:14.636438  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:14.616743  7144 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:14.638227  5448 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:16:14.644927  5371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:33046
I20260709 13:16:14.645678  5447 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:14.637140  5449 raft_consensus.cc:2376] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5. Re-sending same reply.
I20260709 13:16:14.662987  5371 raft_consensus.cc:606] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:14.663528  5371 raft_consensus.cc:614] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:14.638031  7088 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.637072  6897 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:14.672323  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:14.639278  6791 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.007s	sys 0.007s
I20260709 13:16:14.674657  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:14.676102  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:14.679136  5522 raft_consensus.cc:2368] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:14.680269  5448 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:14.681568  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.682077  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.688709  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 177265us
W20260709 13:16:14.689996  6042 leader_election.cc:336] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.978s (SENT)
I20260709 13:16:14.864125  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:14.865768  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:14.866791  5522 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:14.885059  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 195095us
I20260709 13:16:14.898496  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:14.898936  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.899232  5519 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:14.899350  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.899731  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.900027  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.900193  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:14.679653  6791 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.007s
I20260709 13:16:14.889801  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:14.906127  5522 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:14.907714  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:14.908641  5522 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:14.679672  7088 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:14.910357  7103 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.910845  7103 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:14.912787  7088 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:14.914278  7170 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.356s	user 0.000s	sys 0.000s
I20260709 13:16:14.904258  7076 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:16:14.917922  7167 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 13:16:14.918123  7076 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:14.903957  7148 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:14.922026  7148 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:14.922832  7079 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.923400  7079 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:14.924983  7148 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:14.926937  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:14.909911  7093 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:14.942755  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.944293  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:14.691532  7146 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:14.921190  7076 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:14.994956  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:14.995954  5523 raft_consensus.cc:2410] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:16:14.925315  7079 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:14.984218  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.984258  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:15.002902  5524 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:14.926532  7176 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.926327  7174 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:14.918040  7147 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:15.021026  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 122) took 2528 ms. Trace:
I20260709 13:16:15.027313  5372 rpcz_store.cc:276] 0709 13:16:12.492840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.493884 (+  1044us) service_pool.cc:224] Handling call
0709 13:16:12.517843 (+ 23959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.891051 (+373208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.020755 (+2129704us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54001856d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:15.020941 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768014720}
I20260709 13:16:15.039588  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:15.040242  5523 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:15.026037  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.971693  7093 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.072343  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.075078  5519 raft_consensus.cc:2410] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:15.112342  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 940) took 1879 ms. Trace:
I20260709 13:16:15.112923  5375 rpcz_store.cc:276] 0709 13:16:13.233190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.233326 (+   136us) service_pool.cc:224] Handling call
0709 13:16:13.240732 (+  7406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.612096 (+371364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.111981 (+1499885us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400331154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:15.112257 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850081536}
I20260709 13:16:15.111523  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.116218  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.028694  7147 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:14.928123  7144 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:15.121140  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.012s	sys 0.031s
W20260709 13:16:15.128765  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.012s	sys 0.031s
W20260709 13:16:15.129477  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 583430us
I20260709 13:16:15.130687  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:15.119560  6972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.293s	user 0.034s	sys 0.048s
W20260709 13:16:15.134106  6972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.326s	user 0.036s	sys 0.048s
I20260709 13:16:15.138243  5416 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:15.139024  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.140224  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:15.120251  7084 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:15.142026  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.146584  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.126914  7103 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.038344  7174 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:15.029762  7176 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.131529  7079 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.129172  7128 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:15.179207  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.177778  6973 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:15.144042  6791 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:15.219085  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.223555  5443 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.014s	sys 0.047s
I20260709 13:16:15.137451  6848 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:15.132007  7148 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.199842  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.201220  5444 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:15.143412  7084 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.142858  7146 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:15.145128  7152 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:15.180269  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:15.239821  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59619.3us
I20260709 13:16:15.179347  7088 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:15.186156  7186 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.160s	user 0.000s	sys 0.002s
I20260709 13:16:15.141490  7076 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:16:15.177584  7177 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:15.223928  5443 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.014s	sys 0.047s
I20260709 13:16:15.188167  7184 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:15.206045  7185 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:16:15.217092  7159 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.871s	user 0.006s	sys 0.006s
I20260709 13:16:15.191771  7103 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:15.199774  7128 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.203194  7079 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.240937  7084 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.241549  7152 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.239274  7146 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:15.244693  7184 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.245898  6867 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:15.257091  6696 consensus_meta.cc:287] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.819s	user 0.012s	sys 0.000s
I20260709 13:16:15.201704  7147 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.258968  7076 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.260308  7128 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.287940  7093 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.240073  7148 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:15.295311  7190 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:16:15.258467  6973 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 13:16:15.351328  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 235171us
I20260709 13:16:15.273964  7146 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:15.269752  7152 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.278041  6867 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.271974  7194 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.231242  6884 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:15.390818  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:15.391790  5441 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.259183  7159 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.277752  7184 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.395399  7159 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:15.396020  6867 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.361124  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.398895  6973 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.399377  6973 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:15.400215  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.400851  7200 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:15.369889  7197 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:16:15.401301  7200 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.370554  7072 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:15.401757  7200 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.402001  7072 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:15.403103  7072 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.404117  7072 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:15.375567  7189 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:16:15.377386  7199 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:16:15.405838  7159 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:15.376120  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:15.407016  5447 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.407316  6973 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.400859  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:15.410693  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:15.411180  7171 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.926s	user 0.003s	sys 0.013s
W20260709 13:16:15.411456  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.379487  7188 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:15.412623  7188 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:15.413058  7083 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.413179  7176 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.413527  7083 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:15.362608  7196 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:16:15.413987  7083 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.413843  7188 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:15.414832  7179 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:16:15.415421  7188 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.416254  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1141) took 1082 ms. Trace:
I20260709 13:16:15.416671  5446 rpcz_store.cc:276] 0709 13:16:14.333839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.355755 (+ 21916us) service_pool.cc:224] Handling call
0709 13:16:14.356421 (+   666us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:14.357041 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.357082 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:14.379423 (+ 22341us) log.cc:844] Serialized 520 byte log entry
0709 13:16:14.638058 (+258635us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:14.638099 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.638173 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.416008 (+777835us) raft_consensus.cc:1685] finished
0709 13:16:15.416027 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.416190 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"spinlock_wait_cycles":48775040,"thread_start_us":204315,"threads_started":1,"wal-append.queue_time_us":683361}
I20260709 13:16:15.417676  7076 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.418321  7076 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:15.418659  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:15.419081  7141 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.419597  7141 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.419850  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:15.420001  7141 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.420758  6696 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.420445  7152 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.420974  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:15.421694  5444 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:15.421267  6696 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.423743  6696 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:15.424576  7032 consensus_meta.cc:287] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.911s	user 0.015s	sys 0.000s
I20260709 13:16:15.425879  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.426918  5369 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:15.398442  7146 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.428725  7146 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:15.390902  5442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1115) took 2877 ms (client timeout 3089 ms). Trace:
I20260709 13:16:15.370230  5450 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:15.402071  5520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1046) took 1795 ms (client timeout 2228 ms). Trace:
I20260709 13:16:15.412104  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.362775  7147 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.429626  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1047) took 1822 ms. Trace:
I20260709 13:16:15.431547  5515 rpcz_store.cc:276] 0709 13:16:13.606719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.608124 (+  1405us) service_pool.cc:224] Handling call
0709 13:16:13.608462 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.378415 (+769953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.429345 (+1050930us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54002b98d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:15.429564 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724495104}
I20260709 13:16:15.380748  7174 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.379082  7079 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:15.430092  5520 rpcz_store.cc:269] 0709 13:16:13.606409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.630307 (+ 23898us) service_pool.cc:224] Handling call
0709 13:16:15.401879 (+1771572us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002db254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:15.402013 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332105600}
I20260709 13:16:15.430812  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.438985  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.431569  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:15.439868  5369 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:15.439644  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:15.389096  7073 consensus_meta.cc:287] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.000s
I20260709 13:16:15.450275  5447 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:15.457384  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.444043  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.460155  5367 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:16:15.457818  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.460933  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.461630  5368 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:15.437907  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 238133us
I20260709 13:16:15.452574  5369 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.461639  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:15.462719  5446 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:15.444307  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.462984  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.463672  5373 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:15.430636  7194 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.466018  5367 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:15.466488  5367 pending_rounds.cc:85] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:15.466861  5367 pending_rounds.cc:107] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:15.467209  5367 raft_consensus.cc:2889] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.467912  5374 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:15.467986  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.442267  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.469395  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:15.420445  7076 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:15.473254  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.473591  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.476879  5441 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:15.481796  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.461876  7159 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.513149  7159 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.514112  7159 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.460875  7183 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:15.519948  7183 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:15.431165  5442 rpcz_store.cc:269] 0709 13:16:12.513351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.514721 (+  1370us) service_pool.cc:224] Handling call
0709 13:16:15.383571 (+2868850us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b540019d554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:15.390805 (+  7234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152805120}
I20260709 13:16:15.471704  7079 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.476346  5447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "862a628beec44315b003538bc747056b"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
W20260709 13:16:15.490677  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.443473  7200 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.441690  7084 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.494081  6848 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.474861  7194 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.477553  7066 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:15.477689  7146 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.542111  7146 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.542614  7146 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.481061  7139 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.488926  7076 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:15.547151  7076 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.547667  7076 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:15.401326  7184 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.551697  7184 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:15.558228  7128 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.472970  6867 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.504498  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.471707  7176 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:15.509353  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.510033  7141 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.511761  7148 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.511950  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:15.528649  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46385.9us
I20260709 13:16:15.538506  7200 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:15.541524  7066 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.553134  7083 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.573203  5450 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:15.497534  7152 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.541026  7194 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.593152  5369 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:15.601064  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 345095us
I20260709 13:16:15.535214  7079 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.602623  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.610446  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:15.599850  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 403343us
W20260709 13:16:15.618091  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.548818  7076 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.626827  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.628286  5370 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:15.627583  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.661602  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.662707  5370 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
W20260709 13:16:15.663782  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.665469  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44248.8us
I20260709 13:16:15.618716  7066 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.670621  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.674237  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.674965  5369 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:15.626993  5374 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
W20260709 13:16:15.674149  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.622161  6791 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.671836  5450 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:15.680583  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.675027  5370 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:15.681460  7176 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.687880  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:15.689755  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.681618  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.686060  5374 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:15.712049  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.715840  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:15.669299  7073 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.718487  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1154) took 1275 ms. Trace:
I20260709 13:16:15.733354  5448 rpcz_store.cc:276] 0709 13:16:14.443315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.863511 (+420196us) service_pool.cc:224] Handling call
0709 13:16:14.863884 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.864103 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:15.217548 (+353445us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.717321 (+499773us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.718022 (+   701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:15.718083 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:15.718133 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.718264 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.718409 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37425,"prepare.queue_time_us":260727,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3696,"raft.queue_time_us":17875,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":9185,"thread_start_us":798343,"threads_started":3}
I20260709 13:16:15.738821  5367 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.741155  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.741735  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:15.742867  5370 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:15.735549  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:15.745399  5442 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:15.746111  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 272611us
I20260709 13:16:15.747717  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:15.745471  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1044) took 2174 ms. Trace:
I20260709 13:16:15.750957  5521 rpcz_store.cc:276] 0709 13:16:13.570558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.570727 (+   169us) service_pool.cc:224] Handling call
0709 13:16:13.721477 (+150750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.722267 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.745231 (+2022964us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540025d0d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:15.745378 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345462528}
I20260709 13:16:15.750097  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.758237  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:15.718308  5447 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:15.761373  5447 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.735061  7076 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.763299  5448 raft_consensus.cc:2376] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4. Re-sending same reply.
I20260709 13:16:15.738168  7139 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.682667  7194 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:16:15.746624  7141 raft_consensus.cc:2764] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:16:15.771073  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:15.717121  7148 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:15.776746  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.768026  5340 leader_election.cc:400] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:16:15.716979  7176 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:15.779852  5414 connection.cc:256] RPC call timeout handler was delayed by -2.2854315479999059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 13:16:15.772980  5447 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.687088  7079 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:16:15.782799  5448 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.638526  7183 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.768868  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:15.786669  5340 leader_election.cc:403] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:15.800864  5442 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:15.774029  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.801327  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:15.781387  7162 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:15.791988  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:15.806109  5450 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:15.741307  7073 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:15.785836  7032 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:16:15.785722  6848 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:15.818640  7205 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:16:15.818500  7214 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:15.798575  7152 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.825103  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:15.826807  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:15.827634  5442 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:15.828404  7128 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:15.832360  7128 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.832573  7176 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.832963  7128 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:15.834548  6883 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:15.808692  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.764858  7184 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:16:15.764364  7200 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:15.836721  7200 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.836503  7188 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:15.837203  7200 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.836531  7184 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:15.837875  7184 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:15.811342  7084 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:15.838737  7184 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.807955  6696 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Leader election lost for term 3. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:16:15.840117  7184 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.818848  6848 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.822144  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.820763  7141 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:15.841828  7141 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:15.842804  7141 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.845873  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1153) took 1402 ms. Trace:
I20260709 13:16:15.847143  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:15.846344  5449 rpcz_store.cc:276] 0709 13:16:14.443028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.656626 (+213598us) service_pool.cc:224] Handling call
0709 13:16:15.366546 (+709920us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5800018998. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:15.366776 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.367203 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.367235 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:15.367767 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:16:15.617411 (+249644us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:15.617478 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.617561 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.845569 (+228008us) raft_consensus.cc:1685] finished
0709 13:16:15.845588 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.845790 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6533,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":149,"spinlock_wait_cycles":34955648,"thread_start_us":249203,"threads_started":1,"wal-append.queue_time_us":410917}
I20260709 13:16:15.847596  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 82) took 2221 ms. Trace:
I20260709 13:16:15.848191  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:15.848620  5449 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:15.849288  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:15.850023  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.850697  6696 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:15.851148  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.851251  7079 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:15.851806  5371 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:15.802359  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.852785  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:15.853185  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50913.3us
I20260709 13:16:15.821877  7171 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.854576  5371 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:15.831211  5450 raft_consensus.cc:2410] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:15.815500  6867 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:15.858615  5450 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:15.731266  7203 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:16:15.848039  5518 rpcz_store.cc:276] 0709 13:16:13.626066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.662854 (+ 36788us) service_pool.cc:224] Handling call
0709 13:16:13.663460 (+   606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.673817 (+ 10357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.673843 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:15.371992 (+1698149us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4c0026b480. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2058a20 00007fc1d2069a29 00007fc1d202f644 00007fc1d2056f2d 00007fc1d2056b93 00007fc1d3d8718b 00007fc1d3d87cb5 00007fc1d3d89004 00007fc1d3d88729 00007fc1d3d8dd96 00007fc1d3d82adb
0709 13:16:15.372696 (+   704us) log.cc:844] Serialized 494 byte log entry
0709 13:16:15.764623 (+391927us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:15.764672 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.764749 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.847307 (+ 82558us) raft_consensus.cc:1685] finished
0709 13:16:15.847325 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.847529 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28095360,"thread_start_us":390908,"threads_started":1,"wal-append.queue_time_us":472846}
W20260709 13:16:15.859730  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.862257  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.864117  5448 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:15.847466  5368 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:15.870254  5370 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:15.875072  5449 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:15.877100  5371 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:15.882019  5521 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:15.880913  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:15.882705  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:15.883469  5518 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:15.885627  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.886229  5371 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.890746  5520 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:15.892582  5520 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:15.898082  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:15.897845  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 81854.9us
I20260709 13:16:15.902647  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:15.903373  5518 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:15.904278  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:15.904878  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:15.872385  6883 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.829818  7152 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.894246  6076 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:15.907760  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.924561  5368 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:15.911616  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:15.906603  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.884815  6579 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.914541  7224 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.918568  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:15.919003  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:15.919669  7079 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.874605  7217 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:15.930531  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1038) took 2456 ms. Trace:
I20260709 13:16:15.861325  7171 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:15.940551  5516 rpcz_store.cc:276] 0709 13:16:13.474040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.474226 (+   186us) service_pool.cc:224] Handling call
0709 13:16:13.493051 (+ 18825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.589074 (+ 96023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.930260 (+2341186us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b5400154354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:15.930465 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185954560}
W20260709 13:16:15.936661  5414 connection.cc:256] RPC call timeout handler was delayed by -1.8259429849999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2811s for a response
I20260709 13:16:15.943739  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.944705  5368 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:15.946424  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.948000  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.911651  7148 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:15.950866  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:15.955760  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:15.965875  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.967180  5368 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:15.971503  5490 connection.cc:256] RPC call timeout handler was delayed by -1.1265114680002171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:16:15.972343  5490 connection.cc:256] RPC call timeout handler was delayed by -1.1103114680001909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 13:16:15.941932  7072 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:15.943993  7084 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:15.972747  5490 connection.cc:256] RPC call timeout handler was delayed by -1.0905114680001589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 13:16:15.978655  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:15.980484  5490 connection.cc:256] RPC call timeout handler was delayed by -1.0824114680001458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:16:15.981096  5490 connection.cc:256] RPC call timeout handler was delayed by -1.0266114680000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:16:15.986047  5368 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:15.972024  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:15.988396  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.989275  5368 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:15.969214  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.991984  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.000101  5368 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:15.958268  7148 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.924441  6883 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:15.971935  6696 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.973802  6973 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:15.941187  7203 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:16:16.033389  7073 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.034543  5516 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:16.035472  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:16.030400  7147 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.004s
W20260709 13:16:16.040587  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48657.2us
W20260709 13:16:16.037447  5414 connection.cc:256] RPC call timeout handler was delayed by -1.5416927979999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:16:15.938144  6579 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:15.942274  7224 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.030077  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:15.972429  7217 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:16.050603  7213 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:16:16.051179  7216 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:16:16.051990  7219 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:16:16.053794  5414 connection.cc:256] RPC call timeout handler was delayed by -1.4826315479999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2779s for a response
I20260709 13:16:15.986874  6077 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:15.977823  7072 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.115094  7072 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.031004  6948 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.077593  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.120221  5448 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:16.121135  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.121376  7214 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.121799  5448 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:16.122234  7214 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.041865  7225 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.078986  5372 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:16.123471  7225 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.054201  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:16.126036  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 71913.9us
W20260709 13:16:16.084321  5414 connection.cc:256] RPC call timeout handler was delayed by -1.4772315479999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2785s for a response
W20260709 13:16:16.128263  5414 connection.cc:256] RPC call timeout handler was delayed by -1.4048927979999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:16:16.128659  5414 connection.cc:256] RPC call timeout handler was delayed by -1.3724927979999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:16:16.128932  5414 connection.cc:256] RPC call timeout handler was delayed by -1.3310927979998723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 13:16:16.129187  5414 connection.cc:256] RPC call timeout handler was delayed by -1.3103927979998389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:16:16.129765  5414 connection.cc:256] RPC call timeout handler was delayed by -1.3040927979998287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:16:16.130165  5414 connection.cc:256] RPC call timeout handler was delayed by -1.2824927979997938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:16:16.130586  5414 connection.cc:256] RPC call timeout handler was delayed by -1.1825927979998596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:16:16.130882  5414 connection.cc:256] RPC call timeout handler was delayed by -1.0628927979998934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 13:16:16.131153  7217 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.135842  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.057837  6696 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:16.136523  5441 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.136668  7183 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:16.131223  6897 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.137316  6696 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.138607  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1156) took 1694 ms. Trace:
I20260709 13:16:16.139008  5444 rpcz_store.cc:276] 0709 13:16:14.443841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.233454 (+789613us) service_pool.cc:224] Handling call
0709 13:16:15.246927 (+ 13473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.422078 (+175151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.138340 (+716262us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400239954. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:16.138540 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401292160}
I20260709 13:16:16.140192  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.140795  5444 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:16.043339  7144 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:16.140465  7146 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.003s
I20260709 13:16:16.143628  7146 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.137388  7230 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:16:16.088208  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.091905  6883 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:15.969144  7128 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.150022  7157 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:16.096771  7171 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.098091  7032 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.151242  7203 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:15.990190  7176 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:16:16.151852  7032 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:16.152415  7146 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.089555  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:16.104622  6884 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
I20260709 13:16:16.108022  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:16.114143  7083 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.114984  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.122746  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.122893  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:16.078267  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.180205  5448 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:16.124107  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 977) took 1198 ms. Trace:
I20260709 13:16:16.028369  7084 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:16.095633  7152 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.127197  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:16.184535  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57404.9us
I20260709 13:16:16.154904  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:16.184233  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 328164us
I20260709 13:16:16.156369  5375 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:16.103694  7224 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.046331  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1042) took 2568 ms. Trace:
I20260709 13:16:16.041529  7221 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:16.129788  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:16.154662  5442 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:16.160822  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.174234  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.211102  5367 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:16.178725  5522 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:16.181443  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.212299  5448 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:16.048868  6973 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.186398  5441 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 2.
I20260709 13:16:16.221403  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.187026  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.155479  5371 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:16.222658  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.223891  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:16.224318  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:16.158183  7159 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.003s
I20260709 13:16:16.189528  5516 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.152331  7203 consensus_queue.cc:1243] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:16.181268  5523 rpcz_store.cc:276] 0709 13:16:14.925868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.114798 (+188930us) service_pool.cc:224] Handling call
0709 13:16:15.403810 (+289012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.404283 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:15.404932 (+   649us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.747925 (+342993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:15.747991 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:15.748034 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.748097 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.123940 (+375843us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002db250. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:16.124052 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":906,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":597,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":8466,"spinlock_wait_cycles":663827200,"thread_start_us":341940,"threads_started":1,"wal-append.queue_time_us":426890}
I20260709 13:16:16.192245  7231 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.193872  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.170253  6883 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:16.200083  7225 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.201635  7032 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.213658  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.261366  5516 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:16.262326  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.147397  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:16.217409  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.228016  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:16.233985  5441 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:16.241107  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.249908  5444 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.250244  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.250463  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:16.267004  5373 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:16:16.267518  5367 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.138609  6897 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:16:16.151243  7139 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:16.252482  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.252637  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:16.252058  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 105560us
I20260709 13:16:16.193822  7183 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.258194  7128 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:16.255761  7231 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.254909  7072 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:16.256289  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69360.3us
I20260709 13:16:16.253218  7159 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.255278  7240 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:16:16.332929  5448 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:16.208863  5517 rpcz_store.cc:276] 0709 13:16:13.475318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.491351 (+ 16033us) service_pool.cc:224] Handling call
0709 13:16:13.537502 (+ 46151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.373706 (+836204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.987249 (+1613543us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54001536d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:16.043574 (+ 56325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381027200}
I20260709 13:16:16.255715  5521 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:16.269847  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.271651  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.336123  5371 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:16.271806  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.337512  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 102) took 1822 ms. Trace:
I20260709 13:16:16.337087  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.338761  5371 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:16.338127  5446 rpcz_store.cc:276] 0709 13:16:14.514996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.463491 (+948495us) service_pool.cc:224] Handling call
0709 13:16:15.463794 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.464469 (+   675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.464512 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:15.465062 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:16:15.780679 (+315617us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:15.804291 (+ 23612us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.804504 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.804581 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.337229 (+532648us) raft_consensus.cc:1685] finished
0709 13:16:16.337261 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.337401 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17576,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":6114,"raft.queue_time_us":30486,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":7890,"spinlock_wait_cycles":52222848,"thread_start_us":288054,"threads_started":1,"wal-append.queue_time_us":411065}
I20260709 13:16:16.272691  7183 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:16.278345  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.302587  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.344570  5516 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:16.302956  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.261888  6883 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.347932  6973 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.348719  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.275130  6967 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:16:16.348997  7231 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.350019  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:16.352118  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.321954  7200 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.353785  7240 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:16.350118  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:16.354516  7240 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:16.354723  5371 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.355755  7200 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.355605  7240 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.357020  7240 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.309731  6884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36782 (request call id 63) took 19375 ms. Trace:
I20260709 13:16:16.334888  7128 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:16.370189  7128 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.370950  7100 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.370015  6884 rpcz_store.cc:276] 0709 13:15:56.934181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.550336 (+1616155us) service_pool.cc:224] Handling call
0709 13:15:59.147643 (+597307us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b58002846d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3ce80aa 00007fc1d3d6a447 00007fc1d3d8770a 00007fc1d3d8876a 00007fc1d3d8791b 00007fc1d3d9303c 00007fc1d3d926b3 00007fc1d3d8a9fa 00007fc1d8d524c9 00007fc1d22cec54
0709 13:15:59.217174 (+ 69531us) log.cc:844] Serialized 494 byte log entry
0709 13:16:16.309617 (+17092443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22247,"raft.queue_time_us":46667,"raft.run_cpu_time_us":1232,"raft.run_wall_time_us":1234,"spinlock_wait_cycles":303046144,"thread_start_us":137799,"threads_started":1,"wal-append.queue_time_us":284252,"wal-append.run_cpu_time_us":2907,"wal-append.run_wall_time_us":1068095}
I20260709 13:16:16.314157  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:16.315843  7214 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.253720  7224 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.276178  5442 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:16.334268  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.334543  5444 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
W20260709 13:16:16.256194  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 119228us
I20260709 13:16:16.252919  7148 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.273371  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.345991  5450 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.269073  7225 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:16.357435  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85707.7us
I20260709 13:16:16.374553  5367 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:16.382951  5441 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:16.346570  7183 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.353848  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.386272  5516 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
W20260709 13:16:16.386751  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52621.9us
I20260709 13:16:16.360734  7159 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.308518  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.374231  7224 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:16.390671  7224 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.391219  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.392586  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.363034  7162 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:16.364868  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.349094  6883 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:16.364089  7184 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.008s
I20260709 13:16:16.373925  5373 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:16.383663  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.396227  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.385043  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:16.396924  5524 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:16.397063  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.398284  5414 leader_election.cc:400] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:16.398064  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.378778  5371 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:16.384457  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 193860us
I20260709 13:16:16.393456  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.393191  5523 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:16.396793  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:16.385803  7066 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.004s
I20260709 13:16:16.398495  5414 leader_election.cc:403] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:16.357265  6973 raft_consensus.cc:2764] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:16.384182  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:16.400735  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.384014  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.399313  5516 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.396818  5442 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.399566  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.408681  5441 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.407310  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.383376  7225 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:16.408766  5373 raft_consensus.cc:2410] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:16.393679  7217 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.415506  5373 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:16.417995  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:16.400323  7152 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.415870  5367 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:16.419850  5367 pending_rounds.cc:85] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:16.420140  5367 pending_rounds.cc:107] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:16.400061  6043 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:16.420605  5367 raft_consensus.cc:2889] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.420871  5523 raft_consensus.cc:2368] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:16.394788  7162 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:16.418130  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 152399us
I20260709 13:16:16.414289  7225 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.413626  5450 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:16.420073  5373 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:16.423516  5441 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:16.421906  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.421813  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.422322  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.414340  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.403167  7231 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:16.426236  5371 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:16.426731  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.436715  5367 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:16.435936  5371 pending_rounds.cc:85] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:16.437242  5367 pending_rounds.cc:85] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:16.437608  5371 pending_rounds.cc:107] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:16.437686  5367 pending_rounds.cc:107] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:16.434976  5524 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:16.428205  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.438441  5367 raft_consensus.cc:2889] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.419346  6883 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:16.441880  7231 raft_consensus.cc:2764] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:16.442797  7231 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:16.448570  5367 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:16.437929  5371 raft_consensus.cc:2889] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.409731  6579 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.434124  5523 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:16.451087  5442 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:16.431254  5373 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:16.451916  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.452741  5523 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:16.453262  5367 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:16.456287  5523 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:16.461699  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.438731  7143 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.415091  7066 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.464813  5371 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:16.467274  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.466668  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.468479  5524 raft_consensus.cc:1813] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.468549  7041 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.469334  5524 raft_consensus.cc:2410] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:16:16.470001  7200 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:16.471084  5442 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:16.472270  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.472805  5442 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.438078  6973 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:16.466982  7143 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:16.478920  7143 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.483841  5442 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:16.484834  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.485394  5442 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.491663  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 950) took 1061 ms. Trace:
I20260709 13:16:16.492195  5372 rpcz_store.cc:276] 0709 13:16:15.429909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.431788 (+  1879us) service_pool.cc:224] Handling call
0709 13:16:16.491438 (+1059650us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54001c70d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:16.491562 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422849280}
I20260709 13:16:16.494378  5366 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:16.499150  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.500135  5446 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:16.501586  5442 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:16.503140  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.508154  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.509650  5442 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.519761  5442 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:16.520910  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.466423  7194 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.524689  5516 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:16.501351  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.530228  5517 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:16.531436  5446 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:16.533883  5446 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:16.541003  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 147637us
I20260709 13:16:16.539275  7144 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.562234  7144 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.564630  7144 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.558830  6791 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.566206  6791 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.569029  6791 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.558904  7194 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:16.572547  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 147229us
I20260709 13:16:16.576818  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.578667  7250 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:16.587515  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 187513us
I20260709 13:16:16.572682  6884 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.578039  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.593256  6884 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.593786  6884 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.594117  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.594461  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.595088  5372 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:16:16.595744  7211 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.595933  7073 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.596195  7211 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.596369  7073 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.596616  7211 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.596747  7073 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.593705  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.542786  7245 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.600353  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:16.606024  5446 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:16.560695  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:16.611281  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 189543us
I20260709 13:16:16.612627  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:16.613704  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53105.5us
I20260709 13:16:16.581378  7066 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.585371  7079 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:16.626801  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 956) took 2232 ms. Trace:
I20260709 13:16:16.614586  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.615993  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.634689  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.635931  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.604174  7200 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:16.602452  6973 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:16.613884  7171 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.632247  5446 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:16.619810  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.631362  5443 rpcz_store.cc:276] 0709 13:16:14.394579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.394991 (+   412us) service_pool.cc:224] Handling call
0709 13:16:14.395512 (+   521us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:14.396070 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.396112 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:14.446382 (+ 50270us) log.cc:844] Serialized 52 byte log entry
0709 13:16:14.642105 (+195723us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:15.242606 (+600501us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.259478 (+ 16872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.259554 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.622407 (+1362853us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b24002bf958. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0b259c4 00007fc1d0b23acb 00007fc1d0cdedc9 00007fc1d0cdea55 00007fc1d0cddfb0 00007fc1d3954488 00007fc1d3954be8 00007fc1d392c398 00007fc1d392776a 00007fc1d3926bb6
0709 13:16:16.626386 (+  3979us) raft_consensus.cc:1685] finished
0709 13:16:16.626501 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.626709 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15228,"prepare.queue_time_us":384441,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":15806,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":42610,"spinlock_wait_cycles":10619648,"thread_start_us":731823,"threads_started":2,"wal-append.queue_time_us":559567}
I20260709 13:16:16.625514  7140 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.649932  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:16.620880  7250 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:16.646039  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.630676  7079 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:16.639133  6848 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.637921  7032 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.647102  5443 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:16.626909  7225 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.641887  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.637149  7159 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.639284  7137 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.657729  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:16.659560  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 65439.8us
I20260709 13:16:16.642910  7171 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.673202  5518 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:16.673605  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:16.675601  7193 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.311s	user 0.000s	sys 0.004s
I20260709 13:16:16.676159  5372 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:16.676573  5372 pending_rounds.cc:85] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 2
I20260709 13:16:16.676796  5372 pending_rounds.cc:107] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:16.677038  5372 raft_consensus.cc:2889] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.677729  7140 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.678185  7171 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.670962  5446 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.684346  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.686334  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.687580  5373 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:16.687907  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.693593  5443 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:16.699705  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.703801  5490 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:16.705255  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.705961  5449 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:16.609627  7245 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:16.709748  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.651793  7252 raft_consensus.cc:2764] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:16.710649  5367 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:16.656663  7214 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.624516  7224 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.661599  6848 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:16.715873  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:16.719998  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 70189us
I20260709 13:16:16.717133  5490 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:16.719847  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 954) took 2355 ms. Trace:
I20260709 13:16:16.724503  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:16.717298  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.727407  5371 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 2: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:16.716154  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.728098  5367 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:16.672334  7249 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:16.709353  7137 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.733026  5446 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:16.724598  5445 rpcz_store.cc:276] 0709 13:16:14.364239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.372410 (+  8171us) service_pool.cc:224] Handling call
0709 13:16:14.372826 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.374252 (+  1426us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:14.625645 (+251393us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.123178 (+497533us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:15.130604 (+  7426us) log.cc:844] Serialized 26 byte log entry
0709 13:16:15.130750 (+   146us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:15.130938 (+   188us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.137987 (+  7049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.138070 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.675311 (+1537241us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b24002bf8c8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0b259c4 00007fc1d0b23acb 00007fc1d0cdedc9 00007fc1d0cdea55 00007fc1d0cde09d 00007fc1d391010e 00007fc1d392788c 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221
0709 13:16:16.719585 (+ 44274us) raft_consensus.cc:1685] finished
0709 13:16:16.719617 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.719775 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728,"prepare.queue_time_us":533259,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":3554,"raft.queue_time_us":11303,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":32426,"spinlock_wait_cycles":40204672,"thread_start_us":642945,"threads_started":2,"wal-append.queue_time_us":594957}
I20260709 13:16:16.717986  7152 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.734917  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.720763  7218 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:16.730013  6848 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.714948  6897 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:16.739714  5446 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:16.737700  5445 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:16.730269  6973 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:16.718829  7250 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.736384  7214 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:16.757663  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:16.758781  5368 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:16.719769  7162 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:16.742786  7218 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:16.734586  7143 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.719358  7200 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.774760  7218 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.757226  6883 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:16.735023  7249 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:16.747081  6579 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:16.754904  6897 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:16.807142  6897 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.811842  6884 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.761111  7140 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:16:16.814206  5441 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:16.816656  7143 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.780694  7066 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:16:16.823268  7255 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:16.831048  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1214) took 1072 ms. Trace:
I20260709 13:16:16.831621  5375 rpcz_store.cc:276] 0709 13:16:15.762157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.786731 (+ 24574us) service_pool.cc:224] Handling call
0709 13:16:16.830770 (+1044039us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400051ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:16.830965 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735588096}
W20260709 13:16:16.834770  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.835263  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.836578  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.767767  7254 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.798327  6883 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:16.803340  7079 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:16.805804  7251 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:16.838049  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1207) took 1269 ms. Trace:
W20260709 13:16:16.840873  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.748843  7128 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:16.759384  7137 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:16.866142  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.846799  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.860446  5366 rpcz_store.cc:276] 0709 13:16:15.568265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.807328 (+239063us) service_pool.cc:224] Handling call
0709 13:16:16.494042 (+686714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.494771 (+   729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.837832 (+343061us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54001c70d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:16.837969 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1537085824}
I20260709 13:16:16.868944  5340 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.870883  5520 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:16.872500  5516 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:16.878934  5258 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fd246431fed24a99b47e2ccdf988b1ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:16.877457  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:16.864255  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.814268  6884 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.847533  7203 raft_consensus.cc:2764] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:16.888331  5516 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:16.847400  6883 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:16.905224  7265 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:16.905839  6883 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.907126  6883 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.908577  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.909410  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.867544  6973 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.910303  7265 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.910036  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.910704  7265 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.911131  7265 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.860389  7252 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.901611  7257 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.901731  7227 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:16.903831  7203 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:16.929571  7257 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:16.894134  7079 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.882917  7041 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:16:16.932693  7257 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:16.933677  6791 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.934162  6791 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:16.934576  6791 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.932693  7041 consensus_queue.cc:1243] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:16.912205  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.883692  7146 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.935853  7146 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.936363  7146 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.870417  7159 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.937629  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.913775  7224 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.939534  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.940230  5442 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 3.
I20260709 13:16:16.940853  7249 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:16.942435  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:16.942974  7128 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:16.920358  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:16.934396  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:16.865579  7144 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:16:16.955097  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:16.955525  7144 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:16.956182  7144 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:16.914435  7211 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.959452  7211 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.960896  7141 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:16.961316  7141 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:16.949815  7076 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:16.961975  7076 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:16.963371  7076 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.964704  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.965797  7217 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:16.966364  7217 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:16.967235  7217 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.969012  7217 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.925971  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.881920  7214 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:16.947311  5519 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.946394  5520 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:16.938402  5448 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:16.953212  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 203154us
I20260709 13:16:16.954162  7245 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:16.956264  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:16.980209  5524 raft_consensus.cc:606] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:16.927318  5449 raft_consensus.cc:2955] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:16.980930  7162 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:16.962314  7141 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.978048  7140 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:16.983261  7140 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:16.984223  7140 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:16.985262  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.986413  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:16.987407  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.988620  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.972136  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:16.990097  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 265678us
I20260709 13:16:16.991683  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.941287  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:16.989146  5446 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:16.992545  5442 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:16:16.991573  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.972204  5441 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:16.994495  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:16.995393  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:17.019364  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.964756  7076 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.021844  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.989260  7225 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:16.946869  7171 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:17.031535  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:16.996575  7141 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.028239  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:17.037076  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:17.032513  7128 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:17.028211  7249 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:17.028781  7224 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.039239  7266 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:16:17.054116  7266 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:17.033615  7257 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:17.040652  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:17.042367  5520 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.036808  7254 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:17.021130  7245 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:17.117053  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.016013  7162 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:17.075096  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:17.020910  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 90285.6us
I20260709 13:16:17.022557  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:17.027853  7159 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.029052  6884 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:17.158183  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 289300us
W20260709 13:16:17.165481  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 90467.9us
I20260709 13:16:17.169550  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:17.027685  7263 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:17.040181  7152 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:17.145609  7079 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.183640  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:17.033075  7137 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.138s
I20260709 13:16:17.033349  7237 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.137s
I20260709 13:16:17.062439  7256 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:17.192934  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:17.039206  7143 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 13:16:17.202028  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:17.205013  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:17.024045  7144 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:17.206983  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 182111us
I20260709 13:16:17.209636  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:17.212322  5448 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:17.178064  7240 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.179243  7159 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.176795  7162 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:17.129601  7073 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:17.060698  6791 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:17.182547  7152 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:17.190227  7203 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:17.213871  7183 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.817s	user 0.013s	sys 0.000s
I20260709 13:16:17.213986  6071 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:17.197710  6884 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:17.061034  7214 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.225009  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:17.199841  7041 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:17.190266  7263 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:17.229691  5450 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:17.214425  7257 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:17.217170  7159 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:17.227007  7206 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:16:17.242548  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 376473us
I20260709 13:16:17.200901  7079 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.237800  5523 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:17.224746  7152 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:17.250317  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:17.225809  7203 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:17.256242  5448 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:17.257238  5450 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:17.258628  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 233890us
I20260709 13:16:17.236584  7144 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.238690  7041 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.238240  7270 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:17.238459  7128 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:17.263129  7275 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.278206  7275 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.278640  7275 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.280786  7148 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.281680  7263 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.269021  6070 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:17.232501  7183 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.263753  7278 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:16:17.269407  7041 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.261889  7203 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.262344  7254 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.276196  6791 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:17.268808  7143 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:16:17.261664  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:17.308241  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46646.8us
I20260709 13:16:17.285087  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:17.299283  5490 connection.cc:256] RPC call timeout handler was delayed by -1.2810136910002257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2763s for a response
W20260709 13:16:17.306085  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.234673  7162 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.257267  7257 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:17.316802  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66544.6us
I20260709 13:16:17.317487  5515 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:17.292722  7148 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.319410  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:17.322785  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:17.307471  7270 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:17.324877  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 119989us
I20260709 13:16:17.315514  7277 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:17.325495  6076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59508 (request call id 67) took 1460 ms. Trace:
I20260709 13:16:17.289984  7146 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.317678  7171 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:17.337291  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:17.320513  7148 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.322341  7032 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:17.339666  6076 rpcz_store.cc:276] 0709 13:16:15.861701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.872268 (+ 10567us) service_pool.cc:224] Handling call
0709 13:16:15.893815 (+ 21547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.894088 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:15.965027 (+ 70939us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.579978 (+614951us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b18001f8fa0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c6d2a6 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219
0709 13:16:16.582533 (+  2555us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b18001f8fa0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d7c6058f 00007fc1d0c9f571 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd
0709 13:16:16.839864 (+257331us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b18001f8fa0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:16:17.273650 (+433786us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18001f8fa0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:16:17.321199 (+ 47549us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.321408 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.321484 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:17.321528 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.321609 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.321734 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4151,"prepare.queue_time_us":1055272,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":5436,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":31982,"spinlock_wait_cycles":47282944,"thread_start_us":286863,"threads_started":2,"wal-append.queue_time_us":286191}
I20260709 13:16:17.322527  6791 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.337812  7256 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.349088  7280 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:17.321812  7214 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:16:17.302794  6884 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.314217  7254 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.349922  7148 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.370615  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:17.368731  7285 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:17.373734  7285 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:17.374248  7285 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.380053  5339 leader_election.cc:400] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:17.344724  6883 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:17.349833  7217 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:17.397866  7268 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.370855  6791 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:17.347091  7128 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.381732  7073 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:17.448733  7286 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:16:17.445695  7289 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:17.450207  7276 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:16:17.458762  7079 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.451659  7257 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:17.451486  7275 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.464449  7159 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.465709  7275 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.454028  7254 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.441937  7268 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.466708  7159 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:17.468317  7268 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:17.444605  6848 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.000s
I20260709 13:16:17.445842  7245 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.469153  7245 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.361896  7256 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.469027  6848 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.474850  7256 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.475304  6848 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:17.475711  7245 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.468703  7041 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.478859  7041 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.373104  7283 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:16:17.440464  6791 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:17.480050  7041 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.480474  7041 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:17.481278  7041 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.480492  6791 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.482570  7041 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.384320  7143 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 13:16:17.487972  7273 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:16:17.492664  7183 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:17.494009  7146 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.382170  7280 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:16:17.506665  7277 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:17.534449  7265 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.623s	user 0.014s	sys 0.001s
I20260709 13:16:17.446486  7270 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.580046  7277 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:17.578905  7218 consensus_meta.cc:287] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.001s
I20260709 13:16:17.533640  7203 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:17.586695  7152 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.556927  7227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51142 (request call id 2) took 5666 ms. Trace:
I20260709 13:16:17.549170  7265 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.599237  7152 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.588377  7084 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:17.591919  7218 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:17.607857  7218 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:17.609393  7265 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.647420  7285 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:17.651005  7141 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.001s
I20260709 13:16:17.652629  7203 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:17.593406  7227 rpcz_store.cc:276] 0709 13:16:11.884311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.884503 (+   192us) service_pool.cc:224] Handling call
0709 13:16:11.982504 (+ 98001us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b5800430dd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3ce80aa 00007fc1d3d6a447 00007fc1d3d8770a 00007fc1d3d8876a 00007fc1d3d8791b 00007fc1d3d9303c 00007fc1d3d926b3 00007fc1d3d8a9fa 00007fc1d8d524c9 00007fc1d22cec54
0709 13:16:12.006357 (+ 23853us) log.cc:844] Serialized 494 byte log entry
0709 13:16:13.395312 (+1388955us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400315ea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d01dbe 00007fc1d3d0c930 00007fc1d3d0c8d8 00007fc1d3d0c858 00007fc1d3d0c813 00007fc1d3d0ba9c 00007fc1d9bf7626 00007fc1d9bf1dd8 00007fc1d3d487cb 00007fc1d3d4b2c0
0709 13:16:17.550966 (+4155654us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2594,"raft.run_cpu_time_us":1285,"raft.run_wall_time_us":120684,"spinlock_wait_cycles":256550144,"thread_start_us":498951,"threads_started":1,"wal-append.queue_time_us":705109,"wal-append.run_cpu_time_us":16393,"wal-append.run_wall_time_us":1690525}
I20260709 13:16:17.671566  7148 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:17.672350  7304 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:16:17.675364  7285 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.678712  7148 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.679171  6791 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.682749  6791 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:17.737811  7243 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.393s	user 0.000s	sys 0.005s
W20260709 13:16:17.753887  7238 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.502s	user 0.002s	sys 0.004s
I20260709 13:16:17.845964  7072 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.870596  7194 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.874379  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1179) took 1698 ms. Trace:
I20260709 13:16:17.874897  5443 rpcz_store.cc:276] 0709 13:16:16.176319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.697614 (+521295us) service_pool.cc:224] Handling call
0709 13:16:16.697933 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.889531 (+191598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.889562 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.918905 (+ 29343us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.178832 (+259927us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:17.178870 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.178939 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.874065 (+695126us) raft_consensus.cc:1685] finished
0709 13:16:17.874089 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.874303 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6814,"raft.queue_time_us":42244,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3206,"thread_start_us":415336,"threads_started":2,"wal-append.queue_time_us":269487}
I20260709 13:16:17.877743  5443 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:17.879189  5443 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:17.880460  5443 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:17.881731  5443 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.883543  5443 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:17.886786  5447 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.887352  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58818 (request call id 1159) took 2514 ms. Trace:
I20260709 13:16:17.887904  5447 rpcz_store.cc:276] 0709 13:16:15.373051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.469398 (+ 96347us) service_pool.cc:224] Handling call
0709 13:16:17.885907 (+2416509us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540019bc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d83a3d 00007fc1d8d53cd0 00007fc1d22d8254 00007fc1d22d81e2 00007fc1d22d8111 00007fc1d22d808c 00007fc1d22d7342 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:17.887252 (+  1345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450697600}
I20260709 13:16:17.893647  6897 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:17.894182  6897 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:17.895071  6897 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.898125  7184 raft_consensus.cc:993] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:17.898664  7237 raft_consensus.cc:1081] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:17.900322  7261 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.901526  7261 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:17.902114  5520 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:17.902518  7261 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.903740  7261 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:17.915190  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.915740  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.925992  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1075) took 1608 ms. Trace:
I20260709 13:16:17.926440  5517 rpcz_store.cc:276] 0709 13:16:16.317297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.463127 (+145830us) service_pool.cc:224] Handling call
0709 13:16:16.463526 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.530710 (+ 67184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.925765 (+1395055us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b540016cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:17.925928 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152889088}
I20260709 13:16:17.380626  5339 leader_election.cc:403] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:17.945348  7194 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:17.945546  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 566611us
I20260709 13:16:17.948645  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1182) took 1771 ms. Trace:
I20260709 13:16:17.949117  5449 rpcz_store.cc:276] 0709 13:16:16.177326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.716088 (+538762us) service_pool.cc:224] Handling call
0709 13:16:16.716362 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.927155 (+210793us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:17.012270 (+ 85115us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.305859 (+293589us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.306050 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.306097 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:17.306137 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.481764 (+175627us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:16:17.933022 (+451258us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003bc254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:17.933099 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.948558 (+ 15459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19043,"prepare.queue_time_us":118525,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":19380,"raft.run_cpu_time_us":3090,"raft.run_wall_time_us":187360,"spinlock_wait_cycles":495308928,"thread_start_us":246373,"threads_started":2,"wal-append.queue_time_us":254089}
I20260709 13:16:17.952769  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:17.954160  7137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.001s	sys 0.002s
W20260709 13:16:17.954545  7137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.001s	sys 0.002s
I20260709 13:16:17.955662  7072 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.959642  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1201) took 2393 ms. Trace:
I20260709 13:16:17.960086  5370 rpcz_store.cc:276] 0709 13:16:15.566031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.759582 (+193551us) service_pool.cc:224] Handling call
0709 13:16:15.870082 (+110500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.870667 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.959409 (+2088742us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b54001e9450. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:17.959571 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218556288}
I20260709 13:16:17.965371  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:17.967283  6791 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.967756  6791 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.968114  6791 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.977666  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:17.981262  7194 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:17.981679  7072 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.987263  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:17.985812  7148 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:17.990095  7285 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:17.992209  7261 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.992807  7261 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:17.995052  7261 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:17.999851  5444 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:18.002749  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.005189  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.006580  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.007702  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.009075  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.009596  5520 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.015666  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1054) took 1853 ms. Trace:
I20260709 13:16:18.016166  5521 rpcz_store.cc:276] 0709 13:16:16.162367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.163343 (+   976us) service_pool.cc:224] Handling call
0709 13:16:16.163793 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.335714 (+171921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.015139 (+1679425us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b54002dad54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:18.015573 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210911104}
I20260709 13:16:18.016837  5520 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:18.022015  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.022828  5520 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:18.023150  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.023582  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:18.032838  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1059) took 1837 ms (client timeout 2104 ms). Trace:
W20260709 13:16:18.033346  5515 rpcz_store.cc:269] 0709 13:16:16.195435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.221106 (+ 25671us) service_pool.cc:224] Handling call
0709 13:16:18.032582 (+1811476us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002b9654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:18.032763 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518071680}
I20260709 13:16:18.047632  5517 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:18.045809  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.050925  5521 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.036885  7250 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.048841  7072 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:18.035650  7294 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:18.046873  7309 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:18.049067  7285 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:18.047206  7261 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.046658  7148 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:16:18.036756  7174 consensus_queue.cc:1059] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:16:18.036616  7032 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:16:18.064716  7073 raft_consensus.cc:3055] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:18.065124  7073 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:18.058923  7285 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.069227  7270 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.069696  7270 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:18.072417  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.059773  7294 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.073781  7073 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:18.074985  7073 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.075507  7294 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:18.059795  7072 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.077948  7072 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.059317  7250 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:18.080987  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.081911  7270 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.071094  6791 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.083259  7270 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.084519  6791 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.061071  7309 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:18.087088  5450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.012s	sys 0.032s
W20260709 13:16:18.087464  5450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.012s	sys 0.032s
I20260709 13:16:18.080786  7250 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.089389  7309 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:18.089936  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 105) took 1191 ms. Trace:
W20260709 13:16:18.092228  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 989) took 2199 ms (client timeout 1761 ms). Trace:
I20260709 13:16:18.097941  5450 rpcz_store.cc:276] 0709 13:16:16.898290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.258093 (+359803us) service_pool.cc:224] Handling call
0709 13:16:17.258575 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.333730 (+ 75155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.333762 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.335019 (+  1257us) log.cc:844] Serialized 494 byte log entry
0709 13:16:18.087800 (+752781us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:18.087841 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.089528 (+  1687us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b54003223d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:18.089572 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.089626 (+    54us) raft_consensus.cc:1685] finished
0709 13:16:18.089638 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.089875 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171723136,"thread_start_us":729485,"threads_started":1,"wal-append.queue_time_us":228173}
I20260709 13:16:18.100035  5259 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 23048b90f57d48a4be8be78bc78d9204 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
W20260709 13:16:18.100131  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.101152  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.102015  5446 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:18.098438  5518 rpcz_store.cc:269] 0709 13:16:15.892976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.904092 (+ 11116us) service_pool.cc:224] Handling call
0709 13:16:18.091983 (+2187891us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540016c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:18.092121 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097319296}
I20260709 13:16:18.097787  6042 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:18.103706  7032 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:18.104105  7032 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.104420  7032 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.111522  5446 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
I20260709 13:16:18.062816  7261 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.113385  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.116695  5442 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.115098  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:18.118162  5339 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:18.120055  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.121133  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.121408  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.122103  5517 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:18.122083  5518 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:18.123171  7194 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.115942  7041 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:18.143198  7285 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:16:18.123585  7203 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:18.142566  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:18.137324  7072 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:18.155306  5442 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:16:18.156494  7227 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:18.164441  7227 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:18.165459  7227 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:18.166242  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51198.9us
I20260709 13:16:18.166965  6042 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:18.153784  7194 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.154474  7041 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.160557  7250 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:18.163843  5521 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:18.155965  7203 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.176659  7041 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.179639  7203 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.170459  7261 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.181103  7250 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:18.198582  5489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.021s	sys 0.036s
W20260709 13:16:18.250563  5489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.022s	sys 0.037s
W20260709 13:16:18.250902  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 907847us
I20260709 13:16:18.201531  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1189) took 1742 ms. Trace:
I20260709 13:16:18.251808  7309 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:18.199435  5519 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:18.252498  5445 rpcz_store.cc:276] 0709 13:16:16.459092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.754155 (+295063us) service_pool.cc:224] Handling call
0709 13:16:16.754475 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.767863 (+ 13388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.767893 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.780552 (+ 12659us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.200872 (+1420320us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b18003d8d60. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1
0709 13:16:18.201024 (+   152us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:18.201062 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.201130 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.201172 (+    42us) raft_consensus.cc:1685] finished
0709 13:16:18.201183 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.201414 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8247,"raft.queue_time_us":29647,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":65082,"spinlock_wait_cycles":3466496,"thread_start_us":68764,"threads_started":1,"wal-append.queue_time_us":102932,"wal-append.run_cpu_time_us":1697,"wal-append.run_wall_time_us":1001730}
I20260709 13:16:18.253961  7309 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:18.254348  7309 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:18.219029  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52133.4us
W20260709 13:16:18.223927  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.213261  5270 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 2 to 5, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 5 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.260881  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.262140  7294 raft_consensus.cc:993] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:18.262619  7294 raft_consensus.cc:1081] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:18.262935  7309 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.264019  7309 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.241853  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.184212  7312 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:18.240293  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.273198  7312 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:18.245822  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 983) took 2363 ms. Trace:
W20260709 13:16:18.273407  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.277765  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:18.274396  7312 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:18.274662  5522 rpcz_store.cc:276] 0709 13:16:15.882015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.882171 (+   156us) service_pool.cc:224] Handling call
0709 13:16:15.900817 (+ 18646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.211770 (+310953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.245553 (+2033783us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540016d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:18.245759 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620353280}
I20260709 13:16:18.282686  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.283021  7041 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:18.283532  5447 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.283749  7041 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.277350  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:18.287024  7041 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.290807  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.291498  5370 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.292234  7313 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:18.292742  7313 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.275296  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:16:18.296617  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.299721  7203 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.300482  7203 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:18.244155  5448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.001s	sys 0.013s
W20260709 13:16:18.311281  5448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.002s	sys 0.014s
I20260709 13:16:18.311997  5448 raft_consensus.cc:2955] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:18.187474  6070 raft_consensus.cc:2410] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:16:18.314953  7174 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.315721  7174 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:18.238371  6071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59492 (request call id 73) took 1304 ms. Trace:
I20260709 13:16:18.316712  6071 rpcz_store.cc:276] 0709 13:16:16.933815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.934024 (+   209us) service_pool.cc:224] Handling call
0709 13:16:18.238095 (+1304071us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54005901d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:18.238299 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470604032}
I20260709 13:16:18.318934  7174 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:18.319365  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.192507  7032 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:18.319418  7285 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.324430  7285 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:18.326066  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.019s	sys 0.000s
W20260709 13:16:18.326609  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.019s	sys 0.000s
I20260709 13:16:18.327143  7285 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:18.327375  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.327731  7285 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.329625  7285 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.331856  7285 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.184686  7194 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.333964  5445 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:18.335067  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.335747  5522 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.314812  7313 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.335163  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1090) took 1459 ms. Trace:
I20260709 13:16:18.337347  5519 rpcz_store.cc:276] 0709 13:16:16.875728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.994566 (+118838us) service_pool.cc:224] Handling call
0709 13:16:17.024486 (+ 29920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.253912 (+1229426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.334878 (+ 80966us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001662d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:18.335095 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687629696}
I20260709 13:16:18.342144  7032 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.345853  5522 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:16:18.345942  5270 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 1 to 4, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 4 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.190650  7250 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.387724  5447 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:18.387084  5270 catalog_manager.cc:5697] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.389806  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1175) took 2214 ms. Trace:
I20260709 13:16:18.390281  5444 rpcz_store.cc:276] 0709 13:16:16.175118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.701951 (+526833us) service_pool.cc:224] Handling call
0709 13:16:16.942421 (+240470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.000391 (+1057970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.384914 (+384523us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540028c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:18.389601 (+  4687us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540028c150. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:18.389750 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2983243904}
I20260709 13:16:18.390081  5270 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 3 to 4, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 4 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.391471  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.391701  5270 catalog_manager.cc:5697] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 2 to 3, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.392732  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.349910  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.394562  5444 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:18.358536  5369 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:18.359764  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.395880  6791 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:18.396092  5366 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.396365  6791 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:18.397251  6791 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.396008  5444 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:18.398404  6791 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.398877  5444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:16:18.362089  7032 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:18.367743  7279 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:18.368541  7143 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.400930  7143 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.403136  7143 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:18.403332  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.216202  7146 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:18.406420  7146 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:18.407195  7146 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.408169  7146 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.362540  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1195) took 1877 ms. Trace:
I20260709 13:16:18.382333  7137 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.413899  7137 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:18.383635  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.009s	sys 0.006s
W20260709 13:16:18.418857  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.009s	sys 0.007s
W20260709 13:16:18.419236  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 1.05695e+06us
I20260709 13:16:18.323717  7203 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.394640  5445 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:18.397663  7250 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:18.399459  5444 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:18.399986  7032 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:18.376627  6897 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.430814  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:18.431628  6070 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:18.431979  7032 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.356338  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.433126  5367 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.433970  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:18.435499  7270 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.435925  7270 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.436300  7270 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.439220  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:18.432978  5369 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.413574  5441 rpcz_store.cc:276] 0709 13:16:16.485646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.815277 (+329631us) service_pool.cc:224] Handling call
0709 13:16:16.815575 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.993396 (+177821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.362219 (+1368823us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400239454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:18.362471 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359621888}
I20260709 13:16:18.441994  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:18.421217  5444 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.426774  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:18.443159  5371 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:18.443408  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:18.427917  5416 leader_election.cc:336] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.508s (SENT)
I20260709 13:16:18.444056  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:18.444682  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 107) took 1545 ms. Trace:
W20260709 13:16:18.183696  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54607.3us
I20260709 13:16:18.428620  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:18.445067  5448 rpcz_store.cc:276] 0709 13:16:16.898900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.272668 (+373768us) service_pool.cc:224] Handling call
0709 13:16:17.302248 (+ 29580us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:17.309889 (+  7641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.309937 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:17.324785 (+ 14848us) log.cc:844] Serialized 520 byte log entry
0709 13:16:18.311822 (+987037us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:18.425234 (+113412us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.444378 (+ 19144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.444456 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.444504 (+    48us) raft_consensus.cc:1685] finished
0709 13:16:18.444514 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.444631 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3972,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":8820,"thread_start_us":948006,"threads_started":1,"wal-append.queue_time_us":216849}
I20260709 13:16:18.429587  7250 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.433053  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.447974  5522 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
I20260709 13:16:18.429414  6967 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:18.450896  7250 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.447758  7288 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.451071  6967 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:18.416646  7137 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:18.453828  6967 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:18.455586  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:18.456393  6070 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:18.321019  7174 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.446825  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.448822  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:18.446576  7261 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.450420  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:18.460930  5450 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 3: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:18.423768  5370 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
I20260709 13:16:18.442216  5367 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
I20260709 13:16:18.468582  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:18.468005  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:18.468345  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:18.468472  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.482151  7313 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:18.485646  7313 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:18.486495  7313 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.483042  5373 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:18.482812  5371 raft_consensus.cc:2410] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:18.483680  5370 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:18.490252  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:18.491221  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45401.6us
I20260709 13:16:18.458827  7203 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.505513  5366 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:16:18.460546  7041 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.494411  5489 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:18.464735  7288 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.499027  5368 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:18.520511  5368 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:18.520867  5368 pending_rounds.cc:85] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:18.521077  5368 pending_rounds.cc:107] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:18.521298  5368 raft_consensus.cc:2889] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.502779  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:18.484678  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:18.458426  7137 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:18.506644  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.543960  5366 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.492110  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:18.545287  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53265.6us
I20260709 13:16:18.545467  5369 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:18.546078  5369 pending_rounds.cc:85] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:18.508045  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.546373  5369 pending_rounds.cc:107] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:18.546751  5369 raft_consensus.cc:2889] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.478178  5444 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.466845  7032 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.509969  7279 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.512392  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.552420  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.514572  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.506506  7072 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.530265  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.532279  5515 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:18.534232  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.468297  7148 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:16:18.515810  7143 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:18.538682  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.540455  7313 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:18.490505  7270 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.578392  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.579916  7270 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.580664  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.580817  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.546911  5367 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:18.549340  7261 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.582314  7261 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:18.581900  7143 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.582729  7261 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.584007  5367 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:16:18.584312  7143 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:18.524514  7141 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.549770  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.559334  6967 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.585788  6967 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:18.586184  6967 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.585206  5367 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:18.588122  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:18.588933  6070 raft_consensus.cc:2368] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:18.556813  7137 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.590747  5449 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:18.591264  5449 pending_rounds.cc:85] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:18.591533  5449 pending_rounds.cc:107] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:18.591822  5449 raft_consensus.cc:2889] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.593940  5367 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:18.593829  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.595046  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.596302  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.562251  7072 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.517915  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:18.599417  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.599634  7072 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.552690  7279 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:18.600406  7279 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.600862  5523 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:18.602160  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:18.559146  7250 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.604588  7250 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.606674  7250 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:18.607404  7313 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:18.607677  7148 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:18.608050  7148 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:18.608438  7313 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.610157  5369 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:18.610505  5369 pending_rounds.cc:85] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 2
I20260709 13:16:18.610719  5369 pending_rounds.cc:107] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:18.610936  5369 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.498466  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.556874  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.612582  5371 raft_consensus.cc:2410] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:18.508803  7041 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.621213  5374 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:18.536237  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.561077  5520 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [2.2-6.4]
I20260709 13:16:18.516222  7194 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.569571  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.623558  5450 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:18.570374  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.552022  7032 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:18.579871  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.612638  5524 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:18.554149  5444 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:18.634610  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.634438  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.635695  5366 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:18.638892  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.617530  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.642422  5447 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:18.643788  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:18.618214  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 97882.5us
W20260709 13:16:18.618817  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 450165us
I20260709 13:16:18.625986  5520 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:18.644749  5443 raft_consensus.cc:2368] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:18.636107  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.647110  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.581921  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.638357  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:18.636984  5445 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:18.655315  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:18.662097  5269 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 153) took 12642 ms (client timeout 15000 ms). Trace:
I20260709 13:16:18.584955  7141 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.608855  7148 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.629802  7041 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.628715  7309 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.624346  7294 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.699436  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.673729  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.700781  5443 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:18.674315  5523 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:18.674821  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.701752  5445 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.703404  5366 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:18.703945  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.705928  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.672578  5522 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:18.675625  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:18.667563  5447 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:18.640070  7032 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.591672  7137 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:18.691900  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.720780  5521 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:18.675508  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.724005  5520 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:18.694933  5374 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:18.707607  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.707953  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:18.674291  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 146031us
I20260709 13:16:18.727322  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.728116  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.728582  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.729765  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.729830  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.732642  5521 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
W20260709 13:16:18.734202  5416 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.779s (SENT) [suppressed 21 similar messages]
I20260709 13:16:18.646080  7143 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.714846  5444 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:18.638468  7194 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:18.662691  5269 rpcz_store.cc:269] 0709 13:16:05.995889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.996030 (+   141us) service_pool.cc:224] Handling call
0709 13:16:18.638131 (+12642101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:12.438125 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:12.438904 (+   779us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:12.438958 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:16:12.438984 (+    26us) tablet.cc:662] Decoding operations
0709 13:16:12.440061 (+  1077us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:12.440150 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:12.440191 (+    41us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:16:12.440898 (+   707us) tablet.cc:701] Row locks acquired
0709 13:16:12.440921 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:16:12.441118 (+   197us) write_op.cc:270] Start()
0709 13:16:12.441263 (+   145us) write_op.cc:276] Timestamp: P: 1783602972441055 usec, L: 0
0709 13:16:12.441296 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:16:12.597700 (+156404us) log.cc:844] Serialized 2459 byte log entry
0709 13:16:13.277510 (+679810us) op_driver.cc:464] REPLICATION: finished
0709 13:16:13.344992 (+ 67482us) write_op.cc:301] APPLY: starting
0709 13:16:13.345109 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:13.345379 (+   270us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:13.345565 (+   186us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:13.346664 (+  1099us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:13.346931 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:16:13.346981 (+    50us) write_op.cc:312] APPLY: finished
0709 13:16:13.347340 (+   359us) log.cc:844] Serialized 52 byte log entry
0709 13:16:13.367037 (+ 19697us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:13.371479 (+  4442us) write_op.cc:454] Released schema lock
0709 13:16:13.374486 (+  3007us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:13.385169 (+ 10683us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:13.385212 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":244193,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":67143,"apply.run_cpu_time_us":3458,"apply.run_wall_time_us":40160,"num_ops":6,"prepare.queue_time_us":657257,"prepare.run_cpu_time_us":11833,"prepare.run_wall_time_us":397565,"raft.queue_time_us":249704,"raft.run_cpu_time_us":16303,"raft.run_wall_time_us":57661,"replication_time_us":835990,"thread_start_us":563977,"threads_started":4,"wal-append.queue_time_us":412264,"wal-append.run_cpu_time_us":10045,"wal-append.run_wall_time_us":1349987}]]}
I20260709 13:16:18.709285  7309 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.718852  5443 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:18.717411  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.719398  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:18.739882  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.744366  5448 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:18.745270  5516 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:18.722458  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.749490  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.750612  5372 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.751717  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.752400  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:18.716048  7321 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:16:18.765231  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.747545  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.766844  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.757144  5369 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:18.759117  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:18.760382  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.773272  5515 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:18.773700  5515 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:18.781055  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.782146  5518 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:18.782596  5369 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:18.786377  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.744484  7148 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:18.791438  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.793908  5367 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:18.796597  5367 pending_rounds.cc:85] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:18.796700  5516 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:18.796852  5367 pending_rounds.cc:107] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:18.797117  5367 raft_consensus.cc:2889] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:18.797297  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.774716  5515 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.798264  5515 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.794368  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:18.799204  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:18.799515  5369 raft_consensus.cc:1813] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Handling vote request from an unknown peer 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:18.800778  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:18.795619  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.807101  5374 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.713276  7294 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.801596  5369 raft_consensus.cc:2368] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5.
I20260709 13:16:18.818676  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:18.815395  5445 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:16:18.822777  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:18.833166  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:18.835175  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.755534  7143 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:18.839243  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:18.840580  5369 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:18.907083  5490 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.4.37.190:41135, user_credentials={real_user=slave}} blocked reactor thread for 63335.5us
I20260709 13:16:18.919219  5515 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:18.919384  5374 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:18.921582  5374 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:18.922047  5369 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:18.921730  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:18.921731  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 121035us
I20260709 13:16:18.841575  7332 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.936709  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:18.939668  5369 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:18.941546  5515 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:18.944999  5375 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:18.938423  6897 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
W20260709 13:16:19.000437  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.025058  5372 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:19.027009  5372 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:19.028791  5372 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:18.958006  5374 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:19.029675  5374 pending_rounds.cc:85] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 3
I20260709 13:16:19.030108  5374 pending_rounds.cc:107] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:19.030474  5374 raft_consensus.cc:2889] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:19.040407  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.947108  7332 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:19.005064  5375 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:16:19.041754  5446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:16:19.041965  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:19.042937  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:19.048975  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.043707  5445 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:19.049690  5450 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:19.043776  5441 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:19.047726  5375 pending_rounds.cc:85] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:19.050735  5375 pending_rounds.cc:107] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:19.051115  5375 raft_consensus.cc:2889] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:19.052069  5445 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:19.052809  5447 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:19.053802  5444 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:19.053967  5517 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:19.032379  7285 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:18.711404  7288 consensus_queue.cc:1175] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:19.019187  7266 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:19.055183  5443 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:19.065207  5450 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:19.065407  5447 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:19.057221  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.000396  6791 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:16:19.061115  5444 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:19.079267  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:19.047169  7141 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:19.062322  7326 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:16:19.070708  7343 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.100262  7343 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.102952  7343 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.103533  7343 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.103957  7343 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.072065  7143 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:19.050042  7332 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.074702  7194 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.075641  7294 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:19.080749  6042 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:19.109792  7309 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:19.110786  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:19.112172  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:19.113219  7343 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:19.113260  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.122859  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:19.123456  5523 raft_consensus.cc:606] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:19.081331  5374 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:19.080757  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.125272  5375 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:19.091601  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:19.126462  5447 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:19.079985  5515 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:19.054741  7336 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:19.097625  7279 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:19.148272  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67657.9us
I20260709 13:16:19.099591  5443 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:16:19.128767  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:19.094146  7266 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.153759  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:19.154655  5374 raft_consensus.cc:2376] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7. Re-sending same reply.
I20260709 13:16:19.156648  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:19.158437  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.115639  7332 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.166544  5521 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:19.169049  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.171885  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.175631  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:19.176445  5375 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.152045  7309 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.184723  5372 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:19.187412  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:19.151866  7336 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:19.188084  5515 raft_consensus.cc:606] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:19.188618  7174 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
W20260709 13:16:19.161190  7073 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.005s	sys 0.013s
I20260709 13:16:19.163995  7340 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:19.189190  7174 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:19.194293  5375 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:19.195760  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:19.197288  7336 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:19.197497  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:19.202402  7345 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:19.211483  7266 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:19.213099  6967 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.000s
W20260709 13:16:19.214747  7041 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.504s	user 0.013s	sys 0.000s
I20260709 13:16:19.171523  7032 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:19.225602  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:19.216542  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.252218  5523 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.223814  5524 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:19.257580  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.263803  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68168.5us
I20260709 13:16:19.252409  5375 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:19.267884  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.272926  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:19.218922  6791 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.224429  7332 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.236169  7174 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:16:19.281622  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66323.8us
I20260709 13:16:19.190521  7309 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:19.234172  6098 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea060 after lost signal to thread 4249
I20260709 13:16:19.238008  7279 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:19.195087  7340 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.282897  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:19.269665  6071 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:19.302367  5523 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:19.295249  7141 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:19.278802  7336 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.290716  6897 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.298370  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:19.269728  7137 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:19.270234  7353 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.295259  7146 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.887s	user 0.009s	sys 0.005s
I20260709 13:16:19.304508  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.282747  7343 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:19.281023  7266 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:19.306185  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:19.261801  7041 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.261947  6967 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.288694  7285 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.282876  7344 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.309092  7225 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.015s
I20260709 13:16:19.311836  5375 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:19.314765  5366 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:19.313254  5489 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:19.305159  7340 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.347509  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.297699  6791 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:19.301385  7294 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:19.374336  5366 pending_rounds.cc:85] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 2
I20260709 13:16:19.375535  5372 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:19.328186  7252 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.347530  7261 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.003s
I20260709 13:16:19.378060  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:19.378384  5366 pending_rounds.cc:107] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:19.378284  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:19.376449  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65402.7us
I20260709 13:16:19.379397  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:19.386772  5442 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:19.385798  5370 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:19.341903  7332 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.397699  5366 raft_consensus.cc:2889] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:19.395969  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82828.3us
I20260709 13:16:19.396440  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.382642  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:19.386034  7349 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 13:16:19.314018  7279 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.321702  7032 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.375124  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.398569  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:19.346916  6098 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea740 after lost signal to thread 5307
I20260709 13:16:19.342252  7194 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:19.341935  6897 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:19.403257  5375 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
W20260709 13:16:19.380290  7225 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.007s	sys 0.015s
I20260709 13:16:19.341717  7343 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.400806  7351 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:19.412346  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.420149  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:19.311597  7336 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.415292  7141 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.374464  7285 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.412864  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.421525  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:19.313902  7353 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.427103  5375 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
W20260709 13:16:19.424502  7148 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260709 13:16:19.398062  7261 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:19.469161  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:19.401440  7361 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:16:19.471347  5375 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:19.472049  5373 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:19.472472  5373 pending_rounds.cc:85] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 3
I20260709 13:16:19.472745  5373 pending_rounds.cc:107] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:19.472985  5373 raft_consensus.cc:2889] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:19.425182  7363 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:19.482364  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:19.420215  7294 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:19.426671  7041 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.485319  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:19.486163  5375 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:19.404070  7174 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:19.382586  7344 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.487035  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:19.418874  7194 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:19.488651  5446 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:19.390303  7252 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.490669  5446 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:19.472365  6098 debug-util.cc:398] Leaking SignalData structure 0x7b080024fe20 after lost signal to thread 5399
W20260709 13:16:19.509043  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.498708  5375 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.485538  7148 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.486261  7363 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:19.540345  5446 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:19.552081  5372 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:19.485360  7313 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:19.498899  7225 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:19.555806  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 156119us
I20260709 13:16:19.556442  6791 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:19.556699  7357 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:16:19.487975  6897 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.510797  7309 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:19.561903  5375 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
W20260709 13:16:19.556696  7359 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:16:19.565696  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.090513  5375 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
W20260709 13:16:19.679329  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 280831us
I20260709 13:16:20.100165  5446 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:20.101030  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58818 (request call id 1227) took 1059 ms. Trace:
I20260709 13:16:19.712141  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.126554  5444 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:19.715495  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:20.131922  5445 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:19.710520  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.134243  5447 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:19.704046  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:20.136216  5448 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:19.710698  5449 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:20.137753  7385 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.138639  7385 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:19.696607  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.690822  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 103896us
W20260709 13:16:19.566083  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.995050  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.565778  6098 debug-util.cc:398] Leaking SignalData structure 0x7b0800196860 after lost signal to thread 5474
I20260709 13:16:19.938843  6967 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:20.152609  6098 debug-util.cc:398] Leaking SignalData structure 0x7b080035b2a0 after lost signal to thread 5475
I20260709 13:16:19.640455  6897 raft_consensus.cc:993] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:20.163424  7372 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:19.563585  7143 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 13:16:20.155748  6098 debug-util.cc:398] Leaking SignalData structure 0x7b08003905c0 after lost signal to thread 5548
I20260709 13:16:19.613902  7188 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:20.167632  6098 debug-util.cc:398] Leaking SignalData structure 0x7b0800385640 after lost signal to thread 6101
I20260709 13:16:20.149322  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:16:20.168339  6098 debug-util.cc:398] Leaking SignalData structure 0x7b080037fea0 after lost signal to thread 6102
I20260709 13:16:19.594691  7194 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:19.886178  7225 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:19.592021  7252 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.564625  7279 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:16:20.172127  7279 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:20.172812  7279 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:19.590981  7285 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.592723  7261 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:19.586174  7332 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:19.585449  7336 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.563431  7266 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:16:20.007696  7339 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.175616  7339 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:19.885474  7250 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:20.177708  7250 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.179028  7339 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.567413  7343 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:19.571424  7347 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:16:20.180886  7250 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:19.553548  7363 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.702488  7374 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:20.189191  7374 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:20.190696  7279 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:19.564680  7354 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:16:20.192941  7279 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.946240  7383 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.015173  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1254) took 1518 ms. Trace:
I20260709 13:16:20.022722  7384 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:20.023885  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 1.11209e+06us
I20260709 13:16:20.196110  5370 rpcz_store.cc:276] 0709 13:16:18.496421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.501167 (+  4746us) service_pool.cc:224] Handling call
0709 13:16:18.516339 (+ 15172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.396299 (+879960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.014124 (+617825us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b5400331654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:20.014779 (+   655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1999070592}
W20260709 13:16:20.038236  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.014s	sys 0.017s
I20260709 13:16:20.055438  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1111) took 1319 ms. Trace:
I20260709 13:16:20.065600  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:20.076915  5517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1001) took 1545 ms (client timeout 1779 ms). Trace:
I20260709 13:16:19.716886  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1273) took 1004 ms. Trace:
I20260709 13:16:19.704190  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:20.106926  5442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1008) took 1535 ms (client timeout 1579 ms). Trace:
I20260709 13:16:20.101838  7314 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:20.103250  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 991) took 1002 ms. Trace:
I20260709 13:16:20.101081  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:20.113158  7288 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.714226  5450 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:20.276611  5450 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:20.144938  5446 rpcz_store.cc:276] 0709 13:16:19.041517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.041632 (+   115us) service_pool.cc:224] Handling call
0709 13:16:20.097590 (+1055958us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54003bc254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d83a3d 00007fc1d8d53cd0 00007fc1d22d8254 00007fc1d22d81e2 00007fc1d22d8111 00007fc1d22d808c 00007fc1d22d7342 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:20.100874 (+  3284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013203840}
I20260709 13:16:20.277655  5372 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:20.148120  7367 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:20.278450  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 990) took 1178 ms. Trace:
I20260709 13:16:20.278147  5450 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.278944  5372 rpcz_store.cc:276] 0709 13:16:19.100128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.064845 (+964717us) service_pool.cc:224] Handling call
0709 13:16:20.278368 (+213523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.279773  5450 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.280565  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.148765  7137 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:20.281615  7137 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:20.283185  7137 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:20.283208  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59215.5us
I20260709 13:16:20.284520  7137 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.277976  5366 rpcz_store.cc:276] 0709 13:16:18.712871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.713091 (+   220us) service_pool.cc:224] Handling call
0709 13:16:18.713411 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.399496 (+686085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.716637 (+317141us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54000c5b54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:19.716828 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382140160}
I20260709 13:16:20.286664  7385 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.287633  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.150184  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:20.151578  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:20.290732  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:20.149297  7379 raft_consensus.cc:993] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:20.293354  7379 raft_consensus.cc:1081] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:20.163995  6897 raft_consensus.cc:1081] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
W20260709 13:16:20.172299  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.176169  7332 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.651016  7340 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:20.302650  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 201989us
I20260709 13:16:20.303617  5443 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:20.304384  7367 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:20.304932  7340 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.182166  7339 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:20.182659  7225 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.168365  7188 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.195590  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1280) took 1387 ms. Trace:
I20260709 13:16:20.196630  7383 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.199565  5521 rpcz_store.cc:276] 0709 13:16:18.735987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.736188 (+   201us) service_pool.cc:224] Handling call
0709 13:16:18.736608 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.167360 (+430752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.054787 (+887427us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b540025cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:20.055193 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988036864}
W20260709 13:16:20.201066  5517 rpcz_store.cc:269] 0709 13:16:18.531092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.535910 (+  4818us) service_pool.cc:224] Handling call
0709 13:16:20.073501 (+1537591us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54002774d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:20.076611 (+  3110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944984320}
W20260709 13:16:20.210676  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.016s	sys 0.018s
W20260709 13:16:20.318526  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 897044us
W20260709 13:16:20.265887  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.267587  5375 rpcz_store.cc:276] 0709 13:16:19.100402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.565359 (+464957us) service_pool.cc:224] Handling call
0709 13:16:20.103159 (+537800us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:20.266258  5442 rpcz_store.cc:269] 0709 13:16:18.571346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.579587 (+  8241us) service_pool.cc:224] Handling call
0709 13:16:20.106344 (+1526757us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54003bd154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:20.106676 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731329792}
I20260709 13:16:20.274637  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1270) took 1618 ms. Trace:
I20260709 13:16:20.320240  5371 rpcz_store.cc:276] 0709 13:16:18.643302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.643525 (+   223us) service_pool.cc:224] Handling call
0709 13:16:18.676228 (+ 32703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.695824 (+ 19596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.695872 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.696498 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.183629 (+487131us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:19.183675 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.183746 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.198581 (+1014835us) raft_consensus.cc:1685] finished
0709 13:16:20.198638 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.262010 (+ 63372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19095,"raft.queue_time_us":19225,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":20980,"thread_start_us":427513,"threads_started":1,"wal-append.queue_time_us":563656}
W20260709 13:16:20.322322  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.322640  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.323880  5371 raft_consensus.cc:2410] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:20.275580  7143 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:20.314886  7374 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:20.291754  5522 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:16:20.196596  7384 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.286806  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.325378  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.330528  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.328914  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:20.340183  5375 raft_consensus.cc:2368] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5.
I20260709 13:16:20.327932  7314 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:20.299054  5372 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:20.293080  7288 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:19.600775  7344 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.305574  7250 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.315770  5367 rpcz_store.cc:276] 0709 13:16:18.808430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.812885 (+  4455us) service_pool.cc:224] Handling call
0709 13:16:18.813227 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.018374 (+205147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.018427 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.041613 (+ 23186us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.244965 (+203352us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:19.245024 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.245121 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.592212 (+347091us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:16:20.195028 (+602816us) raft_consensus.cc:1685] finished
0709 13:16:20.195069 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.195415 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125423,"raft.run_cpu_time_us":3887,"raft.run_wall_time_us":646195,"spinlock_wait_cycles":47692160,"thread_start_us":355085,"threads_started":2,"wal-append.queue_time_us":239142}
I20260709 13:16:20.346472  7250 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.347187  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.347406  7288 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.348706  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.348970  7250 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.349763  5366 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:20.305704  5446 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:19.908883  7361 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:20.351469  7314 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.351799  7361 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.352799  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:20.306747  7386 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:20.308681  7378 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:20.323782  7383 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.307585  6897 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:20.355321  7361 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.309214  7309 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:20.310067  7266 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:20.310379  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:20.309124  7367 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:20.324967  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:20.322691  7188 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.329614  7384 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:20.360574  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50400.2us
I20260709 13:16:20.362054  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:20.365042  7384 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:20.333307  7353 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.365969  7353 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:20.366560  7344 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:20.368168  7361 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:20.368594  7361 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:20.333798  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.352231  6071 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.353094  7339 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.355870  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.313012  7385 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.312314  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:20.325133  7225 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.358294  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:20.358733  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.370800  5450 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:20.357161  5490 connection.cc:256] RPC call timeout handler was delayed by -1.3580240259998391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:16:20.376515  5490 connection.cc:256] RPC call timeout handler was delayed by -1.2797240259999398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
I20260709 13:16:20.378074  7361 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.379144  7266 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:20.379782  7266 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.380291  7266 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.374352  7339 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:20.383493  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 71529.3us
I20260709 13:16:20.383898  7339 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.384829  7309 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:20.389370  5375 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:20.395347  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:20.395584  6071 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:20.396481  7141 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:20.397796  7141 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.398244  7141 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.398648  7141 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.398372  7314 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:20.399873  7388 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:20.400254  7388 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:20.401678  7388 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:20.406862  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.407904  5367 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:20.409142  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.410749  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1295) took 1355 ms. Trace:
I20260709 13:16:20.416051  5372 raft_consensus.cc:2376] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6. Re-sending same reply.
I20260709 13:16:20.416949  7383 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:20.327991  7352 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.089s	user 0.000s	sys 0.013s
I20260709 13:16:20.426363  5373 rpcz_store.cc:276] 0709 13:16:19.054714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.058561 (+  3847us) service_pool.cc:224] Handling call
0709 13:16:19.101757 (+ 43196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.473276 (+371519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.409775 (+936499us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54001ea354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:20.410524 (+   749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843862400}
I20260709 13:16:20.432631  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.434633  6897 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.436646  6897 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.437822  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1287) took 1518 ms. Trace:
I20260709 13:16:20.439311  6897 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:20.438493  5369 rpcz_store.cc:276] 0709 13:16:18.919142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.940382 (+ 21240us) service_pool.cc:224] Handling call
0709 13:16:18.940724 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.948158 (+  7434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.948190 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.952589 (+  4399us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.163364 (+210775us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:19.163421 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.163504 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.327049 (+1163545us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:20.437121 (+110072us) raft_consensus.cc:1685] finished
0709 13:16:20.437153 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.437582 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7034,"raft.queue_time_us":10543,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":66451,"spinlock_wait_cycles":12111744,"thread_start_us":114385,"threads_started":1,"wal-append.queue_time_us":200525}
I20260709 13:16:20.443715  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.444603  5369 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:20.445704  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.446467  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.447328  5375 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:20.448541  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.451179  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1262) took 1951 ms. Trace:
I20260709 13:16:20.451709  5368 rpcz_store.cc:276] 0709 13:16:18.499853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.522247 (+ 22394us) service_pool.cc:224] Handling call
0709 13:16:18.522532 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.756178 (+233646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.756223 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.224989 (+468766us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b2c00000658. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:16:19.225376 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.283141 (+ 57765us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:19.283184 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.283607 (+   423us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.450599 (+1166992us) raft_consensus.cc:1685] finished
0709 13:16:20.450641 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.450975 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17356,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":35564928,"thread_start_us":290585,"threads_started":2,"wal-append.queue_time_us":172229}
I20260709 13:16:20.434295  7340 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.442888  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.446568  5369 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:20.449134  5375 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:20.429723  7383 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:20.457126  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.456782  7340 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:20.458120  5374 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:20.457911  7383 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.459483  7383 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:20.459796  5374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 988) took 1360 ms (client timeout 1580 ms). Trace:
I20260709 13:16:20.432657  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.472010  5446 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:20.464731  5371 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:20.478890  5373 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:20.480039  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:20.481050  6076 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 6: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:20.480778  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.481941  5373 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:20.482136  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.482852  5368 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
W20260709 13:16:20.466409  5490 connection.cc:256] RPC call timeout handler was delayed by -1.0925240259998645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
I20260709 13:16:20.483098  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:20.483897  6076 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:20.484923  5448 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.475436  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.458022  5370 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:20.471525  5450 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 5. Ops: []
I20260709 13:16:20.483222  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 984) took 1384 ms. Trace:
I20260709 13:16:20.464437  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.489184  5368 rpcz_store.cc:276] 0709 13:16:19.098369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.481516 (+1383147us) service_pool.cc:224] Handling call
0709 13:16:20.483172 (+  1656us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.464111  5367 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:20.464910  5340 leader_election.cc:400] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:20.490512  5340 leader_election.cc:403] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:16:20.477084  5374 rpcz_store.cc:269] 0709 13:16:19.099542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.155496 (+ 55954us) service_pool.cc:224] Handling call
0709 13:16:20.459517 (+1304021us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400259ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:20.459719 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2955107584}
I20260709 13:16:20.483182  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.475800  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.495811  5443 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:20.498147  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.501130  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.505777  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.501889  7141 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.507409  5375 raft_consensus.cc:2410] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:20.508612  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.499943  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.460044  7340 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:20.509460  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.515013  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.516258  7338 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:20.517153  5373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:33046
I20260709 13:16:20.517773  5372 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:20.431614  7266 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.547379  7266 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:20.547379  7388 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:20.548748  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 106181us
I20260709 13:16:20.550544  5372 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:20.551558  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 979) took 1454 ms. Trace:
I20260709 13:16:20.551937  5372 rpcz_store.cc:276] 0709 13:16:19.096889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.549591 (+1452702us) service_pool.cc:224] Handling call
0709 13:16:20.550174 (+   583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.551231 (+  1057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.551462 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.513162  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.553583  5372 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:20.554271  5374 raft_consensus.cc:2410] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:16:20.523536  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.524014  7363 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:20.525758  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.505823  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.898682  5447 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:20.901172  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:20.902735  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:20.903827  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:20.518503  5442 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:20.538875  5367 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:20.907258  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.908304  5367 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:20.544520  5373 raft_consensus.cc:606] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:20.910050  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33046 (request call id 2) took 1708 ms. Trace:
I20260709 13:16:20.910437  5373 rpcz_store.cc:276] 0709 13:16:19.201993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.516961 (+1314968us) service_pool.cc:224] Handling call
0709 13:16:20.909939 (+392978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.911628  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.912954  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.517302  5443 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:20.554436  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1004) took 1212 ms. Trace:
I20260709 13:16:20.917016  5375 rpcz_store.cc:276] 0709 13:16:19.342026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.499714 (+1157688us) service_pool.cc:224] Handling call
0709 13:16:20.554352 (+ 54638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.918100  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.556035  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 980) took 1457 ms. Trace:
I20260709 13:16:20.918762  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:20.919481  5523 raft_consensus.cc:2376] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6. Re-sending same reply.
I20260709 13:16:20.922164  5518 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.570753  5368 raft_consensus.cc:2410] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:20.574806  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.927212  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.575554  5371 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:20.599717  5370 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:20.623693  5369 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.609997  6070 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:20.568562  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:16:20.651093  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 74400us
I20260709 13:16:20.998585  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:20.661127  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.690881  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.000258  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.691696  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 327960us
I20260709 13:16:20.573082  7141 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:20.731503  7395 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:16:20.636165  7194 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.113827  7194 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.581800  7288 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:20.564522  7338 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.120069  7288 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:21.120592  7288 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:21.120316  7338 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:20.562685  7363 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:20.743491  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 982) took 1645 ms. Trace:
I20260709 13:16:21.123471  5374 rpcz_store.cc:276] 0709 13:16:19.097747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.556220 (+1458473us) service_pool.cc:224] Handling call
0709 13:16:20.560196 (+  3976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.562442 (+  2246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.562482 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.563112 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.638380 (+ 75268us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:20.638439 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.638553 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.743158 (+104605us) raft_consensus.cc:1685] finished
0709 13:16:20.743189 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:20.743383 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3207,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":3692,"thread_start_us":74799,"threads_started":1,"wal-append.queue_time_us":134537}
I20260709 13:16:21.125515  7194 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:20.768703  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:20.776988  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:20.778684  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:20.797096  7372 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.797626  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:20.800608  7405 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:20.803340  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.808081  5517 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:20.811808  7371 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:20.820745  7361 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.838486  7137 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:20.882234  7270 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:20.889968  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 316079us
I20260709 13:16:20.918807  5372 rpcz_store.cc:276] 0709 13:16:19.097172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.552710 (+1455538us) service_pool.cc:224] Handling call
0709 13:16:20.553241 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.554005 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.554238 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.909175  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.934106  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 995) took 1832 ms. Trace:
I20260709 13:16:20.934264  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 983) took 1836 ms. Trace:
I20260709 13:16:20.936766  7410 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.937228  7378 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.937952  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.939496  5373 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
W20260709 13:16:20.514304  5490 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.541s (SENT)
W20260709 13:16:21.000872  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.002557  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:21.003374  7344 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:21.012312  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:21.018728  5448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.008s
I20260709 13:16:21.021739  6076 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:21.030195  7415 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:21.033524  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.033804  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.127584  5445 raft_consensus.cc:2368] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 4. Current term is 5.
W20260709 13:16:21.131482  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 97748.5us
I20260709 13:16:21.131286  7378 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.131923  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:20.680124  7339 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:21.132730  5373 raft_consensus.cc:2376] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7. Re-sending same reply.
I20260709 13:16:21.133404  5366 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:21.133755  7405 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.134300  7339 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.134495  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:21.029016  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:21.134676  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 132457us
I20260709 13:16:21.035917  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 115) took 1320 ms. Trace:
I20260709 13:16:21.038179  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:21.135877  7225 raft_consensus.cc:2764] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:16:21.136160  7405 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.136318  5442 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:21.136596  7225 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.137005  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:21.048243  7412 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:16:21.051379  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:21.063717  5273 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.075100  5520 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:21.128741  5375 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:21.088406  5443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:16:21.155668  5443 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.156077  5443 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.091233  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:21.154441  5520 pending_rounds.cc:85] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 2
I20260709 13:16:21.161665  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:21.124765  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 116) took 1408 ms. Trace:
I20260709 13:16:21.126080  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:20.756688  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:20.765132  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:21.162928  5524 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.126361  7288 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:21.043880  5270 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 154) took 13088 ms (client timeout 15000 ms). Trace:
W20260709 13:16:21.164443  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 366931us
I20260709 13:16:21.138211  7410 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.159389  5520 pending_rounds.cc:107] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:21.169659  5520 raft_consensus.cc:2889] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:21.143648  7270 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.139096  7383 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:21.140100  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.141042  5447 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:16:21.141222  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 629244us
W20260709 13:16:21.141743  5448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.009s	sys 0.009s
I20260709 13:16:21.142117  5522 raft_consensus.cc:2368] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7.
I20260709 13:16:21.141911  7372 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.141996  5369 rpcz_store.cc:276] 0709 13:16:19.098000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.575320 (+1477320us) service_pool.cc:224] Handling call
0709 13:16:20.617413 (+ 42093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.933938 (+316525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.934183 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.142660  7137 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:21.192533  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:21.187692  5443 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.143211  5367 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:21.144119  5370 rpcz_store.cc:276] 0709 13:16:19.136218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.495225 (+1359007us) service_pool.cc:224] Handling call
0709 13:16:20.934011 (+438786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.146466  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:21.146806  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.131948  5445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
W20260709 13:16:21.081880  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.161808  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:21.111934  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:21.138315  7344 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:21.171027  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:21.173727  7288 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.135696  5441 rpcz_store.cc:276] 0709 13:16:19.715446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.715625 (+   179us) service_pool.cc:224] Handling call
0709 13:16:19.715891 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.194016 (+478125us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:20.212415 (+ 18399us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.320109 (+107694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:20.320180 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:20.320235 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.035476 (+715241us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400239e54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:21.035532 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.035728 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":79991,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":3966,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":162,"spinlock_wait_cycles":1098442496,"thread_start_us":68160,"threads_started":2,"wal-append.queue_time_us":55411}
I20260709 13:16:21.184607  7363 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:21.176568  7249 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:21.181622  5372 raft_consensus.cc:2376] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4. Re-sending same reply.
I20260709 13:16:21.192397  5273 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 4 to 5, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 5 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:21.182993  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:21.162451  5444 rpcz_store.cc:276] 0709 13:16:19.716348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.128232 (+411884us) service_pool.cc:224] Handling call
0709 13:16:20.128975 (+   743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.262010 (+133035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.262043 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.298733 (+ 36690us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.490498 (+191765us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:20.490539 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.490607 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.124507 (+633900us) raft_consensus.cc:1685] finished
0709 13:16:21.124529 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.124694 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14532,"raft.run_cpu_time_us":1406,"raft.run_wall_time_us":1795,"spinlock_wait_cycles":1597824,"thread_start_us":236144,"threads_started":2,"wal-append.queue_time_us":260931}
I20260709 13:16:21.197054  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:21.209473  5366 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:21.209811  5373 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:21.176057  7410 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.184921  7378 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:21.205868  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:21.208962  5368 raft_consensus.cc:2376] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5. Re-sending same reply.
I20260709 13:16:21.200788  5375 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:21.187256  7383 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:21.192360  7137 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:21.218747  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:21.220468  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:21.212613  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:21.215389  5443 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.223196  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:21.224551  5372 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:21.218328  5369 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5. Re-sending same reply.
I20260709 13:16:21.228086  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:21.229036  5521 raft_consensus.cc:1813] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
I20260709 13:16:21.229753  5521 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:21.222982  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 189651us
W20260709 13:16:21.223037  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 76660.9us
I20260709 13:16:21.232263  5374 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:21.206708  7194 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.231210  5273 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 3 to 5, term changed from 2 to 4, VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) evicted. New cstate: current_term: 4 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.211287  7249 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.239904  5375 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:21.236907  7370 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.243631  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:21.247993  5368 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:21.251024  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:21.248975  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 492353us
I20260709 13:16:21.252236  5370 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:21.260483  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1012) took 1048 ms. Trace:
I20260709 13:16:21.260963  5374 rpcz_store.cc:276] 0709 13:16:20.194973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.229821 (+1034848us) service_pool.cc:224] Handling call
0709 13:16:21.230324 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.242761 (+ 12437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.243021 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.263801  5522 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:21.266088  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 993) took 2149 ms. Trace:
I20260709 13:16:21.266702  5375 rpcz_store.cc:276] 0709 13:16:19.100956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.215231 (+2114275us) service_pool.cc:224] Handling call
0709 13:16:21.239722 (+ 24491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.250020 (+ 10298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.250291 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.268184  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 992) took 2151 ms. Trace:
I20260709 13:16:21.268754  5368 rpcz_store.cc:276] 0709 13:16:19.100690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.215148 (+2114458us) service_pool.cc:224] Handling call
0709 13:16:21.247752 (+ 32604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.251316 (+  3564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.251587 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.270982  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:21.271914  5515 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.237653  7422 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.274917  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 987) took 2175 ms. Trace:
I20260709 13:16:21.279287  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1005) took 1876 ms. Trace:
I20260709 13:16:21.284819  5369 rpcz_store.cc:276] 0709 13:16:19.403433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.237287 (+1833854us) service_pool.cc:224] Handling call
0709 13:16:21.237714 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.266446 (+ 28732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.266494 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.278844 (+ 12350us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:21.278907 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.279002 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.279201 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.249586  7249 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.288496  5366 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:21.289608  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 998) took 2138 ms. Trace:
I20260709 13:16:21.294260  5372 rpcz_store.cc:276] 0709 13:16:19.151374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.234626 (+2083252us) service_pool.cc:224] Handling call
0709 13:16:21.271981 (+ 37355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.289143 (+ 17162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.289185 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.289271 (+    86us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:21.289317 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.289413 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.289544 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:21.297775  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 91282.7us
I20260709 13:16:21.281011  5373 rpcz_store.cc:276] 0709 13:16:19.099231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.214879 (+2115648us) service_pool.cc:224] Handling call
0709 13:16:21.236296 (+ 21417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.244768 (+  8472us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:21.244816 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.262445 (+ 17629us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:21.262502 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.262596 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.274642 (+ 12046us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b54001e9450. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:21.274831 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":287,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":19012,"spinlock_wait_cycles":5557120}
I20260709 13:16:21.262147  7338 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.235769  7309 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:16:21.307978  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.310670  5373 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:21.303272  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:21.320439  5369 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:21.320844  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 88235.3us
I20260709 13:16:21.319916  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:21.292479  7266 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.297118  7363 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.296885  7371 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:21.325881  5375 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:21.326423  5372 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:21.326861  5370 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:21.283149  7294 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:21.283803  7415 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:21.333650  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.340061  5370 pending_rounds.cc:85] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 3
I20260709 13:16:21.347451  5370 pending_rounds.cc:107] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:21.347844  5370 raft_consensus.cc:2889] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:21.164710  5270 rpcz_store.cc:269] 0709 13:16:07.955663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.975543 (+ 19880us) service_pool.cc:224] Handling call
0709 13:16:21.043592 (+13068049us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:18.909890 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:19.072031 (+162141us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:19.072080 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:16:19.072101 (+    21us) tablet.cc:662] Decoding operations
0709 13:16:19.072894 (+   793us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:19.072955 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:19.072983 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:16:19.073640 (+   657us) tablet.cc:701] Row locks acquired
0709 13:16:19.073685 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:16:19.073839 (+   154us) write_op.cc:270] Start()
0709 13:16:19.073957 (+   118us) write_op.cc:276] Timestamp: P: 1783602979073791 usec, L: 0
0709 13:16:19.073979 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:19.074723 (+   744us) log.cc:844] Serialized 2078 byte log entry
0709 13:16:19.470866 (+396143us) op_driver.cc:464] REPLICATION: finished
0709 13:16:19.587790 (+116924us) write_op.cc:301] APPLY: starting
0709 13:16:19.587907 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:19.588158 (+   251us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:19.588324 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:19.589406 (+  1082us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:19.589732 (+   326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:16:19.589800 (+    68us) write_op.cc:312] APPLY: finished
0709 13:16:19.590171 (+   371us) log.cc:844] Serialized 46 byte log entry
0709 13:16:19.590405 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:19.590553 (+   148us) write_op.cc:454] Released schema lock
0709 13:16:19.590612 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:19.639657 (+ 49045us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:19.642697 (+  3040us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3164220,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":106044,"apply.run_cpu_time_us":3338,"apply.run_wall_time_us":26218,"num_ops":5,"prepare.queue_time_us":334344,"prepare.run_cpu_time_us":21001,"prepare.run_wall_time_us":341091,"raft.queue_time_us":179405,"raft.run_cpu_time_us":27397,"raft.run_wall_time_us":157747,"replication_time_us":353438,"thread_start_us":375080,"threads_started":4,"wal-append.queue_time_us":148752,"wal-append.run_cpu_time_us":20844,"wal-append.run_wall_time_us":1371168}]]}
I20260709 13:16:21.339540  5372 pending_rounds.cc:85] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 2
I20260709 13:16:21.350126  5372 pending_rounds.cc:107] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:21.350898  5372 raft_consensus.cc:2889] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:21.369406  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60022.4us
I20260709 13:16:21.324165  7339 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:16:21.273825  7370 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.337145  7371 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:21.376998  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 105481us
I20260709 13:16:21.377318  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:21.333326  7351 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.328928  7410 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.389693  7410 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.390282  7419 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:21.390754  7419 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:21.391131  7419 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.392501  7410 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.393894  7425 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.394373  7425 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:21.382464  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60926.6us
I20260709 13:16:21.387769  7351 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.395231  7351 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.388489  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.388962  7371 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:21.408121  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.337283  7266 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.412429  5521 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.325628  7137 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.325076  7383 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.394974  7425 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:21.417012  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 109618us
W20260709 13:16:21.443744  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 115298us
W20260709 13:16:21.444042  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55718.1us
I20260709 13:16:21.398259  7372 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:21.448920  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 161052us
I20260709 13:16:21.371081  7294 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:21.452409  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44681.9us
I20260709 13:16:21.457820  5445 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.458336  5445 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.402401  7422 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:21.430965  7410 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.393781  7415 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.380818  7363 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:21.483675  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:21.481141  5445 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.486644  5517 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:21.482264  7270 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.469306  7372 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:21.491730  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.414233  7426 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:16:21.489189  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.488077  5447 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:21.498939  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.503108  5445 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.508024  7270 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.508652  7270 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:21.492709  7137 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.518769  5519 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:21.522673  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:21.506203  7383 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.524678  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:21.525892  7363 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:21.527511  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45516.2us
I20260709 13:16:21.528399  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.528903  7266 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:21.529644  7338 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.530221  7370 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:21.492151  7372 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:21.531989  7372 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:21.533268  7372 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.533658  7405 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.497846  7427 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.535389  7294 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:21.535553  7427 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:21.536062  7427 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:21.539728  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.537611  7415 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.565616  5515 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:16:21.568302  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:21.569674  7339 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:21.566174  5524 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:21.571432  5518 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.571791  5518 raft_consensus.cc:614] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:21.577579  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.502332  7194 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:21.588485  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 142501us
W20260709 13:16:21.630323  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 107715us
I20260709 13:16:21.624256  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.576761  7309 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:21.652235  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:21.632647  7416 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.305s	user 0.000s	sys 0.002s
I20260709 13:16:21.660480  5416 leader_election.cc:400] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5.
I20260709 13:16:21.660990  5416 leader_election.cc:403] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.662719  5524 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
W20260709 13:16:21.663748  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 183435us
I20260709 13:16:21.580157  7422 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:21.657644  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:21.673928  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 98217.6us
I20260709 13:16:21.638371  7434 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:21.679492  5521 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:21.639366  7266 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.650301  7288 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.646123  7309 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:21.648005  7270 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:21.631511  7363 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.625305  7194 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.681627  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.688818  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:21.692764  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:21.690074  7225 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.003s
W20260709 13:16:21.683688  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.691504  7434 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:21.707695  7410 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:21.724380  7433 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:16:21.730362  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52356.6us
I20260709 13:16:21.729195  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:21.681715  7339 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:21.704487  7405 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.744601  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:21.736591  5518 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:21.716922  7270 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:21.717754  7225 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.722746  7378 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:21.744203  5396 debug-util.cc:398] Leaking SignalData structure 0x7b080015e180 after lost signal to thread 4249
I20260709 13:16:21.731710  7410 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.715835  7428 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5.
I20260709 13:16:21.756572  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:21.762755  5515 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:21.762632  7339 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:21.763979  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.755749  7443 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.765882  7443 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:21.768666  7443 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:21.770903  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:21.772469  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.741882  7294 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:21.753605  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1259) took 1203 ms. Trace:
I20260709 13:16:21.782815  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:21.752110  7435 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:16:21.782321  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:21.797626  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53084.6us
I20260709 13:16:21.798193  5515 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:21.798800  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.752034  7378 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.775503  5449 rpcz_store.cc:276] 0709 13:16:20.550583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.067974 (+517391us) service_pool.cc:224] Handling call
0709 13:16:21.068421 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.078100 (+  9679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.078146 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.078745 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.104509 (+ 25764us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:21.104581 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.104660 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.753279 (+648619us) raft_consensus.cc:1685] finished
0709 13:16:21.753301 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.753530 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9096,"raft.queue_time_us":10451,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":25370,"threads_started":1,"wal-append.queue_time_us":121606}
I20260709 13:16:21.806396  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:21.777027  7410 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.749339  7405 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.785521  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:21.818742  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.775398  7270 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:21.828097  7445 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:16:21.752468  7309 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:21.835623  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.830509  7428 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:21.827937  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44763.3us
I20260709 13:16:21.805089  7288 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:16:21.842576  5371 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:21.801540  7441 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:21.845235  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 166697us
I20260709 13:16:21.846269  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d219441478644a3e8915df9d2083022c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:21.890764  5516 raft_consensus.cc:606] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.805750  7378 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:21.844405  5396 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9fc0 after lost signal to thread 5307
W20260709 13:16:21.889356  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 147668us
I20260709 13:16:21.805896  7225 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:21.846608  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.891212  5516 raft_consensus.cc:614] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:21.895383  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 76715.4us
I20260709 13:16:21.896513  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.907970  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:21.907214  6043 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.012s
W20260709 13:16:21.910579  6043 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.011s	sys 0.012s
W20260709 13:16:21.910933  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 515460us
I20260709 13:16:21.890341  7441 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:21.915228  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.916514  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:21.900718  7225 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:21.922657  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.911808  7309 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:21.926592  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 141204us
I20260709 13:16:21.910085  7449 raft_consensus.cc:2764] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:21.938313  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:21.775593  7431 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:16:21.923807  7194 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.928336  7225 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.920723  7441 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.802771  7415 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:16:21.943950  5518 raft_consensus.cc:1813] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
I20260709 13:16:21.890038  7419 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:21.941234  5396 debug-util.cc:398] Leaking SignalData structure 0x7b08002634c0 after lost signal to thread 5399
I20260709 13:16:21.958266  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.942721  7266 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:21.961397  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:21.959303  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 142639us
I20260709 13:16:21.961912  5518 raft_consensus.cc:2368] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 5.
W20260709 13:16:21.962924  7447 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:16:21.939896  7370 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:21.965085  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.949777  7428 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:21.953713  7194 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:21.963160  7270 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:21.973083  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1289dc7debf403aa87416568de586e6"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:21.956511  7344 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.965513  7449 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:21.976655  7449 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:21.977042  7449 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.977913  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:21.980671  7338 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:21.982942  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44678.6us
I20260709 13:16:21.894328  7434 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:21.975608  5516 raft_consensus.cc:606] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:21.986681  5516 raft_consensus.cc:614] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:21.953896  7429 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.171s
I20260709 13:16:21.989800  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:21.987202  5396 debug-util.cc:398] Leaking SignalData structure 0x7b0800359f00 after lost signal to thread 5474
I20260709 13:16:21.997838  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:22.001909  7415 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.002005  7419 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.002727  7415 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.004998  7415 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:22.005805  7430 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.475s	user 0.006s	sys 0.000s
I20260709 13:16:22.005604  7452 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:16:21.996186  7249 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.003s
I20260709 13:16:22.007786  7249 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.009970  7249 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.010592  7383 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:22.011128  7383 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.011720  7427 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.013615  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:22.016960  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:22.017516  5396 debug-util.cc:398] Leaking SignalData structure 0x7b08003118e0 after lost signal to thread 5475
W20260709 13:16:22.017904  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.018472  7421 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:22.018832  5396 debug-util.cc:398] Leaking SignalData structure 0x7b080034b4c0 after lost signal to thread 5548
W20260709 13:16:22.018968  7448 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:16:22.020188  5396 debug-util.cc:398] Leaking SignalData structure 0x7b0800323d00 after lost signal to thread 6101
W20260709 13:16:22.020502  5396 debug-util.cc:398] Leaking SignalData structure 0x7b0800338fc0 after lost signal to thread 6102
I20260709 13:16:21.983464  7344 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:21.969637  7443 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:22.021987  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38156 (request call id 139) took 1261 ms. Trace:
I20260709 13:16:21.984874  7266 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:22.042009  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.013180  7383 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.031260  5371 rpcz_store.cc:276] 0709 13:16:20.760453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.185914 (+425461us) service_pool.cc:224] Handling call
0709 13:16:22.021286 (+835372us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b5400185bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:22.021389 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997377920}
I20260709 13:16:21.973202  7194 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:21.996776  7371 consensus_meta.cc:287] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
W20260709 13:16:21.997879  7437 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:16:21.990435  7428 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:22.018865  7421 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:22.041245  7415 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.041466  7419 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:22.066027  7361 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.907s	user 0.010s	sys 0.005s
I20260709 13:16:22.066613  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:22.067988  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:22.069129  7432 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:16:22.070199  7432 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:22.070531  7432 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:22.071969  7431 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.071601  7432 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.074314  7432 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.022850  7338 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:22.042420  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:22.051597  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.030485  7344 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.072456  7431 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:22.072811  7370 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.060447  7194 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.086252  7370 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.088661  7370 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:22.088560  7294 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:22.089352  7451 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.041721  7426 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:22.090251  7294 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:22.090713  7294 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:22.091488  7225 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:22.080605  5414 connection.cc:256] RPC call timeout handler was delayed by -1.4282824120000441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:16:22.093232  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60462.9us
W20260709 13:16:22.093691  5414 connection.cc:256] RPC call timeout handler was delayed by -1.3382824119998986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:16:22.094072  5414 connection.cc:256] RPC call timeout handler was delayed by -1.3238824119998753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:16:22.062282  7415 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.082849  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:22.062498  7427 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.042119  7410 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.062826  7419 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:22.094465  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:22.094379  5414 connection.cc:256] RPC call timeout handler was delayed by -1.2752824120000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:16:22.096937  5414 connection.cc:256] RPC call timeout handler was delayed by -1.2086824119999164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 13:16:22.097357  5414 connection.cc:256] RPC call timeout handler was delayed by -1.1384824120000303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 13:16:22.097750  5414 connection.cc:256] RPC call timeout handler was delayed by -1.1321824120000201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:16:22.080132  7361 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.062507  7383 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:22.079398  7338 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:22.048983  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 152536us
I20260709 13:16:22.059772  7371 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:22.081776  7429 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:16:22.084075  7431 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.109483  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1267) took 1102 ms. Trace:
I20260709 13:16:22.095289  7415 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.099736  7419 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.099912  7249 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.120729  5441 rpcz_store.cc:276] 0709 13:16:21.006706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.214787 (+208081us) service_pool.cc:224] Handling call
0709 13:16:21.238868 (+ 24081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.302477 (+ 63609us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:21.335689 (+ 33212us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.506265 (+170576us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.562702 (+ 56437us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.568928 (+  6226us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:21.570047 (+  1119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.571376 (+  1329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.109223 (+537847us) raft_consensus.cc:1685] finished
0709 13:16:22.109243 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.109395 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31139,"prepare.queue_time_us":26545,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":171270,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":12477,"thread_start_us":123321,"threads_started":2,"wal-append.queue_time_us":311302}
W20260709 13:16:22.143770  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 248053us
I20260709 13:16:22.148661  5490 leader_election.cc:400] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5.
I20260709 13:16:22.150382  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:22.111887  7338 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.091976  7294 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:22.156234  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 189235us
I20260709 13:16:22.159636  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:22.158865  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64510.3us
I20260709 13:16:22.106338  7370 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:22.163422  5339 leader_election.cc:400] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 5.
I20260709 13:16:22.144737  7405 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.127599  7427 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:22.108896  7426 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:16:22.167464  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:22.168252  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:22.163427  7446 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:16:22.170009  5339 leader_election.cc:403] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:22.175813  7469 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:16:22.193660  5371 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
W20260709 13:16:22.190599  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.160101  7351 consensus_meta.cc:287] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.008s
I20260709 13:16:22.179302  7424 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:22.179979  7459 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:16:22.165864  7370 consensus_queue.cc:1243] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:22.183611  7378 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.159699  7461 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.185487  5370 raft_consensus.cc:2376] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6. Re-sending same reply.
I20260709 13:16:22.164347  7383 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.156405  7466 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.195170  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:22.182694  7421 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.199981  7405 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.216411  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1265) took 1210 ms. Trace:
I20260709 13:16:22.217123  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:22.218019  5445 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:22.219143  7475 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.220384  7225 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.209928  7294 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.159929  7428 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.201633  7194 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.184418  7270 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.204958  7351 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:22.212749  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50743.8us
I20260709 13:16:22.211917  7383 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.188547  7427 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:22.123178  7266 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.232643  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1275) took 1223 ms. Trace:
W20260709 13:16:22.232559  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73004.9us
I20260709 13:16:22.228802  5520 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:22.236856  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 127530us
I20260709 13:16:22.233636  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:22.237998  5447 rpcz_store.cc:276] 0709 13:16:21.009191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.658815 (+649624us) service_pool.cc:224] Handling call
0709 13:16:21.678197 (+ 19382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.819351 (+141154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.844839 (+ 25488us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.904583 (+ 59744us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.110394 (+205811us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:22.110450 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.110559 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.232418 (+121859us) raft_consensus.cc:1685] finished
0709 13:16:22.232438 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.232584 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14834,"raft.queue_time_us":53025,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":7109,"thread_start_us":285822,"threads_started":2,"wal-append.queue_time_us":214201}
W20260709 13:16:22.283670  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50132.9us
W20260709 13:16:22.284965  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 156341us
I20260709 13:16:22.196206  7473 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:22.287513  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:22.291332  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.216851  5448 rpcz_store.cc:276] 0709 13:16:21.006107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.203921 (+197814us) service_pool.cc:224] Handling call
0709 13:16:21.204426 (+   505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:21.325558 (+121132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.325604 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:21.376984 (+ 51380us) log.cc:844] Serialized 52 byte log entry
0709 13:16:21.923478 (+546494us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:21.923518 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.923586 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.216174 (+292588us) raft_consensus.cc:1685] finished
0709 13:16:22.216194 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.216347 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74483,"raft.queue_time_us":184335,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":523066,"threads_started":2,"wal-append.queue_time_us":576194}
I20260709 13:16:22.229521  7410 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.294627  5519 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:22.294790  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:22.295635  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.236734  7422 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.283882  7471 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:22.297832  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.236891  7371 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:22.311653  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:22.311918  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:22.299312  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.314538  5515 raft_consensus.cc:2368] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5.
I20260709 13:16:22.226294  7270 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:22.298005  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.302037  5446 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:16:22.302793  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.297931  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:22.304297  5522 raft_consensus.cc:2368] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:22.291741  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.305874  5444 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:22.213809  7466 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:22.230760  7383 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.308650  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.233626  7464 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:22.225246  7449 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.320766  5517 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:22.321815  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 126740us
I20260709 13:16:22.296478  7288 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.328383  5523 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:22.330473  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.282745  7338 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.308698  7471 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.317859  7361 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.337678  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:22.380136  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.380956  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86260.6us
I20260709 13:16:22.328979  7428 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:22.382251  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.324793  7466 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.385805  5447 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:22.387872  5446 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.382542  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.390390  5446 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:22.380151  7464 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.393838  7464 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.394573  7464 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.395056  7464 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.399173  7270 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:22.380518  7465 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.285s	user 0.001s	sys 0.001s
I20260709 13:16:22.310921  7422 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.453357  7422 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.453771  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:22.456653  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:22.458266  7476 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:22.459021  7476 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:22.459497  7476 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:22.460420  7476 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.464530  7422 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:22.384804  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.474470  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:22.342541  7471 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:22.442021  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53752.4us
I20260709 13:16:22.441084  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.442452  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:22.442929  7431 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.443727  7455 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.474967  7194 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.475759  7225 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:22.382304  7361 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.445915  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.446573  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.491413  5524 raft_consensus.cc:2368] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
W20260709 13:16:22.450140  5414 leader_election.cc:336] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.761s (SENT)
I20260709 13:16:22.456323  7415 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.475370  5447 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:22.397218  5521 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:22.480482  7488 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.380223  7288 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.480612  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:22.516109  5450 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.481153  7449 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.481328  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:22.517072  6076 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:22.481789  7425 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.007s	user 0.013s	sys 0.000s
I20260709 13:16:22.482113  5443 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:22.482558  7338 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.482374  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.484261  7378 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:22.477583  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:22.538371  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.422396  5523 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:22.492805  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.539546  5515 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:22.500159  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:22.484623  7441 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:16:22.506800  5522 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:22.508307  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.519789  7249 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:22.549233  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 124509us
I20260709 13:16:22.549685  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.551905  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:22.562980  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 99153.1us
I20260709 13:16:22.533962  7488 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.557125  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:22.557288  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47554.2us
I20260709 13:16:22.557231  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.558179  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.541714  5441 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:22.575379  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.488399  7344 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.580797  5515 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:22.582609  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1128) took 1338 ms. Trace:
I20260709 13:16:22.555933  7351 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:22.565400  7449 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:22.591990  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.593794  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.599282  5518 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:22.601513  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.596393  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.603418  5522 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.597280  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.584782  5520 rpcz_store.cc:276] 0709 13:16:21.244613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.244767 (+   154us) service_pool.cc:224] Handling call
0709 13:16:21.273358 (+ 28591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.239708 (+966350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.579667 (+339959us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54001e6254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:22.582541 (+  2874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196751744}
I20260709 13:16:22.566424  7361 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:22.606340  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 164034us
I20260709 13:16:22.606762  5524 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:22.604454  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:22.585579  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:22.602042  5518 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:22.535156  7425 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.584291  7451 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.583830  7464 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.610303  5518 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.587028  7419 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.591814  7338 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.599836  7473 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:22.644940  7338 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.645404  7338 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.632040  5450 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:22.645649  7431 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.645712  7473 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.559552  7441 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.650386  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:22.654702  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.655997  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.659430  6076 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:22.657991  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.671475  5518 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:22.676406  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 95485us
I20260709 13:16:22.600775  7405 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.598927  7449 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:16:22.682467  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 125475us
W20260709 13:16:22.689580  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77376.8us
I20260709 13:16:22.682118  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:22.703794  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 70959.8us
I20260709 13:16:22.709259  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.717072  5448 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:22.719904  5444 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.653303  7427 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:22.723162  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:22.723130  7137 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:22.722985  7449 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:22.725222  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:22.739074  5370 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:22.725529  7436 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:22.674927  7339 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:22.677263  7431 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:22.720665  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 102327us
I20260709 13:16:22.733716  5523 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:16:22.744913  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 140604us
W20260709 13:16:22.747927  5416 connection.cc:256] RPC call timeout handler was delayed by -1.2706966550001653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:16:22.749248  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:22.749905  5373 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.674667  7249 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:16:22.692986  7405 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.757557  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:22.762343  5523 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.754429  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:22.759272  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:22.763819  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:22.764508  5368 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.764364  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:22.765407  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:22.767464  5366 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.714907  7432 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:22.740187  7415 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.770671  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:22.777756  5372 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:22.772037  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.772001  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:22.775822  5369 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:22.781880  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:22.761466  7371 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.804227  5370 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
W20260709 13:16:22.807814  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48851.5us
I20260709 13:16:22.805712  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:22.782142  7475 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.556s	user 0.000s	sys 0.012s
W20260709 13:16:22.813992  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69114.1us
I20260709 13:16:22.808844  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:22.803494  7422 consensus_queue.cc:1243] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:22.848937  5442 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:22.849349  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:22.854959  5449 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.763402  7309 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:16:22.862108  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:22.851569  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 116022us
I20260709 13:16:22.862888  5371 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.867170  5416 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:22.872727  5523 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:22.874480  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:22.880363  5442 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
W20260709 13:16:22.848030  7461 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 13:16:22.881583  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:22.813730  7288 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.813882  7371 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.782514  7490 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:22.783413  7383 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.849051  7475 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 5.
I20260709 13:16:22.862150  7339 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:22.845621  7452 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:16:22.884362  7449 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:22.923333  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.926173  5445 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:22.896842  7461 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.897950  7344 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.931473  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:22.935912  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:22.905313  7436 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:22.871603  7431 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:16:22.871405  7137 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:16:22.883744  7427 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:22.932771  5414 leader_election.cc:400] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5.
W20260709 13:16:22.942286  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 167248us
I20260709 13:16:22.943380  7425 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:22.944563  7436 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:22.929659  7294 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.931056  7309 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:22.917953  7415 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:16:22.940708  7475 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.997346  6042 leader_election.cc:400] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 4. Current term is 5.
I20260709 13:16:23.009653  6042 leader_election.cc:403] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:22.966176  7487 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.951216  7419 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.019642  5517 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:22.980612  7441 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.026743  5371 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:23.000113  7309 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:22.979405  7488 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:23.014849  7500 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.279s	user 0.000s	sys 0.002s
I20260709 13:16:23.015573  7501 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:23.004889  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 196170us
I20260709 13:16:22.981323  7294 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:23.011514  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75737.5us
W20260709 13:16:23.009922  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85443.8us
I20260709 13:16:23.027936  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:23.071164  5371 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.981451  7458 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.269s
W20260709 13:16:23.068455  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84867.1us
W20260709 13:16:22.996340  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 242003us
W20260709 13:16:23.078467  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.077404  5414 leader_election.cc:400] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:23.084627  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:23.078759  7510 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:23.074782  7294 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.068392  7405 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.090009  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.094218  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:23.076450  7509 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.106201  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:23.073945  7432 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:23.107926  5340 leader_election.cc:400] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:23.108599  5340 leader_election.cc:403] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:23.115984  5518 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:23.119513  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:23.122335  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 444602us
I20260709 13:16:23.123674  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.125216  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.099510  7415 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.100881  7426 raft_consensus.cc:2764] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:23.134974  5447 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:23.060763  7339 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:23.143293  5446 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:23.145134  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:23.150763  5522 consensus_meta.cc:287] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:16:23.151332  5522 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:23.153728  5414 leader_election.cc:400] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4.
I20260709 13:16:23.155032  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.093700  7488 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:16:23.121079  7405 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:23.025805  7487 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.169518  7487 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.134217  7438 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:23.133868  7383 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.121651  7452 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:16:23.211649  5366 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
W20260709 13:16:23.218250  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 73187.3us
I20260709 13:16:23.144178  7371 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:23.219079  5371 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
W20260709 13:16:23.220244  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65329.7us
I20260709 13:16:23.220963  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:23.103983  7309 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.223773  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.162541  7419 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:23.232909  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.234673  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.235641  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:23.225124  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 123693us
I20260709 13:16:23.226481  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:23.226859  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:23.210021  7434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.011s	sys 0.018s
I20260709 13:16:23.229110  5373 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:23.238350  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:23.238898  5373 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.209484  7464 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.142108  7415 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.248149  5372 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:23.254848  5368 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:23.249958  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.211982  7487 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:23.208140  7515 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:23.259640  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:23.277624  5366 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.230139  7249 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:23.243580  7434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.011s	sys 0.019s
I20260709 13:16:23.219480  7438 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:23.287348  5373 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
W20260709 13:16:23.252969  7338 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.001s
I20260709 13:16:23.290071  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.292941  5366 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:23.244158  7476 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:23.256309  7288 raft_consensus.cc:2764] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:23.243999  7344 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.243830  7425 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:23.236873  7501 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:23.311798  7459 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:16:23.270844  7507 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:16:23.304221  7451 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.297197  5371 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:23.252766  7383 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.305958  7515 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:23.316092  5372 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:23.270299  7514 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:23.322520  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.260632  5368 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:23.299575  7309 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:23.298678  7458 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:23.302906  7371 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:23.301234  7487 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:23.345204  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:23.337595  7415 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.311509  7249 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:23.304641  7504 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.321208  7338 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.342409  7514 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:23.324604  7476 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.371137  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:23.345335  7425 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:23.428541  5449 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.573s	user 0.015s	sys 0.000s
I20260709 13:16:23.428969  5449 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:16:23.432091  5443 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:23.440083  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.441105  5449 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
W20260709 13:16:23.450414  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 79358.4us
I20260709 13:16:23.451335  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:23.433300  7466 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.992s	user 0.014s	sys 0.001s
I20260709 13:16:23.453706  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:23.449572  7526 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:16:23.406725  7451 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.468961  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.471499  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1284) took 1160 ms. Trace:
I20260709 13:16:23.471799  5449 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:16:23.458995  7449 consensus_meta.cc:287] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.010s
I20260709 13:16:23.472299  5441 rpcz_store.cc:276] 0709 13:16:22.311215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.311454 (+   239us) service_pool.cc:224] Handling call
0709 13:16:22.328601 (+ 17147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.581795 (+253194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.471014 (+889219us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b540033d1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:23.471390 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489601408}
I20260709 13:16:23.474045  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.480451  5447 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:23.453147  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:23.493192  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.494673  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.495544  5449 raft_consensus.cc:2410] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:23.469597  7415 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.508318  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:23.508679  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 389229us
I20260709 13:16:23.459013  7518 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.209s
I20260709 13:16:23.509713  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:23.431149  7438 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:23.455415  7517 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.238s
I20260709 13:16:23.492676  6070 raft_consensus.cc:1813] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
W20260709 13:16:23.552943  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.458055  7466 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.555068  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:23.553150  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45267.8us
I20260709 13:16:23.556545  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.588486  5518 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:23.473558  7378 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:16:23.454953  7249 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:23.557966  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.590507  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.490187  7426 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:23.595227  5449 raft_consensus.cc:2410] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:23.597846  5516 raft_consensus.cc:2368] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5.
I20260709 13:16:23.585043  7449 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:23.604334  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.605100  5373 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:16:23.587442  7475 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.602056  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.608309  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.609078  5516 raft_consensus.cc:2368] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8.
I20260709 13:16:23.609148  5522 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:23.591536  7523 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:16:23.615952  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.465291  7515 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.606525  7405 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.617851  7405 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:23.620052  7405 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:23.620540  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.621592  7371 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:23.624104  7451 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.624853  7458 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.626154  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.627127  7476 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.627556  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:23.628345  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.630198  5449 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:23.631083  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.632244  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.633776  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.635174  5414 leader_election.cc:400] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5.
W20260709 13:16:23.635970  7294 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.531s	user 0.003s	sys 0.016s
I20260709 13:16:23.636364  7294 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.637704  7451 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.638253  7451 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:23.638715  7451 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.626259  5490 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.641078  7484 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.641877  7484 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.642403  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:23.642608  5448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1283) took 1345 ms (client timeout 1587 ms). Trace:
W20260709 13:16:23.643059  5448 rpcz_store.cc:269] 0709 13:16:22.297558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.297701 (+   143us) service_pool.cc:224] Handling call
0709 13:16:23.642404 (+1344703us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540023a854. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:23.642548 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916127488}
I20260709 13:16:23.644121  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1279) took 1409 ms. Trace:
I20260709 13:16:23.644297  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.647365  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.644557  5445 rpcz_store.cc:276] 0709 13:16:22.234392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.256194 (+ 21802us) service_pool.cc:224] Handling call
0709 13:16:22.291010 (+ 34816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.926657 (+635647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.643833 (+717176us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b540032f5d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:23.644059 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460130048}
I20260709 13:16:23.552690  7415 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.493016  7487 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.602681  7378 consensus_queue.cc:1243] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:23.607971  6070 raft_consensus.cc:2368] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:16:23.653606  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.654302  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:23.657109  5414 leader_election.cc:400] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8.
I20260709 13:16:23.659500  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.661096  7351 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:23.663137  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.615094  7449 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:23.667579  7512 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:23.670037  7529 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:16:23.671962  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.685459  5414 leader_election.cc:403] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:23.475862  7514 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.614427  7473 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:23.664553  7516 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:16:23.655701  7476 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:23.707541  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50520.7us
I20260709 13:16:23.712404  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.712925  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:23.714401  7501 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:23.703768  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1058) took 1293 ms. Trace:
I20260709 13:16:23.715451  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.718178  5445 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:23.716383  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.718981  5448 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.671260  7338 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.696878  7410 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.719978  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:23.725850  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83540.6us
I20260709 13:16:23.730659  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:23.726017  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.717835  5524 rpcz_store.cc:276] 0709 13:16:22.410434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.692330 (+281896us) service_pool.cc:224] Handling call
0709 13:16:22.721178 (+ 28848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.740961 (+ 19783us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:23.631389 (+890428us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b1800334180. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf
0709 13:16:23.631594 (+   205us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.703265 (+ 71671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.703333 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:23.703386 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.703492 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.703673 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":121314,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":12381,"raft.queue_time_us":454,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"spinlock_wait_cycles":13228288,"thread_start_us":165862,"threads_started":2,"wal-append.queue_time_us":70988}
I20260709 13:16:23.734711  5490 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:23.655310  7475 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:23.719600  7455 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.231s	user 0.018s	sys 0.005s
I20260709 13:16:23.737349  7457 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.754398  7457 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:23.754894  7457 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.755973  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:23.756834  7338 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:23.757258  7338 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:23.757766  7338 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.758122  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:23.758340  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1062) took 1301 ms. Trace:
I20260709 13:16:23.758772  5520 rpcz_store.cc:276] 0709 13:16:22.456696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.713706 (+257010us) service_pool.cc:224] Handling call
0709 13:16:22.723496 (+  9790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.775866 (+ 52370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.775905 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.801967 (+ 26062us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.941747 (+139780us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:22.941790 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.941864 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.758117 (+816253us) raft_consensus.cc:1685] finished
0709 13:16:23.758139 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.758283 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52832,"raft.queue_time_us":43757,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11287,"thread_start_us":56011,"threads_started":1,"wal-append.queue_time_us":248246}
I20260709 13:16:23.760772  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:23.760964  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:23.761622  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1055) took 1366 ms. Trace:
I20260709 13:16:23.762276  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.762982  7488 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:23.763593  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:23.764264  5522 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5. Re-sending same reply.
I20260709 13:16:23.764644  7225 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:23.763681  7405 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:23.765163  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:23.764580  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:23.766669  5520 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:23.766294  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.704977  7512 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:23.739354  5340 leader_election.cc:400] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:16:23.737340  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:23.750270  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 147) took 1588 ms. Trace:
I20260709 13:16:23.752452  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:23.751349  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.750972  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1146) took 1436 ms. Trace:
I20260709 13:16:23.761977  5517 rpcz_store.cc:276] 0709 13:16:22.394937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.541455 (+146518us) service_pool.cc:224] Handling call
0709 13:16:23.761402 (+1219947us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b540023c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:23.761567 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45316480}
I20260709 13:16:23.711722  7351 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:23.885028  5521 rpcz_store.cc:276] 0709 13:16:22.314636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.683264 (+368628us) service_pool.cc:224] Handling call
0709 13:16:22.719334 (+ 36070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.803954 (+ 84620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.804004 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.848260 (+ 44256us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.077841 (+229581us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:23.078003 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.078085 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.750740 (+672655us) raft_consensus.cc:1685] finished
0709 13:16:23.750764 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.750913 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51008,"raft.queue_time_us":67755,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":41705,"thread_start_us":170826,"threads_started":1,"wal-append.queue_time_us":254180}
I20260709 13:16:23.887787  5517 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:23.744378  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.890311  5367 rpcz_store.cc:276] 0709 13:16:22.161758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.164195 (+  2437us) service_pool.cc:224] Handling call
0709 13:16:22.175317 (+ 11122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.215945 (+ 40628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.215985 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.216544 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.726909 (+510365us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b1800442120. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:16:23.207265 (+480356us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:23.207307 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.207387 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.749924 (+542537us) raft_consensus.cc:1685] finished
0709 13:16:23.749946 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.750204 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22485,"raft.queue_time_us":30843,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":50906,"spinlock_wait_cycles":38913408,"thread_start_us":480021,"threads_started":1,"wal-append.queue_time_us":1122404}
I20260709 13:16:23.767508  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.884693  5340 leader_election.cc:403] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:23.893110  5447 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
W20260709 13:16:23.732005  7471 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 1.240s	user 0.012s	sys 0.003s
I20260709 13:16:23.895380  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.730283  7514 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.906483  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.907667  5446 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:23.737614  7528 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:16:23.771627  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:23.891866  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 127370us
I20260709 13:16:23.902151  7424 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:23.792763  5489 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.587s (SENT) [suppressed 36 similar messages]
W20260709 13:16:23.739698  7509 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.616s	user 0.000s	sys 0.009s
W20260709 13:16:23.738873  7536 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:16:23.894507  5442 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
W20260709 13:16:23.738206  7533 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:16:23.742020  7498 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8.
I20260709 13:16:23.898993  5448 raft_consensus.cc:2410] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:23.972452  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.973182  5448 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:23.886397  5515 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:23.926025  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:23.749691  7455 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:23.750463  7415 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.753077  7309 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:23.753077  7137 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.744867  7422 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.930197  5517 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:23.930039  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 192772us
I20260709 13:16:24.005834  5523 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:24.006284  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:23.746282  7535 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:16:23.747938  7466 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.743775  7475 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:23.765163  7225 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:23.970238  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.924901  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:23.986936  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.737550  7410 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:23.993001  7344 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.000s
I20260709 13:16:23.994403  7451 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.745481  7473 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:23.928066  7424 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.997083  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.999001  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:23.929567  7484 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:24.024204  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 284989us
I20260709 13:16:24.002022  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.002874  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:23.972678  7509 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 4. Current term is 5.
I20260709 13:16:23.986502  7501 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:23.923769  7471 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:24.010776  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 85962us
I20260709 13:16:24.011947  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.038980  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:24.040582  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:24.040868  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 248249us
W20260709 13:16:24.028580  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 269294us
I20260709 13:16:24.012959  5490 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:24.015759  5367 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:24.011495  7498 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.747212  7449 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.027861  5447 raft_consensus.cc:2410] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:24.030061  5518 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:24.024920  7455 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.025903  7484 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:24.064064  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.064908  5370 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:24.008013  7294 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:24.023587  7344 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.043016  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:24.043479  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:23.995554  7512 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.075712  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:24.077199  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:24.043417  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.024320  7424 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.051395  5442 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.007663  7485 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:24.054347  7498 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:24.048625  7249 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:24.058983  7288 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.067041  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.038432  7466 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:24.071830  6076 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:24.085081  5366 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:24.096324  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.104683  5442 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.103615  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.115803  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:24.115991  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.116725  5367 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.117198  5372 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:24.118537  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.120036  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.123816  7344 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:24.124406  7344 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.125602  7460 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.125330  7344 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.126101  7460 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.126204  7524 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.127187  7524 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } attrs { replace: true } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:24.128427  7460 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:24.128458  5441 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:24.130393  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.131170  5441 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:24.131112  7524 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:24.098142  7499 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:24.070806  7518 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:24.135167  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.137003  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:24.143261  5447 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.138115  5374 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:24.139647  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:24.139730  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:24.070245  7484 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:24.159206  5370 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:24.169935  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:24.077919  7509 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:16:24.170991  7559 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.171831  7559 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:24.170331  7512 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.080032  7438 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:16:24.174095  5370 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:24.138114  7405 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:24.174695  5372 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:24.151726  7518 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:24.098034  7266 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:16:24.042217  7351 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:24.179397  5374 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:24.134445  7288 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:24.199450  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.179733  7451 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.180083  7473 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:24.195097  7551 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:16:24.210784  7410 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.193535  7518 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:24.216382  7548 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.289s	user 0.003s	sys 0.000s
W20260709 13:16:24.217254  7550 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:16:24.218037  7549 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:16:24.218425  7338 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.220484  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 124) took 1362 ms. Trace:
I20260709 13:16:24.221971  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1286) took 1883 ms. Trace:
I20260709 13:16:24.222515  7471 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:24.049566  7501 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.225778  5366 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:24.226696  7457 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:24.228006  7534 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.626s	user 0.000s	sys 0.001s
I20260709 13:16:24.228601  7424 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.268543  7457 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:24.229584  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:24.232049  7476 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.002s
I20260709 13:16:24.272737  7476 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:24.234229  7405 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.278090  5449 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:24.291006  5447 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:24.292773  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.293803  5447 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:24.295061  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:24.295812  5447 raft_consensus.cc:2376] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3. Re-sending same reply.
I20260709 13:16:24.296797  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:24.302762  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:24.235704  7539 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.498s	user 0.000s	sys 0.001s
I20260709 13:16:24.237569  5368 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 6: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:24.211311  7560 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:24.242877  5367 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:24.114836  7485 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.141162  7225 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.257665  5444 rpcz_store.cc:276] 0709 13:16:22.338250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.338429 (+   179us) service_pool.cc:224] Handling call
0709 13:16:22.385307 (+ 46878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.726012 (+340705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.221690 (+1495678us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b5400238a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:24.221906 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769038592}
I20260709 13:16:24.256982  5443 rpcz_store.cc:276] 0709 13:16:22.858300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.870491 (+ 12191us) service_pool.cc:224] Handling call
0709 13:16:23.429533 (+559042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.432638 (+  3105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.220259 (+787621us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540029d6d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:24.220420 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218748160}
I20260709 13:16:24.242292  7288 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:24.268652  7424 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.172297  7559 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.315263  5446 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:24.348783  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.349879  5446 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:24.350328  5447 raft_consensus.cc:1813] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Handling vote request from an unknown peer 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:24.350956  5447 raft_consensus.cc:2368] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5.
I20260709 13:16:24.352118  5446 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:16:24.352303  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 275188us
I20260709 13:16:24.340663  5448 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.300920  7338 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.340655  7560 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:24.389873  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:24.399286  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:24.401633  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:24.404388  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:24.391306  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:24.396960  5446 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:24.414714  5446 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:24.409713  7438 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:24.411356  7514 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:16:24.411557  7309 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:24.419106  7309 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.419520  7309 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.421509  7457 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.409452  7468 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.428890  7438 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:24.384861  7410 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.430356  7482 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:24.430786  7482 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:24.431646  7482 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.432358  7501 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.430790  7410 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.435462  7410 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.437742  7514 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:24.438522  7559 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.439095  7266 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:24.439518  7266 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:24.440394  7266 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.445722  7225 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.447736  7309 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.451479  7560 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:24.456633  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.454155  6070 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:24.454484  7485 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.463578  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.474416  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.475359  5524 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:24.456475  7524 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.452448  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1063) took 1446 ms. Trace:
W20260709 13:16:24.460036  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.438958  7562 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:16:24.476281  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.489548  5524 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:24.490864  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:24.478091  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.478783  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.465157  5519 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.479519  5373 rpcz_store.cc:276] 0709 13:16:23.005816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.305804 (+299988us) service_pool.cc:224] Handling call
0709 13:16:23.306277 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.605680 (+299403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.451915 (+846235us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54001e9454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:24.452329 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686455040}
I20260709 13:16:24.480268  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.493916  5516 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:24.494454  5521 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:24.484478  5448 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:24.488324  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:24.492697  5446 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.495400  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.498847  5446 raft_consensus.cc:3055] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:24.498687  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.499995  5446 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.500784  5446 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:24.501507  7270 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.501838  5446 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:24.509341  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:24.489759  7524 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:24.512048  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 120852us
I20260709 13:16:24.517343  5446 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:16:24.523518  5446 pending_rounds.cc:85] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 5
I20260709 13:16:24.520375  7429 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.504560  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.536762  5373 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:24.539402  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:24.523352  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.524407  5446 pending_rounds.cc:107] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:16:24.519330  7566 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:24.534266  5524 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:24.541841  5446 raft_consensus.cc:2889] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.543284  5516 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:24.488274  7466 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:16:24.475841  7249 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.546988  5516 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:24.551724  5446 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:24.555387  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:24.557823  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.560307  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:24.488941  7455 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:16:24.565586  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50211.5us
I20260709 13:16:24.582562  5339 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:24.584014  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:24.554222  7515 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:24.554044  7309 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:24.511822  7484 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.558538  7566 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.582867  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:24.571121  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:24.592834  5373 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.593691  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:24.594357  7521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.000s	sys 0.019s
I20260709 13:16:24.562438  7429 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:24.607869  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:24.607694  5445 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.032s	sys 0.072s
W20260709 13:16:24.617455  5445 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.032s	sys 0.072s
I20260709 13:16:24.624984  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:24.626909  7464 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.627382  7464 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.627730  7464 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.629505  7338 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:24.633558  7490 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:24.634066  7490 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.634403  7490 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:24.610157  7521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.000s	sys 0.019s
W20260709 13:16:24.640226  6042 leader_election.cc:336] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.526s (SENT)
I20260709 13:16:24.605247  7569 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.642391  7569 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:24.642776  7569 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.647605  7338 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:24.604899  7567 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:24.654244  7567 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.655195  7567 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.606600  7512 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.658247  7512 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.592197  7428 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.598069  7515 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.597689  7466 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.578351  7499 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.673203  5373 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:24.681304  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:24.663887  7428 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.666587  7515 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:24.687719  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 94142.4us
I20260709 13:16:24.666851  7466 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:24.694885  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.691525  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:24.616657  7518 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.700978  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.705384  5373 raft_consensus.cc:1813] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Handling vote request from an unknown peer 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:24.706604  5373 raft_consensus.cc:2368] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 6.
I20260709 13:16:24.709285  5490 leader_election.cc:400] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 6.
I20260709 13:16:24.709901  5490 leader_election.cc:403] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:24.688380  7498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.006s	sys 0.014s
I20260709 13:16:24.674373  7524 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:24.701930  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 365768us
I20260709 13:16:24.689788  7519 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:24.697213  7466 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:24.712702  7498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.007s	sys 0.015s
I20260709 13:16:24.724294  5517 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:24.722522  7455 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.730214  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1069) took 1171 ms. Trace:
I20260709 13:16:24.610929  7249 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.707366  7451 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:24.719601  7566 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.720949  5373 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:24.689209  7568 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:24.716720  7485 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:24.712800  7351 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.746716  6076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 79) took 1400 ms (client timeout 1827 ms). Trace:
I20260709 13:16:24.738657  5518 rpcz_store.cc:276] 0709 13:16:23.559040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.628419 (+ 69379us) service_pool.cc:224] Handling call
0709 13:16:23.628696 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.050819 (+422123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.729921 (+679102us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540016c1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:24.730140 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922281216}
I20260709 13:16:24.718382  7344 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:24.762035  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.762552  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:24.771055  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:24.768294  6076 rpcz_store.cc:269] 0709 13:16:23.334847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.335072 (+   225us) service_pool.cc:224] Handling call
0709 13:16:24.735338 (+1400266us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54005c1cd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:24.735479 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668185344}
I20260709 13:16:24.773805  5373 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:24.739980  7498 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.789486  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.758924  7270 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:24.731721  7405 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.806373  7270 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.864491  7518 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:24.765121  7456 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:16:24.864331  7498 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.865072  7270 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:24.866430  7490 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:24.810554  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:24.811645  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:24.867913  6069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 82) took 1435 ms. Trace:
I20260709 13:16:24.868327  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:24.868290  6069 rpcz_store.cc:276] 0709 13:16:23.432532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.452640 (+ 20108us) service_pool.cc:224] Handling call
0709 13:16:24.811370 (+1358730us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5800004598. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:24.867855 (+ 56485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4887296}
I20260709 13:16:24.812701  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:24.868930  7490 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:24.834316  6077 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:24.841589  7436 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:24.843134  7574 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:16:24.844301  7482 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:24.844821  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 79899.4us
I20260709 13:16:24.849932  7344 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:24.850481  7575 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:16:24.853890  7429 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:24.856133  7266 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.775297  7351 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:24.728185  7499 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.862762  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:24.868848  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:24.894882  5522 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:24.869247  5373 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:24.771652  7309 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:24.821538  6070 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:24.870256  6071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 81) took 1462 ms (client timeout 1873 ms). Trace:
I20260709 13:16:24.795562  7451 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:16:24.901938  6071 rpcz_store.cc:269] 0709 13:16:23.408293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.438884 (+ 30591us) service_pool.cc:224] Handling call
0709 13:16:24.812588 (+1373704us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b5800004598. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67eee 0000000000375939 00007fc1d8cdb1e0 00007fc1d8da40c4 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:24.870193 (+ 57605us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13433088}
I20260709 13:16:24.885128  7492 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.800741  7338 raft_consensus.cc:2764] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:24.889991  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:24.906060  5521 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.797976  7568 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.906947  5373 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:16:24.896003  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:24.876521  7436 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:24.908870  5373 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:24.881239  7344 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:24.917793  5373 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:24.921403  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.905104  7492 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.922595  5441 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:24.913373  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:24.899565  7484 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:24.933174  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:24.877177  7405 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.901944  7351 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:24.906473  7443 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.888823  7518 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:24.973192  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.937855  7137 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.915486  7309 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.919574  7524 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:16:24.969185  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:24.965029  7429 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:24.993163  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:24.961987  5521 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:24.936386  7436 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:24.974259  7443 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:25.011392  7428 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.026160  7451 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.043979  7515 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.048038  7515 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:25.039373  7405 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.037379  7492 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:25.056084  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.985478  7568 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.051285  7436 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.051103  7455 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 6.
W20260709 13:16:25.077809  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 300707us
I20260709 13:16:25.082136  7351 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:25.082877  7429 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:25.083159  7351 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:25.084100  7429 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.082314  7524 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:25.094015  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 332486us
I20260709 13:16:25.085693  7524 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:25.097667  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 109119us
I20260709 13:16:25.101091  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.100417  7457 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:25.104115  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1320) took 1036 ms. Trace:
I20260709 13:16:25.110432  5367 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:25.112327  5447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.011s	sys 0.003s
W20260709 13:16:25.112974  5447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.011s	sys 0.003s
I20260709 13:16:25.097976  7464 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.132920  5489 leader_election.cc:400] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5.
I20260709 13:16:25.114310  7519 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:25.085127  7351 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.100955  7455 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:25.156307  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.119546  7457 consensus_queue.cc:1243] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:25.162014  5446 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:25.153200  7589 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:16:25.134902  7410 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.180732  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.120942  7492 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:16:25.190485  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 100159us
I20260709 13:16:25.162168  7309 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:25.221491  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.189028  7599 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.184042  7597 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.220078  7266 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.191648  7428 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.195344  7514 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.183179  7518 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:25.158958  7524 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.188535  7457 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:25.234544  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.222766  7421 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.256125  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.257478  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.258572  7270 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.259876  7270 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:25.260775  7560 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.267396  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:25.248389  7588 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.172s	user 0.001s	sys 0.001s
I20260709 13:16:25.241822  7410 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.273689  7464 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.277661  7597 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.280915  7524 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.288811  7484 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:25.289616  7484 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:25.290716  7484 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.292574  7294 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:25.293071  7294 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:25.294268  7294 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.295423  7294 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.255084  7514 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.301647  7514 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:25.297952  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.247922  7599 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.306224  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:25.274399  7595 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:16:25.311657  7605 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:16:25.311446  7344 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.312786  7288 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:25.250401  7266 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.314826  5443 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:25.315851  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1043) took 1727 ms. Trace:
I20260709 13:16:25.355964  5441 rpcz_store.cc:276] 0709 13:16:23.588309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.131987 (+543678us) service_pool.cc:224] Handling call
0709 13:16:24.132303 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.923238 (+790935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.305500 (+382262us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54003cc654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:25.315764 (+ 10264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812044032}
I20260709 13:16:25.324577  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:25.319989  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:25.321239  7466 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.008s
I20260709 13:16:25.368584  7466 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.370772  7466 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.272011  7596 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:16:25.362720  7597 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.371999  7597 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.226786  7519 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:25.323969  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:25.374101  7566 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:25.374539  7597 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.375473  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1305) took 1790 ms. Trace:
I20260709 13:16:25.313966  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1056) took 1689 ms. Trace:
I20260709 13:16:25.376551  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:25.376416  5448 rpcz_store.cc:276] 0709 13:16:23.624407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.986644 (+362237us) service_pool.cc:224] Handling call
0709 13:16:25.313682 (+1327038us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54002adad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:25.313889 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721512192}
I20260709 13:16:25.377835  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:25.327754  7569 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.003s
I20260709 13:16:25.386632  5521 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:25.340073  5273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 38) took 8742 ms. Trace:
I20260709 13:16:25.340490  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 128) took 1997 ms. Trace:
W20260709 13:16:25.342137  7601 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:16:25.343447  7594 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:16:25.343353  5515 raft_consensus.cc:606] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.528021  5515 raft_consensus.cc:614] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:25.481846  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:25.346630  7607 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.125s	user 0.004s	sys 0.001s
I20260709 13:16:25.346871  7564 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.347368  7485 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.347990  7572 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.348646  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 472026us
I20260709 13:16:25.349186  7225 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:25.349838  7405 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.350383  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:25.353554  5369 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:25.354058  5370 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:25.374601  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1306) took 1785 ms. Trace:
I20260709 13:16:25.337652  7464 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:25.375876  5442 rpcz_store.cc:276] 0709 13:16:23.585416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.099052 (+513636us) service_pool.cc:224] Handling call
0709 13:16:24.099462 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.110212 (+ 10750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.375226 (+1265014us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b540028c654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:25.375406 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11297152}
W20260709 13:16:25.385025  7561 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.023s	user 0.005s	sys 0.004s
I20260709 13:16:25.385339  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:25.385855  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:25.561151  5522 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:25.338650  7599 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:25.439754  7595 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:16:25.440165  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1055) took 1816 ms. Trace:
I20260709 13:16:25.532757  7466 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.571751  5449 rpcz_store.cc:276] 0709 13:16:23.624088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.765752 (+141664us) service_pool.cc:224] Handling call
0709 13:16:25.387676 (+1621924us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400321ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:25.440080 (+ 52404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858861952}
I20260709 13:16:25.440725  7449 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:25.441589  7456 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:25.450609  5450 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:25.446343  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:25.387428  5519 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:16:25.463588  7579 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.596s	user 0.000s	sys 0.003s
I20260709 13:16:25.465339  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:25.466046  5508 tablet_service.cc:1558] Processing DeleteTablet for tablet 0276d804ade348368656bbe6805214df with delete_type TABLET_DATA_TOMBSTONED (TS 544c82a50cc4477886bb6f7d58f455ca not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36782
I20260709 13:16:25.575156  5441 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:25.578384  5518 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:25.466087  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:25.578965  5516 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.579130  5441 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 13:16:25.528337  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 204431us
W20260709 13:16:25.528752  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 365980us
I20260709 13:16:25.528985  5521 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.468959  5445 rpcz_store.cc:276] 0709 13:16:23.343302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.041955 (+698653us) service_pool.cc:224] Handling call
0709 13:16:24.076749 (+ 34794us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:24.617999 (+541250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.618043 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:24.659897 (+ 41854us) log.cc:844] Serialized 52 byte log entry
0709 13:16:24.775146 (+115249us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:24.801106 (+ 25960us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.339819 (+538713us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b18003a8100. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:16:25.340058 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.340137 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.340183 (+    46us) raft_consensus.cc:1685] finished
0709 13:16:25.340285 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.340432 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56330,"prepare.queue_time_us":31353,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":6730,"raft.queue_time_us":635071,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":261,"spinlock_wait_cycles":5333248,"thread_start_us":655457,"threads_started":2,"wal-append.queue_time_us":321881}
W20260709 13:16:25.532348  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.580307  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:25.543114  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55967.8us
I20260709 13:16:25.545683  5446 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:25.547021  5444 rpcz_store.cc:276] 0709 13:16:23.588903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.349444 (+760541us) service_pool.cc:224] Handling call
0709 13:16:24.384532 (+ 35088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.390610 (+  6078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.390645 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.390689 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:24.390722 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.374382 (+983660us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b540028cb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:25.374433 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.374547 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13368704}
I20260709 13:16:25.439754  7557 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.586874  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:25.588166  5369 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:25.564409  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1311) took 1482 ms. Trace:
I20260709 13:16:25.589373  5443 rpcz_store.cc:276] 0709 13:16:24.081970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.383942 (+301972us) service_pool.cc:224] Handling call
0709 13:16:25.314592 (+930650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.355367 (+ 40775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.564188 (+208821us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54002adad0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:25.564347 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078994304}
I20260709 13:16:25.439850  7569 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:25.566527  5368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1315) took 1502 ms (client timeout 1575 ms). Trace:
I20260709 13:16:25.535856  7344 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.568949  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1090) took 1488 ms. Trace:
I20260709 13:16:25.537137  7597 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:25.346132  7441 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.603848  5517 rpcz_store.cc:276] 0709 13:16:24.081002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.081275 (+   273us) service_pool.cc:224] Handling call
0709 13:16:24.134903 (+ 53628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.738134 (+603231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.568704 (+830570us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540016c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:25.568890 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354973568}
I20260709 13:16:25.468797  5273 rpcz_store.cc:276] 0709 13:16:16.598289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.612275 (+ 13986us) service_pool.cc:224] Handling call
0709 13:16:25.340004 (+8727729us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:21.753469 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:21.836638 (+ 83169us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:21.836696 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:16:21.836720 (+    24us) tablet.cc:662] Decoding operations
0709 13:16:21.837355 (+   635us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:21.837467 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:21.837497 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:21.837980 (+   483us) tablet.cc:701] Row locks acquired
0709 13:16:21.838042 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:16:21.838233 (+   191us) write_op.cc:270] Start()
0709 13:16:21.838378 (+   145us) write_op.cc:276] Timestamp: P: 1783602981838171 usec, L: 0
0709 13:16:21.838413 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:16:21.910296 (+ 71883us) log.cc:844] Serialized 1292 byte log entry
0709 13:16:22.848716 (+938420us) op_driver.cc:464] REPLICATION: finished
0709 13:16:23.250491 (+401775us) write_op.cc:301] APPLY: starting
0709 13:16:23.288571 (+ 38080us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:23.326549 (+ 37978us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:23.348074 (+ 21525us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:23.591708 (+243634us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:23.696362 (+104654us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:16:23.717018 (+ 20656us) write_op.cc:312] APPLY: finished
0709 13:16:23.739161 (+ 22143us) log.cc:844] Serialized 34 byte log entry
0709 13:16:24.236904 (+497743us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d0c820ac 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b
0709 13:16:24.640331 (+403427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:24.640452 (+   121us) write_op.cc:454] Released schema lock
0709 13:16:24.640514 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:24.640948 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:24.640983 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":610731,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":341828,"apply.run_cpu_time_us":28132,"apply.run_wall_time_us":1423085,"num_ops":3,"prepare.queue_time_us":179271,"prepare.run_cpu_time_us":15722,"prepare.run_wall_time_us":555526,"raft.queue_time_us":218989,"raft.run_cpu_time_us":20785,"raft.run_wall_time_us":331355,"replication_time_us":927592,"spinlock_wait_cycles":74162432,"thread_start_us":1571047,"threads_started":5,"wal-append.queue_time_us":1359175,"wal-append.run_cpu_time_us":33030,"wal-append.run_wall_time_us":1372319}]]}
I20260709 13:16:25.584764  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:25.603423  7585 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:16:25.554880  7564 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:25.608533  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.587746  7518 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:25.589893  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.527408  7482 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.590955  5368 rpcz_store.cc:269] 0709 13:16:24.064388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.077599 (+ 13211us) service_pool.cc:224] Handling call
0709 13:16:25.566307 (+1488708us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400185bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:25.566469 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271288704}
I20260709 13:16:25.566182  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:25.614187  5442 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.591550  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:25.615389  5449 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:25.567266  7410 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.625561  5445 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:25.612445  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:25.579615  5441 pending_rounds.cc:85] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 3
I20260709 13:16:25.596029  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1328) took 1423 ms. Trace:
I20260709 13:16:25.110353  5371 rpcz_store.cc:276] 0709 13:16:24.067334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.157586 (+ 90252us) service_pool.cc:224] Handling call
0709 13:16:24.183043 (+ 25457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.353727 (+170684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.353777 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.379937 (+ 26160us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.759153 (+379216us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:25.101374 (+342221us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.103674 (+  2300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.103778 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.103838 (+    60us) raft_consensus.cc:1685] finished
0709 13:16:25.103856 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.104040 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":82470,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":39902,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":3359,"thread_start_us":815966,"threads_started":3,"wal-append.queue_time_us":638730}
I20260709 13:16:25.628026  5441 pending_rounds.cc:107] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:25.589258  7225 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.578747  7249 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.630246  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48691.8us
I20260709 13:16:25.577654  7456 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:25.616443  7514 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.547492  7566 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:16:25.617345  5517 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:25.618244  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1150) took 3105 ms. Trace:
I20260709 13:16:25.619594  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.590538  7466 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.549181  7572 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.609249  7557 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:25.611157  7421 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:25.637748  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:25.545632  7485 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:25.623121  5366 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:25.623452  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:25.686600  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:25.687351  5522 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:25.628507  5441 raft_consensus.cc:2889] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.635888  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:25.631491  5490 leader_election.cc:336] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.575s (SENT)
I20260709 13:16:25.628170  5372 rpcz_store.cc:276] 0709 13:16:24.172924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.194186 (+ 21262us) service_pool.cc:224] Handling call
0709 13:16:24.207203 (+ 13017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.241574 (+ 34371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.241613 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.242135 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.689150 (+447015us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.911071 (+221921us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.914750 (+  3679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.914829 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.452997 (+538168us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:25.589141 (+136144us) raft_consensus.cc:1685] finished
0709 13:16:25.595494 (+  6353us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.595928 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3329,"prepare.queue_time_us":151941,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":14525,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":16906,"spinlock_wait_cycles":26825600,"thread_start_us":581164,"threads_started":2,"wal-append.queue_time_us":601825}
I20260709 13:16:25.609094  7597 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:25.633255  7225 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.634460  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1331) took 1382 ms. Trace:
I20260709 13:16:25.604558  7499 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.601871  7449 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:25.622304  7569 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.639705  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:25.637005  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47215.6us
W20260709 13:16:25.631929  7137 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.000s
I20260709 13:16:25.636626  7436 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.687449  5369 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:25.689720  5374 rpcz_store.cc:276] 0709 13:16:24.252033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.253538 (+  1505us) service_pool.cc:224] Handling call
0709 13:16:24.297207 (+ 43669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.297750 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:24.674238 (+376488us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.055986 (+381748us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.056469 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.056613 (+   144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:25.341809 (+285196us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b1800168940. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:16:25.342262 (+   453us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.342479 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.342576 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.634194 (+291618us) raft_consensus.cc:1685] finished
0709 13:16:25.634219 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.634379 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6142,"prepare.queue_time_us":789693,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":100,"raft.queue_time_us":7186,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":2328,"spinlock_wait_cycles":4788480,"thread_start_us":692687,"threads_started":2,"wal-append.queue_time_us":392788}
I20260709 13:16:25.639745  7599 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:25.694787  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1334) took 1422 ms. Trace:
I20260709 13:16:25.698498  5368 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.630471  7567 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.624590  7441 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.634891  5523 rpcz_store.cc:276] 0709 13:16:22.513055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.914375 (+401320us) service_pool.cc:224] Handling call
0709 13:16:22.921678 (+  7303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.006422 (+1084744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.617959 (+1611537us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002783d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:25.618155 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492689792}
I20260709 13:16:25.701809  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:25.685801  7421 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.715976  5375 rpcz_store.cc:276] 0709 13:16:24.272029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.733275 (+461246us) service_pool.cc:224] Handling call
0709 13:16:24.733721 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:24.734094 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.734120 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:24.734711 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 13:16:25.061215 (+326504us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:25.348662 (+287447us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.348875 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.348973 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.694457 (+345484us) raft_consensus.cc:1685] finished
0709 13:16:25.694488 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.694702 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293892,"prepare.queue_time_us":291804,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":5133,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":22111,"thread_start_us":324010,"threads_started":1,"wal-append.queue_time_us":383213}
I20260709 13:16:25.703318  7137 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.704445  7309 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:25.742002  7270 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.751271  7309 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:25.751469  7270 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.751780  7309 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:25.751925  7270 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.752851  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:25.752730  7309 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.708061  5446 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:25.642657  7518 consensus_queue.cc:1243] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:25.720312  7436 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.637709  7616 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.157s
I20260709 13:16:25.794998  7436 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:25.638567  7249 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.682499  7614 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.714787  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1066) took 2009 ms. Trace:
I20260709 13:16:25.797442  5447 rpcz_store.cc:276] 0709 13:16:23.706459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.351758 (+645299us) service_pool.cc:224] Handling call
0709 13:16:24.393832 (+ 42074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.414727 (+ 20895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.414779 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.415514 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.113466 (+697952us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:25.132891 (+ 19425us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.447016 (+314125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.447216 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.714584 (+267368us) raft_consensus.cc:1685] finished
0709 13:16:25.714605 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.714729 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":313766,"prepare.queue_time_us":17288,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":337345,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":212,"thread_start_us":588583,"threads_started":1,"wal-append.queue_time_us":686683}
I20260709 13:16:25.639122  7524 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.714061  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78280us
I20260709 13:16:25.803012  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.804281  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:25.639230  7560 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.686597  7514 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.719785  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:25.813177  5444 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.718802  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:25.719460  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:25.738695  7515 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:25.739584  7441 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:25.742367  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 110916us
I20260709 13:16:25.738090  7570 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:25.821358  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.689574  7597 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.682580  7617 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:16:25.745972  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:25.746429  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:25.753656  5375 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:25.753721  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:25.683904  7338 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:25.630834  7482 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.718393  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:25.755223  7421 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.757272  7466 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.757939  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:25.759191  5524 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:25.759543  7567 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.691023  5371 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:25.764882  5442 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:25.787487  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:25.810873  7415 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.839913  5372 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:25.792547  7572 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.792726  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:25.719131  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:25.842090  5448 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:25.808583  5516 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:25.810145  5521 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:25.720759  7559 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.815778  7456 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.816164  7270 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.715346  7557 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:25.818794  7225 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.823328  5374 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.706960  7499 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.858070  7559 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:25.859077  7499 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.801473  7266 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:25.830156  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:25.860157  5375 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:25.860378  7443 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.861546  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:25.862320  5375 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:25.836118  5368 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:25.820330  7599 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.820201  7515 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:25.851863  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:25.852190  7339 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:25.839514  7421 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.866863  7339 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:25.867326  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51720 (request call id 20) took 1106 ms. Trace:
I20260709 13:16:25.867233  7421 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.852785  7512 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:25.867847  5515 rpcz_store.cc:276] 0709 13:16:24.760431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.762430 (+  1999us) service_pool.cc:224] Handling call
0709 13:16:25.867116 (+1104686us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54001e6754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d86853 00007fc1d8d5460a 00007fc1d22da7d4 00007fc1d22da762 00007fc1d22da691 00007fc1d22da60c 00007fc1d22d98c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:25.867237 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313154304}
I20260709 13:16:25.827946  7309 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.853231  5442 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:25.852845  7449 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:25.857133  7485 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:25.633653  7410 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.866123  5369 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:25.830647  7570 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:25.820587  7524 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:25.822693  7569 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:16:25.844159  7616 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.890257  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:25.891371  5375 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:25.889742  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:25.870034  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:25.870476  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:25.919020  5371 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.920044  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:25.906414  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:25.921320  5521 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.911186  5516 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:25.922119  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:25.922396  5517 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:25.922586  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:25.923180  5516 raft_consensus.cc:2376] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5. Re-sending same reply.
I20260709 13:16:25.911615  7410 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.923640  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:25.924909  5372 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:25.911873  7421 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.829387  7560 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:16:25.889011  7270 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.921203  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:25.855506  7564 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:25.889133  7438 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:25.945387  7438 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:25.894984  5368 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:25.947578  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:25.938145  5444 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:25.938396  5369 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:25.902240  7266 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.924976  7569 consensus_queue.cc:1243] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:25.956274  5517 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:25.917285  7294 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.004s
I20260709 13:16:25.869735  7572 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 13:16:25.960608  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.965483  5516 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:25.965757  5372 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:25.994323  5369 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:25.867934  7339 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:25.957088  7462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.032s	sys 0.052s
I20260709 13:16:26.002954  5368 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:26.003350  5517 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:26.009492  5371 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:26.013082  5371 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:25.953249  7560 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.022439  5516 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:26.031301  5521 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:26.029595  5515 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:26.032541  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.033946  5368 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:26.018298  7462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.032s	sys 0.053s
I20260709 13:16:25.930219  7616 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.043315  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:26.016499  7429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.018s	sys 0.019s
I20260709 13:16:26.048974  7484 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.050992  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.050755  7570 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.054708  7570 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.965085  7266 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.056656  5368 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:16:26.043392  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.057823  7514 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:25.955262  7515 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.066565  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.081355  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.081727  7567 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:26.082634  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.083267  5517 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
W20260709 13:16:26.051524  7429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.019s	sys 0.019s
I20260709 13:16:26.083789  7266 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:26.085033  7515 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.089280  7616 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:26.072547  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1326) took 1213 ms. Trace:
I20260709 13:16:26.053251  5521 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
I20260709 13:16:26.075333  5516 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:26.035003  7560 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:26.095059  5450 rpcz_store.cc:276] 0709 13:16:24.858764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.977285 (+118521us) service_pool.cc:224] Handling call
0709 13:16:26.063656 (+1086371us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540023a354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:26.072488 (+  8832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049103232}
I20260709 13:16:26.114678  5374 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:26.144819  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:26.157018  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.164913  5449 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:26.166402  7572 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:26.168121  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.168648  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:26.168799  5516 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:26.170640  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:26.167783  7405 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.156436  7482 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:26.156626  7567 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:16:26.176348  7405 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:26.174569  7266 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.173589  7424 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:26.176873  7614 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:26.179466  7405 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:26.180045  7485 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:26.181069  7485 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:26.181434  7485 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:26.051693  7438 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.184710  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.190795  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:26.192373  7449 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:26.194161  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1064) took 1454 ms. Trace:
I20260709 13:16:26.194720  5366 rpcz_store.cc:276] 0709 13:16:24.739894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.086886 (+346992us) service_pool.cc:224] Handling call
0709 13:16:25.087187 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.686670 (+599483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.193798 (+507128us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54000fafd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:26.194056 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231968512}
I20260709 13:16:26.186175  7424 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:26.203456  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:26.174037  7383 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:26.214083  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:26.182945  7421 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:26.229123  7572 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:26.229902  7572 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.230399  7572 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:26.205122  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.182576  7566 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:26.224099  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:26.203574  7449 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:26.234474  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:26.201669  7425 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:26.182188  7485 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.230566  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:26.263299  5339 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:26.266121  7270 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:26.266826  7415 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:26.267352  7415 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:26.268283  7415 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.269534  7270 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:26.270634  7270 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.273762  7424 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.231792  7556 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:26.278236  7556 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.278765  7556 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.209281  7514 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:26.220072  7451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.007s	sys 0.023s
I20260709 13:16:26.290380  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.173300  7560 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.329051  5516 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:26.332394  5516 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:16:26.339506  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:26.193670  7597 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.343523  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:26.343675  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:26.349471  5520 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
W20260709 13:16:26.311295  7488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.547s	user 0.036s	sys 0.024s
I20260709 13:16:26.350231  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:26.350553  5523 raft_consensus.cc:606] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:26.350807  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:26.351053  5523 raft_consensus.cc:614] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:26.351450  5374 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:26.352870  7566 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.353330  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:26.353415  7566 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:26.327945  7451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.013s	sys 0.026s
I20260709 13:16:26.360101  5366 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:26.342118  7564 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:26.259636  7567 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
W20260709 13:16:26.368780  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.018s	sys 0.019s
I20260709 13:16:26.338877  7485 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.341681  7338 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.338651  7425 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:26.357971  7309 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.351773  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:26.369354  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.018s	sys 0.019s
I20260709 13:16:26.355228  7614 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:26.357661  7482 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:26.372412  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.371407  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:26.399938  5370 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:26.400674  5519 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:16:26.358626  7488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.593s	user 0.036s	sys 0.025s
I20260709 13:16:26.418823  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:26.396935  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45211.8us
W20260709 13:16:26.373279  7351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.048s	user 0.003s	sys 0.045s
W20260709 13:16:26.375360  6071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.008s	sys 0.022s
I20260709 13:16:26.399024  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:26.432021  5368 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:26.422353  7618 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:26.432754  7618 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.433110  7618 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.433447  5368 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.401582  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:26.222790  7405 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 13:16:26.436209  7425 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.340042  7514 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.438473  7566 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:26.439211  7514 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:26.419570  5374 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:26.374202  7410 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:26.441689  7410 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.419808  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:26.397377  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.368525  7564 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.422868  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:26.423465  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:26.446455  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:26.447978  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:26.396936  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 575268us
W20260709 13:16:26.358043  7568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.018s	sys 0.046s
I20260709 13:16:26.348462  7569 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 13:16:26.454821  7568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.018s	sys 0.047s
W20260709 13:16:26.456780  5340 connection.cc:256] RPC call timeout handler was delayed by -1.5569406780000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:16:26.457500  5340 connection.cc:256] RPC call timeout handler was delayed by -1.5155406779999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 13:16:26.460116  7556 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:26.419220  5508 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.030s	sys 0.058s
W20260709 13:16:26.424275  7351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.003s	sys 0.046s
I20260709 13:16:26.445088  5371 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:26.418679  7567 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:26.398970  7614 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:26.443382  6071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.009s	sys 0.022s
W20260709 13:16:26.463310  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43610.1us
I20260709 13:16:26.442131  7410 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.511566  5368 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:26.512797  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:26.508592  5367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.015s	sys 0.011s
W20260709 13:16:26.513828  5367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.016s	sys 0.011s
W20260709 13:16:26.465094  5508 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.030s	sys 0.058s
I20260709 13:16:26.399041  7338 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:26.462523  7564 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.460407  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:26.508842  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.156s	user 0.000s	sys 0.043s
W20260709 13:16:26.466038  7455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.018s	sys 0.034s
I20260709 13:16:26.429903  7466 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
W20260709 13:16:26.466100  7487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.709s	user 0.024s	sys 0.019s
I20260709 13:16:26.508165  7567 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:16:26.507187  7611 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.020s	sys 0.047s
I20260709 13:16:26.418964  7449 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:26.518661  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.000s	sys 0.043s
I20260709 13:16:26.477653  7482 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:26.572890  5515 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:26.511900  7488 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.514263  7490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.003s	sys 0.048s
I20260709 13:16:26.602121  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:26.466449  7514 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.599918  7487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.843s	user 0.025s	sys 0.028s
W20260709 13:16:26.578796  7484 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
W20260709 13:16:26.583487  7619 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
W20260709 13:16:26.599488  7611 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.021s	sys 0.049s
I20260709 13:16:26.515513  7614 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:26.601109  7570 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.546s	user 0.000s	sys 0.012s
I20260709 13:16:26.580196  7466 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.614240  5522 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.017s	sys 0.013s
I20260709 13:16:26.570585  7309 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:26.570345  7599 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:26.578634  7338 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:26.571437  7597 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:26.519620  7455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.019s	sys 0.035s
I20260709 13:16:26.602079  7482 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.617434  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:26.584312  7429 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:16:26.621114  7249 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:26.527495  7294 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 13:16:26.517711  7266 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
W20260709 13:16:26.631687  5522 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.018s	sys 0.013s
I20260709 13:16:26.516201  7351 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
W20260709 13:16:26.616294  7490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.006s	sys 0.050s
I20260709 13:16:26.637321  7599 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:26.646502  5517 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:26.647651  5447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.009s	sys 0.070s
I20260709 13:16:26.613293  7488 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.623836  7572 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:26.652328  5413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.290s	user 0.008s	sys 0.021s
W20260709 13:16:26.678370  5413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.316s	user 0.008s	sys 0.021s
W20260709 13:16:26.643229  7519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.010s	sys 0.036s
I20260709 13:16:26.616129  7514 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.630960  7487 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:26.665956  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48633.6us
W20260709 13:16:26.673559  5447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.009s	sys 0.070s
I20260709 13:16:26.677211  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1183) took 1299 ms. Trace:
W20260709 13:16:26.680565  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.651968  7309 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:26.682435  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.638973  7466 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.666983  7338 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.664357  7460 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:26.669934  7249 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.710281  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:26.709861  5524 rpcz_store.cc:276] 0709 13:16:25.378407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.446641 (+ 68234us) service_pool.cc:224] Handling call
0709 13:16:25.446935 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.835530 (+388595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.676888 (+841358us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400278dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:26.677136 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717590912}
W20260709 13:16:26.680279  7519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.010s	sys 0.036s
W20260709 13:16:26.714804  5369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.015s	sys 0.012s
I20260709 13:16:26.681546  7570 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:26.722522  5369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.015s	sys 0.012s
I20260709 13:16:26.660772  7482 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.688265  7556 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:26.685317  7487 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:26.815562  5372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.014s	sys 0.036s
W20260709 13:16:26.816362  5372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.014s	sys 0.036s
I20260709 13:16:26.817551  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1075) took 1358 ms. Trace:
W20260709 13:16:26.764511  5442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.010s	sys 0.027s
W20260709 13:16:26.829753  5442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.017s	sys 0.034s
W20260709 13:16:26.762917  7557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.014s	sys 0.030s
I20260709 13:16:26.818188  5372 rpcz_store.cc:276] 0709 13:16:25.459503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.993861 (+534358us) service_pool.cc:224] Handling call
0709 13:16:26.023048 (+ 29187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.023382 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:26.041332 (+ 17950us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.817058 (+775726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.817133 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:26.817203 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.817302 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.817484 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18140,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":470,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":7981,"thread_start_us":744552,"threads_started":1}
I20260709 13:16:26.753270  7429 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.813531  6070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.010s	sys 0.029s
W20260709 13:16:26.855710  7557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.014s	sys 0.030s
W20260709 13:16:26.863125  6070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.010s	sys 0.030s
I20260709 13:16:26.819571  7487 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.874671  5373 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:16:26.761457  7570 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.860106  7225 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.814046  7288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.020s	sys 0.031s
I20260709 13:16:26.877146  7524 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:26.894588  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1344) took 1541 ms. Trace:
W20260709 13:16:26.895553  7622 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:16:26.897475  7570 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:26.898748  7488 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:26.900277  7572 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:26.868219  7429 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.903017  7429 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:26.858457  7599 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.912300  7599 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:26.911345  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.916479  7567 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.918931  7567 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.894497  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1346) took 1536 ms. Trace:
I20260709 13:16:26.920827  5375 rpcz_store.cc:276] 0709 13:16:25.358055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.863038 (+504983us) service_pool.cc:224] Handling call
0709 13:16:25.863444 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.928753 (+ 65309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.894228 (+965475us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54000c6a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:26.894435 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63517440}
I20260709 13:16:26.922359  7492 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:26.923205  7492 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:26.895013  5367 rpcz_store.cc:276] 0709 13:16:25.353048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.362219 (+  9171us) service_pool.cc:224] Handling call
0709 13:16:25.369143 (+  6924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.468064 (+ 98921us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:25.541635 (+ 73571us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.087174 (+545539us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b1800043ea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:16:26.514229 (+427055us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.514964 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.515123 (+   159us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.515743 (+   620us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.515904 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.515972 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.894405 (+378433us) raft_consensus.cc:1685] finished
0709 13:16:26.894426 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.894541 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98417,"prepare.queue_time_us":76522,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":118,"raft.queue_time_us":426778,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":30704,"spinlock_wait_cycles":5276032,"thread_start_us":884775,"threads_started":1,"wal-append.queue_time_us":1309925}
I20260709 13:16:26.924080  7492 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.924774  7572 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.918286  7620 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:16:26.868557  7309 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.866789  7456 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.926491  5374 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.863263  7568 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.888353  7630 tablet_replica.cc:333] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:16:26.964582  5374 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:26.945355  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.005s	sys 0.027s
W20260709 13:16:26.993556  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.007s	sys 0.027s
W20260709 13:16:26.994068  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 646554us
I20260709 13:16:26.965210  7464 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.997400  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:26.991715  7425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.027s
W20260709 13:16:26.968175  7624 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:16:26.926209  7249 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.925325  7492 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:26.992915  6042 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.019s	sys 0.023s
W20260709 13:16:27.017858  6042 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.020s	sys 0.024s
W20260709 13:16:27.018297  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 589487us
W20260709 13:16:26.999514  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.890489  7288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.020s	sys 0.032s
I20260709 13:16:26.970327  7484 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.015264  5374 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.008637  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 548264us
W20260709 13:16:27.010957  5518 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.019s	sys 0.027s
I20260709 13:16:27.011873  5448 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:26.925261  7572 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:26.934994  7225 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.041858  5518 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.022s	sys 0.030s
W20260709 13:16:27.013633  7425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.000s	sys 0.028s
I20260709 13:16:26.995699  7499 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.997963  7568 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:27.075977  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:27.007917  7514 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:27.066931  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:27.067639  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:27.022742  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.072710  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:27.096809  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.096915  5374 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:27.097724  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.072890  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:27.101743  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.091332  7499 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.103075  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:27.104146  7499 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.105109  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:27.025163  7249 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.106283  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:27.107246  7249 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.100107  7630 raft_consensus.cc:2243] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:27.108568  7630 raft_consensus.cc:2272] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:27.110145  7338 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.110703  7338 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.112578  7630 ts_tablet_manager.cc:1916] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:27.115537  6073 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:27.107007  5446 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:27.117631  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:27.117730  7488 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.118402  5446 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:27.118909  7557 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:27.119323  7557 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:27.120162  7557 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.127725  7338 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.130441  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:27.131999  7249 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:27.074400  7410 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
W20260709 13:16:27.075018  7637 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:16:27.077948  5489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.004s	sys 0.018s
W20260709 13:16:27.036408  7636 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:16:27.096844  7568 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.099140  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:27.099586  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:27.027222  7466 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.008159  7464 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.138072  5489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.004s	sys 0.018s
I20260709 13:16:27.074460  7225 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:27.150820  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.170343  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.144922  5519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.013s	sys 0.013s
W20260709 13:16:27.185950  5519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.013s	sys 0.015s
I20260709 13:16:27.041294  7484 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.092129  7519 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:27.173540  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.191236  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:27.187613  7455 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.177145  7564 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.588s	user 0.016s	sys 0.002s
I20260709 13:16:27.193207  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:27.194677  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.016s	sys 0.014s
W20260709 13:16:27.198640  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.016s	sys 0.014s
W20260709 13:16:27.199029  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 684691us
I20260709 13:16:27.199702  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:27.201249  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:27.190160  7424 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.018s	sys 0.022s
W20260709 13:16:27.174297  7611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.035s	sys 0.068s
I20260709 13:16:27.141253  7410 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.240301  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1337) took 1503 ms. Trace:
I20260709 13:16:27.276813  5447 rpcz_store.cc:276] 0709 13:16:25.736813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.799191 (+ 62378us) service_pool.cc:224] Handling call
0709 13:16:25.799555 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.799888 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.799913 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.800421 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.709379 (+908958us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:26.709447 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.709678 (+   231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.240024 (+530346us) raft_consensus.cc:1685] finished
0709 13:16:27.240054 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.240234 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1138,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7800,"thread_start_us":908574,"threads_started":1,"wal-append.queue_time_us":1143466}
W20260709 13:16:27.234314  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48651.1us
I20260709 13:16:27.279954  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:16:27.282611  5520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.013s	sys 0.016s
W20260709 13:16:27.283020  5520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.013s	sys 0.016s
I20260709 13:16:27.278939  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:27.285195  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:27.288772  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:27.246407  7611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.035s	sys 0.069s
W20260709 13:16:27.249500  7424 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.019s	sys 0.022s
W20260709 13:16:27.201833  7449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.038s	sys 0.079s
I20260709 13:16:27.204303  7499 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.271317  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:27.194977  7249 raft_consensus.cc:2764] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:16:27.197767  7383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.009s	sys 0.039s
I20260709 13:16:27.235385  7524 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:27.289535  5447 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:27.206084  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:27.201198  7455 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.291656  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.010s	sys 0.020s
W20260709 13:16:27.346789  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.011s	sys 0.020s
W20260709 13:16:27.347397  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 637170us
W20260709 13:16:27.329643  7449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.038s	sys 0.084s
W20260709 13:16:27.278887  7641 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
W20260709 13:16:27.297964  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.197969  7225 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
W20260709 13:16:27.319201  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.201020  7519 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:27.292097  7429 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:27.333983  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 430422us
W20260709 13:16:27.345921  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 139921us
I20260709 13:16:27.371781  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:27.348169  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:27.374038  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1363) took 1024 ms. Trace:
I20260709 13:16:27.374432  5366 rpcz_store.cc:276] 0709 13:16:26.350029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.350165 (+   136us) service_pool.cc:224] Handling call
0709 13:16:26.352538 (+  2373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.361092 (+  8554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.373792 (+1012700us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b54001851d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:27.373983 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16916864}
I20260709 13:16:27.376180  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:27.200210  7564 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.329959  7499 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:27.343897  7383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.009s	sys 0.042s
I20260709 13:16:27.385324  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:27.292969  5522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.018s	sys 0.022s
W20260709 13:16:27.386988  5522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.018s	sys 0.022s
I20260709 13:16:27.390413  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:27.381410  7485 consensus_meta.cc:287] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.984s	user 0.009s	sys 0.004s
I20260709 13:16:27.393711  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 102) took 1702 ms. Trace:
W20260709 13:16:27.380321  7635 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:16:27.404757  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.401265  5522 rpcz_store.cc:276] 0709 13:16:25.691651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.691837 (+   186us) service_pool.cc:224] Handling call
0709 13:16:25.705352 (+ 13515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.705599 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:26.667494 (+961895us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.392928 (+725434us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.392984 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:27.393024 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.393101 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.393639 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1168001,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":1685383,"threads_started":2}
I20260709 13:16:27.385105  7499 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.411149  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51720 (request call id 21) took 1465 ms. Trace:
I20260709 13:16:27.387897  7451 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:27.394855  7640 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.319s	user 0.001s	sys 0.001s
W20260709 13:16:27.394269  7618 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.961s	user 0.010s	sys 0.004s
I20260709 13:16:27.411612  5523 rpcz_store.cc:276] 0709 13:16:25.946070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.947425 (+  1355us) service_pool.cc:224] Handling call
0709 13:16:27.410967 (+1463542us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400154354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d86853 00007fc1d8d5460a 00007fc1d22da7d4 00007fc1d22da762 00007fc1d22da691 00007fc1d22da60c 00007fc1d22d98c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:27.411087 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924786944}
I20260709 13:16:27.415884  5374 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:27.419924  5366 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:27.396337  7249 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:27.442891  5367 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:27.396113  7484 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:27.432212  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:27.395424  7266 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.395800  7383 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:27.436708  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:27.440042  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:27.403548  7572 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.406526  7652 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.402730  7654 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:27.407801  7449 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:27.444216  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1076) took 1984 ms. Trace:
I20260709 13:16:27.427623  7451 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:27.435215  7638 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
W20260709 13:16:27.510942  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.512816  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 141158us
I20260709 13:16:27.441452  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:27.441751  7415 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.518337  5369 rpcz_store.cc:276] 0709 13:16:25.459789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.995209 (+535420us) service_pool.cc:224] Handling call
0709 13:16:26.034001 (+ 38792us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.034203 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.034232 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.042809 (+  8577us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.723146 (+680337us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.723203 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.723302 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.443955 (+720653us) raft_consensus.cc:1685] finished
0709 13:16:27.443985 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.444147 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":672471,"threads_started":1,"wal-append.queue_time_us":956261}
I20260709 13:16:27.407981  7424 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:16:27.441653  7464 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:27.444303  7614 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.807s	user 0.011s	sys 0.005s
I20260709 13:16:27.536250  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:27.553026  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:27.429019  7567 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:16:27.538702  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1342) took 1690 ms. Trace:
I20260709 13:16:27.449209  7288 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.508399  7309 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.508857  7652 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.542675  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:27.529301  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 460081us
W20260709 13:16:27.566951  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 278241us
W20260709 13:16:27.637061  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.623900  5442 rpcz_store.cc:276] 0709 13:16:25.850289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.870115 (+ 19826us) service_pool.cc:224] Handling call
0709 13:16:25.887445 (+ 17330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.887851 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:25.887884 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.888772 (+   888us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.830360 (+941588us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.830421 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.830524 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.538466 (+707942us) raft_consensus.cc:1685] finished
0709 13:16:27.538488 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.538640 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":389,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":941199,"threads_started":1,"wal-append.queue_time_us":1124337}
I20260709 13:16:27.508028  7270 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.638381  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:27.511026  7266 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:27.639763  5522 raft_consensus.cc:2410] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:27.508740  7645 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.649041  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.696936  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61502.2us
I20260709 13:16:27.528923  7338 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.536415  7451 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.441290  7618 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.528923  7524 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:27.452585  7249 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.534466  7572 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:27.551290  7466 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:27.639958  7464 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.630666  7449 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:27.645380  7309 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.745639  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:27.733649  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 286891us
I20260709 13:16:27.644824  7652 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:27.715215  7599 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.004s
I20260709 13:16:27.624249  7415 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.629570  7614 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.751999  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.773839  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:27.740971  7410 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.721537  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 87) took 2331 ms. Trace:
I20260709 13:16:27.687762  7288 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.749686  7492 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.000s
I20260709 13:16:27.698177  7270 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.780357  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 142070us
I20260709 13:16:27.712841  7338 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:16:27.777799  7487 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.000s
I20260709 13:16:27.761775  7309 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.799927  5366 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:27.800424  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:27.779559  5522 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:27.713076  7645 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:27.816013  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:27.817345  5522 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:27.817312  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 264340us
I20260709 13:16:27.815994  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:27.779314  7564 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.793529  7566 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:27.747066  7572 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:27.801214  7410 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.821658  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.758800  7464 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.749964  7466 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.822108  7660 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
W20260709 13:16:27.818142  7648 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.426s	user 0.001s	sys 0.001s
I20260709 13:16:27.780043  7455 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:27.836941  7557 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.854723  7678 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.858233  7464 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.822788  7677 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.838444  7410 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.859175  7677 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.859647  7677 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.860742  7421 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:27.860864  7410 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.861311  7421 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:27.818903  7487 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.862349  7618 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:27.862424  7421 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.863238  7618 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.863659  7618 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.863719  7487 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.863976  7421 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.845736  7688 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:27.866554  7669 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
W20260709 13:16:27.867089  7482 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.057s	user 0.011s	sys 0.000s
I20260709 13:16:27.867573  7482 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.868981  5517 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:27.871037  7466 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:27.873481  7270 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:27.874203  7661 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:16:27.874925  7429 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:27.875537  7429 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:27.875780  7658 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:16:27.820899  7676 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:27.876847  7676 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:27.877156  7657 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:16:27.877331  7676 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:27.878294  7664 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:16:27.879894  7668 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:16:27.880118  7438 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.880148  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:27.881940  5515 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:27.884609  5450 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:27.885931  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1120) took 1529 ms. Trace:
I20260709 13:16:27.886538  5524 rpcz_store.cc:276] 0709 13:16:26.356348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.717735 (+361387us) service_pool.cc:224] Handling call
0709 13:16:26.718159 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.719731 (+  1572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.719777 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.720384 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.293625 (+573241us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:27.293687 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.293781 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.885684 (+591903us) raft_consensus.cc:1685] finished
0709 13:16:27.885705 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.885865 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98307,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":9177,"thread_start_us":478813,"threads_started":1,"wal-append.queue_time_us":618439}
I20260709 13:16:27.890039  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1118) took 1626 ms. Trace:
I20260709 13:16:27.846873  7338 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:27.848316  7515 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.849684  7492 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.850668  7475 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:16:27.851156  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1192) took 1618 ms. Trace:
I20260709 13:16:27.852882  7455 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:27.889086  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:27.822736  7519 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:27.840104  7655 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 13:16:27.890597  5520 rpcz_store.cc:276] 0709 13:16:26.263724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.676039 (+412315us) service_pool.cc:224] Handling call
0709 13:16:26.676495 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.676777 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.676814 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.682709 (+  5895us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.283500 (+600791us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:27.283560 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.283726 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.889689 (+605963us) raft_consensus.cc:1685] finished
0709 13:16:27.889720 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.889959 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":567975,"threads_started":1,"wal-append.queue_time_us":762074}
I20260709 13:16:27.924331  5524 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:27.924568  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:27.925182  5520 raft_consensus.cc:606] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:27.897800  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:27.927009  5515 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:27.902446  5518 rpcz_store.cc:276] 0709 13:16:26.232779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.233086 (+   307us) service_pool.cc:224] Handling call
0709 13:16:26.233500 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.439946 (+206446us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:27.066759 (+626813us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.402796 (+336037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.403812 (+  1016us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:27.403864 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.850875 (+447011us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400164ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:27.850938 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.851089 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":433908,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":309066,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":27475,"spinlock_wait_cycles":474216832,"thread_start_us":937877,"threads_started":2,"wal-append.queue_time_us":573611}
I20260709 13:16:27.928387  5522 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
W20260709 13:16:27.902221  7650 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
I20260709 13:16:27.864173  7618 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:27.896584  7656 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.448s	user 0.001s	sys 0.000s
W20260709 13:16:27.915128  7647 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.410s	user 0.001s	sys 0.001s
I20260709 13:16:27.842533  7653 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:27.930910  5515 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:27.901795  7515 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:27.921895  7492 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.811599  7266 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.827744  7524 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.950981  7421 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.952144  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1117) took 1688 ms. Trace:
I20260709 13:16:27.929790  7455 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.970346  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.958164  5516 rpcz_store.cc:276] 0709 13:16:26.263326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.337565 (+ 74239us) service_pool.cc:224] Handling call
0709 13:16:26.337938 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.398171 (+ 60233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.398228 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.421024 (+ 22796us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.991406 (+570382us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:26.991481 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.991579 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.951857 (+960278us) raft_consensus.cc:1685] finished
0709 13:16:27.951883 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.952068 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5040,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":25924,"thread_start_us":499582,"threads_started":1,"wal-append.queue_time_us":943531}
I20260709 13:16:27.945753  7515 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.834896  7449 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.955013  7456 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.986s	user 0.009s	sys 0.005s
W20260709 13:16:27.982228  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.934231  7451 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:27.971174  7421 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.989331  7681 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:16:27.999215  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1107) took 2016 ms. Trace:
I20260709 13:16:27.999781  5521 rpcz_store.cc:276] 0709 13:16:25.983054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.032227 (+ 49173us) service_pool.cc:224] Handling call
0709 13:16:27.998970 (+1966743us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b54002783d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:27.999132 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44697856}
W20260709 13:16:28.006976  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.007337  7441 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:28.007472  7492 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.007783  7441 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:28.008773  7441 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.009770  7441 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.019687  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1344) took 1025 ms. Trace:
W20260709 13:16:28.020880  7643 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.832s	user 0.001s	sys 0.015s
I20260709 13:16:27.784965  6070 rpcz_store.cc:276] 0709 13:16:25.379653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.384944 (+  5291us) service_pool.cc:224] Handling call
0709 13:16:25.385474 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.592961 (+207487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.602432 (+  9471us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.713068 (+110636us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.872844 (+1159776us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:26.872901 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.872992 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.630587 (+757595us) raft_consensus.cc:1685] finished
0709 13:16:27.640826 (+ 10239us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.706914 (+ 66088us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128299,"raft.queue_time_us":138158,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":114,"thread_start_us":1130931,"threads_started":1,"wal-append.queue_time_us":1446784}
I20260709 13:16:28.020215  5441 rpcz_store.cc:276] 0709 13:16:26.994717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.995480 (+   763us) service_pool.cc:224] Handling call
0709 13:16:26.998793 (+  3313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:26.999170 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.999197 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:27.024534 (+ 25337us) log.cc:844] Serialized 52 byte log entry
0709 13:16:27.384860 (+360326us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:27.786146 (+401286us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.786554 (+   408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.786734 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:28.019408 (+232674us) raft_consensus.cc:1685] finished
0709 13:16:28.019431 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.019614 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":355966,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":16141,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":24512,"thread_start_us":621110,"threads_started":2,"wal-append.queue_time_us":841323}
I20260709 13:16:28.024413  7559 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:28.027171  7455 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.028049  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1347) took 1012 ms. Trace:
I20260709 13:16:28.028438  5450 rpcz_store.cc:276] 0709 13:16:27.015965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.025738 (+  9773us) service_pool.cc:224] Handling call
0709 13:16:27.069040 (+ 43302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.885259 (+816219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.027781 (+142522us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b540033ccd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:28.027984 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874657664}
W20260709 13:16:28.036818  7665 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:16:28.038036  7654 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:28.038486  7614 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.038772  7654 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.039999  7482 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.043766  7339 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.043869  7288 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.051247  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1198) took 1791 ms. Trace:
I20260709 13:16:28.052770  7309 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.056092  7309 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.056519  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 154) took 3662 ms. Trace:
I20260709 13:16:28.081777  5445 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:27.943493  7653 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:27.990984  7670 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.241s	user 0.001s	sys 0.001s
I20260709 13:16:28.086266  7560 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.002903  7249 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:28.074360  7628 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 1.221s	user 0.014s	sys 0.000s
I20260709 13:16:28.076427  7425 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:28.105333  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 289438us
W20260709 13:16:28.074390  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.078320  7415 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.098091  7441 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.084367  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.081920  5373 rpcz_store.cc:276] 0709 13:16:24.394335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.974327 (+579992us) service_pool.cc:224] Handling call
0709 13:16:25.567131 (+592804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.880983 (+1313852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.054969 (+1173986us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400185bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:28.056145 (+  1176us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400185bd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:28.056365 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4368666368}
I20260709 13:16:28.109699  5374 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:28.109525  7441 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.110086  5368 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:28.109546  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.112566  5367 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:28.113818  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.115411  7249 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.116086  7249 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:28.117740  5366 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:28.088958  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1354) took 1054 ms. Trace:
I20260709 13:16:28.107769  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:28.124625  5446 rpcz_store.cc:276] 0709 13:16:27.034811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.119104 (+ 84293us) service_pool.cc:224] Handling call
0709 13:16:27.119713 (+   609us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.120489 (+   776us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:27.429286 (+308797us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.761548 (+332262us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.762513 (+   965us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.762749 (+   236us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:27.762804 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.762920 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:28.088610 (+325690us) raft_consensus.cc:1685] finished
0709 13:16:28.088642 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.088859 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7800,"prepare.queue_time_us":430965,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":7090,"raft.queue_time_us":10377,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":10507,"thread_start_us":539985,"threads_started":2,"wal-append.queue_time_us":423414}
I20260709 13:16:28.108451  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:28.085588  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.129580  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.130259  5372 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:28.130990  5366 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:28.051831  5519 rpcz_store.cc:276] 0709 13:16:26.339353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.464667 (+125314us) service_pool.cc:224] Handling call
0709 13:16:26.465015 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.465277 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:27.186478 (+721201us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.781329 (+594851us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.865994 (+ 84665us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:28.049822 (+183828us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b180018e7a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:16:28.050144 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.050635 (+   491us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.050806 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:28.050860 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:28.050918 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.050980 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.051163 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266166,"prepare.queue_time_us":681081,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":143,"raft.queue_time_us":309956,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":56979,"spinlock_wait_cycles":11070080,"thread_start_us":1269743,"threads_started":3,"wal-append.queue_time_us":438079}
I20260709 13:16:28.135522  5366 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:28.146602  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.139252  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.154111  5367 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:28.092676  7566 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.167032  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.167783  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:28.172045  5516 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.168936  5520 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:28.173946  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.174428  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.175211  5519 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:28.175393  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.106261  7288 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.106459  7405 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:28.105845  7557 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.176118  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.177954  5520 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:28.180544  5523 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:28.166347  7559 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.128958  7425 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:28.136762  7482 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:28.134657  7451 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.187076  5515 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:28.192040  5519 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:28.190667  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.201736  5369 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:28.214156  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:28.202363  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:28.203428  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.037s	sys 0.060s
I20260709 13:16:28.214918  5519 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:28.215075  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.037s	sys 0.061s
I20260709 13:16:28.215853  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:28.181118  7572 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:28.217953  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:28.207108  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 388126us
I20260709 13:16:28.181164  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.219539  5366 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:28.219640  5521 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:28.226269  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.004s	sys 0.008s
W20260709 13:16:28.227646  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.004s	sys 0.008s
I20260709 13:16:28.231259  7466 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:28.232136  7464 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:28.232678  5366 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:28.225935  7515 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.227190  5516 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:28.211059  7482 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.307715  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.310653  5371 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:28.307983  5369 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:28.236701  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:28.237764  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.238739  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.313047  5374 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:28.276202  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.313908  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.314361  5373 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:28.314510  5374 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:28.315449  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:28.222709  7599 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:28.241830  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:28.247701  7615 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.249199  7462 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.327530  7462 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.330201  7462 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.249679  7294 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.330760  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.331403  5371 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:28.331127  7294 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.332381  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.265663  7492 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.251118  7455 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:28.333971  7492 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.252880  7684 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:28.336133  7492 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.336200  7684 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:28.336741  7684 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:28.206591  7559 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:28.337750  7684 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.339341  7684 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.339593  7559 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:28.188268  7686 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:16:28.185670  7288 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.342128  7686 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:28.342543  7686 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:28.343451  7686 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.344072  7288 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.259822  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.179299  7566 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.344815  7686 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:28.266772  5445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1330) took 2531 ms (client timeout 2154 ms). Trace:
I20260709 13:16:28.345583  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:28.345798  5445 rpcz_store.cc:269] 0709 13:16:25.706896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.707177 (+   281us) service_pool.cc:224] Handling call
0709 13:16:28.238339 (+2531162us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54003bcc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:28.238528 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5005646720}
I20260709 13:16:28.216729  6071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59508 (request call id 79) took 3126 ms. Trace:
I20260709 13:16:28.197885  7557 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.193720  7405 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.234373  7625 raft_consensus.cc:993] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:28.235394  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.375079  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:28.375730  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 157844us
I20260709 13:16:28.376128  5367 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:28.240038  7425 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.234529  7410 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:28.256511  7677 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.325407  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.382611  5368 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:28.383765  5445 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:16:28.384181  5445 pending_rounds.cc:85] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:28.384464  5445 pending_rounds.cc:107] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:16:28.384696  5445 raft_consensus.cc:2889] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.384773  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.318781  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:28.385857  5372 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.386102  5446 raft_consensus.cc:2410] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:28.321224  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.388953  5519 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:28.349282  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.391383  5373 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:28.392894  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.316079  5374 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.347016  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:28.349647  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.396945  5521 raft_consensus.cc:606] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:28.397140  5371 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:28.397606  5521 raft_consensus.cc:614] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.317377  7482 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.333277  7294 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.258349  7441 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.346967  5375 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:28.377260  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:28.228950  7270 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 13:16:28.382633  5340 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:28.401098  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.402557  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:28.350947  5524 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:28.446666  5447 raft_consensus.cc:2410] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:28.446899  5441 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:28.427196  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.446305  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.411289  5367 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.448182  5450 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:28.318369  7611 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:16:28.457331  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.458315  5515 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:28.457228  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:28.459470  5516 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:28.318233  7662 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 13:16:28.402590  7644 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:28.468487  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:28.402333  7524 raft_consensus.cc:1081] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:28.436622  7572 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.349002  7599 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.473398  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.475147  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.497605  5450 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:28.352474  7615 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.488903  7688 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.479179  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:28.400954  7464 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:16:28.480365  5447 raft_consensus.cc:1217] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-4.3]   Dedup: 2.2->[4.3-4.3]
I20260709 13:16:28.510370  5447 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:16:28.483283  5372 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:28.484401  5367 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:28.507197  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.511478  5442 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:28.486943  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:28.466198  7429 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.001s
I20260709 13:16:28.469048  5374 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:28.446341  7696 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:28.526422  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:28.491899  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.475855  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.501731  5444 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:28.457985  7676 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.002s
I20260709 13:16:28.493017  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.504015  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.504914  7599 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.505709  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:28.506415  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:28.507040  7652 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.000s
I20260709 13:16:28.449975  7288 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:16:28.513432  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.513412  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.545954  5367 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:28.524261  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:28.547528  5448 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:28.548918  5490 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:28.487962  7294 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:28.494202  7462 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.553831  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.554728  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.555688  5442 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:28.498307  7425 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.474159  7475 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:16:28.488978  7602 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:16:28.561448  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:28.592921  7566 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.545037  7492 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:28.494131  7644 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.571046  7466 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:28.674350  7438 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.000s
W20260709 13:16:28.588039  7618 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.647s	user 0.000s	sys 0.011s
I20260709 13:16:28.590350  5442 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:28.623191  7706 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.550570  7698 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:16:28.620555  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:28.605932  7499 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.160s	user 0.003s	sys 0.011s
I20260709 13:16:28.560076  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:28.611456  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.687461  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.607110  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1119) took 2343 ms. Trace:
W20260709 13:16:28.653138  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 91822.7us
I20260709 13:16:28.553085  7484 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:28.546069  7429 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.551334  7652 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.603061  5369 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:28.507228  7688 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.500869  7572 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.550938  7676 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.563148  7616 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:28.654228  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.559657  7294 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:28.619561  7654 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.004s
I20260709 13:16:28.568270  7462 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:28.672575  5444 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:28.587576  5450 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:28.707334  5450 pending_rounds.cc:85] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:28.550151  7568 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.679555  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:28.680892  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 224114us
I20260709 13:16:28.684829  7351 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.710641  5448 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.559201  7696 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:28.689211  5517 rpcz_store.cc:276] 0709 13:16:26.264058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.677412 (+413354us) service_pool.cc:224] Handling call
0709 13:16:26.699995 (+ 22583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.869381 (+1169386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.606811 (+737430us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540016bcd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:28.607053 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687767296}
I20260709 13:16:28.688627  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:28.690241  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:28.671329  7492 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.675794  7266 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:28.717347  7492 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:28.702696  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.706718  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.677856  5442 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:28.719471  5442 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.720536  5442 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.723444  7688 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.647575  7630 ts_tablet_manager.cc:1929] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:16:28.707648  5450 pending_rounds.cc:107] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:28.727275  7568 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.727555  7421 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.728602  5450 raft_consensus.cc:2889] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.731346  5518 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:28.731666  5522 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:28.695007  7557 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.693629  7484 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.728269  7630 log.cc:1199] T 0276d804ade348368656bbe6805214df P 544c82a50cc4477886bb6f7d58f455ca: Deleting WAL directory at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-2-root/wals/0276d804ade348368656bbe6805214df
I20260709 13:16:28.746913  7438 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:28.746762  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57172.1us
W20260709 13:16:28.751538  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.744575  5519 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:28.683568  7618 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.701752  7616 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.754782  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.752113  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:28.690917  7499 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.351836  6071 rpcz_store.cc:276] 0709 13:16:25.089959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.095417 (+  5458us) service_pool.cc:224] Handling call
0709 13:16:25.117784 (+ 22367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.234519 (+116735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.244769 (+ 10250us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.363277 (+118508us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.517551 (+1154274us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.520011 (+  2460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.600981 (+ 80970us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:28.073485 (+1472504us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:28.188554 (+115069us) raft_consensus.cc:1685] finished
0709 13:16:28.188583 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.212643 (+ 24060us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17174,"raft.queue_time_us":87125,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":4134,"spinlock_wait_cycles":7941888,"thread_start_us":1002301,"threads_started":2,"wal-append.queue_time_us":1272092}
I20260709 13:16:28.760324  5517 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:28.728561  7466 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:28.733225  7410 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:28.786835  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:28.788080  5367 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.748126  7484 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.737380  7677 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.732810  7568 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.750344  7294 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.758960  7616 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.748216  7266 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:28.806725  5367 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:28.847807  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.848767  5367 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:28.690666  7706 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.711905  7654 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:28.770088  7615 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.762352  7438 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:28.729374  7351 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.785362  7466 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.874929  7410 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.876111  7466 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.876420  5516 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:28.878229  7572 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.878616  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.847481  7568 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.856535  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:28.832252  7339 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.766s	user 0.008s	sys 0.004s
I20260709 13:16:28.833578  7692 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.881345  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.833109  5448 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:28.882272  7429 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.882519  5449 raft_consensus.cc:2410] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:28.757781  7421 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:16:28.867386  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:28.883693  7515 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.878634  7499 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.886691  5516 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:28.872143  7630 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36782 (request call id 68) took 3487 ms. Trace:
I20260709 13:16:28.871986  7652 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.874226  7654 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:28.875487  7696 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:28.881466  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.897840  5367 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:28.898824  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:28.873888  7618 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:28.887715  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.785272  7678 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:28.872552  7706 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.893080  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.899050  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.989065  7678 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:28.989668  5369 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:28.886929  7697 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 13:16:28.981070  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.988713  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:28.992020  5367 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:28.916790  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 189946us
I20260709 13:16:29.002986  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.993611  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.004216  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.990780  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.987607  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:28.886420  7499 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:28.997776  5517 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:28.895182  7560 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.808s	user 0.006s	sys 0.006s
I20260709 13:16:29.005482  5522 raft_consensus.cc:2410] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:16:29.041411  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.012146  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.042467  5374 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:29.042941  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.043401  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.044092  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:29.050940  6042 leader_election.cc:336] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.519s (SENT)
I20260709 13:16:29.051819  6042 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:28.894436  7675 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.972990  7699 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.512s	user 0.004s	sys 0.000s
I20260709 13:16:29.053808  5367 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:29.057713  5370 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:16:29.065039  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:29.058430  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.061300  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.067766  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.067875  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:29.069628  5516 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:29.071091  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.072954  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.073761  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.074141  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.074777  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.075117  5522 raft_consensus.cc:2410] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:28.977007  7653 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:28.966068  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:29.077812  5367 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:28.940238  7652 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.080544  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:28.996598  7492 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.081683  7572 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:29.082527  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.083765  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:29.055034  7425 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:16:29.062549  7644 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.072407  7675 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:29.087193  7688 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:29.096840  5518 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:29.076954  7515 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:29.101079  7462 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:29.102568  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:28.979417  7611 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:16:28.981791  7514 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:28.991619  7438 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.061612  7690 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:29.104810  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.017s	sys 0.016s
W20260709 13:16:29.157886  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.018s	sys 0.017s
W20260709 13:16:29.158237  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 775617us
I20260709 13:16:29.159322  6076 raft_consensus.cc:2410] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:16:29.107000  7625 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:29.067173  7488 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.110399  5375 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:29.076440  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:29.162369  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 86037us
I20260709 13:16:29.112174  5441 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:29.113119  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:28.975068  7249 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:29.040071  7499 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:28.988221  7568 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.990393  7678 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:29.134455  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50791.3us
I20260709 13:16:29.071907  7441 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:28.895709  7692 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.143831  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.154022  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:29.163803  7625 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:29.155652  7706 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:29.146915  7515 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:28.966454  7266 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.167754  7488 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:29.166229  5340 connection.cc:256] RPC call timeout handler was delayed by -1.3209930289999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 13:16:29.166424  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.132656  5523 raft_consensus.cc:606] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.130849  7652 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.185194  5523 raft_consensus.cc:614] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:29.145752  7718 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:29.185750  5367 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:29.186645  5368 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.188505  5519 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:29.190353  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.171156  7616 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:29.185376  5340 connection.cc:256] RPC call timeout handler was delayed by -1.0932930289998239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:16:29.201725  5340 connection.cc:256] RPC call timeout handler was delayed by -1.059093028999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:16:29.202318  5340 connection.cc:256] RPC call timeout handler was delayed by -1.0104930289999174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 13:16:29.146464  7688 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:29.208356  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.218343  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.215031  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.214028  5516 raft_consensus.cc:2410] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:29.180020  7706 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:29.179793  7625 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.182567  7492 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.183933  7425 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:29.196774  7718 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.238896  7466 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:29.194739  7557 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:16:28.893006  7630 rpcz_store.cc:276] 0709 13:16:25.464951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.465609 (+   658us) service_pool.cc:224] Handling call
0709 13:16:26.812439 (+1346830us) ts_tablet_manager.cc:1151] Deleting tablet 0276d804ade348368656bbe6805214df
0709 13:16:26.861050 (+ 48611us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:27.512154 (+651104us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:28.625945 (+1113791us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:28.872063 (+246118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1119804,"thread_start_us":913172,"threads_started":1}
I20260709 13:16:29.218860  7415 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.178433  7724 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.234786  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.229344  7560 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.181365  7568 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.237612  5517 raft_consensus.cc:2368] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:16:29.211674  7652 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.212186  7441 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:29.205001  7566 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:16:29.255470  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:29.180492  7484 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.274822  7484 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.275058  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:29.221318  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:29.277519  7717 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:16:29.277632  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.278533  7692 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.249523  7625 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.278927  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:29.279759  5518 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:29.280660  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:29.272224  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.231076  7688 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:29.281781  7684 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.005s
I20260709 13:16:29.282189  7710 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.287739  7488 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.179064  7499 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.290128  7499 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.291164  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.292061  7701 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:29.292766  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.293246  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.294126  7675 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.294169  7701 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.295740  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.295940  7515 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:29.300027  7686 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.955s	user 0.008s	sys 0.006s
I20260709 13:16:29.209460  7722 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:16:29.302241  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:29.302567  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:29.302956  5370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1370) took 2930 ms (client timeout 2586 ms). Trace:
I20260709 13:16:29.303256  5518 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
W20260709 13:16:29.303360  5370 rpcz_store.cc:269] 0709 13:16:26.372781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.401162 (+ 28381us) service_pool.cc:224] Handling call
0709 13:16:29.302742 (+2901580us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54000e01d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:29.302850 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6029097728}
I20260709 13:16:29.304674  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:29.304803  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.306834  7560 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.300843  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.319516  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.218075  7572 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:16:29.325829  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:29.245579  7718 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:29.328974  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.254376  7724 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.330485  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.334448  5368 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:29.346975  5258 catalog_manager.cc:5028] TS 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): tablet 0276d804ade348368656bbe6805214df (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:16:29.347200  7441 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.348991  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1376) took 1039 ms. Trace:
I20260709 13:16:29.349399  5373 rpcz_store.cc:276] 0709 13:16:28.309677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.418516 (+108839us) service_pool.cc:224] Handling call
0709 13:16:28.419007 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.685896 (+266889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.685933 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.761885 (+ 75952us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.189077 (+427192us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:29.189118 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.189192 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.348778 (+159586us) raft_consensus.cc:1685] finished
0709 13:16:29.348797 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.348932 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88960,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":37614,"thread_start_us":661956,"threads_started":2,"wal-append.queue_time_us":546084}
I20260709 13:16:29.312291  7616 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.364486  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.365859  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.341519  7701 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.375245  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.349460  7568 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:29.257102  7415 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.353335  7560 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.363656  7611 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:29.351095  7724 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:29.396037  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.372794  7421 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:29.398355  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:29.398468  7421 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:29.398850  7645 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:29.400750  7421 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:29.402773  7706 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:29.387295  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:29.387625  7482 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.927s	user 0.008s	sys 0.006s
I20260709 13:16:29.406073  7482 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.408674  7482 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.368438  7488 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.409571  5520 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:29.411111  5524 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:29.415284  7415 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.377791  7710 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.395172  7701 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.377539  7722 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:29.382566  7568 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:29.415941  7690 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:29.417943  5524 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:29.418207  7568 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.419476  7568 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.419517  5524 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:29.397270  7611 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.426038  7611 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.416744  7722 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.441227  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.444273  5522 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:29.453697  5522 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:29.458145  7466 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.462251  7653 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.449858  7449 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:16:29.452688  7421 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:29.455032  7696 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:29.491796  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:29.499620  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:29.502632  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 127499us
I20260709 13:16:29.478008  7425 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:29.500794  7696 consensus_queue.cc:1243] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:29.498059  7572 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:16:29.502252  7449 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:29.514760  5340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.888s (SENT) [suppressed 15 similar messages]
W20260709 13:16:29.523298  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 177966us
I20260709 13:16:29.508854  7560 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 13:16:29.518203  7733 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:16:29.509310  7421 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.511057  7499 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:29.509649  7566 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:16:29.521807  7449 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:29.547740  7746 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.553723  7744 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.554289  5523 pending_rounds.cc:85] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 1
I20260709 13:16:29.554638  5523 pending_rounds.cc:107] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:16:29.554888  5523 raft_consensus.cc:2889] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.544104  7499 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:29.554297  7744 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.558331  7499 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.559646  7499 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.561180  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.561987  5522 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:29.563347  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:29.564220  7696 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.564296  7744 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.564770  7696 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.565200  7696 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.566010  7724 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.570346  7438 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.570910  7438 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.571878  5517 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:29.573570  6071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:29.573064  7438 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.578058  7696 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.582732  7713 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:29.583243  7713 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:29.583948  5518 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:29.584625  7559 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:29.585009  7559 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:29.585842  7722 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.586791  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1087) took 1135 ms. Trace:
I20260709 13:16:29.584126  7713 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:29.587162  5441 rpcz_store.cc:276] 0709 13:16:28.450990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.455620 (+  4630us) service_pool.cc:224] Handling call
0709 13:16:29.586625 (+1131005us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540029ead4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:29.586735 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122259712}
I20260709 13:16:29.587494  7713 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.543282  6074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:29.585927  7559 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.590443  7559 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.590571  7676 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.591681  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.524556  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:29.598047  6042 leader_election.cc:336] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.161s (SENT)
I20260709 13:16:29.598183  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.600950  5517 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:29.588320  7611 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:29.602180  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 77719.7us
I20260709 13:16:29.602999  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:29.603322  5447 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:29.605404  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.606276  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.606691  5443 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:29.607319  5447 raft_consensus.cc:2410] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:16:29.605923  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.609259  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.610492  5447 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:29.611690  7739 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:29.612593  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.613772  5450 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:29.613884  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99163.2us
I20260709 13:16:29.616390  5442 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:29.604247  7746 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.619088  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:29.620724  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:29.594369  7718 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.623756  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.614820  7449 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.634909  5450 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:29.633194  7740 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:16:29.637290  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:29.629897  7572 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:29.615506  7739 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:29.611768  7690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51142 (request call id 3) took 2508 ms. Trace:
I20260709 13:16:29.640957  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.644083  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.644629  5416 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:29.645100  5447 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:16:29.620594  7724 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.646143  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:29.636063  7425 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.652222  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:29.639148  7572 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.640264  7568 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:16:29.645711  7449 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.638716  7694 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.643515  7739 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:29.681504  7750 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:16:29.687038  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.694784  5450 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:29.652743  7451 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.646147  7421 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.711323  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:29.702253  7716 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.505s	user 0.003s	sys 0.000s
I20260709 13:16:29.719897  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1377) took 1410 ms. Trace:
I20260709 13:16:29.652931  7696 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.720503  5371 rpcz_store.cc:276] 0709 13:16:28.309971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.436284 (+126313us) service_pool.cc:224] Handling call
0709 13:16:28.436905 (+   621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.555319 (+118414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.555365 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.580420 (+ 25055us) log.cc:844] Serialized 26 byte log entry
0709 13:16:28.957964 (+377544us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:28.958031 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.958140 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.701647 (+743507us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:29.719501 (+ 17854us) raft_consensus.cc:1685] finished
0709 13:16:29.719534 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.719812 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12951,"raft.queue_time_us":114209,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":15549,"spinlock_wait_cycles":6784768,"thread_start_us":439148,"threads_started":2,"wal-append.queue_time_us":546983}
I20260709 13:16:29.705685  7694 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.715430  5441 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:29.710757  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.710173  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.726907  7720 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:29.727389  7720 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:29.728358  7720 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.721094  7746 raft_consensus.cc:2764] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:29.734999  5443 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:29.735867  7754 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:16:29.736304  7718 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.711242  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.699286  7572 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.741581  5517 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:29.644090  7690 rpcz_store.cc:276] 0709 13:16:27.103644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.103923 (+   279us) service_pool.cc:224] Handling call
0709 13:16:27.127132 (+ 23209us) log.cc:844] Serialized 494 byte log entry
0709 13:16:29.611583 (+2484451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46576,"raft.queue_time_us":820940,"raft.run_cpu_time_us":2405,"raft.run_wall_time_us":257634,"thread_start_us":589880,"threads_started":2,"wal-append.queue_time_us":617776,"wal-append.run_cpu_time_us":2758,"wal-append.run_wall_time_us":1185319}
I20260709 13:16:29.704746  5339 leader_election.cc:400] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:16:29.778254  5339 leader_election.cc:403] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:29.781673  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 129564us
I20260709 13:16:29.785761  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.788829  5441 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:29.788780  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:29.787917  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.726150  7694 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:29.798841  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.799719  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 95777.4us
I20260709 13:16:29.801985  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.803031  5449 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:29.804936  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.805861  5375 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.812036  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.812286  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.815141  5447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
W20260709 13:16:29.801872  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.817696  5447 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.818128  5447 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.791457  7425 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:29.790735  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:29.820991  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.832621  5367 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.813758  5339 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:29.801467  7421 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.807616  7718 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.835103  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:29.838500  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47875.7us
I20260709 13:16:29.843439  5443 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:29.843974  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.844568  5374 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:29.850644  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.851372  5443 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:29.831002  5449 raft_consensus.cc:2955] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:29.852216  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.852779  5443 raft_consensus.cc:2376] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7. Re-sending same reply.
I20260709 13:16:29.853607  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.854461  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.855288  5448 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:29.856096  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.857057  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.830122  7425 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.857712  5448 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.858065  5441 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:16:29.858675  6076 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 84) took 2834 ms (client timeout 1969 ms). Trace:
I20260709 13:16:29.858891  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.859788  5368 pending_rounds.cc:85] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:29.864876  5368 pending_rounds.cc:107] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:29.857762  7425 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.865571  6077 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:29.860109  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.873121  5448 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:29.861119  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.861589  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.874110  5446 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:29.874435  5444 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:29.874827  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.863469  5366 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:29.842622  5447 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.864418  5441 pending_rounds.cc:85] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:29.865232  7460 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.876362  5441 pending_rounds.cc:107] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:29.865278  5368 raft_consensus.cc:2889] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:29.864568  6076 rpcz_store.cc:269] 0709 13:16:27.024368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.024516 (+   148us) service_pool.cc:224] Handling call
0709 13:16:29.858428 (+2833912us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b540049d9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:29.858576 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4788150016}
I20260709 13:16:29.876771  5441 raft_consensus.cc:2889] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.866807  5373 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:29.860787  5370 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:29.879177  5369 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:29.875141  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:29.883453  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69747.9us
I20260709 13:16:29.884613  5367 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:29.885169  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:29.886785  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47524.5us
I20260709 13:16:29.887549  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:29.890621  5447 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:29.892853  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:29.892988  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.893666  5374 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.896437  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:29.902149  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.903105  5444 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:29.908244  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.866716  7696 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.910037  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:29.913218  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.917268  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:29.918375  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:29.915691  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:29.924172  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:29.926888  5524 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.907975  7644 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.888458  7270 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.902343  7559 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.930060  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:29.905771  7415 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.945559  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:29.935195  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:29.946187  5444 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.939374  5374 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:29.914347  7745 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.862572  7421 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.971319  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.889333  7460 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.977821  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.891569  7724 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:16:29.955803  5375 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:29.955722  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.982841  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:29.983002  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.983451  5372 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
W20260709 13:16:29.984912  7757 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 13:16:29.985922  7758 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:29.986049  7249 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:29.986554  7249 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:29.987506  7249 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.988535  7249 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.989001  5522 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:16:29.990003  7761 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:29.990104  7460 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:29.991472  7755 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:16:29.991771  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1148) took 1224 ms. Trace:
I20260709 13:16:29.992139  5519 rpcz_store.cc:276] 0709 13:16:28.767382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.098326 (+330944us) service_pool.cc:224] Handling call
0709 13:16:29.098632 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.205263 (+106631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.991564 (+786301us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b540025dad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:29.991717 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206196992}
I20260709 13:16:29.928189  7438 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.993129  7438 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.993587  7438 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.994719  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:30.001775  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.960875  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 262985us
I20260709 13:16:29.963742  5444 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:29.963790  5524 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:29.927875  7710 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:29.972726  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:30.039763  5373 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.973160  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:29.973842  5366 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:29.968950  7425 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:29.943397  7614 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:29.979272  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:30.052356  5441 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:29.980459  5369 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.057315  5369 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:30.059888  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.060585  5441 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:30.062942  5369 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:29.992436  5443 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:30.002532  7466 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:29.930896  7676 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:16:30.003024  7351 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:29.932827  7611 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.002135  7438 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.038096  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.040771  5374 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:30.065760  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 150842us
I20260709 13:16:30.078076  5447 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:29.957221  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:30.082605  5367 raft_consensus.cc:2410] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:30.054373  7728 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 13:16:29.968950  7572 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.067152  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:30.093410  5366 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.058472  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59508 (request call id 83) took 1016 ms. Trace:
I20260709 13:16:30.102303  5366 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:30.070557  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:30.103849  5372 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.104215  5518 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.070106  5375 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 13:16:30.106436  5370 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.067736  7466 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:30.057588  7678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.038s	sys 0.075s
I20260709 13:16:30.084621  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1221) took 1450 ms. Trace:
I20260709 13:16:30.086410  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:30.125680  5516 rpcz_store.cc:276] 0709 13:16:28.633949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.070750 (+436801us) service_pool.cc:224] Handling call
0709 13:16:30.084398 (+1013648us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540025d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:30.084559 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324927232}
I20260709 13:16:30.126495  5441 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:30.087641  5374 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:30.105602  5259 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b301483f19c4d508e00d917819ac039 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
W20260709 13:16:30.132812  5259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 67125.3us
W20260709 13:16:30.088269  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 140351us
I20260709 13:16:30.039634  7482 raft_consensus.cc:2764] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:30.143054  5446 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:30.143528  5446 pending_rounds.cc:85] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:30.143122  5441 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:30.099723  5373 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:30.144315  5446 pending_rounds.cc:107] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:30.144649  5446 raft_consensus.cc:2889] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.140637  7421 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.076517  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:30.065733  7614 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:29.969149  7739 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.072162  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:30.218942  7614 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.225437  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:30.226083  6077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59510 (request call id 86) took 3123 ms. Trace:
I20260709 13:16:30.226481  6077 rpcz_store.cc:276] 0709 13:16:27.102243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.107967 (+  5724us) service_pool.cc:224] Handling call
0709 13:16:29.865158 (+2757191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.868032 (+  2874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.225873 (+357841us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b540049d9d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:30.226028 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6326720384}
I20260709 13:16:30.212749  7763 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.228489  6073 raft_consensus.cc:2368] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:16:30.230561  7425 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:29.980630  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.117120  5442 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:30.117293  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:30.115046  7678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.038s	sys 0.075s
I20260709 13:16:30.050901  7710 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:30.112749  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 113839us
W20260709 13:16:30.139562  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.284286  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.143505  5372 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:30.161955  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:30.163126  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86791.9us
W20260709 13:16:30.284421  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.286696  5443 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:30.287281  5518 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:30.254797  5415 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:30.288235  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:30.270958  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.115612  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 158740us
I20260709 13:16:30.290956  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:30.291499  5450 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.291764  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:30.292294  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:30.292533  5521 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:30.291204  5523 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:30.296104  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:30.296927  5521 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:30.301815  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 47152.4us
I20260709 13:16:30.303297  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:30.285166  7425 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.316016  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.292927  7618 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.325582  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.326370  7405 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.331091  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:30.283340  7560 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:30.309800  7724 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.310015  7421 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:30.316006  7266 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:30.335120  5520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1132) took 2159 ms (client timeout 2812 ms). Trace:
I20260709 13:16:30.315505  7676 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:30.321980  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:30.320674  7766 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.337117  5520 rpcz_store.cc:269] 0709 13:16:28.172433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.190300 (+ 17867us) service_pool.cc:224] Handling call
0709 13:16:30.331444 (+2141144us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540025d5d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:30.331636 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2746302208}
I20260709 13:16:30.338384  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:30.341946  5521 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:30.102308  6070 rpcz_store.cc:276] 0709 13:16:29.040283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.054294 (+ 14011us) service_pool.cc:224] Handling call
0709 13:16:29.124310 (+ 70016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.220245 (+ 95935us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:29.460623 (+240378us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.605804 (+145181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.610981 (+  5177us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:29.613569 (+  2588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.004947 (+391378us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b54003156d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:30.032604 (+ 27657us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.050831 (+ 18227us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":384747,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":107,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2114,"spinlock_wait_cycles":156903680,"thread_start_us":338753,"threads_started":2,"wal-append.queue_time_us":178136}
I20260709 13:16:30.345368  7438 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:30.333072  7572 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.343230  7309 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:16:30.313611  7499 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:30.336934  7266 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.354538  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:30.329010  7691 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:30.323055  7425 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.332258  7618 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.346638  7766 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.358350  7266 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.361321  6069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59492 (request call id 93) took 1004 ms. Trace:
I20260709 13:16:30.361791  6069 rpcz_store.cc:276] 0709 13:16:29.356891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.360541 (+  3650us) service_pool.cc:224] Handling call
0709 13:16:30.354375 (+993834us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b5800004598. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:30.361240 (+  6865us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12652800}
I20260709 13:16:30.362895  7720 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.364115  7746 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:30.364259  7425 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.364552  7746 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:30.362895  7618 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:30.351626  7560 consensus_queue.cc:1243] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 53eb858bdf82438d83f1be6a01da2e0e log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:30.352818  7673 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.352494  7676 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:30.366230  7746 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.366909  7739 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.367790  7746 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.368078  7557 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:30.368613  7557 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:30.369566  7557 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:30.370067  7644 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:30.371642  7710 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.372298  7557 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.375429  7766 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:30.370728  7616 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:30.360992  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:30.379601  7616 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:30.366945  7676 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:30.386986  7718 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
I20260709 13:16:30.387166  7724 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:30.387965  7718 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:16:30.387722  7466 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:30.390403  7466 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:30.400624  7616 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:30.401839  7616 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.474828  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:30.484282  5340 leader_election.cc:400] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:16:30.482895  5368 raft_consensus.cc:2955] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 3 to 7, VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:30.505017  5371 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:30.507979  5415 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:30.506258  5372 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:30.513481  5445 raft_consensus.cc:2410] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:30.519176  5447 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:30.530560  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:30.533078  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 122361us
I20260709 13:16:30.535343  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:30.538266  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 199808us
I20260709 13:16:30.539793  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:30.539840  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:30.541769  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:30.419589  7266 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.546233  7338 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:30.546486  5490 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:30.547071  7338 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:30.548770  7338 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.549005  7266 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:30.546233  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:30.558007  7309 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.560820  7309 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:30.561416  7309 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.562129  7309 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.553936  7270 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:30.565951  7266 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:30.566568  7266 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:30.566956  7270 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:30.571393  7438 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:30.571831  7405 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:30.572407  7405 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:30.580204  7405 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.567009  7266 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.580876  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:30.586086  7482 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:30.587039  7460 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:30.587725  7460 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.587787  7566 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.588284  7460 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.590368  7696 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.591101  7514 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:30.591245  7696 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.592724  7351 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:30.595112  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.596702  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.598367  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.599388  5441 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:30.600193  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.600692  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.600383  7514 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:30.603238  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.604244  5446 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:30.602092  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:30.607977  7769 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:16:30.600270  7720 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:30.608983  7614 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:30.609783  7614 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:30.609563  7720 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.611366  7614 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.604135  7514 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:30.617553  7514 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:30.617905  5441 raft_consensus.cc:2376] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6. Re-sending same reply.
I20260709 13:16:30.619096  7720 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.619350  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.618928  7514 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.620965  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.622449  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.623382  5441 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:30.623708  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.624240  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.625108  5441 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:30.620970  7514 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.608932  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:30.627339  7482 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:30.628161  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:30.628455  7482 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:30.629540  7438 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:30.602110  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.605340  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:30.638893  5446 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:30.602622  7405 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.642742  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.643739  5448 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:30.643970  7690 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:30.645015  7690 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:30.645754  5445 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:30.645850  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:30.646759  5446 raft_consensus.cc:2368] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:30.646891  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.647094  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.647652  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:30.649295  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.650372  5450 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:30.630187  7438 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:30.651990  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.652453  7438 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.666440  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.670320  5449 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:30.645380  7690 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:30.718693  7690 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:30.724741  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 141304us
W20260709 13:16:30.750104  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.608016  7696 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.760681  7309 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.763827  7309 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:30.765594  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:30.766458  7309 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:30.769256  7266 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:30.785604  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.781760  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.787806  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:30.785296  7783 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.122s	user 0.000s	sys 0.008s
I20260709 13:16:30.774587  7690 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.802440  5449 raft_consensus.cc:2368] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:16:30.812945  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.813858  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.814371  5442 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:30.815199  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.817186  5445 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:30.773536  7460 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:30.820020  7460 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:30.820988  7784 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.157s	user 0.002s	sys 0.006s
I20260709 13:16:30.803934  7713 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:30.822052  7713 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:30.822098  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.822935  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:30.823904  5442 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:30.825045  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:30.825274  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.825883  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.826797  5448 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:30.814244  5443 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:30.825893  5372 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:30.831558  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:30.832348  5441 pending_rounds.cc:85] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 3
I20260709 13:16:30.832423  5445 raft_consensus.cc:2376] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6. Re-sending same reply.
I20260709 13:16:30.837571  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:30.837726  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:30.838521  5450 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.805469  7266 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:30.832893  5441 pending_rounds.cc:107] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:30.847244  5441 raft_consensus.cc:2889] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.846553  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:30.778398  7482 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:30.874825  7788 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.186s	user 0.003s	sys 0.000s
W20260709 13:16:30.892343  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:30.894888  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.850203  7766 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:30.896400  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 106483us
I20260709 13:16:30.904237  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:30.929561  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:30.931090  5374 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:30.940049  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:30.941126  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.911691  7713 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:30.953270  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:30.927795  5269 catalog_manager.cc:5697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.958381  5372 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:30.968818  5490 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:30.975517  5371 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:30.976471  5340 leader_election.cc:336] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.633s (SENT)
I20260709 13:16:30.948591  7460 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:16:30.971302  5269 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 5, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:30.988056  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:30.958444  7766 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.006812  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:31.007985  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68134.9us
I20260709 13:16:31.008257  7777 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.008952  7777 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:31.012104  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50343.9us
I20260709 13:16:31.019680  5524 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:31.010699  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.025856  5450 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:31.026494  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:31.024562  7787 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.216s	user 0.002s	sys 0.001s
I20260709 13:16:31.011301  7676 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:31.013737  7790 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.261s	user 0.001s	sys 0.002s
I20260709 13:16:31.018893  7351 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:31.045755  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:31.047362  7710 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.047948  7794 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260709 13:16:31.048089  7710 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.052387  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:31.054734  7710 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.011657  7777 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.043401  5371 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.069540  7351 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:31.070904  7351 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.075740  7766 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:31.076472  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 100415us
I20260709 13:16:31.040321  7338 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.083451  5269 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 5, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 5 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.085713  5269 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:16:31.093787  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 83208.8us
I20260709 13:16:31.086151  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:31.088920  5269 catalog_manager.cc:5697] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:31.106803  5371 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:31.118741  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:31.131704  5269 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 3 to 5, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 5 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:31.108901  7676 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:31.131043  7614 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:31.171067  5371 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:31.138219  7720 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.174552  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73365.3us
I20260709 13:16:31.191812  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:31.199946  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:31.202060  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.207732  7662 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.208370  7662 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:31.218380  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:31.187490  7614 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:31.222740  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:31.187068  7720 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.198482  5269 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 5, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 5 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:31.242430  5340 leader_election.cc:336] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.874s (SENT)
W20260709 13:16:31.235209  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.216848  7662 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.251148  5367 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.246788  5522 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:16:31.252056  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:31.259869  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63320.5us
I20260709 13:16:31.262490  5371 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:31.257694  7266 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.268934  7720 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.269899  7720 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.270658  7720 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.297472  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:31.301555  5371 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:31.302181  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:31.302860  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:31.303097  7662 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:31.304176  7662 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.304975  7662 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.300170  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.296047  5269 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 4, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 4 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:31.313643  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92807.7us
I20260709 13:16:31.292587  7676 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:31.335309  7795 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:16:31.273705  7614 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.348278  5368 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:31.357599  5368 pending_rounds.cc:85] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 3
I20260709 13:16:31.358029  5368 pending_rounds.cc:107] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:31.358309  5368 raft_consensus.cc:2889] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:31.338227  7806 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:31.362264  7806 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.370877  7777 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:31.371698  7777 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.343482  5269 catalog_manager.cc:5697] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 2, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:31.381213  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.377952  5340 leader_election.cc:336] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.031s (SENT)
I20260709 13:16:31.391558  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.386104  7763 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.387306  7777 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.388012  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.394171  7662 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:31.396688  7662 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:31.388270  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.397390  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.398222  7801 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:16:31.398164  7766 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:31.399835  7766 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:31.401365  7813 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:16:31.402784  5340 leader_election.cc:336] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.084s (SENT)
I20260709 13:16:31.403318  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.403695  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:31.349670  7266 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.396239  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.373620  7814 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.437000  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:31.437902  5521 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.447679  5269 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 2, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.424001  7777 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.456974  5520 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:31.448199  7482 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:31.460242  5269 catalog_manager.cc:5697] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:31.473579  7777 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.460074  7806 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.478137  7806 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.478633  7806 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.480669  7806 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.482393  7768 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:31.483044  7768 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.485661  7812 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:31.486408  7812 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.488957  7812 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.489941  5521 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10.
I20260709 13:16:31.457507  7814 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.514870  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:31.522394  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:31.544334  5521 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:31.547480  5367 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:31.550578  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 147885us
I20260709 13:16:31.481182  7806 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.544377  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 148292us
I20260709 13:16:31.536720  7662 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:31.553229  7814 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.568858  7806 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.571324  7806 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.572142  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.574863  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.575654  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.577764  7828 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:31.578199  7806 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.577282  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.581686  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:31.582305  7806 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.583724  7482 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.584530  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.585469  7482 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.586090  7828 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:31.586529  7828 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.586864  7828 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.590240  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.593844  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.565222  7768 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:31.596405  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.567270  7662 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:31.598366  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:31.601882  5340 leader_election.cc:336] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.118s (SENT)
I20260709 13:16:31.602269  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:31.597780  7820 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:16:31.601687  5520 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:31.596213  7806 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:31.609316  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.614078  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:31.615465  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:31.616650  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:31.619177  7768 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.620354  7482 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:31.622750  5372 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.623178  7806 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:31.622889  7482 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.623680  7806 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.625723  7806 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.626016  7662 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:31.608423  7676 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:31.625201  7482 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:31.630201  7676 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:31.631167  7821 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:31.640012  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44941.8us
I20260709 13:16:31.638486  7676 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.653963  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.655378  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:31.640550  7797 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.461s	user 0.000s	sys 0.003s
I20260709 13:16:31.657611  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f76d25595424c71acc6031d1608a975"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:31.658224  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:31.658769  5520 raft_consensus.cc:606] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.658947  5369 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:31.659157  5520 raft_consensus.cc:614] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.656051  7821 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.662757  7821 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.664714  5371 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:31.666980  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.667236  5373 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:16:31.674327  7803 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.363s	user 0.003s	sys 0.000s
I20260709 13:16:31.675122  5371 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:31.675258  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:31.676540  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:31.677145  5521 raft_consensus.cc:606] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.677742  5521 raft_consensus.cc:614] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:31.680418  7791 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.686s	user 0.001s	sys 0.001s
I20260709 13:16:31.684120  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:31.684767  7720 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.685591  7768 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:31.687777  7710 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:31.688655  7266 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:31.689100  7266 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:31.689508  7266 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.690322  7711 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:31.690919  7711 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:31.687817  7824 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:31.694132  7824 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:31.694568  7824 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.693104  7711 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.696031  7711 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.672672  7696 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.711361  5373 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:31.713553  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.714382  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.670229  7821 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.723706  5368 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:31.737738  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:31.738111  7828 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.738807  7766 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:31.739298  7766 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.739643  7766 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.748334  7766 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.755362  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:31.756407  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 126016us
W20260709 13:16:31.761371  7829 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:16:31.733168  5372 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:31.764161  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:31.768131  5520 raft_consensus.cc:606] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.768579  5520 raft_consensus.cc:614] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:31.763363  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 108557us
W20260709 13:16:31.782182  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 108926us
W20260709 13:16:31.786707  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 186783us
I20260709 13:16:31.792322  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.796270  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:31.799340  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.787187  7696 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.783980  7676 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.801211  7711 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.826809  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07d1fef577c411787d1f686a4774389"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:31.829612  5524 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:31.834188  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47179.6us
I20260709 13:16:31.825935  7614 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:31.837183  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51343us
I20260709 13:16:31.827613  5520 raft_consensus.cc:606] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.840963  7766 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:31.835206  7266 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.849462  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.821337  7720 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:31.846725  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.806797  7696 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:31.854938  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49128.3us
I20260709 13:16:31.806103  7618 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:16:31.856168  7616 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:31.856689  7616 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.857059  7616 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.828325  7824 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.863343  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:31.866182  7676 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:31.862193  7824 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.851449  7482 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:16:31.876366  5520 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:31.849581  7828 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.870026  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.885551  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.893695  7821 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.889598  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:31.896385  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47043.9us
I20260709 13:16:31.897575  7720 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.898185  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.899755  7696 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:31.900156  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.901983  7710 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.902968  7710 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:31.902006  7266 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:31.890969  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:31.905648  5524 raft_consensus.cc:606] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.905284  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:31.910511  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:31.892061  7766 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:31.914412  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59693.3us
I20260709 13:16:31.910197  7828 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.891788  7614 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:31.908951  7351 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:31.922330  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:31.914136  7824 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:31.916965  7482 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:31.927783  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:31.929796  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:31.921995  7766 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:31.919873  7351 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:31.917145  7821 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:16:31.958534  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.954798  7351 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.945124  7616 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.933692  7766 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.955188  7824 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:31.960754  7768 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.960652  7270 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.993986  5340 leader_election.cc:400] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:31.994428  5340 leader_election.cc:403] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:32.001600  7405 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:32.002079  7405 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:32.003523  7616 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:32.004042  7824 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:31.989317  7720 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.991052  7711 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.003046  7405 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.043834  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:32.017928  7833 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:16:31.991129  7270 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.013165  7823 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:32.043741  7812 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.045397  7696 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.039952  7720 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.048244  7768 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.060822  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67048us
I20260709 13:16:32.019214  7266 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:32.010128  7614 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:32.064328  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 81181.2us
I20260709 13:16:32.059715  7405 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.058815  7828 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:32.058569  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 139340us
W20260709 13:16:32.094779  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45981.5us
I20260709 13:16:32.070923  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:32.112322  7711 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.113617  5490 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:32.069257  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.114697  7711 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:32.077593  7825 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:32.061538  7812 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.067950  7768 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.120394  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.098374  7616 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:32.072211  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:32.070446  7720 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.061694  7696 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.144066  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:32.138432  7711 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:32.147235  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75164.7us
I20260709 13:16:32.147761  7841 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:32.148506  7841 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:32.144852  7828 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:32.149695  7841 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.152175  7840 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.148777  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:32.152626  7840 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:32.153028  7840 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.153203  7828 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.155226  7828 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:32.156519  7836 raft_consensus.cc:993] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
W20260709 13:16:32.144398  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73618.1us
W20260709 13:16:32.167896  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.070063  7270 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.174847  7828 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.169727  7266 raft_consensus.cc:1081] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:32.175472  7828 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.142066  7616 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:32.184638  7351 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.187121  7616 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.190564  7616 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.188640  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:32.197855  7847 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:32.199453  5522 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:32.200827  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:32.201753  5524 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:32.201606  7849 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:32.202860  7836 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:32.203224  7836 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:32.204433  7828 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.204110  7836 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.143707  7825 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:32.189201  7768 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.206218  5524 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:32.206911  7825 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:32.207862  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.208482  5521 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:32.209544  7351 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:32.209443  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:32.210448  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.211988  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:32.243743  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.212942  7696 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.214707  7838 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:32.221915  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50684us
I20260709 13:16:32.247910  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:32.250067  7696 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.250440  5522 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:32.251533  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.255895  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:32.225957  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43527.1us
I20260709 13:16:32.217248  7812 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.229632  7270 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.257678  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.257733  7270 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.260325  7270 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.231493  7825 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:32.261703  7710 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:32.262547  7710 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:32.261893  7825 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.264037  7710 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:32.264423  7710 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:32.264822  7825 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.235948  7711 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.265275  7710 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:32.266381  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.267267  7710 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.268568  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:32.181452  7720 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:32.249190  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:32.270813  7720 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.277915  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.206094  7836 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.239145  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:32.284848  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.285754  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.291676  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.292464  5521 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:32.236961  7840 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.290007  7825 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:32.297926  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 147711us
I20260709 13:16:32.299758  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.290867  7711 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.302956  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.302940  7766 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:16:32.309403  5518 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:32.309578  7825 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:32.310890  7825 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.317090  7812 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:32.317708  7812 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.319761  7812 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.321396  5524 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:32.322088  7840 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:32.323076  7720 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.325197  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.326237  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.327569  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.327579  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.328270  7405 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.328478  5515 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:32.328886  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.329519  5521 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:32.327826  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.330778  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.331504  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:32.332801  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:32.338372  5515 raft_consensus.cc:2376] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7. Re-sending same reply.
I20260709 13:16:32.338167  7853 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:16:32.341408  7839 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:32.342247  7839 consensus_queue.cc:1243] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:32.342144  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:32.343146  5515 raft_consensus.cc:2376] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8. Re-sending same reply.
I20260709 13:16:32.349587  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.358253  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:32.357369  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:32.360909  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.361641  5518 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:32.362761  5374 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:32.364797  5366 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:32.373610  7838 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.374229  7838 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:32.376626  7838 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:32.377864  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:32.378608  5366 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:16:32.380606  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:32.355728  7711 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:16:32.388942  7838 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.389401  7838 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.389798  7838 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.397639  7720 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:32.398483  7720 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:32.399935  7720 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.429944  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:32.437506  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:32.438217  5366 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.440114  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:32.443899  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.444654  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.445801  5516 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:32.447646  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.448560  5374 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:32.347878  7836 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:16:32.349707  7839 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:16:32.438297  7405 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.452250  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:32.460450  5374 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.454136  7405 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:32.461849  7405 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.453651  7830 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.462767  7830 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:32.466290  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.461853  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.471479  5516 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:32.473568  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:32.474028  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 117873us
I20260709 13:16:32.474400  5367 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.474915  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.475781  7270 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.476419  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.476781  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:32.477612  7270 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.477824  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.438820  7812 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:32.479084  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.479748  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.482290  5441 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:16:32.484766  5374 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:32.485880  5366 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:32.486996  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:32.487098  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 147886us
I20260709 13:16:32.487172  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:32.494602  5449 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:32.494766  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:32.491279  5442 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:32.495848  5447 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:32.504571  5445 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:32.504942  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:32.495039  5449 pending_rounds.cc:85] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 3
I20260709 13:16:32.506747  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:32.512974  5449 pending_rounds.cc:107] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:32.513401  5449 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.523630  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:32.528121  5367 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:32.529287  5366 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:32.511288  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.530791  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:32.497133  7270 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.496400  7840 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:32.540231  5450 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
W20260709 13:16:32.543802  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.511288  7836 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:16:32.547526  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.513171  7841 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:32.548856  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:32.558164  7840 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:32.511531  7837 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:32.560679  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:32.564132  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59915.3us
I20260709 13:16:32.525319  7830 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.565765  5518 raft_consensus.cc:2410] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:16:32.568697  5450 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.490128  7812 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:32.571714  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.490777  7838 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:32.578604  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.571237  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:32.575205  5448 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.576077  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.580511  5444 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.577742  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:32.583427  5443 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:32.583889  5443 pending_rounds.cc:85] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 3
I20260709 13:16:32.586333  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.588802  5443 pending_rounds.cc:107] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:32.531478  7696 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:32.578050  7405 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.566501  7837 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:32.592007  7837 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.592555  7405 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:32.593345  5371 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:32.594156  5446 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:32.594897  5446 pending_rounds.cc:85] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 3
I20260709 13:16:32.595197  5446 pending_rounds.cc:107] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:32.595410  5446 raft_consensus.cc:2889] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.595595  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:32.589188  5443 raft_consensus.cc:2889] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.570082  7841 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:32.598414  7841 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.601552  5445 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:32.602706  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:32.603338  5374 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.603736  5370 pending_rounds.cc:85] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 1
I20260709 13:16:32.604069  5370 pending_rounds.cc:107] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:32.604287  5370 raft_consensus.cc:2889] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.608911  5368 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:32.611932  5374 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:32.612684  5447 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:32.613111  5447 pending_rounds.cc:85] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 4
W20260709 13:16:32.614233  5269 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 150) took 11497 ms (client timeout 15000 ms). Trace:
I20260709 13:16:32.617908  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:32.613322  5447 pending_rounds.cc:107] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:32.619388  5447 raft_consensus.cc:2889] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.568913  7720 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:32.623932  7710 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.623530  5450 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
W20260709 13:16:32.627974  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.632501  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:32.587484  7711 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:32.635870  5444 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:32.635602  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:32.619333  7812 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:32.659438  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:32.660925  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 127594us
I20260709 13:16:32.667730  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:32.632688  7838 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:32.634251  7711 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:32.679054  5444 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:32.683754  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:32.671169  5340 connection.cc:256] RPC call timeout handler was delayed by -1.2599701720000667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 13:16:32.614717  5269 rpcz_store.cc:269] 0709 13:16:21.116898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.121582 (+  4684us) service_pool.cc:224] Handling call
0709 13:16:32.614133 (+11492551us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:31.625615 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:31.626248 (+   633us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:31.626301 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:16:31.626336 (+    35us) tablet.cc:662] Decoding operations
0709 13:16:31.627459 (+  1123us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:31.627581 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:31.627601 (+    20us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:16:31.632296 (+  4695us) tablet.cc:701] Row locks acquired
0709 13:16:31.632355 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:16:31.632563 (+   208us) write_op.cc:270] Start()
0709 13:16:31.632733 (+   170us) write_op.cc:276] Timestamp: P: 1783602991632491 usec, L: 0
0709 13:16:31.632772 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:16:31.633827 (+  1055us) log.cc:844] Serialized 4388 byte log entry
0709 13:16:31.752614 (+118787us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d0c820ac 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b
0709 13:16:31.929008 (+176394us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b18002566c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:16:32.184942 (+255934us) op_driver.cc:464] REPLICATION: finished
0709 13:16:32.347193 (+162251us) write_op.cc:301] APPLY: starting
0709 13:16:32.347439 (+   246us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:32.354693 (+  7254us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:32.354727 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:32.367829 (+ 13102us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:32.368172 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:16:32.368246 (+    74us) write_op.cc:312] APPLY: finished
0709 13:16:32.368614 (+   368us) log.cc:844] Serialized 82 byte log entry
0709 13:16:32.369405 (+   791us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:32.369576 (+   171us) write_op.cc:454] Released schema lock
0709 13:16:32.369646 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:32.377219 (+  7573us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:32.377251 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":159172,"apply.run_cpu_time_us":4413,"apply.run_wall_time_us":25614,"num_ops":11,"prepare.queue_time_us":119611,"prepare.run_cpu_time_us":31046,"prepare.run_wall_time_us":228509,"raft.queue_time_us":203155,"raft.run_cpu_time_us":7123,"raft.run_wall_time_us":198135,"replication_time_us":511046,"spinlock_wait_cycles":79997056,"thread_start_us":517624,"threads_started":4,"wal-append.queue_time_us":239969}]]}
I20260709 13:16:32.672569  7482 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.675733  7614 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:32.706775  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 133927us
I20260709 13:16:32.680301  7266 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:32.707559  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.695973  7696 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.694646  7840 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:32.718164  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.677300  7766 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:32.720248  5447 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.706401  7812 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:32.708735  5448 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:32.739234  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.739924  5443 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.739789  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:32.741081  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:32.784607  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63441.5us
I20260709 13:16:32.727025  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:32.738023  7405 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.724917  7812 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:32.727838  7720 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:32.727676  7696 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:16:32.795982  5340 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.576s (SENT)
I20260709 13:16:32.796509  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.789011  5446 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:16:32.811539  5340 leader_election.cc:336] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.584s (SENT)
I20260709 13:16:32.812252  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.813941  5450 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 13:16:32.817102  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 89559.5us
I20260709 13:16:32.791111  7482 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:32.820911  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 100961us
I20260709 13:16:32.798733  7614 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:32.810693  7826 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:32.829133  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:32.828514  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:32.821281  6073 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:32.830562  5446 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.797049  7867 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:16:32.796128  7405 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:32.842489  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:32.820739  5450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
W20260709 13:16:32.874420  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.878037  7872 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:16:32.878227  7878 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.004s
I20260709 13:16:32.848232  7812 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:32.884892  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73399.2us
I20260709 13:16:32.830945  7871 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.837956  7270 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.880050  7482 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.881387  7720 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.824357  7823 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:32.826424  7768 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.891667  5446 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:32.824484  7266 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:32.799417  7711 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:32.896656  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 222178us
I20260709 13:16:32.904145  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:32.922091  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:32.904925  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:32.917501  5516 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:32.895406  7870 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.926862  5369 raft_consensus.cc:2410] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:16:32.928373  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:32.928716  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 99767.1us
I20260709 13:16:32.941093  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:32.928660  7614 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.932309  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:32.943890  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:32.944502  5373 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.903044  7879 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:32.933996  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 91588.9us
I20260709 13:16:32.905827  7869 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:32.934828  7766 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:32.935961  7837 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.898499  7871 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.936625  7266 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.924409  7823 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.921643  7270 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:32.938066  7868 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:16:32.926975  7696 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:32.943516  7867 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:32.955260  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:32.954358  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:33.018359  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43687.5us
I20260709 13:16:32.947816  7869 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:32.946799  6069 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:32.949239  7871 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:33.024026  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 76830.7us
I20260709 13:16:32.961944  7881 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:33.027273  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 79123.4us
I20260709 13:16:32.963666  7867 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.962502  7825 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.034358  7886 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:16:33.038151  7869 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:33.068856  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 117251us
I20260709 13:16:33.040172  5443 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:33.058712  5447 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
W20260709 13:16:33.064905  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 117917us
I20260709 13:16:33.088745  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:33.086406  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 183125us
I20260709 13:16:33.063356  7867 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:33.092061  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.098326  7405 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:33.098711  7897 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:33.101517  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.103065  5373 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:16:33.115175  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:33.115993  6069 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:33.101560  7766 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:33.145123  7766 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:33.149531  7860 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.595s	user 0.001s	sys 0.001s
W20260709 13:16:33.150775  7863 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.596s	user 0.002s	sys 0.000s
I20260709 13:16:33.150552  7825 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:33.138902  7861 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.687s	user 0.003s	sys 0.002s
W20260709 13:16:33.157295  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 89386us
I20260709 13:16:33.157764  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:33.158768  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 70125.3us
W20260709 13:16:33.158883  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 218208us
I20260709 13:16:33.120083  7405 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:33.159706  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:33.128437  7869 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.167853  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:33.169087  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.170948  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.179145  5447 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:16:33.165988  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:33.175836  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:33.212574  5443 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:33.181929  7885 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:33.193580  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.195631  7718 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:33.196513  7901 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.197197  7906 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:33.202821  7270 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.205775  7766 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.207983  7837 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:33.178321  5441 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
W20260709 13:16:33.211580  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 43783.4us
I20260709 13:16:33.221504  7718 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.216262  7885 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:33.224236  7877 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.329s	user 0.001s	sys 0.001s
W20260709 13:16:33.228374  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.229292  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:33.248629  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.253018  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.258342  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:33.258695  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.259624  5449 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:33.260465  7838 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.260778  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:33.261694  7875 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:33.232986  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.233952  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.235443  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.236413  7879 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:33.236858  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 79180.6us
I20260709 13:16:33.237572  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:33.239494  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 73566.4us
I20260709 13:16:33.239769  5443 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10.
I20260709 13:16:33.242566  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.242731  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.172083  7405 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:33.246296  7718 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.248549  7885 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:33.283560  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54354.4us
I20260709 13:16:33.248430  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.263446  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.229588  7710 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.285161  5367 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:33.271677  5449 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:16:33.273026  5340 leader_election.cc:336] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.807s (SENT)
I20260709 13:16:33.245977  7825 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.279970  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:33.284736  5441 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 4.
W20260709 13:16:33.281772  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.289041  5370 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:33.287264  5367 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:16:33.289057  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:33.246522  7812 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.291240  5373 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:33.243556  7906 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:33.292141  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:33.292852  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:33.302983  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 278156us
I20260709 13:16:33.314814  5447 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:33.316699  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:33.318280  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.284118  7766 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.321648  5372 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:33.331858  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.287698  7881 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:33.337607  7881 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:33.342744  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.337111  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.311673  7690 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:33.347921  5450 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.348521  5450 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.317655  7903 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.342444  7351 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:33.360117  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.293530  7710 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.322404  7836 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:33.311810  7825 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.376336  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.376677  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.321226  7839 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:33.379977  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.382752  5443 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:33.374079  5375 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:33.356556  7690 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:16:33.355923  7853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.007s	sys 0.019s
I20260709 13:16:33.387306  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:33.389411  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 116415us
I20260709 13:16:33.391727  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.392382  5449 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:16:33.393343  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:33.368228  7270 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.400714  5375 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:33.396411  5449 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:33.397334  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:33.395037  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 115129us
I20260709 13:16:33.397559  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.398181  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:33.398746  5340 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.860s (SENT)
I20260709 13:16:33.366036  7886 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.404452  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.376832  7720 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.402782  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:33.389074  7853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.007s	sys 0.019s
I20260709 13:16:33.413398  5442 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:33.414930  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.405104  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:33.402256  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:33.381029  7351 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:33.367444  7837 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:16:33.415333  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 91814.9us
I20260709 13:16:33.418309  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.420894  5443 raft_consensus.cc:2368] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:16:33.415230  5450 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.409597  5449 raft_consensus.cc:2376] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6. Re-sending same reply.
I20260709 13:16:33.422803  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.436827  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.448510  5449 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:33.446947  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.436940  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.375372  7405 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:33.450845  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.456518  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:33.450420  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.457680  5449 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:33.463100  5446 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:33.452701  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.419523  7720 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.458473  7902 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.368057  7903 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.465704  5442 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:33.450156  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.407449  7270 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.411928  7867 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.449752  7907 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.456619  7826 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:33.483045  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84329.4us
W20260709 13:16:33.520241  5340 leader_election.cc:336] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.910s (SENT)
I20260709 13:16:33.520687  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:33.488001  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.488775  5375 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:33.490389  5443 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:33.452924  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:33.513279  5447 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:33.517038  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:33.422448  7898 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 13:16:33.445981  7884 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
W20260709 13:16:33.527544  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 73530.8us
I20260709 13:16:33.479529  7405 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.536450  5442 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:33.555401  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:33.555653  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.414378  7906 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.479718  7690 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:33.588603  5446 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:33.539796  7351 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.591794  7891 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.511112  7902 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:33.592931  7924 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:33.596329  7904 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
W20260709 13:16:33.597270  7908 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:16:33.598304  7920 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:16:33.599268  7916 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:16:33.628743  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.597193  7710 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:33.633281  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 116997us
I20260709 13:16:33.590329  7825 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.635567  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:33.636360  5446 raft_consensus.cc:2376] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6. Re-sending same reply.
I20260709 13:16:33.524139  7907 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.677129  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.678136  5446 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:33.686915  5371 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:33.689996  7902 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:33.695420  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:33.696172  5517 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
W20260709 13:16:33.682343  7871 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.003s
I20260709 13:16:33.708061  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:33.685177  7924 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:33.712718  7924 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.686332  7931 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:33.722779  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.723773  5449 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:33.709108  5523 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:33.726730  5517 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:33.729322  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:33.731247  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:33.711078  7903 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.751006  5449 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:33.737884  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1442) took 1027 ms. Trace:
W20260709 13:16:33.754653  7930 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:16:33.756060  5270 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.757951  5270 catalog_manager.cc:5697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.759608  7867 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.759714  5515 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:33.721634  7720 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.752444  5444 rpcz_store.cc:276] 0709 13:16:32.710118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.710284 (+   166us) service_pool.cc:224] Handling call
0709 13:16:32.719270 (+  8986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.839148 (+119878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.839177 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.847893 (+  8716us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.160934 (+313041us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:33.160973 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.161053 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.737624 (+576571us) raft_consensus.cc:1685] finished
0709 13:16:33.737647 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.737812 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112338,"raft.queue_time_us":98966,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":10019,"thread_start_us":276374,"threads_started":2,"wal-append.queue_time_us":413498}
I20260709 13:16:33.721958  7931 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:33.775694  6042 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:33.778409  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:33.779448  5449 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:33.717272  7871 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.788712  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.785172  5270 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.762703  7891 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.792683  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.795006  5374 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
W20260709 13:16:33.793278  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 199528us
I20260709 13:16:33.798046  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:33.799568  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:33.792466  5270 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 5 to 6, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:33.801059  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 241053us
I20260709 13:16:33.812384  5442 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:33.813938  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:33.794404  7270 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.816370  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:33.816447  5270 catalog_manager.cc:5697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 5, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.794348  7911 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:16:33.834259  5270 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 2 to 5, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.838337  7876 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:33.839010  7876 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.839124  7944 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:33.839604  7876 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.842726  7912 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:33.843171  7912 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:33.844116  7912 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:33.845918  7812 consensus_meta.cc:287] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.528s	user 0.013s	sys 0.000s
I20260709 13:16:33.847909  7823 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.848714  7823 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:33.851619  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:33.809621  7710 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:16:33.858485  7871 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:33.859203  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82117.8us
I20260709 13:16:33.860675  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:33.832916  7931 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.826714  7934 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:33.863379  7934 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:33.863799  7934 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.865235  5368 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.865471  5441 raft_consensus.cc:2368] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:33.868593  7270 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.870239  5370 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:33.870460  5375 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:33.872866  7907 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.875483  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:33.878736  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:33.891147  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:33.895293  5270 catalog_manager.cc:5697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 6, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 6 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:33.901170  5368 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:33.853291  7869 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.002s
I20260709 13:16:33.845335  7912 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:33.924108  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 140820us
W20260709 13:16:33.952545  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.800987  7891 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:33.963613  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 71018.3us
I20260709 13:16:33.964818  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:33.966625  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:33.830724  7690 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:16:33.899471  7944 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.898988  7907 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.899168  7270 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.976627  5370 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:33.849406  7823 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:16:33.975874  7766 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.003s
I20260709 13:16:33.989960  5270 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 3, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.973851  7911 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.963007  7836 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:34.011129  7836 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:34.014503  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 202036us
I20260709 13:16:33.994415  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:33.995504  7925 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:33.983296  7270 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:33.998809  7896 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.999328  7891 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:33.982101  7826 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:33.993587  7924 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:16:33.982721  7944 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:34.008180  7718 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 13:16:34.010063  7823 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:34.033842  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:34.035060  5270 catalog_manager.cc:5697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.045336  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:34.031440  7836 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:34.053016  5270 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index 3 to 4, term changed from 1 to 3, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.065557  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:34.069375  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.069622  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.040644  7907 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:34.070688  5523 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:34.048928  7891 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:34.050997  7897 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:34.090674  7938 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:16:34.044027  7826 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.093093  7932 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 13:16:34.041606  7911 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:16:34.065829  7885 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.745s	user 0.014s	sys 0.000s
I20260709 13:16:34.095081  7826 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.097229  5270 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:34.098263  7939 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:16:34.039067  7925 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.105391  7828 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.108011  7828 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:34.108920  7828 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.110397  7828 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:34.105154  7937 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:16:34.122980  7876 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.074139  7907 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.053489  7823 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:16:34.048029  7718 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:34.130519  7718 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:34.096652  7896 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.135035  5270 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 4 to 6, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.131613  7907 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.140995  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:34.148732  5450 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.106966  7925 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:34.152184  7270 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.153314  7875 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.154834  7934 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:34.112536  7911 consensus_queue.cc:1243] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:34.165481  5369 raft_consensus.cc:2368] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9.
W20260709 13:16:34.168619  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96518.1us
I20260709 13:16:34.169926  5270 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.175047  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58818 (request call id 1450) took 1354 ms. Trace:
W20260709 13:16:34.175587  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:34.175688  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 108905us
I20260709 13:16:34.178556  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:34.178905  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:34.179525  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.179581  5523 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.180266  5520 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:34.176982  5450 rpcz_store.cc:276] 0709 13:16:32.815998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.816416 (+   418us) service_pool.cc:224] Handling call
0709 13:16:34.147053 (+1330637us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54003cc154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d83a3d 00007fc1d8d53cd0 00007fc1d22d8254 00007fc1d22d81e2 00007fc1d22d8111 00007fc1d22d808c 00007fc1d22d7342 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:34.166137 (+ 19084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051635584}
W20260709 13:16:34.185596  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.186942  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.186674  5270 catalog_manager.cc:5697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 4 to 7, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.188338  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:34.180629  7919 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.645s	user 0.004s	sys 0.002s
I20260709 13:16:34.174834  7875 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.191488  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:34.116523  7885 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.194175  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:34.195463  5520 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.182284  7896 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:34.185671  7897 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.184908  7881 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:34.190537  7876 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.205247  5270 catalog_manager.cc:5697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.191679  7823 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:34.211426  7914 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.532s	user 0.000s	sys 0.001s
W20260709 13:16:34.216063  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.204677  7896 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.220304  7896 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.217482  7826 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.228255  7826 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.216266  7823 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.229547  7931 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.229794  7823 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.217031  7961 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:34.237884  7961 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.238257  7961 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.187791  7718 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:34.240537  7718 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:34.240972  7718 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:34.243633  7824 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.243798  7934 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.244326  7824 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.245576  7885 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.246703  7911 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.246929  7824 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.247409  7911 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.207780  7881 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:34.251055  5369 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:34.251492  7881 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:34.255240  5520 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:34.263006  7826 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.206169  7897 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.264389  5373 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:34.265838  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:34.273903  5270 catalog_manager.cc:5697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 6, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.279021  7915 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.283025  7944 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:34.284572  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.324551  5517 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:34.286543  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.326717  5270 catalog_manager.cc:5697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.288076  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:34.294464  7941 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:34.295723  7921 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.300125  7926 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.300359  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:34.332852  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.321240  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:34.304204  5374 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:34.322826  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:34.333858  5371 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:34.335098  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47108us
I20260709 13:16:34.320472  7825 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.336206  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.338969  5270 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 5 to 6, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.341804  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:34.343319  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:34.345325  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.329550  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:34.306586  7925 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:16:34.352698  5270 catalog_manager.cc:5697] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 4, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 4 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:34.356720  5490 leader_election.cc:400] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9.
I20260709 13:16:34.357126  5490 leader_election.cc:403] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:34.358358  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.360941  5371 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:34.362020  7909 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:16:34.363698  7873 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.364265  7964 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:34.364915  7964 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:34.366304  7911 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.366130  7964 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.343971  7922 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.346480  7885 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:34.361388  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.371702  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.348289  7828 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:34.350281  6069 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.369042  7812 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.379339  5270 catalog_manager.cc:5697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 6, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.380954  7876 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.383457  7876 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.385759  7933 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.386380  7933 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.388545  7933 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:34.390810  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:34.391822  7909 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:34.392912  7949 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.396s	user 0.000s	sys 0.002s
I20260709 13:16:34.393337  7909 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:34.393659  7912 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:34.395146  7912 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:34.395606  7912 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.336632  7921 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.401208  7876 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.403014  7921 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.404989  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:34.406558  7954 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:16:34.406584  6070 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:34.271854  7907 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.415144  7903 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.417359  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.419340  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.426129  5523 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:34.427315  5270 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.428471  5368 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:34.431187  5416 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.438055  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.346218  7825 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.448403  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:34.449398  7879 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:34.451774  5515 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:34.449625  7947 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:34.454331  5370 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:34.455649  5370 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:34.450321  7825 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.450353  7898 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:16:34.450904  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.462105  7898 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.462678  7898 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.464161  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:34.464881  5366 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:34.330531  7718 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.466068  7718 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.469133  7898 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:34.441260  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.404484  7912 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.337306  7926 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.446277  7944 consensus_queue.cc:1059] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:34.446624  5270 catalog_manager.cc:5697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.447572  7812 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.448096  7885 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.453644  7947 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:34.439062  6069 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:34.439293  5372 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:34.439754  7921 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.369606  7899 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:34.473518  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:34.487267  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.537463  5442 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:34.538098  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50950.1us
I20260709 13:16:34.489744  5450 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:34.378355  7828 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.497709  5445 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:34.426450  7903 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:34.548849  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 75474.4us
I20260709 13:16:34.439483  7881 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9.
I20260709 13:16:34.470355  7720 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.471167  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.528699  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:34.529031  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:34.555163  5519 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.529657  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:34.556281  5517 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:34.529691  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:34.530243  5521 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:34.557482  5516 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:34.527608  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.531082  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.532389  5524 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:34.557969  5516 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:34.532900  5270 catalog_manager.cc:5697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 2 to 5, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.533628  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:34.536180  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:34.545584  7869 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:34.474865  7710 consensus_queue.cc:1175] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 6 index: 4 } }
I20260709 13:16:34.547051  7871 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.547820  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.489079  7870 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.490993  7825 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.551328  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.561650  5372 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:34.537247  7899 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.552639  7405 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:34.546188  7915 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:34.568137  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 85742.4us
I20260709 13:16:34.584088  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041443b19a6248948edd8e88378fd175"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:34.505735  7898 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:16:34.548655  7828 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.576509  5442 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:34.582163  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 111078us
I20260709 13:16:34.514958  7812 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.584712  5518 raft_consensus.cc:606] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:34.594561  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:34.594827  5518 raft_consensus.cc:614] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:34.577482  5516 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.569710  7824 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.596060  5516 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.584648  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:34.559626  6070 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:34.587786  7886 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:34.620352  5520 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:34.583720  7899 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.615526  5270 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.581208  7871 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.626586  7871 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.628538  5270 catalog_manager.cc:5697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.635885  7875 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:34.637017  7614 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:34.638764  5441 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:34.592737  7897 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.631708  5270 catalog_manager.cc:5697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 3, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.606101  7869 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.651145  7869 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.652446  5270 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.654101  7869 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.644016  5519 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:34.645814  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:34.611943  7944 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:34.611737  7405 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:34.610572  7922 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:34.664017  5442 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:34.667598  5270 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.669552  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:34.603856  7720 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:16:34.688726  7975 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:16:34.593883  7906 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:16:34.606525  7961 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.609368  7824 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.669411  7944 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.585784  7870 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.666776  7812 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.702913  7869 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:34.719360  7947 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.720142  7405 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:34.743320  7824 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.705054  7898 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:34.744189  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:34.707484  7614 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.741247  5375 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:34.746074  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:34.708709  7923 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.694880  7885 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:16:34.722244  7973 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:34.784704  5366 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.776410  5445 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:34.728180  5516 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:34.785683  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.703610  5270 catalog_manager.cc:5697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.783769  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:34.768405  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.790462  5515 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:34.755080  7824 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.842183  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:34.862865  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.863803  5517 raft_consensus.cc:2410] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:34.860332  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.715070  7944 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:34.809124  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.846642  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:34.705655  7823 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.873389  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:34.756772  7870 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.784567  7898 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.851307  7718 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.854944  5523 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:34.769498  7935 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.287s
I20260709 13:16:34.705817  7970 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:34.874707  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.848516  7614 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.841792  7873 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.917057  7873 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.919718  7873 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:34.771370  7976 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.278s	user 0.003s	sys 0.000s
I20260709 13:16:34.835577  7869 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:34.919827  7823 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.921094  7869 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:34.891232  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.849586  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:34.897361  5366 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:34.759472  7971 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.171s
I20260709 13:16:34.852052  7926 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.902539  7718 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.916229  7961 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:34.891063  7898 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.886890  7875 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:34.939448  5520 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:34.924543  7978 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:16:34.950570  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:34.951596  5521 raft_consensus.cc:606] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:34.952036  5521 raft_consensus.cc:614] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:34.801476  7923 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:34.931209  7971 consensus_queue.cc:1243] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:34.874681  7824 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:34.970790  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 361153us
I20260709 13:16:34.971678  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:34.961314  7931 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.005s
I20260709 13:16:34.980890  5450 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:34.987882  5450 pending_rounds.cc:85] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 4
I20260709 13:16:34.988235  5450 pending_rounds.cc:107] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:34.988579  5450 raft_consensus.cc:2889] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:34.912338  7970 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:34.995715  5373 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:34.970196  7718 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:35.008688  7981 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.310s	user 0.000s	sys 0.002s
W20260709 13:16:35.023425  7979 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:16:35.030215  7992 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:16:35.034049  7987 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:16:35.045200  5449 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:35.055954  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.058187  5450 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:35.042049  7977 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:16:35.063377  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.062306  7935 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:16:35.074781  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:35.075361  5521 raft_consensus.cc:606] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.076404  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:35.072464  7931 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.078560  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.079519  5444 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:35.082736  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.082496  5444 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:35.090842  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.111593  7910 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:35.112102  7824 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.070605  7766 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:16:35.115901  5367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:33046
I20260709 13:16:35.118562  5367 raft_consensus.cc:606] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.119617  5367 raft_consensus.cc:614] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:35.120424  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.120311  5444 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:35.121585  5444 pending_rounds.cc:85] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:35.121894  5444 pending_rounds.cc:107] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:35.122174  5444 raft_consensus.cc:2889] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.060302  7881 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:16:35.090723  7935 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:16:35.129385  5444 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:35.120842  7891 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:35.109584  7931 consensus_queue.cc:1059] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:16:35.125234  7405 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.130218  7616 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:35.118148  7910 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:16:35.140113  5444 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:35.141130  7616 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:35.147289  7616 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.149667  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:35.150357  5521 raft_consensus.cc:606] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.150688  5521 raft_consensus.cc:614] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:35.136565  7923 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:35.138662  7891 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.174134  5444 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:16:35.175032  5444 pending_rounds.cc:85] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:35.175289  5444 pending_rounds.cc:107] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:16:35.175663  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:35.177311  5444 raft_consensus.cc:2889] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.142423  7405 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.176409  5522 raft_consensus.cc:606] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.191661  7891 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.186430  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.192596  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:16:35.174794  7828 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.001s
I20260709 13:16:35.194247  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:35.192636  5517 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:35.172381  7970 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:35.196285  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:35.206378  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.182988  7837 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:35.198036  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:35.206897  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.206997  5522 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:16:35.207453  5523 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.208243  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:35.198307  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:35.202900  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.203446  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.212877  5523 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:35.204183  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.213198  5515 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.213917  5519 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:35.218359  7912 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:35.221287  7911 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:35.221971  7911 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:35.222494  7911 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.226173  5521 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:16:35.227335  7998 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:16:35.207253  7828 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:35.230527  8001 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:35.230726  5443 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.232097  7828 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.180233  7907 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.235311  5444 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:35.237090  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.215866  7837 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:35.241803  5444 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:16:35.234711  7899 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.006s
I20260709 13:16:35.243256  7899 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.244588  5447 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:16:35.183349  7898 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.250624  6070 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:35.246575  7896 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.026s	user 0.010s	sys 0.003s
I20260709 13:16:35.254534  7896 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.256994  5374 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:35.257400  5515 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:35.268247  7944 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.270414  7616 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:35.260432  7849 consensus_queue.cc:1059] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:16:35.274698  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:35.262639  7837 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.279737  7837 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:35.281594  6042 leader_election.cc:336] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.886s (SENT)
I20260709 13:16:35.273404  7616 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:35.300966  7944 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:35.304776  7925 raft_consensus.cc:3055] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:35.305365  7925 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:35.306341  7925 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:35.307386  7911 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.307859  7925 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.317308  7899 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:35.318060  7993 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.181s	user 0.003s	sys 0.000s
I20260709 13:16:35.324277  7896 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.326567  7911 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.326820  7921 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:35.327286  7921 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:35.328145  7921 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.329378  7921 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.333611  7405 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:35.334650  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 363055us
I20260709 13:16:35.350804  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:35.348070  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:35.352268  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:35.353618  7970 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:35.354008  7970 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.354342  7970 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.357496  5520 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:35.360996  7812 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:35.365002  7614 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:35.335245  7991 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:35.339825  7869 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:35.340632  7915 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.347134  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:35.348213  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.378119  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.378916  5369 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:35.380896  7925 raft_consensus.cc:2764] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:35.381937  7898 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:35.382356  7925 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:35.389031  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:35.358850  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:35.335103  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:35.366721  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:35.371169  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.350247  7911 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:35.394057  7911 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.396855  7911 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.400839  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:35.374289  7927 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:35.401662  5369 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:16:35.401064  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66042.7us
I20260709 13:16:35.405648  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:35.403662  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:35.409477  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.410190  5449 raft_consensus.cc:2376] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10. Re-sending same reply.
I20260709 13:16:35.411576  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.413162  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.418025  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:35.418629  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:35.419679  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.416935  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:35.425793  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.425997  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.431149  5441 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:35.432425  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.390169  7405 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:35.436311  5441 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:16:35.510206  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 83401.2us
W20260709 13:16:35.510821  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68990.2us
W20260709 13:16:35.444737  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.408097  7812 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:35.402199  7991 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.530881  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:35.436409  7911 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.380548  7869 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.414979  7828 raft_consensus.cc:2764] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:35.424124  7873 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:35.534840  5375 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:35.387962  7915 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.534065  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:35.425105  7907 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.424474  7614 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:35.532320  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:35.541796  5375 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:35.543517  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.554693  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.556313  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.400575  7903 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:16:35.544972  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.433805  7891 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:35.543378  5339 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:35.593619  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50319us
I20260709 13:16:35.548899  5373 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.552197  5366 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:35.555502  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.425302  7925 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.122s
I20260709 13:16:35.510295  7926 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.570328  5372 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:35.571879  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.602164  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.603863  5450 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:35.435377  7944 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:16:35.602843  5441 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:35.580706  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.552258  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.508652  7875 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:16:35.599875  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.549556  7991 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:35.579654  7903 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:35.596534  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.434816  7616 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 13:16:35.540166  7873 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:35.591548  5371 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:35.532872  7837 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:16:35.623201  5375 raft_consensus.cc:2410] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:35.422072  7927 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.624145  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:35.625670  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.659150  5441 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:35.659976  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.660225  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.521735  7840 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:16:35.550729  7907 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:35.660988  5445 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
W20260709 13:16:35.627166  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 110889us
W20260709 13:16:35.681969  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 57955.4us
I20260709 13:16:35.682991  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:35.631104  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:35.632203  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 114776us
I20260709 13:16:35.543184  7766 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:16:35.531543  7405 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.540820  7881 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:16:35.640303  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.693706  5371 pending_rounds.cc:85] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 2
I20260709 13:16:35.694311  5371 pending_rounds.cc:107] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:35.694712  5371 raft_consensus.cc:2889] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.646173  5366 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:35.647428  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.611052  6073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 103) took 1102 ms. Trace:
W20260709 13:16:35.663918  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 136333us
I20260709 13:16:35.665290  5373 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:35.671727  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:35.673142  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.685702  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:35.616437  7614 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:35.629259  8000 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:35.708060  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:35.685277  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.595556  7935 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:16:35.698323  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.634522  7903 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:35.647857  7873 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.707537  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.699101  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.720283  5450 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.723860  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.640727  7696 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.709756  5445 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:35.658352  7911 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.686614  7907 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.717199  7915 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.616858  7896 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:16:35.712792  5369 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:35.725387  5518 raft_consensus.cc:2410] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:35.736914  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:35.739557  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.746462  5516 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:35.747570  5374 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.635007  7929 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:16:35.688104  7885 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.761859  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.775251  5447 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:35.776400  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.692586  7823 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:35.769937  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.708642  7891 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:35.771531  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.778149  5441 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.777128  5447 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:35.788461  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:35.771267  7986 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:16:35.816179  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 129331us
I20260709 13:16:35.817880  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.823760  5374 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:35.827565  5445 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:35.764873  7696 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.805047  7823 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:35.840746  5369 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:35.841818  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:35.843431  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.849300  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:35.850260  5369 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:35.850555  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.795984  7885 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:35.858199  5445 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:35.844192  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:35.844219  8004 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 13:16:35.866432  5368 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:35.866608  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49494.5us
I20260709 13:16:35.844883  7935 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.701814  6073 rpcz_store.cc:276] 0709 13:16:34.490056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.506652 (+ 16596us) service_pool.cc:224] Handling call
0709 13:16:35.082078 (+575426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.109403 (+ 27325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.114101 (+  4698us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:35.116515 (+  2414us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:35.117190 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.121352 (+  4162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.546177 (+424825us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400409f50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:35.592375 (+ 46198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199834496}
I20260709 13:16:35.878654  7710 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:35.879187  7710 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:35.879582  7710 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:35.883881  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.885643  5445 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:35.886683  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:35.888820  7970 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.004s
I20260709 13:16:35.867035  7766 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:35.894881  7766 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:35.896090  7766 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.897174  7873 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.844403  7614 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:35.898633  8012 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:16:35.900734  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:35.851716  7927 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.888820  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:35.902772  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:35.872327  5450 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:35.909832  7922 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:35.910671  7906 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:35.913463  5445 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:35.913981  7911 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.914515  7911 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.918167  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:35.865236  7896 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.868223  6070 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:35.933192  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:35.930451  5448 raft_consensus.cc:1217] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-6.4]   Dedup: 2.2->[4.3-6.4]
I20260709 13:16:35.935168  5448 pending_rounds.cc:85] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:35.935523  5448 pending_rounds.cc:107] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:35.934890  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:35.935832  5448 raft_consensus.cc:2889] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.913072  7696 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.870079  7869 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:35.941265  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:35.946372  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:35.828755  7991 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.935575  7927 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:35.833501  7903 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.889359  7970 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:35.941475  7720 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:35.958455  8008 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:16:35.932330  7922 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:16:36.000708  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 315474us
I20260709 13:16:35.939884  7896 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.003624  5446 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:16:36.001413  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 274111us
I20260709 13:16:35.980098  7969 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:35.981899  7906 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:35.964798  8016 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:16:36.012952  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44397us
I20260709 13:16:36.014591  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:36.014873  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 173136us
I20260709 13:16:36.015450  5517 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:36.015648  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.978871  7891 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:35.957981  8017 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:16:36.059408  6042 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:35.964794  7823 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.017781  7405 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:36.072220  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67667.8us
I20260709 13:16:36.024080  7921 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:36.076061  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67508.3us
I20260709 13:16:36.075629  5441 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
W20260709 13:16:36.077795  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62229.7us
I20260709 13:16:36.086210  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:36.088356  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:36.108024  8022 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 13:16:36.114115  8027 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:36.113866  7941 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:36.123710  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 64683.8us
I20260709 13:16:36.128360  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:36.130505  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 115606us
I20260709 13:16:36.152714  5517 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:36.136554  7873 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:36.150311  7405 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:36.161818  7405 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:36.162098  7896 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:36.162278  7405 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.163872  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:36.135588  8024 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:36.154489  8033 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.135025  7891 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.186034  5517 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:36.158452  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:36.158824  8009 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.467s	user 0.006s	sys 0.000s
I20260709 13:16:36.151587  8046 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.160495  7970 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:36.181015  7405 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.171255  8048 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:36.181977  7710 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.147085  8047 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:36.194111  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:36.195261  7710 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:36.197556  7911 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.200209  7911 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:36.202121  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:36.200436  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:36.205335  7405 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:36.209434  7921 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:36.210299  7921 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:36.214448  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 87888.8us
I20260709 13:16:36.216715  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:36.217941  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:36.219538  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:36.221588  7710 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:36.222119  7710 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:36.223489  7849 raft_consensus.cc:993] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:36.224314  7849 raft_consensus.cc:1081] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:36.224429  8033 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:36.224929  8033 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.225297  8033 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.189234  8024 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:36.226631  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68321.4us
I20260709 13:16:36.223186  7710 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.273958  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:36.277730  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:36.278630  5442 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:16:36.291920  8018 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.398s	user 0.000s	sys 0.002s
W20260709 13:16:36.300184  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66754.1us
W20260709 13:16:36.302649  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.309743  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:36.310109  7881 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:36.310622  7881 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:36.311546  7881 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.312665  7881 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.313606  7911 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:36.314042  8033 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.314236  7911 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.317818  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:36.318459  5373 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:36.319489  5373 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:36.320428  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:36.321041  5366 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.313642  8032 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:36.316609  7911 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:36.267176  7837 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:36.326503  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.268074  7921 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:36.329660  5517 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:36.329835  5516 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:36.223644  7958 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
W20260709 13:16:36.333755  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 245713us
I20260709 13:16:36.335801  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:36.336081  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:36.355667  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:36.335578  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:36.330909  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 384604us
I20260709 13:16:36.355064  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:36.362267  8033 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:36.362385  8034 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:36.365144  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:36.366024  5521 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.328570  7853 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:36.329627  7837 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:36.364630  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:36.377979  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:36.383365  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:36.332814  8032 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:36.393752  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:36.399232  5521 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:36.401607  5366 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:36.390272  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:36.411060  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:36.411938  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:36.412802  5521 raft_consensus.cc:2368] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6.
I20260709 13:16:36.374439  7911 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:36.432401  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:36.438072  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47885.5us
I20260709 13:16:36.440809  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:36.437963  7405 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:36.385221  7837 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.400043  8033 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.390425  8034 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:36.458624  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:36.390703  7812 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:16:36.385474  7853 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.462384  8034 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:36.433468  8049 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:16:36.589731  8034 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.596040  5442 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:36.461757  8026 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:36.587697  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 129155us
I20260709 13:16:36.599730  7935 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:36.600211  7935 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:36.588531  8039 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.467665  7849 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:16:36.481338  7405 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:36.631335  8047 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:36.637764  7907 consensus_meta.cc:287] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.004s
I20260709 13:16:36.640856  7896 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:36.652745  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:36.617816  8058 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.645078  8024 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:36.671309  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.642201  8039 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:36.641714  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 282482us
W20260709 13:16:36.681926  8061 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 13:16:36.683154  8063 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
W20260709 13:16:36.684490  8055 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:16:36.684677  8050 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
W20260709 13:16:36.686340  8056 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:16:36.686455  7853 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:36.687050  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1191) took 1044 ms. Trace:
I20260709 13:16:36.687523  5371 rpcz_store.cc:276] 0709 13:16:35.642942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.643466 (+   524us) service_pool.cc:224] Handling call
0709 13:16:35.687095 (+ 43629us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:36.022645 (+335550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.022682 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:36.023332 (+   650us) log.cc:844] Serialized 78 byte log entry
0709 13:16:36.095112 (+ 71780us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:36.095153 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.095227 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.686806 (+591579us) raft_consensus.cc:1685] finished
0709 13:16:36.686832 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.686987 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154966,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7534,"thread_start_us":329143,"threads_started":2,"wal-append.queue_time_us":240386}
I20260709 13:16:36.601052  7935 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.720427  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:36.721514  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 307223us
I20260709 13:16:36.670922  8017 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:36.822624  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99968.7us
I20260709 13:16:36.667552  7907 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:36.670245  7896 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:36.858032  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.819878  7935 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:36.829552  5340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.564s (SENT) [suppressed 26 similar messages]
I20260709 13:16:36.884949  5370 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:36.888603  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.893957  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 185621us
I20260709 13:16:36.832404  7614 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.828447  7405 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:36.945080  8069 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:36.949913  8078 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:36.950570  8070 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:16:36.912648  8021 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:36.888998  7958 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:16:36.939116  8030 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:36.949980  8073 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:16:36.939481  8024 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:36.942418  8026 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:36.911442  7614 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:37.013062  8074 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:16:37.018219  8068 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:16:36.978150  7958 consensus_queue.cc:1243] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 53eb858bdf82438d83f1be6a01da2e0e log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:36.950582  8078 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.003175  7931 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.005949  8030 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:36.671866  8058 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.041067  8082 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:16:37.064114  5443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.013s	sys 0.015s
I20260709 13:16:36.822892  8039 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:37.067718  5443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.013s	sys 0.015s
I20260709 13:16:37.005370  8024 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.059330  7933 raft_consensus.cc:993] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:36.827112  8017 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.078106  8084 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.078719  8084 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.080996  8084 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.094368  7933 raft_consensus.cc:1081] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:36.584424  8032 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.101092  8078 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:37.113170  8017 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:37.057396  7931 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.117027  7931 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:37.117972  7614 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:37.119809  7881 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.807s	user 0.003s	sys 0.012s
I20260709 13:16:37.120489  5517 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:37.121920  8039 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:37.123916  7837 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.000s
I20260709 13:16:37.124576  7837 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:37.070360  8060 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.248s	user 0.000s	sys 0.002s
I20260709 13:16:37.129667  7907 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.009665  8026 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.131275  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1334) took 1174 ms. Trace:
I20260709 13:16:37.132936  8026 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:37.127532  8034 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 13:16:37.128400  8058 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.126008  7896 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.131865  5524 rpcz_store.cc:276] 0709 13:16:35.956516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.956814 (+   298us) service_pool.cc:224] Handling call
0709 13:16:35.983623 (+ 26809us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:36.016847 (+ 33224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.016882 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:36.116543 (+ 99661us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b2c00108f48. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:16:36.117262 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.480655 (+363393us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:36.480718 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.480819 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.130846 (+650027us) raft_consensus.cc:1685] finished
0709 13:16:37.130876 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.131191 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89703,"raft.queue_time_us":89870,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":15087,"spinlock_wait_cycles":2517888,"thread_start_us":343117,"threads_started":1,"wal-append.queue_time_us":535459}
I20260709 13:16:37.140492  8030 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.074932  8082 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:37.145063  8072 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 13:16:37.156854  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.159380  5374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1175) took 1628 ms (client timeout 1550 ms). Trace:
I20260709 13:16:37.167079  7903 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.168694  7885 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:37.177613  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.230798  5519 raft_consensus.cc:1813] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
I20260709 13:16:37.231626  5519 raft_consensus.cc:2410] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:16:37.207710  7907 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.232661  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.232261  7907 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.178603  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.233837  5522 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:37.180167  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.235003  7766 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.235347  7907 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.200043  7971 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:37.185297  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:37.186118  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.190744  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.207350  7958 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:37.193212  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.195672  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 153) took 1782 ms. Trace:
I20260709 13:16:37.196566  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:37.198539  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 820574us
W20260709 13:16:37.201146  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 371578us
I20260709 13:16:37.272459  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:37.208658  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1182) took 1749 ms. Trace:
I20260709 13:16:37.208253  8034 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.219108  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.219712  8084 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.221582  5375 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:37.139561  8024 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.181933  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.184389  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:37.228994  5374 rpcz_store.cc:269] 0709 13:16:35.530744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.531873 (+  1129us) service_pool.cc:224] Handling call
0709 13:16:37.159071 (+1627198us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54001202d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:37.159247 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443554048}
I20260709 13:16:37.275527  5448 rpcz_store.cc:276] 0709 13:16:35.459670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.901938 (+442268us) service_pool.cc:224] Handling call
0709 13:16:35.930201 (+ 28263us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:36.059787 (+129586us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:36.060208 (+   421us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.357973 (+297765us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:36.381332 (+ 23359us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.381560 (+   228us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:36.384700 (+  3140us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.431636 (+ 46936us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.192769 (+761133us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b1800359860. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d7c6058f 00007fc1d0c9f571 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd
0709 13:16:37.199764 (+  6995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.208269 (+  8505us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.208340 (+    71us) raft_consensus.cc:1685] finished
0709 13:16:37.208363 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.208586 (+   223us) inbound_call.cc:177] Queueing success response
0709 13:16:37.233800 (+ 25214us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b1800359860. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
Metrics: {"mutex_wait_us":1579084,"prepare.queue_time_us":831462,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":118,"raft.queue_time_us":820517,"raft.run_cpu_time_us":556,"raft.run_wall_time_us":51156,"spinlock_wait_cycles":117143552,"thread_start_us":376265,"threads_started":2,"wal-append.queue_time_us":394440}
I20260709 13:16:37.285684  5520 raft_consensus.cc:2368] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:16:37.286294  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.267582  5449 rpcz_store.cc:276] 0709 13:16:35.414120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.415315 (+  1195us) service_pool.cc:224] Handling call
0709 13:16:35.415623 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.509322 (+ 93699us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:35.774236 (+264914us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.201661 (+427425us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b18003608e0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:16:36.377669 (+176008us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.388750 (+ 11081us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.388937 (+   187us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:36.391097 (+  2160us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.088597 (+697500us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b18003608e0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:16:37.195186 (+106589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.195268 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.195308 (+    40us) raft_consensus.cc:1685] finished
0709 13:16:37.195322 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.195443 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1634416,"prepare.queue_time_us":277262,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":101,"raft.queue_time_us":846469,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":81863,"spinlock_wait_cycles":27203584,"thread_start_us":333588,"threads_started":2,"wal-append.queue_time_us":675211}
I20260709 13:16:37.287428  5371 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:37.262856  7912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.368s	user 0.017s	sys 0.057s
I20260709 13:16:37.291736  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1509) took 1017 ms. Trace:
I20260709 13:16:37.302161  5445 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:16:37.302425  5367 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:37.298264  8083 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:16:37.306793  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 78062us
I20260709 13:16:37.308146  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:37.308449  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:37.303303  5444 rpcz_store.cc:276] 0709 13:16:36.274420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.283661 (+  9241us) service_pool.cc:224] Handling call
0709 13:16:36.284106 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:36.284538 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.284576 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:36.285242 (+   666us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.642161 (+356919us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:36.689746 (+ 47585us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.291241 (+601495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.291367 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.291425 (+    58us) raft_consensus.cc:1685] finished
0709 13:16:37.291445 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.291654 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601140,"prepare.queue_time_us":41035,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":615258,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":169,"thread_start_us":355786,"threads_started":1,"wal-append.queue_time_us":382525}
I20260709 13:16:37.311792  5445 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:37.313411  5445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:16:37.290660  7616 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.284704  7710 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.317059  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1511) took 1042 ms. Trace:
I20260709 13:16:37.315407  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:37.293718  7886 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:37.303100  7912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.017s	sys 0.058s
I20260709 13:16:37.316510  5445 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.355084  5445 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.337538  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:37.303082  7870 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.302443  7915 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.334592  5443 rpcz_store.cc:276] 0709 13:16:36.274952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.296093 (+ 21141us) service_pool.cc:224] Handling call
0709 13:16:36.296561 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.297009 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.297049 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.297694 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.071159 (+773465us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:37.071221 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.071330 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.316822 (+245492us) raft_consensus.cc:1685] finished
0709 13:16:37.316847 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.316995 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1278,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":772988,"threads_started":1,"wal-append.queue_time_us":913558}
I20260709 13:16:37.286342  7958 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.317116  7921 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:37.317016  7922 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:37.293962  8084 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.313794  8059 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:37.389065  8065 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.691s	user 0.000s	sys 0.004s
I20260709 13:16:37.372268  7915 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.386214  8034 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.318817  8083 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:37.399706  7915 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.400194  8083 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:37.384016  8045 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:37.315191  7885 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:16:37.394529  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1513) took 1095 ms. Trace:
I20260709 13:16:37.401105  8045 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:37.395612  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1510) took 1120 ms. Trace:
I20260709 13:16:37.338549  7616 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.339309  7991 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:37.398036  8082 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:37.401530  8045 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:37.387843  7958 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.359769  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:37.401283  5450 rpcz_store.cc:276] 0709 13:16:36.299321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.300256 (+   935us) service_pool.cc:224] Handling call
0709 13:16:36.300606 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.300967 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:36.330172 (+ 29205us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.221817 (+891645us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:37.228371 (+  6554us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.228578 (+   207us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:37.228630 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.228727 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.394196 (+165469us) raft_consensus.cc:1685] finished
0709 13:16:37.394217 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.394410 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":765227,"prepare.queue_time_us":29683,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":17192,"raft.queue_time_us":768971,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":24979,"spinlock_wait_cycles":25587072,"thread_start_us":100513,"threads_started":1,"wal-append.queue_time_us":308916}
I20260709 13:16:37.401904  5441 rpcz_store.cc:276] 0709 13:16:36.274690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.285715 (+ 11025us) service_pool.cc:224] Handling call
0709 13:16:36.286093 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.286537 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:36.286879 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.222739 (+935860us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:37.223264 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.223442 (+   178us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:37.223702 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.223907 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.224001 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.395425 (+171424us) raft_consensus.cc:1685] finished
0709 13:16:37.395445 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.395558 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":747824,"prepare.queue_time_us":5125,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":757676,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":61,"spinlock_wait_cycles":95654528,"thread_start_us":187512,"threads_started":1,"wal-append.queue_time_us":404214}
I20260709 13:16:37.370018  7944 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:37.410331  5445 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.378815  6070 pending_rounds.cc:85] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Aborting all ops after (but not including) 7
W20260709 13:16:37.416299  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 78872.1us
I20260709 13:16:37.376659  7837 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:37.418731  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 310064us
I20260709 13:16:37.357208  7710 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:37.422529  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 178392us
I20260709 13:16:37.425092  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.440831  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.441450  5445 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.441813  5366 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:37.442978  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:37.426571  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.444351  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.429239  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:37.432766  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.402148  7970 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:37.413369  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1520) took 1090 ms. Trace:
I20260709 13:16:37.445854  5449 rpcz_store.cc:276] 0709 13:16:36.323152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.293156 (+970004us) service_pool.cc:224] Handling call
0709 13:16:37.293655 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.293937 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:37.294418 (+   481us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.412887 (+118469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.412966 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:37.413026 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.413116 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.413294 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":261,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":113,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6758,"thread_start_us":117898,"threads_started":1}
I20260709 13:16:37.369217  7870 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.410145  7915 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:37.455498  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58818 (request call id 1523) took 1118 ms. Trace:
I20260709 13:16:37.456094  5445 rpcz_store.cc:276] 0709 13:16:36.324069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.313230 (+989161us) service_pool.cc:224] Handling call
0709 13:16:37.442110 (+128880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:37.437281  6070 pending_rounds.cc:107] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:16:37.462498  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1514) took 1162 ms. Trace:
I20260709 13:16:37.420281  7944 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:37.418651  7873 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:37.410780  8059 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.465047  5446 rpcz_store.cc:276] 0709 13:16:36.299639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.300171 (+   532us) service_pool.cc:224] Handling call
0709 13:16:36.317993 (+ 17822us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.318375 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.318401 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.318851 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.482704 (+163853us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:36.579095 (+ 96391us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.262439 (+683344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.262516 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.388487 (+125971us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:37.454156 (+ 65669us) raft_consensus.cc:1685] finished
0709 13:16:37.462245 (+  8089us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.462428 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699070,"prepare.queue_time_us":986,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2027,"raft.queue_time_us":683625,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":8847,"spinlock_wait_cycles":40709888,"thread_start_us":163536,"threads_started":1,"wal-append.queue_time_us":328402}
I20260709 13:16:37.464178  7837 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:37.464545  6070 raft_consensus.cc:2889] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.487921  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.511749  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:37.464391  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:37.515249  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.516012  5371 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:16:37.517084  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:37.518005  5371 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:37.483870  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:37.520206  8049 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:37.520872  8049 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:37.521385  8049 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.523660  5367 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:37.466639  7970 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.480746  8102 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.536928  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 221105us
W20260709 13:16:37.531965  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48076.2us
I20260709 13:16:37.553455  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1519) took 1230 ms. Trace:
I20260709 13:16:37.550974  5368 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:37.493641  7921 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.546929  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:37.464643  7915 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.491117  7837 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:37.562717  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.560128  7840 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:16:37.563227  7837 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.564280  7837 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:37.566074  8103 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:16:37.567003  8099 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:16:37.567263  7885 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:37.568359  8098 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:37.570122  7915 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.570698  7915 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:37.571056  7915 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:37.571267  8047 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.571712  8047 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.575139  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1564) took 1260 ms. Trace:
W20260709 13:16:37.576081  8101 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:37.571903  7915 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:37.578187  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:37.578908  5372 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:37.579736  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1565) took 1264 ms. Trace:
I20260709 13:16:37.580083  5372 rpcz_store.cc:276] 0709 13:16:36.315084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.317493 (+  2409us) service_pool.cc:224] Handling call
0709 13:16:37.578466 (+1260973us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67e9c 00007fc1d0c67a5b 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:37.578682 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.579437 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.579671 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15600384}
I20260709 13:16:37.581084  8059 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.585750  7616 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:37.583879  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:37.588153  7710 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.590497  7837 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:37.591936  7837 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.592809  8016 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.593341  8016 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.480751  7873 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.595558  8016 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:37.595871  7873 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.596312  8016 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.555308  7944 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.597275  7944 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.596809  8016 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:37.557197  7926 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:37.465847  8045 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.591318  7870 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:37.611238  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 149730us
I20260709 13:16:37.611920  8083 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:37.612346  8083 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.612699  8083 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:37.613900  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67179.3us
I20260709 13:16:37.614733  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:37.615885  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:37.616374  8106 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:37.616942  8106 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:37.617412  8106 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:37.617609  7823 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:37.618431  7823 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:37.627038  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1343) took 1292 ms. Trace:
I20260709 13:16:37.627494  5517 rpcz_store.cc:276] 0709 13:16:36.335104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.335425 (+   321us) service_pool.cc:224] Handling call
0709 13:16:37.626826 (+1291401us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540016c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:37.626932 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1802628992}
I20260709 13:16:37.628019  5521 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:37.550674  8111 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.630003  8111 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.617348  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:37.632997  8111 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.635115  7823 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:37.549933  7970 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.632786  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.575685  5370 rpcz_store.cc:276] 0709 13:16:36.314807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.316978 (+  2171us) service_pool.cc:224] Handling call
0709 13:16:36.317316 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.891073 (+573757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.574750 (+683677us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54000c6054. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:37.575027 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304802304}
I20260709 13:16:37.658413  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:37.606613  5368 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:37.592281  7837 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:37.559064  5448 rpcz_store.cc:276] 0709 13:16:36.322835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.294806 (+971971us) service_pool.cc:224] Handling call
0709 13:16:37.295102 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.295284 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:37.314277 (+ 18993us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.553042 (+238765us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.553097 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:37.553137 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.553213 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.553353 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46951,"prepare.queue_time_us":18969,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":53967,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":196921,"threads_started":1}
I20260709 13:16:37.552452  8034 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:37.557098  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:37.559553  8102 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:37.706094  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.918497  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:37.919978  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:37.802527  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.919202  5445 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
W20260709 13:16:37.736797  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101953us
I20260709 13:16:37.923957  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:37.929136  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:37.929719  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:37.930375  5448 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.930540  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:37.841670  7903 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:37.864802  7873 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:37.909530  8110 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.935107  7873 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:37.937541  8024 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:37.937956  7970 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.925515  8084 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:37.938868  7873 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:37.941593  5448 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:37.942675  8106 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.676473  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:37.821883  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 268659us
I20260709 13:16:37.956423  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:37.954056  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.956444  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:37.957643  5448 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8. Re-sending same reply.
I20260709 13:16:37.957862  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:37.957758  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.960376  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:37.946695  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.966352  5517 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:37.780296  8091 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.943938  8109 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:16:37.968293  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.969359  5368 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:37.641969  7616 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:37.785379  7812 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.919183  7927 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.969842  5414 leader_election.cc:400] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6.
I20260709 13:16:37.926712  7869 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:37.970191  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 293827us
I20260709 13:16:37.971835  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:37.852561  7870 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.989727  5448 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:37.691560  7907 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.820116  8111 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.734097  7910 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:37.956913  8054 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:37.934048  7903 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:37.691836  7823 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.989013  5414 leader_election.cc:403] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:37.561865  7921 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.983144  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:37.990720  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:37.990202  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:37.957180  8100 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.671507  7922 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.328s
I20260709 13:16:37.874189  8021 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:37.993844  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:37.966071  7935 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.966406  8059 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:38.016239  5444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.008s	sys 0.011s
W20260709 13:16:38.045543  5444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.008s	sys 0.011s
I20260709 13:16:37.935158  8110 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.643277  7926 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:38.021832  5443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.011s	sys 0.009s
W20260709 13:16:38.026070  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64880.3us
I20260709 13:16:37.983580  8084 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:37.732717  8049 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.944146  8034 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:37.970254  8016 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:38.004182  7906 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.009s	sys 0.008s
I20260709 13:16:37.973520  8033 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:37.994380  8058 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:38.047899  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.050820  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.044946  7891 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:38.046664  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1526) took 1634 ms. Trace:
I20260709 13:16:38.118322  5444 rpcz_store.cc:276] 0709 13:16:36.412523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.405791 (+993268us) service_pool.cc:224] Handling call
0709 13:16:37.415240 (+  9449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.415519 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:37.439943 (+ 24424us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.046140 (+606197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.046222 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:38.046285 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.046395 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.046584 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24838,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":1219,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":49180,"thread_start_us":605715,"threads_started":1}
I20260709 13:16:38.005846  7869 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.029804  7873 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 5. Current term is 6.
I20260709 13:16:38.001257  7710 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:16:38.063949  8084 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:38.103040  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.004956  7870 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.016280  7927 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.993503  7616 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.031177  7823 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:38.101243  8041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.032s	sys 0.023s
I20260709 13:16:38.018791  7907 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.106490  5445 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:38.039517  7896 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:37.992985  7812 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:37.990993  8091 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.053586  7970 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:38.053609  5443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.012s	sys 0.009s
I20260709 13:16:38.135950  8084 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.044515  7405 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.156683  5449 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.021095  8111 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.022794  8054 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.129953  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:38.111868  7906 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.009s	sys 0.016s
I20260709 13:16:38.039070  8083 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.056521  7935 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.134347  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.026134  7910 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.043292  8021 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:38.131225  8109 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:16:38.040118  8100 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:38.151298  5450 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.123970  7891 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.154148  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1525) took 1742 ms. Trace:
I20260709 13:16:38.240939  5443 rpcz_store.cc:276] 0709 13:16:36.412210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.361348 (+949138us) service_pool.cc:224] Handling call
0709 13:16:37.361699 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.361907 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:37.382021 (+ 20114us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.153637 (+771616us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.153809 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.153857 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:38.153901 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.153962 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.154090 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1767,"prepare.queue_time_us":28634,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":3820,"raft.queue_time_us":18969,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6445,"spinlock_wait_cycles":32026496,"thread_start_us":770965,"threads_started":1,"wal-append.queue_time_us":763659}
I20260709 13:16:38.242714  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.243323  5443 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:38.244102  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:38.136938  8016 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:38.119982  8033 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.119686  8058 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.244349  8106 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.251132  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:38.262061  8058 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.166275  5441 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:38.262549  5368 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:38.263015  8105 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.698s	user 0.000s	sys 0.002s
W20260709 13:16:38.155417  8115 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 13:16:38.158790  7766 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.923s	user 0.007s	sys 0.008s
I20260709 13:16:38.266155  7840 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.266681  7840 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.269614  5517 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:38.262069  7616 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:38.274403  8127 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:16:38.277400  8033 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.278810  7840 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.281950  8120 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:38.282549  8120 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.163427  7405 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.150609  7896 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:38.351424  7896 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.352829  7405 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.155076  8102 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.356304  8100 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.358086  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59510 (request call id 95) took 1076 ms. Trace:
I20260709 13:16:38.358559  6070 rpcz_store.cc:276] 0709 13:16:37.281358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.293245 (+ 11887us) service_pool.cc:224] Handling call
0709 13:16:37.357009 (+ 63764us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:37.597703 (+240694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.597757 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:37.598565 (+   808us) log.cc:844] Serialized 52 byte log entry
0709 13:16:37.999444 (+400879us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:38.238638 (+239194us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.286892 (+ 48254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.357786 (+ 70894us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.357844 (+    58us) raft_consensus.cc:1685] finished
0709 13:16:38.357858 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.358023 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54265,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":73818,"thread_start_us":556051,"threads_started":2,"wal-append.queue_time_us":503113}
I20260709 13:16:38.230947  5444 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:38.231129  7903 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:38.232091  7869 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.232483  8049 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.232811  5449 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:38.232859  8110 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.111876  5448 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
W20260709 13:16:38.233538  8116 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:16:38.362185  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.244894  5443 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:38.363194  7896 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:38.364127  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:38.258080  7921 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:38.260113  8047 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.006s
I20260709 13:16:38.365499  7896 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:38.365999  8047 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.368937  8047 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.179801  5446 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:38.369946  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:38.370111  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.370935  5446 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:38.370862  8122 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:38.371587  8122 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.372448  5370 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:38.286744  5368 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:38.373989  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.374272  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.374781  5443 raft_consensus.cc:1813] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
I20260709 13:16:38.375502  5443 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:38.375579  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.376370  5368 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:38.377110  5443 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:38.293373  5524 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:38.378746  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.379114  5443 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:38.379437  5524 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
I20260709 13:16:38.257157  7837 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.380740  6041 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:38.380751  5443 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:38.382125  7837 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.382830  5443 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:38.385504  8100 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:38.386248  8100 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.387266  8100 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.377223  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.303556  7926 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:38.312484  7870 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.314344  8111 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.291771  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.317471  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1516) took 1997 ms. Trace:
I20260709 13:16:38.316255  7910 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.391011  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.318897  7927 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.320989  8016 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:38.325058  8125 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:38.326985  8034 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:38.320483  7907 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.323109  8091 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.334313  8054 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.350644  7823 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.343385  7891 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.288589  5450 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:38.371901  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.397003  5446 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:38.388080  7903 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:38.302997  8120 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.389673  5442 rpcz_store.cc:276] 0709 13:16:36.321619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.596949 (+275330us) service_pool.cc:224] Handling call
0709 13:16:36.597282 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:37.266821 (+669539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.266872 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:37.286941 (+ 20069us) log.cc:844] Serialized 52 byte log entry
0709 13:16:37.383706 (+ 96765us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:16:37.489318 (+105612us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:37.513740 (+ 24422us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.581603 (+ 67863us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b180017ab20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:16:37.997192 (+415589us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.997455 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.997553 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.317100 (+319547us) raft_consensus.cc:1685] finished
0709 13:16:38.317138 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.317365 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":708016,"prepare.queue_time_us":52908,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":3919,"raft.queue_time_us":721109,"raft.run_cpu_time_us":1293,"raft.run_wall_time_us":119451,"spinlock_wait_cycles":48967680,"thread_start_us":606995,"threads_started":2,"wal-append.queue_time_us":305934}
I20260709 13:16:38.386185  8122 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.371013  7935 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.412396  8122 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.235944  6040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.020s
I20260709 13:16:38.393242  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:38.415045  6040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.000s	sys 0.021s
I20260709 13:16:38.413630  8122 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:38.415282  5368 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
W20260709 13:16:38.414426  8128 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
I20260709 13:16:38.391911  5441 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
W20260709 13:16:38.332345  7944 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.735s	user 0.007s	sys 0.004s
I20260709 13:16:38.419983  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.362867  5444 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
W20260709 13:16:38.436064  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.443331  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:38.447992  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.453516  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.454572  5444 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
W20260709 13:16:38.462265  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.445307  8123 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:38.469849  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:38.466410  8114 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.331s	user 0.001s	sys 0.001s
I20260709 13:16:38.481096  8054 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.488423  7812 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.480605  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.482674  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:38.465313  8084 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.483165  8021 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.486626  8122 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:38.499245  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.471611  8123 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:38.487907  8016 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:38.490172  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.513581  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.517545  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:38.485291  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:38.553090  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 103435us
I20260709 13:16:38.554206  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.555996  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.533399  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.557813  5368 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:38.538152  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.536302  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1203) took 1106 ms. Trace:
I20260709 13:16:38.558676  5367 rpcz_store.cc:276] 0709 13:16:37.430125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.524677 (+ 94552us) service_pool.cc:224] Handling call
0709 13:16:37.525092 (+   415us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:37.604405 (+ 79313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.604456 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:37.605510 (+  1054us) log.cc:844] Serialized 52 byte log entry
0709 13:16:38.026295 (+420785us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:38.026336 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.026408 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.535959 (+509551us) raft_consensus.cc:1685] finished
0709 13:16:38.536000 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.536231 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26221,"raft.queue_time_us":69401,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4130,"thread_start_us":243932,"threads_started":1,"wal-append.queue_time_us":414754}
I20260709 13:16:38.541179  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.541996  8054 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.563679  7970 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:38.564091  8123 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.564543  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:38.565289  8054 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.553848  8122 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:38.566145  8122 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.566756  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:38.567276  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:38.568032  5523 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:38.568377  8122 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.568804  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.562856  8132 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:38.563148  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:38.568728  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:38.570482  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.572041  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1589) took 1153 ms. Trace:
I20260709 13:16:38.572381  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:38.573184  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.562176  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:38.576910  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.581097  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.581607  5520 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.584867  5369 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:38.585228  5367 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:38.580765  5375 rpcz_store.cc:276] 0709 13:16:37.418269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.418421 (+   152us) service_pool.cc:224] Handling call
0709 13:16:37.443107 (+ 24686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.285481 (+842374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.285530 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.285588 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:38.285633 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.571822 (+286189us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540015c2d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:38.571871 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.571981 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936612096}
I20260709 13:16:38.587797  5368 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:38.575919  8132 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:38.589466  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.600057  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:38.563697  8134 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:16:38.608530  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:38.617084  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:38.618110  5368 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:38.618505  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.619391  5517 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:38.621731  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.601841  8132 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.626968  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.623937  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.624305  5520 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:38.634209  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:38.635461  8026 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:38.636116  8026 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:38.637221  8026 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:38.644713  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.654186  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.655297  5448 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:38.649024  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1601) took 1027 ms. Trace:
I20260709 13:16:38.660938  8021 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.658895  5373 rpcz_store.cc:276] 0709 13:16:37.621839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.873178 (+251339us) service_pool.cc:224] Handling call
0709 13:16:37.873852 (+   674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.168524 (+294672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.168574 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.169236 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.461316 (+292080us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:38.461365 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.648440 (+187075us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54001ea354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:38.648511 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.648580 (+    69us) raft_consensus.cc:1685] finished
0709 13:16:38.648600 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.648936 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61361,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":676380928,"thread_start_us":291535,"threads_started":1,"wal-append.queue_time_us":303006}
W20260709 13:16:38.676926  8066 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 2.288s	user 0.009s	sys 0.000s
I20260709 13:16:38.678339  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1508) took 2404 ms. Trace:
I20260709 13:16:38.678830  5447 rpcz_store.cc:276] 0709 13:16:36.274144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.281607 (+  7463us) service_pool.cc:224] Handling call
0709 13:16:36.282048 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.282536 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.282572 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.283140 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.389333 (+106193us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:36.430129 (+ 40796us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.199137 (+769008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.199232 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.676361 (+1477129us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:38.677993 (+  1632us) raft_consensus.cc:1685] finished
0709 13:16:38.678099 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.678253 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":796122,"prepare.queue_time_us":43263,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":798656,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":36980,"spinlock_wait_cycles":125726080,"thread_start_us":105778,"threads_started":1,"wal-append.queue_time_us":105722}
I20260709 13:16:38.668236  8084 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.692117  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.693066  5444 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:38.697678  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1367) took 1068 ms. Trace:
I20260709 13:16:38.700423  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.701368  5444 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:38.702226  5447 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:38.703737  5414 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:38.698280  5521 rpcz_store.cc:276] 0709 13:16:37.628748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.629214 (+   466us) service_pool.cc:224] Handling call
0709 13:16:38.676941 (+1047727us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:38.677199 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.697238 (+ 20039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.697268 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.697309 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:38.697353 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.697458 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.697603 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19706,"spinlock_wait_cycles":707520256}
I20260709 13:16:38.707612  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1358) took 1081 ms. Trace:
I20260709 13:16:38.710256  5446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:16:38.711333  5446 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.711755  5446 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.710343  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.714548  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:38.715818  5444 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:38.719448  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:38.721518  8132 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.726521  8132 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.716702  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:38.753597  8129 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.754256  8129 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.759049  5515 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:38.759801  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1362) took 1132 ms. Trace:
I20260709 13:16:38.760155  5515 rpcz_store.cc:276] 0709 13:16:37.627243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.630610 (+  3367us) service_pool.cc:224] Handling call
0709 13:16:38.758497 (+1127887us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:38.758716 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.759518 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.759739 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726518656}
I20260709 13:16:38.734808  8017 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:38.790110  8095 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.380s	user 0.003s	sys 0.001s
I20260709 13:16:38.789758  8100 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:38.796708  6073 raft_consensus.cc:1813] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
I20260709 13:16:38.793306  8017 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.797524  6073 raft_consensus.cc:2368] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6.
I20260709 13:16:38.801339  8017 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:38.803336  7915 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.825243  8083 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:38.834041  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:38.834849  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:38.835155  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1364) took 1207 ms. Trace:
W20260709 13:16:38.835893  5519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1363) took 1208 ms (client timeout 1528 ms). Trace:
I20260709 13:16:38.836401  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1365) took 1208 ms. Trace:
I20260709 13:16:38.837090  5522 rpcz_store.cc:276] 0709 13:16:37.628127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.631319 (+  3192us) service_pool.cc:224] Handling call
0709 13:16:38.832718 (+1201399us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:38.833001 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.833270 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.833305 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.833357 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:38.833393 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.836124 (+  2731us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.836317 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19929856}
I20260709 13:16:38.835630  5516 rpcz_store.cc:276] 0709 13:16:37.627820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.631099 (+  3279us) service_pool.cc:224] Handling call
0709 13:16:38.833849 (+1202750us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:38.835073 (+  1224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725503360}
W20260709 13:16:38.836851  5519 rpcz_store.cc:269] 0709 13:16:37.627529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.630856 (+  3327us) service_pool.cc:224] Handling call
0709 13:16:38.834633 (+1203777us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:38.835818 (+  1185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726155648}
I20260709 13:16:38.709039  5518 rpcz_store.cc:276] 0709 13:16:37.626121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.629785 (+  3664us) service_pool.cc:224] Handling call
0709 13:16:38.548007 (+918222us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:16:38.548238 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.548475 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:38.603030 (+ 54555us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.707206 (+104176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.707271 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:38.707324 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.707403 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.707547 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97667,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":229,"spinlock_wait_cycles":728020352,"thread_start_us":157285,"threads_started":2}
W20260709 13:16:38.879910  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 850696us
I20260709 13:16:38.827921  5446 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:38.911370  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 207) took 1359 ms. Trace:
I20260709 13:16:38.912052  5374 rpcz_store.cc:276] 0709 13:16:37.552305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.577221 (+ 24916us) service_pool.cc:224] Handling call
0709 13:16:37.577623 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.120759 (+543136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.120793 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.120844 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:38.120874 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.910991 (+790117us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54001856d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:38.911066 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.911282 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248549760}
I20260709 13:16:38.986011  6073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 96) took 1702 ms. Trace:
I20260709 13:16:38.986569  6073 rpcz_store.cc:276] 0709 13:16:37.283628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.298728 (+ 15100us) service_pool.cc:224] Handling call
0709 13:16:38.482496 (+1183768us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800004598. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:16:38.985650 (+503154us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003156d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:38.985870 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631438464}
I20260709 13:16:38.996052  5449 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
W20260709 13:16:39.003675  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 300002us
I20260709 13:16:39.010059  7696 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:39.059708  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:39.060637  5366 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:39.070052  7812 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:39.075263  8122 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:39.075877  8122 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.070852  7812 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.078285  7922 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:39.078822  7922 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.079810  7812 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:39.080550  7812 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:39.082870  7886 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:39.281862  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:39.752688  5368 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:39.766393  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:39.765399  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:39.748032  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.755172  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:39.540922  5446 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:39.776858  5518 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:39.164160  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.777117  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.776736  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1540) took 1057 ms. Trace:
W20260709 13:16:39.780617  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.782644  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:39.780560  5447 rpcz_store.cc:276] 0709 13:16:38.719007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.766157 (+1047150us) service_pool.cc:224] Handling call
0709 13:16:39.776679 (+ 10522us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:39.780362  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.795001  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.795163  5448 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:39.779613  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58818 (request call id 1532) took 1091 ms. Trace:
I20260709 13:16:39.797032  5446 rpcz_store.cc:276] 0709 13:16:38.688523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.688658 (+   135us) service_pool.cc:224] Handling call
0709 13:16:39.779550 (+1090892us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:39.756084  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:39.339107  8026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.000s	sys 0.011s
I20260709 13:16:39.801052  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:39.813987  5414 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.024s	sys 0.022s
W20260709 13:16:39.814517  5414 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.024s	sys 0.022s
W20260709 13:16:39.814913  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 810291us
I20260709 13:16:39.100227  8139 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:39.780297  7922 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:39.791378  8045 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:39.780472  8100 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:39.837754  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.789515  8051 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:39.838563  5447 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:39.799239  8129 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:39.793762  8122 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:39.849905  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:39.809746  8026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.005s	sys 0.017s
I20260709 13:16:39.811616  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:39.850996  5445 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:39.845175  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.815147  8049 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:39.847057  5443 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:39.088387  7812 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:39.092495  7886 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.853708  5448 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:39.836571  7696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.010s	sys 0.008s
I20260709 13:16:39.842552  8030 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.841552  7922 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:39.848897  8129 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.838373  8139 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:39.881335  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:39.865835  7696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.010s	sys 0.011s
I20260709 13:16:39.853345  8122 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.854735  8049 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.871160  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.882923  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:39.846189  8051 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.891346  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.881636  8129 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.866521  8083 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:39.886758  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.888427  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:39.883407  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.892249  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.894694  5444 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:39.894742  5445 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:39.880517  8156 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:39.893754  5450 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:39.903620  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:39.901955  5443 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:39.914462  5445 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:39.893807  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:39.896266  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.870179  8030 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.916147  5444 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:39.891693  8049 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.918910  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:39.874454  7922 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.926749  5518 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:39.931856  6041 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:39.892913  6077 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:39.895891  8122 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.918548  7958 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:39.903138  8083 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.939348  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:39.946461  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:39.916836  8156 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:39.949151  5445 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
W20260709 13:16:39.951694  8148 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:16:39.946370  8139 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:39.942564  7958 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:39.959664  8150 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:16:39.966815  8139 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:39.963353  7812 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:39.961747  7886 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:39.965816  8129 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:39.972851  8139 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:16:39.980284  8151 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:16:39.978864  8122 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:40.008440  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 259793us
I20260709 13:16:39.996110  8083 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:40.001796  8154 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:16:39.998910  8051 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:40.000734  7922 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.022701  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 107) took 1466 ms. Trace:
I20260709 13:16:40.026872  6070 rpcz_store.cc:276] 0709 13:16:38.555404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.562012 (+  6608us) service_pool.cc:224] Handling call
0709 13:16:38.562330 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.580499 (+ 18169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.584603 (+  4104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.590653 (+  6050us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:38.596073 (+  5420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.017356 (+1421283us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5400409f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:40.018761 (+  1405us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.021801 (+  3040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25815296}
I20260709 13:16:40.025215  5273 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 3 to 5, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 5 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:40.035055  8030 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:40.035944  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 253361us
I20260709 13:16:40.028589  7922 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.018601  8139 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:40.030753  7958 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.064848  5273 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.067672  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:40.112105  8054 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:40.112316  8129 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:40.113008  8051 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:40.113461  8041 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:40.113520  8129 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:40.113940  7890 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:40.112129  5273 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 3 to 5, term changed from 2 to 4, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131), VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New cstate: current_term: 4 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:16:40.114058  8041 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:40.103399  7922 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.127804  8041 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.129135  8041 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.129603  7890 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:40.130767  7890 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.132104  8021 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:40.133148  8161 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:40.133667  8161 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:40.129123  8051 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:16:40.134968  8161 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.137720  8161 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.132304  7890 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.157009  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:40.096302  6077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59508 (request call id 94) took 1366 ms. Trace:
W20260709 13:16:40.221136  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 64224.5us
I20260709 13:16:40.223042  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:40.241115  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:40.242695  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 232206us
W20260709 13:16:40.246614  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 495353us
W20260709 13:16:40.248091  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 482068us
I20260709 13:16:40.117414  8129 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:40.249382  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:40.257899  5448 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.220206  7886 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.224502  8156 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.242660  8122 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.247078  8158 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:40.267311  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:40.264269  8175 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:40.333824  5448 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
W20260709 13:16:40.312677  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48689.5us
I20260709 13:16:40.265751  8030 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.346693  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1210) took 1985 ms. Trace:
W20260709 13:16:40.353045  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 104241us
I20260709 13:16:40.271786  7696 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:40.264832  8162 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:40.377755  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 135290us
I20260709 13:16:40.395797  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:40.396588  8184 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.349018  8155 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.397219  8184 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.397663  8155 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:40.398309  8155 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.399871  8184 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:40.358807  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 133777us
I20260709 13:16:40.401625  8187 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:40.402411  8187 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:40.224241  6077 rpcz_store.cc:276] 0709 13:16:38.730307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.734282 (+  3975us) service_pool.cc:224] Handling call
0709 13:16:40.069744 (+1335462us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b540049d9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:40.078271 (+  8527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78274816}
I20260709 13:16:40.297629  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:40.349455  5370 rpcz_store.cc:276] 0709 13:16:38.361606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.571153 (+209547us) service_pool.cc:224] Handling call
0709 13:16:38.571420 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.571623 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:38.660115 (+ 88492us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.225607 (+1565492us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.242502 (+ 16895us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.346349 (+103847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:40.346403 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:40.346445 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.346511 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.346638 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1092176,"prepare.queue_time_us":231341,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":127,"raft.queue_time_us":1122400,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":23622,"spinlock_wait_cycles":6150400,"thread_start_us":660385,"threads_started":4,"wal-append.queue_time_us":1179504}
W20260709 13:16:40.405575  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51692.1us
I20260709 13:16:40.347862  8051 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:40.424849  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:40.427603  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:40.427928  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.277292  7886 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.428773  5374 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:40.429661  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.429917  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.430351  5366 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:40.429665  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:40.431473  5373 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:40.431685  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.434396  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.434810  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:40.435272  5369 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:40.437582  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:40.438205  5367 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.437898  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.438978  5372 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:40.348359  8168 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.441497  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.355351  8030 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.354213  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:16:40.423691  8152 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:40.464843  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:40.464696  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.454510  5373 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:40.407330  8163 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:40.335664  8122 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.472944  5518 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:40.458387  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:40.458602  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:40.421911  8045 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
I20260709 13:16:40.466166  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1200) took 3027 ms. Trace:
W20260709 13:16:40.442042  8157 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:16:40.474509  5374 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:40.470230  5273 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 3 to 7, term changed from 3 to 7, VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) evicted. New cstate: current_term: 7 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.400610  8184 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:16:40.477849  5371 rpcz_store.cc:276] 0709 13:16:37.429164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.518637 (+ 89473us) service_pool.cc:224] Handling call
0709 13:16:37.519054 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:37.557651 (+ 38597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.557703 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:37.563222 (+  5519us) log.cc:844] Serialized 52 byte log entry
0709 13:16:39.755536 (+2192314us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b1800186b20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:16:39.923318 (+167782us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:40.236561 (+313243us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.313978 (+ 77417us) log.cc:844] Serialized 14 byte log entry
0709 13:16:40.424264 (+110286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.424348 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.456299 (+ 31951us) raft_consensus.cc:1685] finished
0709 13:16:40.456320 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.456494 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281745,"prepare.queue_time_us":321462,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":250896,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":30355,"spinlock_wait_cycles":101037696,"thread_start_us":468421,"threads_started":2,"wal-append.queue_time_us":2382713}
I20260709 13:16:40.346064  8158 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.352064  8165 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:16:40.394578  8129 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.459996  8030 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.546015  5367 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:40.488063  5447 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:40.551832  5447 pending_rounds.cc:85] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 4
I20260709 13:16:40.552270  5447 pending_rounds.cc:107] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:40.552798  5447 raft_consensus.cc:2889] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.511665  5516 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:40.445888  8051 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.560949  8051 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:40.407953  8162 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.568310  8162 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:40.457942  7922 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:40.601373  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50939.1us
I20260709 13:16:40.481998  8170 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:16:40.608871  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53299.1us
I20260709 13:16:40.470345  8107 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.553507  7812 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.554126  5273 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.577822  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:40.657735  8192 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:40.596976  8041 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.654233  5273 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:40.630249  8049 consensus_meta.cc:287] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.006s
I20260709 13:16:40.459738  8168 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.630915  7696 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.623668  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 213650us
W20260709 13:16:40.682842  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 287143us
I20260709 13:16:40.615557  8189 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.679657  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99660.6us
W20260709 13:16:40.680495  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 75930.1us
I20260709 13:16:40.685366  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:40.622076  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:40.689033  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:40.692637  5366 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.687482  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:40.691710  8189 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.700526  8134 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.700873  5366 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:40.701161  8134 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:40.703677  8198 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.704198  8198 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.704623  8198 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.705010  8134 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:40.709965  8190 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.710582  8190 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.712819  8190 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.699992  8189 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.690567  7886 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.484608  8163 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:40.738935  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 116941us
I20260709 13:16:40.748350  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:40.739168  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56210.3us
W20260709 13:16:40.736763  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47810.4us
I20260709 13:16:40.749339  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:40.751891  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:40.752357  5516 raft_consensus.cc:606] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:40.740267  8194 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:40.755128  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67740.5us
I20260709 13:16:40.580785  8187 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.755856  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:40.754318  7886 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:40.756665  7886 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.757037  7886 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:40.754182  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:40.758111  8194 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:40.681735  8049 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.624197  7812 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.757265  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:40.722880  8156 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:40.761147  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a548ed234e342789833cf138d282543"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:16:40.747460  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60909.9us
I20260709 13:16:40.764169  5516 raft_consensus.cc:606] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:40.766381  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:40.764097  5490 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:40.765535  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:40.764521  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:40.685983  7696 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.736743  8165 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.746372  8021 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.764843  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:40.771409  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:40.736507  8199 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.773779  8190 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:40.773911  5340 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:40.819335  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45508.4us
I20260709 13:16:40.774499  8197 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:40.822468  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56180.3us
I20260709 13:16:40.774799  8200 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:40.763877  8156 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.830554  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:40.769716  8167 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.778963  8158 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.780340  8021 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:40.763108  8186 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:16:40.781052  8162 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.838649  8021 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.848554  8162 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.849110  8162 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.849838  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:40.783912  8041 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.785821  7886 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.853142  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:40.853801  5443 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:40.788429  8204 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:40.794787  8168 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.622936  8107 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:40.802802  8122 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.803426  8165 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:40.805192  8191 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:16:40.805546  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.770823  8194 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:16:40.838694  7958 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.858156  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:40.807778  7696 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.763288  8189 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:40.858848  5443 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:40.765707  8054 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.859385  8054 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.859751  8054 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.861119  8041 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.815683  8049 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:40.762763  8045 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:40.864876  8045 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:40.765295  8198 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.865804  8107 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:40.865971  8045 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.821797  8190 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.842180  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:40.873409  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:40.873769  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 109313us
I20260709 13:16:40.845969  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:40.623342  8170 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:40.854247  7890 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:16:40.873852  5447 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.847623  5449 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:40.822537  8197 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:40.877823  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:40.893007  5444 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:40.881400  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:40.834182  8156 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:40.877247  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:40.836795  8184 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.837054  8167 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.867321  8045 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.906605  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:40.882421  8190 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.832886  8083 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:16:40.836185  8166 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:16:40.832480  8134 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:16:40.835778  8026 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:16:40.900136  8197 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:40.903298  7890 raft_consensus.cc:2764] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:40.904238  8167 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.901903  8184 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:40.910742  8181 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.921286  8184 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.925614  8198 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.926632  8170 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:40.937058  8184 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.936949  8021 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.947090  8163 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:40.947872  8155 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.004s
I20260709 13:16:40.948549  8155 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:40.953853  8021 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:40.955948  8167 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.960654  8030 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.941398  8162 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.961978  8167 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.963650  8054 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.970736  8155 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.971359  8162 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:40.968709  8165 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.978024  8190 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.979128  8197 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.980315  8190 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.981302  8197 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:41.009301  5270 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 154) took 16110 ms (client timeout 15000 ms). Trace:
I20260709 13:16:40.787649  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:41.019810  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 232072us
I20260709 13:16:40.825986  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:41.022751  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:41.023442  5362 tablet_service.cc:1558] Processing DeleteTablet for tablet fd246431fed24a99b47e2ccdf988b1ff with delete_type TABLET_DATA_TOMBSTONED (TS 86b410d62f4040c39d33dc0698998562 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44078
I20260709 13:16:41.023700  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:41.026542  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 200478us
I20260709 13:16:41.028012  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.034327  5375 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:41.035190  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:41.018476  5270 rpcz_store.cc:269] 0709 13:16:24.900595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.914638 (+ 14043us) service_pool.cc:224] Handling call
0709 13:16:25.332045 (+417407us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf6090 00007fc1d3d94f3a 00007fc1d9b4b1cc 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:41.008747 (+15676702us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:35.162128 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:35.229496 (+ 67368us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:35.229542 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:16:35.229572 (+    30us) tablet.cc:662] Decoding operations
0709 13:16:35.353925 (+124353us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:35.354018 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:35.354051 (+    33us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:16:35.356351 (+  2300us) tablet.cc:701] Row locks acquired
0709 13:16:35.356373 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:16:35.356518 (+   145us) write_op.cc:270] Start()
0709 13:16:35.356631 (+   113us) write_op.cc:276] Timestamp: P: 1783602995356473 usec, L: 0
0709 13:16:35.356650 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:35.540621 (+183971us) log.cc:844] Serialized 11309 byte log entry
0709 13:16:36.117002 (+576381us) op_driver.cc:464] REPLICATION: finished
0709 13:16:36.466094 (+349092us) write_op.cc:301] APPLY: starting
0709 13:16:36.473282 (+  7188us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:36.829401 (+356119us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:36.888443 (+ 59042us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:37.016563 (+128120us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:37.017125 (+   562us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=29
0709 13:16:37.017196 (+    71us) write_op.cc:312] APPLY: finished
0709 13:16:37.117743 (+100547us) log.cc:844] Serialized 193 byte log entry
0709 13:16:37.360859 (+243116us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:37.388230 (+ 27371us) write_op.cc:454] Released schema lock
0709 13:16:37.388312 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:37.388764 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:37.388795 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6988,"reported_tablets":48,"spinlock_wait_cycles":12676480,"child_traces":[["op",{"apply.queue_time_us":324899,"apply.run_cpu_time_us":39552,"apply.run_wall_time_us":927269,"num_ops":29,"prepare.queue_time_us":65657,"prepare.run_cpu_time_us":34974,"prepare.run_wall_time_us":606336,"raft.queue_time_us":240926,"raft.run_cpu_time_us":39417,"raft.run_wall_time_us":221201,"replication_time_us":760184,"thread_start_us":734223,"threads_started":5,"wal-append.queue_time_us":629206,"wal-append.run_cpu_time_us":14365,"wal-append.run_wall_time_us":2340004}]]}
I20260709 13:16:41.052778  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.054855  5445 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:41.055059  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:40.896807  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:41.056869  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 289125us
I20260709 13:16:41.057878  5448 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:41.060062  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:41.061329  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:41.064136  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:41.066442  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 159817us
I20260709 13:16:41.068820  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.073637  5450 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:41.074057  5443 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:41.074754  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:41.075042  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.075832  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a64a51af80064074aad9aefb8f176299"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:41.097069  5515 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:41.098461  8030 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:41.098884  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:41.102208  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49737.1us
I20260709 13:16:41.103472  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.103796  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.104627  5524 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:41.104628  8156 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:40.966734  8041 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.109728  8156 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:40.937063  7958 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:41.114061  8166 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:41.117141  8129 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.122151  8167 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:41.123328  8167 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:41.126369  8054 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:41.130812  8190 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.131556  8190 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:41.132058  8083 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:41.132459  5516 raft_consensus.cc:606] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:41.132869  8083 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.133273  8192 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:41.133599  8083 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:41.134047  8192 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:41.134406  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:41.135466  8184 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.136507  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.136871  7886 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.131590  8170 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.137656  8170 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.137826  8026 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.138218  8170 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.138809  8026 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.139814  8183 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:41.140654  8183 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:41.142258  8193 raft_consensus.cc:993] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:41.142812  7812 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:41.143239  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 74707.8us
I20260709 13:16:41.144335  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:41.145787  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:41.146030  8166 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:41.147706  8181 raft_consensus.cc:1081] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:41.148124  8166 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.149930  8181 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.150511  8181 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.150712  5523 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:41.150950  8181 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.151988  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.152659  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.153045  8198 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:41.153723  8198 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:41.154023  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.156229  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.153716  5373 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:41.131963  8162 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.159252  8162 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:41.158593  8134 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:41.132166  8190 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.101115  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.148018  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.130667  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:41.158547  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55040.7us
I20260709 13:16:41.157272  5372 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:41.159358  8198 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.159852  8162 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.179845  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.185859  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:41.186311  8209 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:41.187971  8209 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.188153  8202 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:41.188465  8209 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.189155  8209 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.188380  8183 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:41.192058  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.192688  5368 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:41.135644  8192 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.195888  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:41.196867  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.198056  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.199196  8107 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.198395  5522 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:41.199275  5373 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.204270  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:41.213783  5519 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:41.209074  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:41.202206  8107 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.202442  8202 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:41.160171  8167 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.226962  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.229748  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.231231  5516 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:41.232860  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.174119  8134 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.243341  8214 tablet_replica.cc:333] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:16:41.243126  8202 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.244953  8202 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.249778  8168 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:41.250646  8021 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:16:41.233899  8189 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.253000  8189 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.253496  8189 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.254906  5369 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:41.255177  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:41.223444  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.259302  7958 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:41.259531  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:41.260819  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51954.9us
I20260709 13:16:41.253683  8026 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.262584  8041 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:41.262336  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.263916  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.252403  8021 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:41.261068  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.225296  8107 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.287240  8026 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.268594  8021 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:41.293856  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.299858  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.291644  8026 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.310125  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.310660  5521 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:41.311389  5521 raft_consensus.cc:614] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:41.311980  7935 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.312583  7935 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:41.312994  7935 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.317591  8139 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:41.317946  8193 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.308764  8026 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.358140  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.365284  5366 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:41.367110  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.375737  5368 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:41.387058  8134 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.388310  8193 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:41.388877  8193 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.395005  8021 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:41.396346  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56271.2us
I20260709 13:16:41.396699  8021 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:41.397378  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:41.320111  8209 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.399434  5369 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:41.402863  5447 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:41.384814  8159 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:16:41.410691  8054 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:41.422215  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 160118us
I20260709 13:16:41.423329  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.424389  8054 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:41.410796  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.425189  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.430930  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.425009  8054 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.445824  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.416642  8107 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.467043  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:41.462496  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 229863us
W20260709 13:16:41.453680  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56478.5us
I20260709 13:16:41.468787  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.458683  8134 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.524304  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.534572  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07d1fef577c411787d1f686a4774389"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:41.537361  5375 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:41.504626  8134 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.546078  5374 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:41.554432  5489 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.554870  8193 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.556054  8196 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:41.556260  7958 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:41.556740  8196 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:41.556905  7958 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:41.560068  7935 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.575340  7935 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:41.575362  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.554905  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.588129  8107 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.590610  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.616567  5369 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:41.567307  8222 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:16:41.604846  8193 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:41.562075  7886 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.621574  8161 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.561993  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.615401  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.617153  5522 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
W20260709 13:16:41.542510  8218 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:16:41.580780  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.605592  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:41.571859  7958 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.643996  7886 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.644351  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.622238  8161 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.648332  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.653000  5371 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:41.654855  8161 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:41.589594  8209 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.655494  7886 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.562296  8184 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:41.657474  8184 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.646323  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.647708  8193 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.660175  8193 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:41.660673  8193 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.660835  8184 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.513190  8181 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:41.647878  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 93545.4us
I20260709 13:16:41.577170  8189 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.541237  8134 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:41.662871  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.667484  5369 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:41.681977  5368 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:41.683115  8189 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.683240  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:41.684468  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.686370  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:41.687184  5524 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:41.688535  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:41.590039  5414 leader_election.cc:336] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.591s (SENT)
I20260709 13:16:41.678203  5450 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:16:41.687292  8183 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.696426  5517 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:41.696631  8183 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:41.697219  8183 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.697247  5515 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:41.704499  5523 raft_consensus.cc:1813] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.707254  5523 raft_consensus.cc:2368] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:41.700325  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.709471  5373 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:41.543071  8170 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.596043  8190 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:41.716069  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.591955  8083 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.715387  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:41.715190  8161 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:41.727499  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 333711us
I20260709 13:16:41.730099  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:41.732378  8189 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:41.732996  8167 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:41.734274  8189 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:41.734952  8189 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:41.736138  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:41.738466  8167 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:41.738694  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:41.739266  8167 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:41.743036  5515 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:41.740625  8167 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.737493  8189 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.747992  8189 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.749907  5516 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:41.694701  8054 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.618112  8196 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.728731  8198 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:41.749948  8168 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:16:41.768314  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.763206  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:41.761956  8184 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.765272  5373 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:41.775884  5521 raft_consensus.cc:606] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:41.780864  5521 raft_consensus.cc:614] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:41.781525  5367 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:41.781903  5373 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:41.782490  8225 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:16:41.785514  8170 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.790827  8083 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:41.791846  8176 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:41.792850  5549 heartbeater.cc:646] Failed to heartbeat to 127.4.37.190:41135 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.37.190:41135 timed out after 15.000s (SENT)
I20260709 13:16:41.793190  8155 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:41.793644  8155 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:41.794919  8155 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:41.796656  8155 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:41.796985  8220 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.218s	user 0.005s	sys 0.000s
W20260709 13:16:41.798533  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68494.6us
I20260709 13:16:41.800891  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:41.776856  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 187060us
I20260709 13:16:41.772738  8208 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:41.802183  8231 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:41.802949  8181 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:41.805344  8202 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.007s
I20260709 13:16:41.805832  5375 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:41.771605  8162 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.009s
I20260709 13:16:41.807610  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:41.819011  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.775687  8198 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:41.824529  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66947us
I20260709 13:16:41.829586  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:41.830559  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.831306  8026 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:41.832403  5414 leader_election.cc:336] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.556s (SENT)
I20260709 13:16:41.832718  8184 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:41.823798  8162 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.809342  8208 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:41.844623  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.846172  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.837342  8198 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.849678  5369 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:41.839425  8184 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.843062  8181 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:41.843216  8208 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:41.863030  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 344728us
I20260709 13:16:41.880112  5367 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:41.897909  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:41.898636  5367 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:41.900017  5367 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:41.902796  8162 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:41.908171  8161 raft_consensus.cc:993] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:41.908077  8238 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:41.909062  8161 raft_consensus.cc:1081] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:41.909250  5519 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:41.909541  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.857312  8184 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.911054  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:41.874768  8181 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:41.888237  8227 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:16:41.889330  5339 leader_election.cc:400] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:41.892670  7886 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:41.912900  8181 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.913583  5339 leader_election.cc:403] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:41.893839  8165 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:41.915330  8165 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:41.915766  8165 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:41.896328  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:41.911116  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:41.908028  8054 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:41.920118  8170 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.925623  8159 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:41.926365  8159 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:41.929483  8159 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:41.916896  8165 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:41.936333  8165 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.939005  5519 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:41.885821  5371 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:41.960098  8190 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:41.973623  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 141293us
I20260709 13:16:41.974819  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:41.969337  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.015s	sys 0.011s
W20260709 13:16:41.979068  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.015s	sys 0.011s
I20260709 13:16:41.982975  5366 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:41.983701  5374 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:41.983094  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:41.861323  8134 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:41.988993  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92829.6us
I20260709 13:16:41.991367  5368 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:41.984822  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.588s (SENT) [suppressed 24 similar messages]
I20260709 13:16:41.999032  5372 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:41.988405  7886 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:42.007622  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.019958  5522 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:41.983412  8190 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:16:42.020515  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.031903  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.064670  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:42.065764  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 640663us
I20260709 13:16:42.035144  8026 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.070181  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:42.078542  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.087325  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 265693us
I20260709 13:16:42.087380  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:42.089257  8107 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:42.089530  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:42.089892  8107 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.090423  8107 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.090709  8166 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:42.087347  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.098707  5524 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: [4.3-7.4]
I20260709 13:16:42.040724  8193 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.066443  8190 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:16:42.104473  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 119686us
I20260709 13:16:42.091988  8235 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:42.107324  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.112540  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:42.115633  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:42.117879  5518 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:42.120193  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.129755  8134 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.131208  8198 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.132383  5373 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.133051  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:42.107800  7886 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.144755  7886 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.141847  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.142205  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.147961  8193 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:42.149163  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.149297  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.150069  5520 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:42.151151  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.143006  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.152076  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.152545  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.152807  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.153277  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.111088  8235 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:42.147711  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:42.167842  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.094213  8196 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:16:42.169868  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 152418us
W20260709 13:16:42.174988  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 69835.8us
I20260709 13:16:42.175657  5370 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.177317  5523 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.179664  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.180143  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:42.181078  5515 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:42.181591  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:42.172755  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 156481us
I20260709 13:16:42.147969  7886 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.184450  8162 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.191969  8162 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:42.192413  8162 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.134142  8183 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.197305  5517 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.199249  8193 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:42.199800  8193 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.199602  8238 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:42.200259  8193 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.202656  5521 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:42.202697  7935 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:42.203640  7935 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.204164  5521 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.168918  8134 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:42.213193  7812 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:42.213702  7812 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:42.214738  7812 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.217144  8107 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.220465  7812 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.224335  8190 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:42.225374  8190 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:42.225734  8190 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:42.189848  8235 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.227070  8235 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:42.227654  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.229139  5414 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.680s (SENT)
I20260709 13:16:42.232997  5519 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.234427  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.235177  5521 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:42.235463  8183 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:42.209616  8134 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:42.236231  8134 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.237635  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:42.240546  5523 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.240706  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:42.244168  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.247303  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:42.241513  5372 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:42.254971  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.226969  8190 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.237200  8208 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.266757  8165 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.228277  7935 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.270838  7935 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.271690  8184 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.288940  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.313158  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.363291  8184 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.364382  8198 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.364980  8170 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7.
I20260709 13:16:42.382509  5446 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:42.365140  5362 tablet_service.cc:1558] Processing DeleteTablet for tablet 23048b90f57d48a4be8be78bc78d9204 with delete_type TABLET_DATA_TOMBSTONED (TS 86b410d62f4040c39d33dc0698998562 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:44078
I20260709 13:16:42.383204  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.368063  5438 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b301483f19c4d508e00d917819ac039 with delete_type TABLET_DATA_TOMBSTONED (TS b781c7e31b7145aea647a7ff649e6ac7 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:58804
I20260709 13:16:42.384328  8190 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.369990  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.386982  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.370797  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:42.365811  8189 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.000s
I20260709 13:16:42.299566  8083 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.399758  8083 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:42.400871  8083 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.402362  8083 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:42.400079  8155 consensus_meta.cc:287] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.003s
I20260709 13:16:42.406365  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.265679  8183 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:16:42.245780  8176 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:16:42.409081  8176 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.409631  8176 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:42.375592  5516 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:42.381603  8165 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.381412  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.382088  8054 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:42.424904  8054 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.424221  8165 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.425297  8054 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.426719  8054 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.427887  8165 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.428648  8054 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.388887  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.429685  8176 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:42.433300  8176 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.439503  5490 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:42.369889  5273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 39) took 11692 ms (client timeout 15000 ms). Trace:
I20260709 13:16:42.440634  8238 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:42.441061  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:42.441180  8238 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.442297  8197 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:42.442339  8238 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:42.392475  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 163366us
I20260709 13:16:42.447854  8184 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:42.448897  8107 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.393122  5340 leader_election.cc:400] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6.
I20260709 13:16:42.392858  8231 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:42.448727  8184 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:42.450068  8231 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.450656  8231 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:42.451675  8231 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.452277  8162 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.452943  8231 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:42.454182  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 81281.1us
I20260709 13:16:42.454891  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:42.455639  6073 raft_consensus.cc:1813] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Handling vote request from an unknown peer b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:42.456321  6073 raft_consensus.cc:2410] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:16:42.396684  8208 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:42.257575  7886 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.392879  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.458547  7886 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.416649  8214 raft_consensus.cc:2243] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.266217  8255 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:42.461046  7886 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.424252  5515 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:16:42.383805  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.463099  8214 raft_consensus.cc:2272] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.463642  8198 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.455027  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:42.464310  8198 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.417059  8237 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.465653  8170 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.465695  8237 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.467895  8237 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.479362  5520 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.469692  8184 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:42.469907  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.467695  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.482465  8237 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.485383  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.487075  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:42.487937  5414 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.732s (SENT)
I20260709 13:16:42.488811  8167 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.471174  5518 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.265118  7958 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.493647  5375 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:42.474001  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.474001  8189 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:42.474864  8170 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:42.475816  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:42.481369  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.489042  5414 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.780s (SENT)
I20260709 13:16:42.505174  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:42.460716  8255 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.470886  5523 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:42.443631  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:42.489710  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 249457us
I20260709 13:16:42.491428  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.503235  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:42.510780  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67225.7us
I20260709 13:16:42.485229  8214 ts_tablet_manager.cc:1916] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:42.467805  8198 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.522195  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:42.440630  5273 rpcz_store.cc:269] 0709 13:16:30.677461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.677794 (+   333us) service_pool.cc:224] Handling call
0709 13:16:42.369550 (+11691756us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:40.917694 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:40.929077 (+ 11383us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:40.929124 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:16:40.929142 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:40.930005 (+   863us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:40.930067 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:40.930099 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:16:40.930869 (+   770us) tablet.cc:701] Row locks acquired
0709 13:16:40.930905 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:16:40.931079 (+   174us) write_op.cc:270] Start()
0709 13:16:40.931193 (+   114us) write_op.cc:276] Timestamp: P: 1783603000931024 usec, L: 0
0709 13:16:40.931212 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:40.931980 (+   768us) log.cc:844] Serialized 2433 byte log entry
0709 13:16:41.481208 (+549228us) op_driver.cc:464] REPLICATION: finished
0709 13:16:42.061770 (+580562us) write_op.cc:301] APPLY: starting
0709 13:16:42.072702 (+ 10932us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:42.123899 (+ 51197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:42.124063 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:42.125150 (+  1087us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:42.125473 (+   323us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:16:42.125531 (+    58us) write_op.cc:312] APPLY: finished
0709 13:16:42.126001 (+   470us) log.cc:844] Serialized 52 byte log entry
0709 13:16:42.126277 (+   276us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:42.126448 (+   171us) write_op.cc:454] Released schema lock
0709 13:16:42.126518 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:42.128457 (+  1939us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:42.128685 (+   228us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1754313,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":516619,"apply.run_cpu_time_us":3989,"apply.run_wall_time_us":66746,"num_ops":6,"prepare.queue_time_us":220622,"prepare.run_cpu_time_us":15049,"prepare.run_wall_time_us":64174,"raft.queue_time_us":338231,"raft.run_cpu_time_us":17414,"raft.run_wall_time_us":521553,"replication_time_us":444661,"thread_start_us":890030,"threads_started":4,"wal-append.queue_time_us":49125}]]}
I20260709 13:16:42.528491  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:42.534854  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.535722  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:42.540851  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.537086  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.550571  5366 raft_consensus.cc:1813] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Handling vote request from an unknown peer b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:42.551887  5366 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:42.535137  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:42.553890  5370 raft_consensus.cc:2410] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:42.554127  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.555682  5373 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:42.553498  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.558771  8255 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:42.561658  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 74781.2us
I20260709 13:16:42.564478  5517 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:42.566339  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.567143  5523 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:42.569897  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.570601  8235 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:42.570814  5518 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:42.571076  8235 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:42.571874  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.572113  8235 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.573037  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.577220  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.577620  8107 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.562706  8208 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:16:42.573791  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.578042  8107 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:42.578387  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.579138  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.579059  8107 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:42.577248  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 88249.4us
I20260709 13:16:42.580502  8107 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.576424  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.581650  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.575605  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.582733  5524 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:42.580436  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.579473  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:42.583488  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.578052  5515 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:42.584802  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.497210  8193 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.522934  7935 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:42.587416  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:42.587565  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.528908  7812 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:42.581496  5414 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.912s (SENT)
I20260709 13:16:42.509299  8134 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.592351  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:42.523131  8165 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:42.593684  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.586371  8197 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.594628  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.596750  5521 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:42.600937  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.597965  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.602941  8170 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:42.603590  8259 tablet_replica.cc:333] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:16:42.602957  5272 catalog_manager.cc:5697] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 7, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } }
I20260709 13:16:42.604161  8170 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.536357  7886 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:16:42.582878  8235 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.606493  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.587849  7935 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.611898  5370 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:42.609174  5416 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:42.593461  8249 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:42.611083  5272 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 5 to 9, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 9 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.624778  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.601730  8165 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.608247  8170 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:42.589668  8183 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:42.634541  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:42.631366  5414 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.639s (SENT)
I20260709 13:16:42.618132  7935 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.624091  8196 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.595938  8252 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:42.633598  8249 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.634330  8193 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:42.654974  8183 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:42.654850  8197 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.657331  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.631806  8165 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:42.650230  8261 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:16:42.643733  8162 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:42.653779  5272 catalog_manager.cc:5697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:16:42.662743  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 71881.2us
I20260709 13:16:42.673563  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:42.674680  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.660770  8183 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.671849  5272 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:16:42.680825  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.656214  8238 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:16:42.675098  5518 raft_consensus.cc:2376] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2. Re-sending same reply.
W20260709 13:16:42.684206  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52885.6us
I20260709 13:16:42.686100  7886 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.688259  8167 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:42.690080  8162 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:16:42.702097  5524 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:42.667268  8155 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:42.677520  8196 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.706046  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:42.707883  5414 leader_election.cc:336] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.642s (SENT)
I20260709 13:16:42.728905  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:42.730366  8238 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:42.731029  8238 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:42.732084  5414 leader_election.cc:336] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.786s (SENT)
I20260709 13:16:42.733629  8184 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.734014  8249 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.735280  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.736754  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.737157  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.732620  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:42.737762  5522 raft_consensus.cc:2376] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7. Re-sending same reply.
I20260709 13:16:42.714594  8134 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.714804  7958 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.675074  8170 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:42.717111  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.717231  8181 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:42.691277  5272 catalog_manager.cc:5697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 3 to 7, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 7 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:42.719759  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:42.749938  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.723510  8155 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:42.737852  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.738619  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:42.752801  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 143791us
W20260709 13:16:42.738852  5414 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.925s (SENT)
I20260709 13:16:42.737778  8255 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.740135  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:42.753557  5520 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:42.709893  8183 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.742254  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.741470  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.759229  5516 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:42.759968  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66224.3us
I20260709 13:16:42.727867  7886 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.740911  5518 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:42.754921  8255 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:42.757175  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.743541  8249 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.750057  8181 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.702445  8262 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:16:42.765600  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:42.783458  7886 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:42.783794  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.784324  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.786558  8237 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:42.786729  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.785516  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.787139  8237 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.772728  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.774168  8198 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.767975  8269 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:42.775362  8271 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:42.774556  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.769891  8235 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:42.753124  8202 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:42.823305  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.767112  5272 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:42.778618  5446 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:42.825016  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.791462  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.753077  8155 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:42.781590  7935 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.782104  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:42.848384  5366 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
W20260709 13:16:42.848559  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 109754us
I20260709 13:16:42.848817  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:16:42.849916  5414 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.045s (SENT)
I20260709 13:16:42.850371  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:42.850742  8183 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.852690  5521 raft_consensus.cc:2368] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:42.797355  5374 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:42.854138  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.850379  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:42.807751  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.809047  5445 raft_consensus.cc:2368] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:42.856642  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.791050  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.860481  5374 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.862154  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.861969  8155 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:42.863515  8155 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.866207  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.820454  5450 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:42.822821  8237 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.867175  5443 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:42.869336  8238 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.870672  8238 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.868363  5368 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:42.785550  5518 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:42.797540  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.830255  8202 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.831508  5272 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:42.832710  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.833295  8235 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.834214  5519 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:42.834873  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.835640  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.809119  8198 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:42.835000  5372 raft_consensus.cc:2376] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10. Re-sending same reply.
I20260709 13:16:42.836436  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:42.836583  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.837167  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:42.783358  8262 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:42.837942  8269 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.838272  8255 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.838976  8196 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.839613  5367 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.840206  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.840588  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.841765  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:42.768874  8170 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.844257  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:42.971801  5441 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.885170  7958 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.907778  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.975242  5450 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:42.951071  5520 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:42.852054  7935 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:42.955569  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.958173  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:42.952759  8262 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:42.883745  8165 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.854254  8107 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:42.973928  5366 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:42.976159  5448 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:42.951148  5272 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 3 to 7, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 7 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.783319  8181 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.980690  5449 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:42.995337  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:42.950392  5446 raft_consensus.cc:1813] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Handling vote request from an unknown peer 86b410d62f4040c39d33dc0698998562
I20260709 13:16:42.986891  5369 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:42.979151  5368 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:43.004091  5446 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:16:42.992084  5366 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.972173  8249 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:42.989024  8231 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.003s
I20260709 13:16:43.002604  5444 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:43.002908  8275 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:16:42.981212  8259 raft_consensus.cc:2243] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:43.006794  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 156909us
I20260709 13:16:43.014511  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.017401  5450 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.018355  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:43.014899  5272 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 6, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.014070  7935 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:16:43.025852  8208 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:43.026595  8208 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:43.017246  8269 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.027364  8197 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:43.027630  8208 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.028591  8270 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:43.029014  8270 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:43.029618  8162 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:43.030026  8270 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:42.995698  7958 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:43.031068  5414 leader_election.cc:336] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.073s (SENT)
I20260709 13:16:43.031520  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:43.031738  8270 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.035985  8181 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.036630  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.035748  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.037483  5448 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.038184  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.039301  5371 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:43.040843  8259 pending_rounds.cc:70] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Trying to abort 1 pending ops.
W20260709 13:16:43.041469  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.042093  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.990965  8198 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.045460  8202 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.046525  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.033339  7958 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.045177  8198 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.055279  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:43.056483  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.041141  8259 pending_rounds.cc:77] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Aborting op as it isn't in flight: id { term: 7 index: 6 } timestamp: 7305637806718017536 op_type: NO_OP noop_request { }
W20260709 13:16:43.061483  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.995272  6073 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:43.059877  5272 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.090186  5448 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
W20260709 13:16:43.097654  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.098269  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.098798  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.099865  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:43.100639  5370 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.101661  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:43.099169  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 72124us
I20260709 13:16:43.102973  5450 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:43.103324  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:43.094321  5449 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:43.104950  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:43.035858  8273 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.086910  8259 raft_consensus.cc:2889] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:43.004467  8107 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.111140  5272 catalog_manager.cc:5697] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.114929  5448 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:43.113451  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.116046  5450 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:16:43.117115  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.110229  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.133363  5446 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:43.126437  5272 catalog_manager.cc:5697] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 2 to 6, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 6 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:43.121670  5414 leader_election.cc:336] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.136s (SENT)
I20260709 13:16:43.139358  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:43.111445  8197 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:43.128721  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:43.147655  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.161158  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.171933  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.174906  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:43.115523  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:43.121924  8259 raft_consensus.cc:2272] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.175849  5373 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:43.178689  5448 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:43.186403  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.193672  5442 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:43.195485  5442 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:16:43.198076  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 76454us
W20260709 13:16:43.200404  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.201912  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:43.197257  5442 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.186810  5450 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.128381  8083 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.209352  5272 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.211058  5272 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 7, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:16:43.181464  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.217752  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.179333  8269 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:43.187278  8202 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:43.189062  8273 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.226555  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.189345  8197 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:43.227826  5414 leader_election.cc:336] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.931s (SENT)
I20260709 13:16:43.235437  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:43.186717  8176 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.234154  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.235579  5272 catalog_manager.cc:5697] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:16:43.228755  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 123863us
I20260709 13:16:43.244087  5449 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:43.245863  5369 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:43.239562  5442 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:43.248847  5368 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:43.249279  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.114465  8262 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.178025  8283 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:16:43.275079  5450 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:43.275710  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.280098  5272 catalog_manager.cc:5697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.238713  8134 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:43.241889  8269 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:43.279763  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:43.246241  8176 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:43.293820  8197 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.295936  8176 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.298290  5442 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:43.299088  8269 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.299530  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.246076  8202 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:43.225311  8083 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.301832  5372 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:16:43.302721  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.308027  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.308668  5448 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.307565  5272 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:16:43.331664  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.339596  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.340543  5515 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:16:43.303727  8262 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.354224  5441 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:43.356297  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.358278  5446 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:43.356418  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.357731  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:43.311098  8165 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.363101  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.364780  5450 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.351536  5272 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.366254  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.311378  8183 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:43.301086  8134 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.392446  5441 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:43.393764  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.394512  5449 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
W20260709 13:16:43.379462  8238 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.000s
I20260709 13:16:43.377089  8139 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:43.398908  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.374698  8183 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:43.403785  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.406543  5441 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:43.407300  5449 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:43.407562  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.407823  8235 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.408136  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.408931  5449 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:43.410476  5449 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:43.412213  8255 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:43.414011  8291 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:16:43.414594  8282 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:16:43.408205  5441 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:43.393764  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.403728  5272 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 5 to 6, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 6 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.416788  5446 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.414001  5449 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.419559  5370 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:43.420684  5272 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.425217  8183 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.427301  5272 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.428282  5272 catalog_manager.cc:5697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.402069  8139 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:43.434141  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.435564  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47800.8us
W20260709 13:16:43.439633  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.440341  5441 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.438720  5272 catalog_manager.cc:5697] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 2 to 3, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 3 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.455281  5272 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.421891  8202 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:43.464068  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.465408  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.467116  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.469704  5449 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.470356  8083 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.471180  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:43.472162  5375 raft_consensus.cc:2410] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:43.468382  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:43.473512  5367 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.438515  8139 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.478981  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.479674  5371 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:43.468092  8293 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:43.468317  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.479699  5445 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.489645  5450 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:43.489235  5369 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.490607  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.491161  5450 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:43.493485  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.496186  5448 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:43.494199  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:43.494933  5272 catalog_manager.cc:5697] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:43.498926  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:43.499631  5375 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:16:43.508421  5445 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:43.499056  5272 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 5 to 8, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 8 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.513942  5272 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:16:43.514768  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.514715  5447 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.516623  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:43.517928  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.520578  5367 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:43.527629  5446 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:43.529675  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.511824  8214 ts_tablet_manager.cc:1929] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:43.536120  8249 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:43.537997  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.545586  8259 ts_tablet_manager.cc:1916] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:43.562932  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.551954  5450 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:43.564505  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.495900  8183 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.564993  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.566479  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.567757  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.568403  5450 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:43.554913  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.560274  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.580698  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.582530  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:43.586724  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.587742  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:43.577378  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.515813  8165 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.599444  5446 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:43.604046  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.604422  5445 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:43.605266  5447 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:43.585717  5489 connection.cc:256] RPC call timeout handler was delayed by -2.2488321030000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260709 13:16:43.606957  5489 connection.cc:256] RPC call timeout handler was delayed by -2.1876321029999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
W20260709 13:16:43.607333  5489 connection.cc:256] RPC call timeout handler was delayed by -1.5171321029999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2926s for a response
I20260709 13:16:43.610293  5449 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:43.611990  5448 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.562752  8249 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:43.617156  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.616896  5450 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
W20260709 13:16:43.621173  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.621793  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.603353  8214 log.cc:1199] T fd246431fed24a99b47e2ccdf988b1ff P 86b410d62f4040c39d33dc0698998562: Deleting WAL directory at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-0-root/wals/fd246431fed24a99b47e2ccdf988b1ff
W20260709 13:16:43.628582  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 130319us
I20260709 13:16:43.629281  5445 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.614812  5448 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:43.631757  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 98049us
I20260709 13:16:43.636319  5447 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.614775  5446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a548ed234e342789833cf138d282543"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:16:43.638648  5446 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.639063  5446 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:43.639582  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.618563  5450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:16:43.627334  8249 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.644215  5450 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.644805  5450 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.645066  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:43.653972  5450 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.654563  5489 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:43.658337  8214 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44078 (request call id 72) took 2649 ms. Trace:
I20260709 13:16:43.661063  5445 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:43.667264  5446 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:43.676734  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.693408  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.700322  5441 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:43.698814  5446 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:43.707823  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 53334.4us
I20260709 13:16:43.716380  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.717875  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.718731  5523 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:43.725133  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:43.695814  8155 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.832s	user 0.013s	sys 0.003s
I20260709 13:16:43.732112  5450 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.735464  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:43.736199  5441 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.695477  8271 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:43.700487  8262 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:43.744386  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.748965  5450 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:16:43.752758  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 524923us
I20260709 13:16:43.753552  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.756556  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.758493  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.759469  6073 raft_consensus.cc:2410] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:43.759606  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.760771  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.763253  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.765885  5520 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:43.742810  8295 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:43.767103  8295 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.767468  8295 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.770967  7935 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:43.771678  7935 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:43.749632  5450 pending_rounds.cc:85] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 2
I20260709 13:16:43.773874  5523 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:43.768848  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:43.776098  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:43.765044  5442 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:43.780246  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:43.774003  5450 pending_rounds.cc:107] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:43.782023  5450 raft_consensus.cc:2889] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:43.746611  8054 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:43.789168  5445 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:43.792164  5414 leader_election.cc:336] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.027s (SENT)
I20260709 13:16:43.793627  8170 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.796725  8249 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.745389  8262 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:43.800139  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:43.786501  8054 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:43.778342  8271 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:43.808120  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:43.798031  8165 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.802979  8262 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.805238  8298 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:16:43.811566  8304 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.827339  5441 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:43.828862  5521 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:43.805294  7958 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 13:16:43.831811  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48846.3us
I20260709 13:16:43.832016  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:43.841809  8286 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.534s	user 0.004s	sys 0.000s
I20260709 13:16:43.847674  8249 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.819247  8235 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:43.817804  8165 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.857638  5444 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:43.851078  5340 leader_election.cc:400] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:43.834261  8054 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.859400  5340 leader_election.cc:403] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:43.853137  8287 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.505s	user 0.000s	sys 0.002s
I20260709 13:16:43.829299  8298 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:43.806404  7935 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.864315  8165 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.867935  8235 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5.
I20260709 13:16:43.691314  8214 rpcz_store.cc:276] 0709 13:16:41.009508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.022861 (+ 13353us) service_pool.cc:224] Handling call
0709 13:16:41.242407 (+219546us) ts_tablet_manager.cc:1151] Deleting tablet fd246431fed24a99b47e2ccdf988b1ff
0709 13:16:41.242548 (+   141us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:42.462276 (+1219728us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54001216d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d94362 00007fc1d777f34c 00007fc1d8da260a 00007fc1d8dd32d0 00007fc1d8db983d 00007fc1d8db97e9 00007fc1d8db9779 00007fc1d8db9741 00007fc1d8db896d 000000000038f354
0709 13:16:42.884173 (+421897us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:43.511514 (+627341us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:43.658227 (+146713us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1153058,"spinlock_wait_cycles":42316032,"tablet-delete.queue_time_us":193007,"thread_start_us":138538,"threads_started":1}
I20260709 13:16:43.869499  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:43.870497  5260 catalog_manager.cc:5028] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): tablet fd246431fed24a99b47e2ccdf988b1ff (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:16:43.870437  8271 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.872658  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:43.873566  8235 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:43.873857  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.874123  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:43.874894  8162 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.875598  8162 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.862476  8298 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:43.878356  8298 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:43.874869  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:43.869735  8214 tablet_replica.cc:333] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
W20260709 13:16:43.886260  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.887760  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:43.860564  8197 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:43.942175  8197 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:43.942997  8197 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.895269  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:43.850553  8139 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:43.957712  8139 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.894060  8290 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:43.898694  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:43.884924  8235 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:43.961148  8235 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:43.961740  8235 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.961809  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:43.962591  5521 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.900373  8107 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:43.904239  7958 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:43.964244  7958 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:43.964708  7958 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.905371  8134 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:43.916497  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.973312  5375 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.973649  5372 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.975421  5374 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.977131  5369 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:43.981017  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:43.981685  5366 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.982429  5369 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:43.885353  8054 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.928438  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1669) took 1138 ms. Trace:
W20260709 13:16:43.929996  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.921691  7935 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.930589  8170 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:43.940446  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.997694  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.896500  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:43.994405  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:44.002435  5370 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:43.896589  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:43.985303  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:44.012089  5374 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.986265  5375 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:16:43.986791  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 152243us
I20260709 13:16:43.987062  5373 rpcz_store.cc:276] 0709 13:16:42.790122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.790248 (+   126us) service_pool.cc:224] Handling call
0709 13:16:43.928132 (+1137884us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54000fa0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:43.928309 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534609152}
I20260709 13:16:43.988445  5521 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:16:44.013446  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:43.989723  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 94571.7us
W20260709 13:16:44.010697  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.988884  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:44.014070  5375 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.014567  5369 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:44.015626  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:44.018203  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:44.019129  5370 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 5.
I20260709 13:16:44.020566  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:44.024555  5371 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:44.026096  8214 raft_consensus.cc:2243] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:44.026690  8184 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:44.027087  8184 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.027405  8184 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.029930  8238 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:44.030997  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.022648  5414 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.082s (SENT)
I20260709 13:16:44.035061  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.040153  5366 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:44.040985  8271 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.042971  8214 raft_consensus.cc:2272] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:44.024504  8298 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:44.044286  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 147886us
I20260709 13:16:44.059749  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:44.045111  5374 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:44.049723  7812 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.033810  8139 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:44.000341  8290 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:44.056027  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:44.065358  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:44.063011  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 166530us
I20260709 13:16:44.066612  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:44.063668  5414 leader_election.cc:336] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.094s (SENT)
I20260709 13:16:44.070448  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:44.071691  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.069186  5375 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
W20260709 13:16:44.077706  5414 leader_election.cc:336] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.139s (SENT)
I20260709 13:16:44.078261  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:44.079754  5414 leader_election.cc:336] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.156s (SENT)
I20260709 13:16:44.080168  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.081604  8271 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.082435  8273 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.081105  8165 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.083793  8165 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:44.084340  8165 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:44.085556  8289 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.069895  8083 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.086534  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:44.087642  5414 leader_election.cc:336] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.236s (SENT)
I20260709 13:16:44.087874  8139 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:44.088248  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.089243  8273 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.089458  8139 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:44.090781  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.098624  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.091017  8196 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:44.096751  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:44.062091  8170 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.110109  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:44.062501  8294 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:16:44.102001  8083 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:44.099640  8107 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.105609  8183 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:44.107725  8196 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:44.107421  8170 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.123538  8193 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.125881  8083 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:44.131187  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:44.133133  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.133550  8202 raft_consensus.cc:2764] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:16:44.146797  8162 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.148154  8197 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.150274  8196 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.154016  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:44.163343  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:44.113025  8290 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:44.152457  8238 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:44.152339  8083 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.157923  8134 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.155239  8107 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.129637  8273 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:16:44.161175  8214 ts_tablet_manager.cc:1916] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:44.136160  8269 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:44.194721  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.189652  8270 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.190716  8107 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:44.191486  8273 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.162186  8183 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:44.181994  8134 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.138010  7812 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:16:44.135569  7958 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:44.198966  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76078.4us
I20260709 13:16:44.169991  8238 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:44.213479  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.205966  8294 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:16:44.217460  8238 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.218043  8183 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.218840  8238 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.222608  8197 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:44.223012  8134 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.200882  8273 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:44.223431  8303 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.224606  8303 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.224287  8273 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.225015  8303 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:44.200803  8202 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.223130  5368 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:44.188349  8295 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.200647  8107 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:44.238386  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.237219  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:44.238315  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73499.6us
I20260709 13:16:44.210001  8269 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.242233  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:44.243027  8270 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.244767  8249 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.222834  7958 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.246699  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:44.250762  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:44.237478  8273 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.241003  8107 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.244767  8197 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:44.292517  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.281286  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.265550  8270 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.250113  8269 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.291949  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:44.222704  8262 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:44.272616  8255 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:44.301039  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:44.302791  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.262034  8134 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:16:44.310660  8259 ts_tablet_manager.cc:1929] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:16:44.310949  8262 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:44.311493  8259 log.cc:1199] T 7b301483f19c4d508e00d917819ac039 P b781c7e31b7145aea647a7ff649e6ac7: Deleting WAL directory at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-1-root/wals/7b301483f19c4d508e00d917819ac039
I20260709 13:16:44.314254  5518 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:44.315858  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56123.7us
I20260709 13:16:44.318362  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:44.323459  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 160221us
I20260709 13:16:44.324465  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:44.304049  8298 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.241631  8303 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.307359  8197 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:44.313512  7812 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.327392  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:44.316732  8285 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:44.315963  8255 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:44.346357  8285 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:44.346669  8255 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.347549  8285 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.319947  8134 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:44.344125  8083 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:44.349560  8134 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:44.350129  8083 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:44.351236  8083 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.350900  8134 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.277391  8290 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.357961  8165 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:44.359164  8184 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.360893  7886 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.361460  7886 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:44.362474  7886 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.363628  8289 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.366243  8197 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.369206  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:44.370404  6073 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:44.334367  8324 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:44.343068  8262 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:44.341215  8162 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:44.338054  8193 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:44.361203  8257 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:44.379688  8257 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:44.381201  8259 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:58804 (request call id 62) took 2013 ms. Trace:
I20260709 13:16:44.382862  8257 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.387346  8269 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:44.330411  8319 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.398361  8303 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.398509  8295 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.333352  8322 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:16:44.340477  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:44.364863  8289 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.385164  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:44.404845  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65354.3us
W20260709 13:16:44.409988  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 69616.7us
W20260709 13:16:44.340932  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 173337us
I20260709 13:16:44.322800  8249 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:44.345343  8298 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.411599  5415 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.413030  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:44.416327  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 121618us
I20260709 13:16:44.423878  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:44.436477  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 111520us
I20260709 13:16:44.436681  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:44.338699  8170 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.445994  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.363890  7886 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.439021  7958 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.449587  7958 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.450024  7958 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:44.450392  7958 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.427448  8322 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.449574  8298 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:44.452463  8298 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:44.453529  8298 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.455350  8270 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.455986  8270 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:44.462630  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 51145.7us
I20260709 13:16:44.450322  8202 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:44.465510  5443 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.467654  5450 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:44.467945  5446 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:44.468616  5449 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:44.468930  5448 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:44.472852  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.475478  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.476610  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:44.458236  8162 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:44.478451  8249 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.480216  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:44.481200  5442 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.419776  8189 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:44.488108  8327 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.457993  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:44.493243  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:44.479692  8235 consensus_meta.cc:287] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.004s
I20260709 13:16:44.472677  8298 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.501092  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.503046  5441 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:44.503420  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:44.500216  8321 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.497097  8249 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:44.499218  8162 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:44.469913  8202 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:44.504563  5521 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:44.505446  8235 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:44.479620  8325 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.485299  8271 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.512460  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.496773  8170 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:44.526676  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:44.509291  7935 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.003s
I20260709 13:16:44.536194  5515 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:44.536499  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:44.537184  5523 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.537447  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:44.530965  5414 leader_election.cc:400] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:44.531134  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:44.539494  5414 leader_election.cc:403] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:44.531466  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:44.532194  8238 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.518882  8249 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.533329  8295 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:44.533890  8054 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.009s
I20260709 13:16:44.533825  8107 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.513221  8202 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.497077  8189 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.504117  8304 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.528369  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:44.587338  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59072.7us
I20260709 13:16:44.587685  8189 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.588436  8189 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:44.536146  8270 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:44.589006  8319 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.589892  8319 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.598152  8214 ts_tablet_manager.cc:1929] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:16:44.606483  8214 log.cc:1199] T 23048b90f57d48a4be8be78bc78d9204 P 86b410d62f4040c39d33dc0698998562: Deleting WAL directory at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0/minicluster-data/ts-0-root/wals/23048b90f57d48a4be8be78bc78d9204
I20260709 13:16:44.509663  8321 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:44.546247  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.517108  8184 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.550604  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.507948  6073 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.526552  8196 raft_consensus.cc:2764] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:44.553689  8331 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:44.554428  8295 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:44.556588  8249 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.547420  8238 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.562413  8162 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.686802  8214 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44078 (request call id 73) took 2322 ms. Trace:
I20260709 13:16:44.564311  8289 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:44.566613  8235 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:44.689370  8295 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.382340  8259 rpcz_store.cc:276] 0709 13:16:42.367459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.367750 (+   291us) service_pool.cc:224] Handling call
0709 13:16:42.603030 (+235280us) ts_tablet_manager.cc:1151] Deleting tablet 7b301483f19c4d508e00d917819ac039
0709 13:16:42.603105 (+    75us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:43.040519 (+437414us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54002ad5d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d94362 00007fc1d777f34c 00007fc1d8da260a 00007fc1d8dd32d0 00007fc1d8db983d 00007fc1d8db97e9 00007fc1d8db9779 00007fc1d8db9741 00007fc1d8db896d 000000000038f354
0709 13:16:43.916481 (+875962us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:44.310493 (+394012us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:44.380911 (+ 70418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":515047,"spinlock_wait_cycles":282225024,"tablet-delete.queue_time_us":218631,"thread_start_us":135877,"threads_started":1}
I20260709 13:16:44.535805  8170 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:44.577699  8271 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:44.527607  8325 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.579337  8197 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.599094  8139 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.599774  8107 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.538228  5520 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:44.593075  8319 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.513047  7812 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.588454  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:44.712320  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 123982us
I20260709 13:16:44.621205  5443 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:44.627107  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 210165us
I20260709 13:16:44.628355  5442 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:44.668176  5523 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
W20260709 13:16:44.670644  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 120107us
I20260709 13:16:44.589071  8189 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:44.644682  8257 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.670276  8321 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.611086  7958 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.700076  8170 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.700642  8249 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:44.687471  8214 rpcz_store.cc:276] 0709 13:16:42.364753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.364949 (+   196us) service_pool.cc:224] Handling call
0709 13:16:43.869315 (+1504366us) ts_tablet_manager.cc:1151] Deleting tablet 23048b90f57d48a4be8be78bc78d9204
0709 13:16:43.869383 (+    68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:44.391716 (+522333us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:44.597983 (+206267us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:44.686722 (+ 88739us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127032,"tablet-delete.queue_time_us":1485746}
I20260709 13:16:44.672605  8255 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.716943  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.718788  8270 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.762909  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.726922  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:44.728863  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:44.765543  5521 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:44.685768  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.766289  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:44.766481  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:44.760401  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:44.766908  5449 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.729568  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:44.769781  5260 catalog_manager.cc:5028] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): tablet 23048b90f57d48a4be8be78bc78d9204 (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:16:44.764442  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.772627  5448 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:44.772910  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:44.773983  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:44.774793  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.775542  5447 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:44.776432  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:44.776666  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.794147  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.794391  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.796976  5441 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:16:44.797856  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 80987.1us
I20260709 13:16:44.869550  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.822206  8269 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.704962  8271 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.762593  8107 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.805047  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 109627us
I20260709 13:16:44.807967  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:44.808799  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:44.880023  5515 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.734330  8196 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:44.748018  8054 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.885883  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 135342us
I20260709 13:16:44.815217  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:44.763903  8249 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.819772  5259 catalog_manager.cc:5028] TS b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): tablet 7b301483f19c4d508e00d917819ac039 (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:16:44.709296  8139 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:44.709601  8197 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.800953  8183 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.747673  8339 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
I20260709 13:16:44.737949  8257 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:44.803061  8303 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.821792  8324 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.732957  8235 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:44.740217  8134 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.874572  5449 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:44.875684  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.912437  5441 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:44.816182  8083 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:16:44.872604  8273 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.003s
I20260709 13:16:44.888511  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.888994  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:44.889180  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:44.895203  5448 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:44.898098  7958 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.868507  8202 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.922346  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.891472  7812 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.890664  8165 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:44.882220  8269 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.891602  8054 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.915006  5515 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:44.909965  8333 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:44.919598  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:44.885808  8290 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:16:44.924458  5447 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
W20260709 13:16:44.896143  5259 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 126444us
I20260709 13:16:44.887773  8107 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.901382  8197 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:44.933367  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.876159  8189 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.888826  8196 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.939249  5520 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.904573  8332 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:16:44.906510  8183 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:44.928793  8238 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:44.931655  8303 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.954608  8139 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.956001  5448 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.944929  7958 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:44.947263  8343 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:16:44.947779  8338 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260709 13:16:44.948431  8341 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:44.931978  8083 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.932865  8273 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.950413  8320 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:16:44.952308  8346 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:16:44.988770  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:44.989648  5521 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:16:44.959357  8183 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:44.959889  8342 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:16:44.948942  8351 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:44.961486  8345 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:44.918931  8134 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:44.936468  8336 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:16:44.964079  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:44.966987  8054 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:44.968914  8271 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:44.971637  8269 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:44.974375  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.923805  8328 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.174s
I20260709 13:16:44.943831  7812 raft_consensus.cc:2764] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:44.964248  8327 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.994783  5515 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:44.995937  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:44.999500  5523 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:44.975543  7958 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.014277  5448 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:45.022189  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
W20260709 13:16:45.033677  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 317388us
I20260709 13:16:45.035833  5521 raft_consensus.cc:606] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.039800  5521 raft_consensus.cc:614] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:45.037688  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 73741us
W20260709 13:16:45.035490  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 93453.4us
I20260709 13:16:45.023314  8351 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:45.044683  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.048503  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:45.048678  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.049338  5367 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.050768  5368 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:45.054055  5371 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.054152  5370 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:44.993795  8083 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.055451  5374 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:45.046432  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:45.048841  8285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.019s
W20260709 13:16:45.057600  8285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.008s	sys 0.019s
I20260709 13:16:45.060627  5366 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:45.037632  8273 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.040489  7958 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.062954  8337 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:45.026875  8321 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.067363  5367 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:45.078822  5368 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:45.077337  5370 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:45.077355  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.079767  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.063417  8257 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:45.084034  5375 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:45.083842  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:45.087417  8351 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.088891  8351 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.076149  7812 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.063712  8350 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:16:45.084697  8249 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.099474  8196 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.100287  5374 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:45.064209  8139 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:45.101539  8321 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.101786  8327 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:45.103575  8202 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.104878  8337 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:45.105357  8134 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.105957  8337 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.107331  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:45.107940  5518 raft_consensus.cc:606] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.108269  5518 raft_consensus.cc:614] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:45.113859  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 224845us
I20260709 13:16:45.146317  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:45.147495  5520 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
W20260709 13:16:45.143813  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.101627  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.144250  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:45.053553  6073 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
W20260709 13:16:45.151242  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49692.7us
I20260709 13:16:45.154331  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.082051  8235 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:45.101627  8139 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.155373  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:45.157606  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.158178  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:45.160326  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.165840  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.167707  8107 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.169775  8361 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.171053  8360 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.171633  8360 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.173883  8235 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.160176  8139 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.108721  8170 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.179927  8170 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.150940  8249 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.182463  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:45.167115  8196 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.183151  5521 raft_consensus.cc:606] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.183236  8196 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:45.183622  5521 raft_consensus.cc:614] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:45.183830  8196 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.186203  8365 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:45.162367  8183 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:45.186959  8365 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.187063  8183 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.187587  8183 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.188040  8365 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.190860  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:45.191843  5521 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.192238  5521 raft_consensus.cc:614] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:45.194113  8270 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.194550  8270 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.195516  8270 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.196457  8270 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.166914  8353 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:45.201713  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:45.202514  5521 raft_consensus.cc:606] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.203851  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:45.212495  8355 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:45.212999  8355 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:45.213788  8360 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.214665  8355 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:45.216149  8355 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.217804  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.218500  5446 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
W20260709 13:16:45.221575  8356 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:16:45.221814  8083 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:45.225584  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 71337.3us
I20260709 13:16:45.226455  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.227720  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:45.227945  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66816.1us
I20260709 13:16:45.230953  7812 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:45.231839  7812 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:45.233063  7812 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.247388  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.248464  5445 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:16:45.255560  5374 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:45.261018  5520 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:45.262725  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:45.264410  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:45.266068  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.237011  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:45.269080  5374 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.276207  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.276340  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:45.277858  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:45.276891  5518 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:45.279892  5374 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:45.279995  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.285775  5446 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:45.287513  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.288384  5444 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:45.292158  5449 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.292886  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:45.293092  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.294000  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.294258  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.295033  5369 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:45.295398  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.296068  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.275534  8285 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:45.229612  8249 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:45.300577  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.301744  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.302837  5520 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:45.309886  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:45.311422  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.313068  5374 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.308686  5489 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:45.298446  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.315495  5517 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.320910  5445 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:45.321596  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.321854  5449 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:45.322734  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.324013  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:45.322863  5442 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:45.319937  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.331341  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.337203  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.337205  5517 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:45.340250  5516 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:45.340853  5518 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:45.342520  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.343039  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.335435  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:45.343814  5449 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:45.337785  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:45.348376  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.348439  5449 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:45.349709  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.316743  8285 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.361061  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.315187  8366 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:45.339808  8273 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.275259  7958 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.359483  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.423632  5374 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:45.354655  8139 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:45.357281  8271 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.372675  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.357918  8197 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:45.374014  8366 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.376768  8361 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:16:45.377982  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.376560  8183 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.381124  8353 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:45.382520  8324 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:45.383639  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:45.436848  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53317.8us
I20260709 13:16:45.398444  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:45.366269  8255 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:45.439002  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 61124.5us
I20260709 13:16:45.403890  8325 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:45.408130  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.452348  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:45.411464  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.362500  8249 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.340193  8332 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:45.299082  8054 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:16:45.363303  8285 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:45.414848  8354 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.255s	user 0.002s	sys 0.000s
I20260709 13:16:45.345329  7886 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:16:45.422004  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 92586.5us
I20260709 13:16:45.426779  5367 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:45.423120  5524 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:45.429924  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.546070  5369 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:45.430789  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:45.401949  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet c3b5667547cf44e88316b27d3edb3a4c: Illegal state: Replica 544c82a50cc4477886bb6f7d58f455ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:16:45.443084  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 146291us
I20260709 13:16:45.420991  8196 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.424367  8303 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:45.497228  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45796.4us
I20260709 13:16:45.426524  8273 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:45.476105  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.428805  8197 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:45.538993  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 85742.6us
I20260709 13:16:45.441784  8202 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.434322  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.549008  5374 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:45.447639  8331 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:45.552218  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.435356  8366 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.428718  8235 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:16:45.555634  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.531136  5375 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:45.531726  8271 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.534205  8269 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.573186  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.542325  8321 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.538632  8352 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.573508  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:45.582149  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.539849  8365 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:16:45.588394  8271 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.589149  8165 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:45.550181  8294 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.592885  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.547266  8238 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:45.575131  8197 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.596966  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:45.548678  8332 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.551177  8325 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:45.611411  8196 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.612274  8364 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:45.612066  8325 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:45.595628  8321 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.614849  8183 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:45.615522  5369 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:45.615897  5369 pending_rounds.cc:85] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 4
I20260709 13:16:45.616110  5369 pending_rounds.cc:107] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:45.616312  8139 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.618251  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:45.597834  8295 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.619540  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:45.620609  8273 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.621184  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:45.622390  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:45.591730  8202 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.622905  8271 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.601944  7935 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:45.623447  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.623822  7935 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.624656  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:45.625960  8368 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:16:45.569697  8290 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:16:45.627279  8290 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.627633  8290 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.628366  8290 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:45.601455  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.578430  8303 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:45.597572  8352 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:45.641463  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44550.4us
I20260709 13:16:45.586336  8269 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.586585  8322 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.609148  8235 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.630872  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.589462  8353 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:16:45.631145  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:45.654618  5524 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.657759  5368 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:45.658459  5368 pending_rounds.cc:85] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 2
I20260709 13:16:45.658718  5368 pending_rounds.cc:107] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:45.658970  5368 raft_consensus.cc:2889] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.625366  5446 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:45.643940  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.644984  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:45.645870  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75229.2us
I20260709 13:16:45.648563  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.624769  7935 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.650619  5450 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:45.661672  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.664237  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:45.664851  5450 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.647975  8339 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.616331  5369 raft_consensus.cc:2889] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.660180  5371 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:45.677145  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:45.648209  8269 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.666508  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.670815  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.649655  8298 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.680974  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:45.698609  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.682917  5524 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:16:45.650074  8235 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.653646  8290 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.695184  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:45.697120  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.697813  5371 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:45.718484  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.738179  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:45.738606  5446 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:45.670164  8083 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.714951  8249 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.721637  8327 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:16:45.706168  7886 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.725191  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:45.744656  5447 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:45.726850  8352 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.730293  8332 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:45.696376  8255 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.656090  8320 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:16:45.644281  8054 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:16:45.770210  8054 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.770713  8054 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.719146  8303 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.778431  8320 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.675311  8339 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:45.739781  8324 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.742184  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.709774  8235 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.745813  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:45.812356  5447 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.746042  5450 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:16:45.715577  8331 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.653409  8322 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.713346  8273 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:16:45.743963  7935 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.710170  8298 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.829384  8298 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:45.761129  8197 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.747387  8165 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:45.766122  8373 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:16:45.832563  8165 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:16:45.766954  8374 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:16:45.833880  8165 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.812422  8366 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:45.768023  8285 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.835528  6073 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:45.836717  8366 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:45.836812  8285 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:45.769016  8083 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:45.837697  8083 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:45.838121  8083 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.839438  8322 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:45.698431  8107 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:45.790900  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 125198us
I20260709 13:16:45.842037  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1293) took 1055 ms. Trace:
I20260709 13:16:45.843578  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.842553  5443 rpcz_store.cc:276] 0709 13:16:44.759263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.761529 (+  2266us) service_pool.cc:224] Handling call
0709 13:16:44.762013 (+   484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:44.810347 (+ 48334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.810396 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:44.822360 (+ 11964us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.943978 (+121618us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.953909 (+  9931us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.954921 (+  1012us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.955586 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.955650 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.217102 (+261452us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:45.814784 (+597682us) raft_consensus.cc:1685] finished
0709 13:16:45.814835 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.815083 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8200,"prepare.queue_time_us":9620,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":16896,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":12239,"spinlock_wait_cycles":59195648,"thread_start_us":67728,"threads_started":1,"wal-append.queue_time_us":173219}
I20260709 13:16:45.742314  8355 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:45.845629  8355 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.845748  5441 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:45.846029  8355 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.848456  8255 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.719362  8365 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:16:45.849660  8385 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:45.850176  8385 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.850287  8365 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.851082  8365 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:45.851255  8385 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:45.854075  8377 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:16:45.854750  8353 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:45.855993  8367 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.363s	user 0.000s	sys 0.002s
I20260709 13:16:45.826565  5442 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:45.778936  8320 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.815016  8331 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.798707  8339 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.830011  5444 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:45.860554  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:45.816748  8170 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.865263  5447 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:45.826749  8183 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:45.878438  5449 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:45.886792  8350 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:45.862435  5370 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:45.887679  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:45.890868  5372 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:45.813033  8054 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:45.889006  5443 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:45.891644  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:45.893196  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:45.899073  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 180673us
I20260709 13:16:45.873842  8298 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:45.912474  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 174355us
I20260709 13:16:45.917061  8294 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.917618  8294 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.921917  8400 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.923910  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.924214  8333 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.924757  8333 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.927219  8333 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:45.927464  5515 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:45.928676  8400 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.930913  5515 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:45.931869  8400 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:45.932686  8359 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.764s	user 0.002s	sys 0.003s
I20260709 13:16:45.934772  5515 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:45.884212  8331 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.939383  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:45.940649  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:45.941174  5515 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:45.941721  5373 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:45.940593  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.890178  8183 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.944444  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:45.947940  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.950527  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:45.951368  5523 raft_consensus.cc:2410] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:45.908124  8298 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:45.953469  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.954427  5448 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:45.959512  5515 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:45.956540  5524 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:45.893530  8170 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.944531  8289 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.937810  8350 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:45.964687  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.956815  8183 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.977784  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.968115  8337 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.975059  8289 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:45.977785  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet 5e725a9779684377b88a2fbc508c37df: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:45.947513  8197 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:45.989830  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:45.971136  8107 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:45.992969  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:45.982105  8360 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:45.972887  8303 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:16:45.994302  8370 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.276s	user 0.001s	sys 0.001s
I20260709 13:16:45.990437  8189 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.010921  8393 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:45.997786  8183 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.012332  8390 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:46.005000  8269 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:45.949729  8320 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.003476  8337 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:16:46.014292  8325 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:46.012249  8350 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:46.053121  8289 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:46.053550  7958 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.053859  8321 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.056417  8235 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.059563  8294 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.060940  8399 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.061506  8399 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.063755  8399 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:46.031028  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46115.1us
I20260709 13:16:45.976948  8352 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:16:46.040266  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 59651.5us
I20260709 13:16:46.052037  8325 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:46.035413  8319 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:46.066398  8170 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.038401  8390 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.992372  8298 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:16:46.067865  8395 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 13:16:46.077560  5522 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:46.076788  8319 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.076565  8202 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.082854  8295 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.081947  8290 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.170469  8396 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:16:46.171913  8411 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:46.084312  8390 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.173682  8325 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.175523  8325 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.176301  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.177341  5519 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.178125  8404 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:16:46.179219  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:46.118228  8319 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.180722  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:46.181694  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:46.182307  5523 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:46.076119  8324 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:46.076319  8238 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:46.094899  8298 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.205883  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:46.211431  8337 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:46.211931  8337 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.212329  8337 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.219802  8355 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.220969  8337 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.167876  8083 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.224954  8337 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.231138  8269 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:46.234834  8235 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.235175  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.236383  5520 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:46.290638  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 165952us
I20260709 13:16:46.307050  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.308073  5520 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.225291  8083 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:46.318457  5367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1716) took 1235 ms (client timeout 1587 ms). Trace:
W20260709 13:16:46.319099  5367 rpcz_store.cc:269] 0709 13:16:45.083399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.083539 (+   140us) service_pool.cc:224] Handling call
0709 13:16:46.318167 (+1234628us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540025a3d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:46.318356 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600356096}
I20260709 13:16:46.321864  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.323025  5524 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:46.291776  8399 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.293387  8294 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:46.329571  8337 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.334560  8331 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.338169  8355 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.340044  5519 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
W20260709 13:16:46.347992  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 355071us
I20260709 13:16:46.340324  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1644) took 1056 ms. Trace:
I20260709 13:16:46.199891  8290 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.356537  5520 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:46.352654  5448 rpcz_store.cc:276] 0709 13:16:45.283759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.377085 (+ 93326us) service_pool.cc:224] Handling call
0709 13:16:45.377532 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.959899 (+582367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.340030 (+380131us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54003cc154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:46.340263 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326087040}
I20260709 13:16:46.379802  5515 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:46.375089  8235 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:46.370829  8394 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.375279  8393 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.349828  8399 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.358862  8337 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.381922  8083 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:16:46.383816  8235 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:46.410950  8339 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.005s
I20260709 13:16:46.418118  8339 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.424619  8107 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:46.425169  8107 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:46.426167  8331 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.415795  8202 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:46.430145  8202 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:46.431107  8202 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:46.432379  8202 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.432603  8337 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.396520  8393 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.392091  8394 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:46.415795  8406 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:16:46.442152  8290 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:46.442504  8393 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.444206  8394 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.446938  8385 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.458076  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1738) took 1047 ms. Trace:
I20260709 13:16:46.460116  5367 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:16:46.438927  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:46.463032  5374 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:46.463414  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:46.463893  5367 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:46.451246  8319 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.498646  5374 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:46.499904  8319 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.500494  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:46.502683  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:46.503436  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:46.454716  8320 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.457208  8355 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.448895  8399 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:46.458513  5368 rpcz_store.cc:276] 0709 13:16:45.410889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.592221 (+181332us) service_pool.cc:224] Handling call
0709 13:16:45.592617 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.659490 (+ 66873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.457802 (+798312us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b54000e0bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:46.458010 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148856192}
I20260709 13:16:46.469976  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:46.470793  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:46.509150  5373 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.509743  5374 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:46.475536  8390 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.476267  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:46.477658  8324 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.487368  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.491416  5371 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:46.512349  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:46.513092  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.513690  5518 raft_consensus.cc:2376] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6. Re-sending same reply.
I20260709 13:16:46.514160  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.514833  5522 raft_consensus.cc:2368] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:46.503484  5367 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:46.506959  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.426160  8107 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.466284  8295 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.517578  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.523854  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.525571  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.526144  5522 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.511641  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:46.532080  5414 leader_election.cc:400] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:46.532668  5414 leader_election.cc:403] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.546381  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:46.547405  5517 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:46.549224  8394 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.558352  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:46.563896  8271 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:46.564507  8271 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.564951  8271 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.579815  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:46.581777  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62900.4us
I20260709 13:16:46.580739  5371 raft_consensus.cc:2376] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8. Re-sending same reply.
I20260709 13:16:46.586526  5368 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:46.593554  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:46.598587  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:46.599704  5368 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:46.601351  5368 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:46.581977  8295 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:46.617698  5373 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:46.622288  5523 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:46.587280  8202 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.622984  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:46.604342  8388 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:16:46.510125  8355 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:46.618916  8054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.040s	sys 0.050s
I20260709 13:16:46.646848  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:46.603832  8332 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:46.522876  8324 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.658427  5371 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:46.650318  5373 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:46.608603  8237 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:46.626025  8319 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:46.675485  5375 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:46.675462  5490 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:46.649749  8054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.040s	sys 0.050s
I20260709 13:16:46.683657  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:46.690968  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:46.629745  8397 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:16:46.676955  8197 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.700963  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.704035  5443 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:46.642663  8202 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.705128  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.708722  5446 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:46.708966  5447 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:46.705479  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.709630  5450 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:46.710656  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:46.711413  5447 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:46.715293  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:46.689776  8385 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:46.706308  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:46.706656  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 76374.2us
W20260709 13:16:46.719357  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.724654  5449 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.705981  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.687058  8165 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:46.713941  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.725298  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.726477  5515 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:46.726198  5448 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:46.697746  8054 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.677500  8270 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:16:46.671770  8332 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.697062  8184 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:46.680801  8333 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:46.684401  8162 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:16:46.687431  8319 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.698864  8271 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.698045  8183 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:16:46.809998  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.788051  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:46.731086  5447 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:46.733911  5374 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:46.747583  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:46.791128  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:46.749717  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:46.847700  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.734846  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:46.848572  5373 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.789870  5517 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:46.748900  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:46.758352  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 74823.1us
W20260709 13:16:46.849833  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 113977us
I20260709 13:16:46.706943  8197 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.893245  5366 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:46.803365  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:46.897004  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.900760  5447 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:46.719769  8269 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:46.895995  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:46.902011  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:46.910022  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:46.839120  8373 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:16:46.810734  8428 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:16:46.819849  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:46.723719  8331 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.913964  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:46.811568  8424 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:16:46.962965  8237 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:46.963465  8237 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:46.964344  8237 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.965555  8269 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:46.965823  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55936.3us
I20260709 13:16:46.966620  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:46.923838  8375 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.967536  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1656) took 1280 ms. Trace:
I20260709 13:16:46.969038  8393 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:46.738231  8364 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.187s
I20260709 13:16:46.869724  8333 consensus_queue.cc:1243] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:46.869287  8054 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.926779  8271 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.737051  8165 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:46.831693  8399 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:46.724363  8385 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.834084  8339 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:46.757755  8321 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.171s
I20260709 13:16:46.758703  8361 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.181s
I20260709 13:16:46.869570  8391 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:46.734599  8404 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.266s
I20260709 13:16:46.930215  8332 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:46.937683  5372 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:46.942974  8322 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:46.810413  8403 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.814s	user 0.000s	sys 0.004s
I20260709 13:16:46.783864  8394 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:46.815003  8189 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
W20260709 13:16:47.073311  8435 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:46.723438  8298 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:47.074735  8298 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.076416  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1638) took 1794 ms. Trace:
I20260709 13:16:47.076850  5445 rpcz_store.cc:276] 0709 13:16:45.281992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.343988 (+ 61996us) service_pool.cc:224] Handling call
0709 13:16:45.344299 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.355665 (+ 11366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.355700 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.357503 (+  1803us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.649131 (+1291628us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b18003f9940. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:16:46.754196 (+105065us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:46.754263 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.754372 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.076099 (+321727us) raft_consensus.cc:1685] finished
0709 13:16:47.076119 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.076352 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10976,"raft.queue_time_us":12585,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3634,"spinlock_wait_cycles":11803392,"thread_start_us":104811,"threads_started":1,"wal-append.queue_time_us":1601338}
I20260709 13:16:47.078895  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:46.955135  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59868.1us
I20260709 13:16:46.958420  5366 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:46.959082  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.082253  5443 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.969039  7958 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:46.924533  5447 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:46.967937  5442 rpcz_store.cc:276] 0709 13:16:45.687427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.311116 (+623689us) service_pool.cc:224] Handling call
0709 13:16:46.311628 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.312096 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.312139 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.327284 (+ 15145us) log.cc:844] Serialized 26 byte log entry
0709 13:16:46.415194 (+ 87910us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:46.415415 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.415504 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.967306 (+551802us) raft_consensus.cc:1685] finished
0709 13:16:46.967325 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.967477 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2141,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11830,"thread_start_us":41739,"threads_started":1,"wal-append.queue_time_us":238800}
I20260709 13:16:46.972177  8375 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:46.990132  5522 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:16:46.992476  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 172758us
I20260709 13:16:46.869192  8184 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.091369  5446 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:46.971778  8393 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:46.905031  8197 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.992252  8237 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.970185  8331 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.001159  8365 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:47.012158  8385 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.998035  8399 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:47.036136  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:46.950505  5449 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:47.110571  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.017637  8271 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:47.083619  5445 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:47.085608  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 345930us
I20260709 13:16:47.085893  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.117686  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:46.988920  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.090190  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:47.087663  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1654) took 1401 ms. Trace:
I20260709 13:16:46.997231  5373 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:16:47.088239  7812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.020s	sys 0.012s
I20260709 13:16:47.030597  8324 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:47.051589  8391 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:47.094012  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.137554  5447 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.044967  8235 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.071377  8295 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:47.098712  5443 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10.
I20260709 13:16:47.043139  8355 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.091676  8401 raft_consensus.cc:2764] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:47.046597  8322 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:47.114708  5448 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.158996  5447 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:47.107142  8365 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.071593  8269 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.143489  8333 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:47.105731  7958 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:47.051296  8339 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:16:47.122076  5441 rpcz_store.cc:276] 0709 13:16:45.686025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.937669 (+251644us) service_pool.cc:224] Handling call
0709 13:16:45.950705 (+ 13036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:45.951063 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.951092 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:45.955854 (+  4762us) log.cc:844] Serialized 26 byte log entry
0709 13:16:45.996193 (+ 40339us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:45.996605 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.996693 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.809762 (+813069us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:47.079420 (+269658us) raft_consensus.cc:1685] finished
0709 13:16:47.079445 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.087598 (+  8153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":638,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5561,"spinlock_wait_cycles":3972992,"thread_start_us":39860,"threads_started":1,"wal-append.queue_time_us":40352}
W20260709 13:16:47.141172  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.144402  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 108388us
I20260709 13:16:47.102814  8394 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.151280  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.152650  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.155175  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34856 (request call id 5) took 1128 ms. Trace:
I20260709 13:16:47.161058  8235 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:47.132092  7812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.020s	sys 0.012s
I20260709 13:16:47.185868  5521 rpcz_store.cc:276] 0709 13:16:46.027237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.027464 (+   227us) service_pool.cc:224] Handling call
0709 13:16:47.154894 (+1127430us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b540025dad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d92735 00007fc1d8d52d29 00007fc1d22d11d4 00007fc1d22d1162 00007fc1d22d1091 00007fc1d22d100c 00007fc1d22d02c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:47.155093 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255304960}
I20260709 13:16:47.139191  8271 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:47.162350  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.207077  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.137962  8202 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.127805  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:47.208740  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81036.2us
I20260709 13:16:47.210115  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:47.130645  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.155803  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:47.185981  5443 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:47.187987  5448 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:47.165246  8365 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.202607  5445 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
W20260709 13:16:47.200556  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 450911us
W20260709 13:16:47.202193  8431 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:16:47.190723  8235 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.223105  5450 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:47.180681  8333 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.145390  8397 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:47.238771  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:47.160856  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.261443  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.200647  8319 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.244236  6073 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:47.271456  5449 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:47.199323  8394 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.273327  5450 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:47.238436  8353 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:47.307843  5449 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:47.184063  8399 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.243901  8183 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:47.235200  8295 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:16:47.270776  8333 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.261039  8165 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.346324  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:47.265951  8235 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:47.313819  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75147.2us
I20260709 13:16:47.267906  8054 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:47.282095  8439 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:47.350371  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:47.203997  8393 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.312007  8353 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.207886  8322 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.309329  8285 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:47.262215  8339 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:47.316011  8183 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:47.345148  8189 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.346517  8445 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.310149  8441 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.238910  8391 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:47.387425  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 158038us
I20260709 13:16:47.262110  7958 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.355427  8238 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.354502  8184 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.372089  8364 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:47.372433  8353 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:47.407862  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 176348us
I20260709 13:16:47.379913  8436 raft_consensus.cc:476] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:47.383292  8397 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:47.391681  8083 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:47.380733  8331 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.433650  8322 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.429164  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:47.429266  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:47.405790  8183 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.453984  5447 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:47.455739  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:47.456229  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:47.409766  8285 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:47.516543  5516 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:47.467218  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:47.479907  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:47.428172  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:47.482636  8165 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:47.481019  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 76580.6us
I20260709 13:16:47.481276  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:47.446924  8364 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.416687  8189 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.466828  8324 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.446421  8238 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:47.491981  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 141679us
I20260709 13:16:47.469866  8436 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:47.358886  8439 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.425841  8445 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.519941  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:47.525645  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44479.5us
I20260709 13:16:47.509850  8107 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:47.517231  8285 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.542315  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:47.550493  8184 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:47.551007  8443 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:16:47.551116  8184 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.552903  8437 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:47.553370  8437 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:47.536340  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:47.554877  5490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.585s (SENT) [suppressed 18 similar messages]
I20260709 13:16:47.544284  8394 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.530445  8257 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:47.528118  8364 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:47.510303  8400 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:47.521744  8438 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:16:47.537635  8324 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.561470  8298 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:47.538094  8303 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:47.569661  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.570407  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.570848  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.540026  8442 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:47.538749  8271 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:47.574263  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.581681  5442 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:47.582003  5443 raft_consensus.cc:2368] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:16:47.591702  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1759) took 1076 ms. Trace:
I20260709 13:16:47.592363  5367 rpcz_store.cc:276] 0709 13:16:46.502898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.519625 (+ 16727us) service_pool.cc:224] Handling call
0709 13:16:46.520042 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.526930 (+  6888us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:46.991602 (+464672us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b1800290c80. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:16:47.268264 (+276662us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.385224 (+116960us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.385867 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.386055 (+   188us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:47.386103 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.386205 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.567810 (+181605us) raft_consensus.cc:1685] finished
0709 13:16:47.579142 (+ 11332us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.579353 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95625,"prepare.queue_time_us":547240,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":12698,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":19490,"spinlock_wait_cycles":30038912,"thread_start_us":310508,"threads_started":2,"wal-append.queue_time_us":170170}
I20260709 13:16:47.557727  8184 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.601218  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:47.600169  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50100.8us
I20260709 13:16:47.600668  8202 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.587565  8400 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.627657  8467 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:47.632716  8235 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.624603  5441 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:47.605306  8238 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:47.585903  8295 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:47.626077  8447 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.210s	user 0.001s	sys 0.001s
I20260709 13:16:47.657150  8189 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:47.658756  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 103802us
W20260709 13:16:47.660382  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 118085us
I20260709 13:16:47.591776  8303 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.626994  8298 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.601966  8333 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.558643  8436 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.666109  8295 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.675254  8295 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.675486  8436 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.678349  8445 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.595448  8437 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.679683  8437 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:47.681387  5517 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:47.683580  8333 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:47.687036  8298 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:47.688476  8298 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.694535  8295 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.694906  8290 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:47.695380  8290 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:47.695133  8295 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:47.696420  8385 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.001s
I20260709 13:16:47.696288  8290 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.697306  8290 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.697624  8295 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.698282  8295 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.698732  8400 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:47.699069  8321 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.698925  8295 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.699647  8321 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.701334  8295 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.706552  8436 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:47.707018  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:47.707713  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.708537  8436 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:47.709141  8457 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.710207  8457 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:47.711364  8457 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.717433  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:47.717943  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50737.8us
I20260709 13:16:47.718329  5367 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.719441  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:47.720422  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.723868  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.724995  5375 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:47.726606  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.728088  5370 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:47.722863  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:47.729993  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 173978us
I20260709 13:16:47.736431  5374 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:47.738691  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:47.741636  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:47.742794  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:47.743047  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.744778  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.744845  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:47.745467  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.745577  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.746373  5372 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:47.752130  5367 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:16:47.735162  8237 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.003s
I20260709 13:16:47.696853  8385 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.751802  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.754598  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.755272  5449 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:47.756021  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.756597  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:47.747190  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.756697  5446 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:47.729270  8257 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:47.761451  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:47.760627  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 146094us
W20260709 13:16:47.759415  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 202771us
I20260709 13:16:47.764575  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.765370  5449 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
W20260709 13:16:47.748021  8438 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:16:47.770596  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet f68a24d9e2f74d7697fec4f27e4c7f0c: Illegal state: Replica 544c82a50cc4477886bb6f7d58f455ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:47.766594  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1762) took 1257 ms. Trace:
I20260709 13:16:47.770421  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.748451  8474 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.779758  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:47.773201  5371 rpcz_store.cc:276] 0709 13:16:46.508984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.582824 (+ 73840us) service_pool.cc:224] Handling call
0709 13:16:46.583233 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.659017 (+ 75784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.763039 (+1104022us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b5400185bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:47.766511 (+  3472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150151424}
I20260709 13:16:47.746932  8189 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:47.747293  8393 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.775075  5370 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
W20260709 13:16:47.791282  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44611.3us
I20260709 13:16:47.759263  8269 raft_consensus.cc:2764] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:47.803797  5446 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:16:47.806561  5441 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:47.811295  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.812672  5370 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:47.815810  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57733.7us
I20260709 13:16:47.817149  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1659) took 1128 ms. Trace:
I20260709 13:16:47.764612  8470 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:47.822211  5370 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:47.824110  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.790345  8442 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:47.836226  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 71958.3us
W20260709 13:16:47.808018  8320 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.300s	user 0.010s	sys 0.007s
I20260709 13:16:47.853993  5515 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:47.782702  8473 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.855080  5371 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:47.783083  8321 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.788353  8054 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.817763  5444 rpcz_store.cc:276] 0709 13:16:46.688666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.689187 (+   521us) service_pool.cc:224] Handling call
0709 13:16:46.689617 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.690039 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.690071 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:46.697586 (+  7515us) log.cc:844] Serialized 52 byte log entry
0709 13:16:47.028963 (+331377us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:47.044343 (+ 15380us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.348930 (+304587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.349063 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:47.816817 (+467754us) raft_consensus.cc:1685] finished
0709 13:16:47.816849 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:47.817063 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6104,"prepare.queue_time_us":4960,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":305129,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":13668,"thread_start_us":594350,"threads_started":2,"wal-append.queue_time_us":485111}
I20260709 13:16:47.762542  8183 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.861207  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:47.861195  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:47.807257  8393 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:47.809747  8189 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:47.893777  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77233us
I20260709 13:16:47.896399  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:47.881167  8435 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:16:47.904526  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:47.905535  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 90328us
I20260709 13:16:47.912094  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:47.912437  5444 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:47.914324  5371 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:47.892037  8397 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.906368  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:47.903641  8054 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.918053  8054 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:47.894869  8257 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:47.923700  8189 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.924479  8189 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:47.924885  8189 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.925246  8189 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.930557  8484 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:47.901077  8473 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.891323  8442 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:47.933715  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:47.934415  5371 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:47.934255  8442 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.938092  8303 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:47.792853  8474 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:47.938795  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:47.939790  8467 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:47.939956  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:47.940372  8474 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:47.903347  6073 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:47.944943  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:47.942548  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:48.000773  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 58330.9us
I20260709 13:16:48.002460  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:47.998373  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83151us
I20260709 13:16:48.002866  8184 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.904424  8439 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.018658  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.019603  5370 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:48.008841  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.020936  5371 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:48.021013  8455 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.021564  8455 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.021951  8455 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.999569  8339 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:48.030437  8455 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.001144  8397 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:47.915303  8235 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:48.034166  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 89271.6us
I20260709 13:16:48.041709  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.042549  5340 leader_election.cc:400] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:16:48.043771  5340 leader_election.cc:403] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:48.042550  5371 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:48.045373  8400 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:48.033656  8303 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:48.045759  8483 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.046482  8054 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:48.046816  8483 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.049376  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:48.050683  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.050819  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.051057  8332 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:48.051578  5516 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:48.051607  8332 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.052790  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.038465  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:48.054050  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.054530  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:48.054586  8298 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.054842  8483 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.055243  8298 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.053568  5521 raft_consensus.cc:2368] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:48.055742  8298 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.055900  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:48.057505  8490 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:48.034659  8184 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.058073  8490 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:48.052183  5524 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:48.059684  5524 pending_rounds.cc:85] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 2
I20260709 13:16:48.059965  5524 pending_rounds.cc:107] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:48.060146  8184 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.018029  8322 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:48.060210  5524 raft_consensus.cc:2889] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.054642  5519 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:48.080775  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.080948  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.081488  5444 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:48.081892  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.082255  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:48.082460  5443 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:48.082788  5444 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.046031  8400 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.057130  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:48.065007  8320 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:48.067109  8298 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.068287  8455 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.070225  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.071997  8235 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.034113  8474 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.073473  8393 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.074730  8473 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.079483  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.061014  8238 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:48.099184  8238 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:48.099270  8488 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.099723  8238 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:48.100346  8353 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.002s
I20260709 13:16:48.099905  8488 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:48.100840  8400 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.100742  8353 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.085078  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.101744  8385 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.101922  5523 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:48.086601  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.102767  8390 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.103609  8353 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.104326  8483 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.104509  8083 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.105049  8083 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:48.104966  8483 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.108206  8483 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.109364  8235 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.110438  8355 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:48.111016  8355 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:48.112308  8235 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.116457  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.117169  5450 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:16:48.088644  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:48.118652  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:48.094307  5371 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:48.072992  8197 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.966s	user 0.007s	sys 0.006s
I20260709 13:16:48.087644  8237 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:48.046828  8467 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:48.043360  8183 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.060485  8490 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:48.097819  5445 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:48.088936  8303 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:48.086760  5446 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:48.120764  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:48.119865  8184 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.113246  8474 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.121639  8197 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.122383  8353 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.126523  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:48.172976  5450 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.087782  8479 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:16:48.137172  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:48.193703  5518 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:48.194000  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56892.4us
I20260709 13:16:48.198192  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.198968  5371 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:48.199339  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1530) took 1383 ms. Trace:
I20260709 13:16:48.200326  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.160574  8382 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:48.199723  5515 rpcz_store.cc:276] 0709 13:16:46.788252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.870325 (+ 82073us) service_pool.cc:224] Handling call
0709 13:16:46.870761 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.883694 (+1012933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.171098 (+287404us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b540016bcd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:48.171356 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258230016}
I20260709 13:16:48.201663  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.112233  8355 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.130575  8473 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:48.211318  8473 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:48.211771  8473 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.137846  8487 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.213511  8487 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.214026  8487 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.216049  8385 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:48.218511  8474 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.132728  8467 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.219743  8488 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:48.220002  8467 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.219537  8303 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:48.220584  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.221452  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1375) took 1708 ms. Trace:
I20260709 13:16:48.222779  5450 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:48.203361  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.208053  8183 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:48.210708  5373 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:48.231902  5373 pending_rounds.cc:85] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 3
I20260709 13:16:48.232211  5373 pending_rounds.cc:107] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:48.232488  5373 raft_consensus.cc:2889] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.216624  8385 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.221827  5520 rpcz_store.cc:276] 0709 13:16:46.513041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.514344 (+  1303us) service_pool.cc:224] Handling call
0709 13:16:46.514634 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.581757 (+ 67123us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:46.660391 (+ 78634us) log.cc:844] Serialized 14 byte log entry
0709 13:16:47.886594 (+1226203us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b180044be40. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:16:48.078111 (+191517us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.078580 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.078709 (+   129us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:48.078742 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.078807 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.221119 (+142312us) raft_consensus.cc:1685] finished
0709 13:16:48.221239 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.221371 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58511,"prepare.queue_time_us":95984,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":3306,"raft.queue_time_us":70881,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":25027,"spinlock_wait_cycles":7375616,"thread_start_us":229948,"threads_started":2,"wal-append.queue_time_us":1479068}
I20260709 13:16:48.192950  8353 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.208335  7812 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.208506  8382 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.243086  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:48.245082  8437 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.004s
W20260709 13:16:48.246541  8485 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:48.249567  8298 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.251377  8385 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.239246  8353 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.240648  8355 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.255762  7812 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.257719  8382 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.258144  8197 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.231474  8183 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.261755  8183 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.265869  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.268589  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.238752  8459 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.276119  8189 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.241739  8400 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:48.282335  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.283509  8459 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:48.286769  8365 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.025s	user 0.006s	sys 0.010s
I20260709 13:16:48.166680  8184 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.287660  8237 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.298870  8375 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:48.299729  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.303210  8492 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
I20260709 13:16:48.306180  5367 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:16:48.308171  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.341331  5367 pending_rounds.cc:85] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 8
I20260709 13:16:48.341625  5367 pending_rounds.cc:107] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:16:48.292587  8353 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.309486  8439 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.311097  8294 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.311535  8385 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.312896  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.316243  7812 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.317461  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.322986  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.327229  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.338039  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.341852  5367 raft_consensus.cc:2889] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.453840  5443 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:48.379506  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.419600  5521 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:48.421171  5371 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:48.454947  5442 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:48.455237  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.455858  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.456552  5442 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:48.456852  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.457409  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.458792  5443 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:48.427572  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.321902  8197 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.337941  8364 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.001s
I20260709 13:16:48.452201  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.483979  5520 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:48.486107  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.475512  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.476986  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:48.339826  8237 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.493587  5516 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:48.494980  5515 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:48.422878  8295 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:48.450472  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:48.335028  8437 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:16:48.550125  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.551139  5515 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
W20260709 13:16:48.553817  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 72267.3us
I20260709 13:16:48.551704  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:48.473876  8385 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:48.595283  8487 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.598872  8353 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:48.605919  8476 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.723s	user 0.003s	sys 0.019s
I20260709 13:16:48.608609  8467 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.610172  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:48.610545  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.610836  8184 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.557701  8462 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.612097  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:48.672725  5444 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.001s
W20260709 13:16:48.673204  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.673202  5444 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:48.490342  8319 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.452585  8439 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.473693  8294 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:48.617061  8503 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:16:48.611419  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 543429us
I20260709 13:16:48.417873  8365 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.682173  8462 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:48.682571  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.618532  8333 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.661787  8382 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.683683  8487 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.498988  8364 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:48.686058  8083 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.004s
I20260709 13:16:48.493062  8197 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.698208  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:48.700966  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.672180  8455 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.701447  5369 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:48.695035  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.707093  5515 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:16:48.713195  5448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1321) took 1964 ms (client timeout 1623 ms). Trace:
I20260709 13:16:48.747532  5444 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
W20260709 13:16:48.747954  5448 rpcz_store.cc:269] 0709 13:16:46.728991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.730414 (+  1423us) service_pool.cc:224] Handling call
0709 13:16:48.692850 (+1962436us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540007eed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:48.692974 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506530688}
I20260709 13:16:48.750058  5442 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
W20260709 13:16:48.751921  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53853.9us
I20260709 13:16:48.672644  8449 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.753793  5522 raft_consensus.cc:2368] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:16:48.753883  5414 leader_election.cc:400] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:48.758797  5414 leader_election.cc:403] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:48.754554  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.703591  8238 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
I20260709 13:16:48.662649  8375 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:16:48.692973  8348 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:48.737483  8184 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.700402  8303 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.763336  5374 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:16:48.761739  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 286616us
W20260709 13:16:48.751192  8494 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
I20260709 13:16:48.736449  8417 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.765189  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.701167  8459 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.701310  8333 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.759797  8487 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:48.783476  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:48.797940  5444 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.746286  8436 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:48.753316  8463 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:48.755929  8457 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:48.767946  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.694603  8319 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.795857  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:48.806711  5448 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:48.748344  8083 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.759246  8455 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.830281  5375 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:48.797210  8417 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.818764  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:48.765966  8238 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:48.855327  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 231288us
I20260709 13:16:48.857697  5444 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:48.860718  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.861920  5372 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:48.877097  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.877810  5372 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.789832  8303 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.881093  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:48.881902  5448 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:48.787926  8184 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.821012  8445 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:48.830806  8457 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:48.889101  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:48.892197  5517 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:48.769129  8449 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.804728  8487 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.806258  8436 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.904903  8417 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.906224  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:48.907163  5445 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:48.909077  8502 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 13:16:48.910377  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:48.911409  5444 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:48.875509  8382 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:48.918419  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 308326us
I20260709 13:16:48.930073  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1772) took 2108 ms. Trace:
I20260709 13:16:48.930689  5366 rpcz_store.cc:276] 0709 13:16:46.821559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.082473 (+260914us) service_pool.cc:224] Handling call
0709 13:16:47.082898 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.102180 (+ 19282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:47.102217 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:47.102691 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.135427 (+1032736us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b180019c480. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:16:48.335542 (+200115us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:48.381130 (+ 45588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.381214 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.915119 (+533905us) raft_consensus.cc:1685] finished
0709 13:16:48.915172 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.929959 (+ 14787us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19005,"raft.queue_time_us":19060,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4117,"spinlock_wait_cycles":4305664,"thread_start_us":199936,"threads_started":1,"wal-append.queue_time_us":1610890}
I20260709 13:16:48.894570  8385 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.941588  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:48.940909  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 187201us
I20260709 13:16:48.943390  5366 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:48.940933  5448 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:48.946187  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:48.906280  8364 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:48.947813  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.956698  5366 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.895346  8445 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.958947  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.900074  8457 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.806463  8463 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.967187  5366 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:48.968158  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.968848  5366 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:48.971414  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.972499  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.947278  8439 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.976392  5515 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:48.976861  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:48.977062  5441 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:48.980957  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:48.981859  5367 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.977259  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.959892  8365 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:48.982990  5515 raft_consensus.cc:2368] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7.
I20260709 13:16:48.973228  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.985798  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:48.986340  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:48.987409  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:48.988447  5515 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:48.983937  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:49.039986  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.011590  5372 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
W20260709 13:16:49.058583  8507 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:16:49.003800  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:48.996990  8505 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:16:48.981791  8467 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:49.085690  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.016928  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:49.000936  5523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1536) took 1572 ms (client timeout 1552 ms). Trace:
I20260709 13:16:49.002604  5449 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:49.069857  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.106917  5372 raft_consensus.cc:2368] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
W20260709 13:16:48.999329  8183 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.001s
I20260709 13:16:49.004520  8319 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.003353  8445 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.001500  8457 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.021611  8295 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.062947  5367 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:49.082957  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.067623  5520 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
W20260709 13:16:49.060917  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77118.3us
I20260709 13:16:48.985919  8290 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:49.010282  8189 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.003901  8455 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:49.104967  5523 rpcz_store.cc:269] 0709 13:16:47.428435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.428864 (+   429us) service_pool.cc:224] Handling call
0709 13:16:49.000701 (+1571837us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54002db254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:49.000839 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418003328}
I20260709 13:16:48.990137  5366 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:49.119082  8237 consensus_meta.cc:287] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 13:16:49.256593  8237 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.258260  5524 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:49.259508  8237 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.246212  5517 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:49.261212  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.262282  5517 raft_consensus.cc:2368] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:49.018748  8351 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.263221  8351 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.266685  8351 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:48.996415  8083 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:49.152861  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 206783us
I20260709 13:16:49.000181  8436 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:49.016775  8473 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.003s
W20260709 13:16:49.153847  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.086369  8444 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.730s	user 0.002s	sys 0.015s
I20260709 13:16:49.109342  5516 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:49.247740  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:49.065303  8521 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:49.150369  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1528) took 2362 ms (client timeout 2039 ms). Trace:
I20260709 13:16:49.087795  8399 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.089808  8474 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:49.047070  8238 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.121868  8487 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:49.086448  8511 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:16:49.288842  8445 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.267970  8457 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:49.291638  8436 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.292081  8457 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.292448  8436 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.267778  8269 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:16:49.134613  8197 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.088078  8439 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.320571  8439 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.322885  8439 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.275768  8473 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:48.998478  8333 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:49.125604  8509 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.249s	user 0.000s	sys 0.002s
I20260709 13:16:49.280525  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:49.328349  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47957.9us
I20260709 13:16:49.330726  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:49.136569  5522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1537) took 1707 ms (client timeout 2235 ms). Trace:
I20260709 13:16:49.043378  8520 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:49.121778  8515 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 13:16:49.281920  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:49.280254  5518 rpcz_store.cc:269] 0709 13:16:46.787556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.787689 (+   133us) service_pool.cc:224] Handling call
0709 13:16:49.150016 (+2362327us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540023c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:49.150238 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3098729216}
I20260709 13:16:49.080756  8332 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.019397  8449 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.275923  8455 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:49.248234  8295 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.081147  8303 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.289209  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.290474  5367 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:49.082067  8463 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.322885  8436 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.315534  5520 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:49.296006  8474 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:49.295768  8521 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:49.319037  8457 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.291739  8445 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.255298  8183 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:49.333571  5522 rpcz_store.cc:269] 0709 13:16:47.429627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.430204 (+   577us) service_pool.cc:224] Handling call
0709 13:16:49.136266 (+1706062us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400154354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:49.136482 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2844886400}
I20260709 13:16:49.283334  8400 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:49.333045  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:49.396440  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63524.1us
I20260709 13:16:49.398375  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:49.282809  8459 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:49.355047  5518 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:49.358003  5517 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:49.153024  8324 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.366780  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.367905  5516 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:49.374531  8295 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.348920  8237 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:49.346014  8520 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.356803  8238 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:49.392514  8436 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.408636  5519 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:49.409554  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:49.399030  5442 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:49.417299  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:49.418162  5442 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.407462  8520 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.420403  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.403390  8463 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:49.401767  8269 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:49.428795  8295 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.425648  5414 leader_election.cc:400] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7.
I20260709 13:16:49.437646  5414 leader_election.cc:403] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.443497  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:49.429544  8452 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.924s	user 0.001s	sys 0.017s
I20260709 13:16:49.445483  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.449211  5367 raft_consensus.cc:2410] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:49.409938  8238 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:49.410440  8237 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:49.446959  5442 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:49.450870  5414 leader_election.cc:400] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:49.454829  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1355) took 1192 ms. Trace:
I20260709 13:16:49.454331  8439 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:49.457883  8439 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.456470  5446 rpcz_store.cc:276] 0709 13:16:48.262881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.263105 (+   224us) service_pool.cc:224] Handling call
0709 13:16:48.263581 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.264054 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.264080 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.274893 (+ 10813us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.483780 (+208887us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:48.549155 (+ 65375us) log.cc:844] Serialized 14 byte log entry
0709 13:16:48.549478 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.549582 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.124935 (+575353us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:49.446636 (+321701us) raft_consensus.cc:1685] finished
0709 13:16:49.454545 (+  7909us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.454750 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59026,"prepare.queue_time_us":58667,"prepare.run_wall_time_us":3264,"raft.queue_time_us":316,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":12189,"spinlock_wait_cycles":23817984,"thread_start_us":197222,"threads_started":1,"wal-append.queue_time_us":509285}
I20260709 13:16:49.459453  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.463001  8473 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.448946  8521 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.465641  5515 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:16:49.456164  8238 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.414270  8474 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.474900  8474 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.447340  8463 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:49.478789  8463 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.481539  8493 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.482311  8493 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.458297  8439 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.456130  5414 leader_election.cc:403] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:49.494443  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43780.8us
I20260709 13:16:49.494608  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.495487  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:49.460939  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.496924  5446 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:49.498699  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:49.434607  8525 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:49.500568  8456 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.504189  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.516604  5367 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:49.422250  8436 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:49.510093  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.522342  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.504596  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.519125  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.434420  8517 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:16:49.524662  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.524775  5370 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:49.525139  5446 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:49.501561  8303 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:49.501778  8455 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7.
I20260709 13:16:49.536392  8436 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.537956  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.560019  5444 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:49.554430  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.561232  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:49.542696  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.548262  5442 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:49.549822  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:49.556660  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.515192  8523 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:49.566773  5366 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:49.565798  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.570338  5444 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:49.577080  5366 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:49.577695  5366 pending_rounds.cc:85] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 3
I20260709 13:16:49.577963  5366 pending_rounds.cc:107] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:49.578436  5366 raft_consensus.cc:2889] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.579883  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.580704  5366 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:49.584683  5367 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:49.517484  8449 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:16:49.514103  8456 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.594362  5444 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:49.598851  8183 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.569643  8523 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.599506  5370 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:49.600677  8445 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:49.600962  8528 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:16:49.601691  8449 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:49.602114  8449 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:49.603152  8449 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.604543  8449 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.599787  8523 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.589884  8520 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:49.616031  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.618081  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.616897  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.555497  7812 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:16:49.634171  5370 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:49.634857  5370 pending_rounds.cc:85] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 4
I20260709 13:16:49.635582  5370 pending_rounds.cc:107] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:49.636000  5370 raft_consensus.cc:2889] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.574644  8237 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:49.637118  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 132387us
I20260709 13:16:49.637359  8303 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.638247  8303 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.639736  8294 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.640437  8303 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.652289  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:49.653105  5369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1796) took 1450 ms (client timeout 1897 ms). Trace:
W20260709 13:16:49.654413  5369 rpcz_store.cc:269] 0709 13:16:48.202371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.203076 (+   705us) service_pool.cc:224] Handling call
0709 13:16:49.652788 (+1449712us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54000f9bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:49.653018 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094034816}
I20260709 13:16:49.656641  5370 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:49.621832  8439 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.641570  8303 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:16:49.662602  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:49.664655  5370 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:49.665310  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.665063  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1688) took 1904 ms. Trace:
I20260709 13:16:49.666896  5369 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:49.649228  8436 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:16:49.655815  8337 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.667953  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.655316  8445 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:49.667268  5447 rpcz_store.cc:276] 0709 13:16:47.760843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.905579 (+144736us) service_pool.cc:224] Handling call
0709 13:16:47.944157 (+ 38578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.944425 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:48.007731 (+ 63306us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.536677 (+1528946us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b180043cba0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:16:49.664285 (+127608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.664339 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:49.664380 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.664856 (+   476us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.665009 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12249,"prepare.queue_time_us":73068,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":106,"spinlock_wait_cycles":31744768,"thread_start_us":127268,"threads_started":1}
I20260709 13:16:49.673921  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:49.676743  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.663388  8493 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.665393  8457 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.672212  8303 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:49.675921  8337 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.685542  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.686355  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:49.687698  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:49.691035  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.699177  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.702814  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:49.703485  5370 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.702672  5369 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:16:49.677001  8525 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:49.706597  8337 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.708550  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:49.711901  8493 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.712713  8439 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.712647  8493 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.715957  8493 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.717414  8523 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.720410  8456 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.719812  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.723225  8523 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.723865  8462 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:49.707634  8520 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.686414  8303 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:49.727730  8303 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.729009  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:49.730352  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:49.731391  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.705974  8184 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.735540  8439 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:49.735940  8184 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.676515  8445 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.736829  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:49.736931  5370 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:49.708092  8525 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:49.741956  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:49.743271  8400 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:49.687994  8457 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.737282  8520 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:49.742223  8184 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.748736  8400 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:49.748817  8303 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:49.765682  8238 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.772152  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.773038  5521 raft_consensus.cc:2368] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:49.742674  8523 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.773849  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.774499  5516 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:49.775610  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.775943  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.776196  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.777228  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.777695  5520 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:49.776444  5516 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:49.778602  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1794) took 1579 ms. Trace:
I20260709 13:16:49.777261  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.780869  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.779016  5375 rpcz_store.cc:276] 0709 13:16:48.199127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.199285 (+   158us) service_pool.cc:224] Handling call
0709 13:16:48.199615 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.853412 (+653797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.778397 (+924985us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400393ad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:49.778549 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449877760}
I20260709 13:16:49.788026  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.790882  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.789129  5518 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:49.774551  8400 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.798633  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.794732  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.804131  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.828966  5520 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:49.879196  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.879352  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.880242  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:49.882513  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:49.889019  5416 leader_election.cc:400] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
W20260709 13:16:49.889336  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.891681  5416 leader_election.cc:403] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.779850  8523 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.894461  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:49.900127  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:49.892737  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.900705  5370 raft_consensus.cc:2368] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8.
I20260709 13:16:49.897964  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.848596  8459 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:49.901638  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.803550  8400 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.901546  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:49.897197  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:49.898531  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:49.903889  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:49.908998  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:49.904372  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:49.909519  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:49.910205  5445 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:49.906528  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.913929  5375 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:49.914258  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:49.915110  5366 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:49.893865  8520 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:49.922747  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.923728  5444 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:49.926626  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:49.898226  8462 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.938934  5441 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:49.940558  8397 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.943110  8400 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:49.943225  5522 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:49.895967  8449 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:49.949203  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1792) took 1750 ms. Trace:
I20260709 13:16:49.956305  5374 rpcz_store.cc:276] 0709 13:16:48.198585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.199513 (+   928us) service_pool.cc:224] Handling call
0709 13:16:48.199799 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.786027 (+586228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.948838 (+1162811us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400185bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:49.949118 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295393152}
I20260709 13:16:49.930125  8436 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:49.976990  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62148.6us
I20260709 13:16:49.978547  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.978621  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:49.981742  5520 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:49.910143  8459 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:49.959540  8484 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.989269  5515 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:49.977625  8436 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:49.993893  5445 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:50.000161  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1550) took 1662 ms. Trace:
I20260709 13:16:49.978827  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:49.916067  8542 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:16:50.000602  5519 rpcz_store.cc:276] 0709 13:16:48.337517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.337765 (+   248us) service_pool.cc:224] Handling call
0709 13:16:49.999946 (+1662181us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54002b9654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:50.000103 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195253120}
I20260709 13:16:50.002367  8484 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.002825  8439 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:50.003428  8439 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.003867  8439 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.004522  8484 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:49.999364  8400 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:50.005445  8400 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.007556  8400 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.018787  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.019793  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1548) took 1697 ms. Trace:
W20260709 13:16:50.020423  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.020841  5516 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:50.021013  5416 leader_election.cc:400] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8.
I20260709 13:16:50.021368  5416 leader_election.cc:403] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:16:50.024689  8532 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.426s	user 0.003s	sys 0.002s
I20260709 13:16:50.020251  5524 rpcz_store.cc:276] 0709 13:16:48.322496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.322657 (+   161us) service_pool.cc:224] Handling call
0709 13:16:50.019548 (+1696891us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54001e6254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:50.019725 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850376064}
I20260709 13:16:49.916742  8525 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.035363  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1317) took 1375 ms. Trace:
I20260709 13:16:50.001770  8436 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.041146  5339 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:50.035969  5371 rpcz_store.cc:276] 0709 13:16:48.660460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.132304 (+471844us) service_pool.cc:224] Handling call
0709 13:16:49.132967 (+   663us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.170300 (+ 37333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.170347 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.255834 (+ 85487us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.524047 (+268213us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:49.524088 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.524154 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.959752 (+435598us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:50.026023 (+ 66271us) raft_consensus.cc:1685] finished
0709 13:16:50.026048 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.035265 (+  9217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36758,"raft.queue_time_us":113851,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":15202,"spinlock_wait_cycles":142550272,"thread_start_us":199820,"threads_started":1,"wal-append.queue_time_us":312582}
W20260709 13:16:50.051820  5340 connection.cc:256] RPC call timeout handler was delayed by -1.4034443479999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:16:50.052343  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:50.062052  8523 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.063027  8523 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 7. Current term is 8.
I20260709 13:16:50.055644  8474 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:50.066589  8474 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.067685  8238 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.068856  8474 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.048280  8361 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:16:50.072060  8552 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:50.056381  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:50.073235  8525 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.019059  8520 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:50.048923  8555 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:50.079824  8555 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.080283  8555 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.054086  8322 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:50.080951  8322 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.081303  8322 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.097707  8337 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.098418  8337 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:50.099098  8337 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.102212  8484 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.102880  8484 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.105365  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.106014  5445 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:50.106138  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.106812  8321 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:50.105233  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.107630  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.107915  8490 raft_consensus.cc:2764] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:50.108242  5450 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:50.106289  8456 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:50.109061  8456 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.106134  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.110689  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:50.111356  8456 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.112175  8488 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.113636  8202 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.114053  8202 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.114400  8202 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.114789  8462 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:50.116432  8436 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.107081  5441 raft_consensus.cc:2410] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:16:50.111884  8456 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.119381  8456 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:50.076063  8550 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:16:50.123422  8459 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.124082  8442 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.124544  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:50.124629  8442 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.125437  5373 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:50.125751  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:50.126219  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:50.126757  5371 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:50.126958  8442 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.127693  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:50.128386  8270 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.122224  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:50.129539  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.130564  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.135191  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.136456  5339 leader_election.cc:400] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:16:50.143657  5339 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.146674  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.146843  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:50.147359  5448 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.154834  5448 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:50.160285  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:50.162086  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 141220us
I20260709 13:16:50.156831  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.165395  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.167446  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:50.168655  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.169466  5520 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:50.170264  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.171241  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.171716  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.171981  5520 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:50.172833  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.174440  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:50.171083  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.181687  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.180768  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.150120  8290 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:50.197273  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.198433  5515 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:50.183607  5441 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:50.194074  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.165198  8298 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.150259  8490 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.195261  5450 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:50.128970  8270 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.193544  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.159852  8521 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.178203  8235 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.182188  7958 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.159073  8442 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:50.193102  8400 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:50.164530  8321 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.203560  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.184732  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.181843  8285 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:50.222844  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.194229  5523 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:50.224431  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.215027  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:50.212673  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.159170  8555 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.193406  8238 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.225446  5523 pending_rounds.cc:85] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 4
I20260709 13:16:50.232759  5523 pending_rounds.cc:107] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:50.233119  5523 raft_consensus.cc:2889] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:50.192643  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:50.187018  5520 raft_consensus.cc:2410] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:16:50.226938  5450 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:50.201615  8320 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:50.228641  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.239213  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.239481  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:50.239724  5448 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.240072  5373 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:50.230526  5521 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:50.206876  8162 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.202226  8436 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.231791  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:50.255188  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 61186.6us
I20260709 13:16:50.222213  8456 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.236701  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.258805  5446 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:50.259307  5441 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:50.215683  7958 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.203059  8290 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:50.242055  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81817.8us
I20260709 13:16:50.250475  5448 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:16:50.195477  8333 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:16:50.212486  8490 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:50.277956  8294 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:50.278303  8202 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:50.277976  8490 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:50.279871  8551 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:16:50.253768  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.256014  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.286717  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1362) took 1947 ms. Trace:
I20260709 13:16:50.287209  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.288380  5524 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:50.287402  5443 rpcz_store.cc:276] 0709 13:16:48.339827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.459764 (+119937us) service_pool.cc:224] Handling call
0709 13:16:48.693093 (+233329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.699861 (+  6768us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:48.960314 (+260453us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.281094 (+320780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.281151 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:49.281200 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.281269 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.286490 (+1005221us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540007eed0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:50.286642 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":351,"prepare.queue_time_us":363764,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":14677,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":178,"spinlock_wait_cycles":535793536,"thread_start_us":580169,"threads_started":2,"wal-append.queue_time_us":434943}
I20260709 13:16:50.256125  5445 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10. Re-sending same reply.
I20260709 13:16:50.236364  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.290298  5444 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:50.291551  5524 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:50.040246  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:50.224434  8298 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:50.256961  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:50.260301  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.195259  8397 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:50.215373  8521 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.231604  8474 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:50.265100  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:16:50.265666  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63342us
I20260709 13:16:50.296614  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.273746  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.275576  8488 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.297271  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.258518  8320 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:50.262626  5447 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 13:16:50.261186  8400 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:50.299110  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:50.306999  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50109.6us
I20260709 13:16:50.251680  8285 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.229718  8321 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.308390  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.252597  8162 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:50.310808  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.316015  5441 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:50.264097  7958 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.309716  5272 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 151) took 9747 ms. Trace:
I20260709 13:16:50.318214  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.317862  5447 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:50.306473  8183 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:16:50.305457  8442 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.320657  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:50.326701  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:50.291549  8202 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.321156  8488 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.309921  8238 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.310261  8285 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.318888  5272 rpcz_store.cc:276] 0709 13:16:40.562268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.562601 (+   333us) service_pool.cc:224] Handling call
0709 13:16:50.309651 (+9747050us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:43.808612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:43.865954 (+ 57342us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:43.866015 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:16:43.866039 (+    24us) tablet.cc:662] Decoding operations
0709 13:16:43.868081 (+  2042us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:43.868203 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:43.868231 (+    28us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:16:43.938554 (+ 70323us) tablet.cc:701] Row locks acquired
0709 13:16:43.938630 (+    76us) write_op.cc:260] PREPARE: finished
0709 13:16:43.938873 (+   243us) write_op.cc:270] Start()
0709 13:16:43.939109 (+   236us) write_op.cc:276] Timestamp: P: 1783603003938787 usec, L: 0
0709 13:16:43.939144 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:16:43.940271 (+  1127us) log.cc:844] Serialized 10534 byte log entry
0709 13:16:44.488862 (+548591us) op_driver.cc:464] REPLICATION: finished
0709 13:16:44.713103 (+224241us) write_op.cc:301] APPLY: starting
0709 13:16:44.724591 (+ 11488us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:44.905154 (+180563us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:44.905290 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:45.090921 (+185631us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:45.091446 (+   525us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 13:16:45.091518 (+    72us) write_op.cc:312] APPLY: finished
0709 13:16:45.092199 (+   681us) log.cc:844] Serialized 181 byte log entry
0709 13:16:45.092462 (+   263us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:45.092758 (+   296us) write_op.cc:454] Released schema lock
0709 13:16:45.092860 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:45.093286 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:45.093316 (+    30us) write_op.cc:454] Released schema lock
0709 13:16:45.199226 (+105910us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8932a 00007fc1d3d0ef14 00007fc1d3d0eec3 00007fc1d3d0ee38 00007fc1d3d0edf3 00007fc1d3d0e0dc 00007fc1d3d37e16 00007fc1d3d1fcbb 00007fc1d3d0a39d 00007fc1d3d0dd75
Metrics: {"mutex_wait_us":8784,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":205386,"apply.run_cpu_time_us":9089,"apply.run_wall_time_us":390325,"num_ops":27,"prepare.queue_time_us":121748,"prepare.run_cpu_time_us":23373,"prepare.run_wall_time_us":323148,"raft.queue_time_us":204710,"raft.run_cpu_time_us":118285,"raft.run_wall_time_us":745598,"replication_time_us":536011,"spinlock_wait_cycles":32627456,"thread_start_us":391568,"threads_started":4,"wal-append.queue_time_us":270837,"wal-append.run_cpu_time_us":25642,"wal-append.run_wall_time_us":1884811}]]}
I20260709 13:16:50.317158  8162 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:50.370012  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 145251us
W20260709 13:16:50.370795  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44205.3us
W20260709 13:16:50.370330  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49767.4us
I20260709 13:16:50.372908  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:50.324779  8521 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.330634  8555 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.327081  8474 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.375180  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.345841  8563 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.366734  8333 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.367339  8303 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.395955  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.350328  8463 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:50.379601  8237 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:16:50.390641  8270 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.386698  8202 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:50.392621  8321 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.368031  8285 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.366462  8488 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:50.365876  8238 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.368539  8493 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:16:50.383579  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.364450  8322 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.368250  8436 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.327375  8456 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:16:50.442586  8436 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.444641  8456 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:50.383936  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.445396  8436 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.443826  8321 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:50.445742  5517 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:50.396634  5524 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:50.336402  8439 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.448722  5450 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:50.402335  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.377653  8564 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.380323  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.405689  8399 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:50.341791  8320 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.409394  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:50.409911  8238 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.409998  8488 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.411841  8457 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.403266  8290 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.401463  8303 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.401636  8563 raft_consensus.cc:2764] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:50.416625  7958 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:50.432258  8560 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:16:50.474057  5366 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:50.421195  8445 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:50.423650  8531 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.789s	user 0.000s	sys 0.007s
I20260709 13:16:50.464449  8270 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:50.477000  8270 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.477891  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1315) took 1856 ms. Trace:
W20260709 13:16:50.471273  8529 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.872s	user 0.006s	sys 0.002s
I20260709 13:16:50.331483  8400 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.331022  8298 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.394117  8333 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.429843  8337 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:50.432176  8235 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.433693  8202 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:50.490785  8202 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.492172  8337 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:50.405437  8565 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:16:50.450940  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48653.4us
I20260709 13:16:50.487784  8333 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.494011  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.495373  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.455250  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:50.497020  5375 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:50.498169  8493 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:50.498679  8493 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:50.499019  8294 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.499789  8294 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:50.454160  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:50.501147  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47062.3us
I20260709 13:16:50.503746  8557 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.504233  8557 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:50.504593  8484 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.505038  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1316) took 1855 ms. Trace:
I20260709 13:16:50.504648  8557 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.505460  5368 rpcz_store.cc:276] 0709 13:16:48.649878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.128961 (+479083us) service_pool.cc:224] Handling call
0709 13:16:49.129476 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.129759 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.129829 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.130451 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.432259 (+301808us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:49.432295 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.432363 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.437074 (+1004711us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:50.504736 (+ 67662us) raft_consensus.cc:1685] finished
0709 13:16:50.504763 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.504970 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144760704,"thread_start_us":277940,"threads_started":1,"wal-append.queue_time_us":407025}
I20260709 13:16:50.455545  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:50.441675  8490 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:50.461114  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.468600  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 95777.6us
I20260709 13:16:50.468819  5370 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.457700  8564 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.420049  8184 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.458227  8456 consensus_queue.cc:1243] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:16:50.425236  8536 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.793s	user 0.000s	sys 0.006s
I20260709 13:16:50.464423  8397 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.478302  5372 rpcz_store.cc:276] 0709 13:16:48.621636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.116785 (+495149us) service_pool.cc:224] Handling call
0709 13:16:49.117161 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.161864 (+ 44703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.161902 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.162583 (+   681us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.473838 (+311255us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:49.473886 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.473964 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.422998 (+949034us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:50.477597 (+ 54599us) raft_consensus.cc:1685] finished
0709 13:16:50.477618 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.477829 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44176,"raft.queue_time_us":44376,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":22022,"spinlock_wait_cycles":59377920,"thread_start_us":185009,"threads_started":1,"wal-append.queue_time_us":294653}
I20260709 13:16:50.477409  8270 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.478279  7958 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.499083  8493 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.472431  8399 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:50.511102  5369 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:16:50.458266  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 78080.7us
I20260709 13:16:50.518026  8285 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:50.525071  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.533931  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.540849  5448 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.540751  5370 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:50.551426  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:50.558048  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44570.6us
I20260709 13:16:50.561138  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.500710  8294 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.561931  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.629000  5517 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:50.563473  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.563776  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.631222  5448 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:50.564152  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.564363  5443 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:50.566730  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.569129  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:50.569984  5441 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:50.572526  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:50.634093  5447 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:50.633994  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.573455  5445 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:50.581529  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.584271  8238 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.558151  8564 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.639940  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:50.642230  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.564925  8439 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.573261  8565 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:16:50.599594  8322 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.616798  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.646319  8320 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:16:50.655612  8298 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.656106  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.656985  8320 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:50.657389  8320 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:50.657598  8183 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.620620  5444 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:50.612645  8303 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.661497  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.662866  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.663632  8298 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:50.664049  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.664341  8298 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.664965  8568 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.666589  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.643980  5521 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:50.644289  5523 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:50.645134  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 76087.4us
I20260709 13:16:50.614682  8490 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.647243  8235 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:50.653213  8474 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:50.653017  8397 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:50.653698  8555 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.654042  8237 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:50.644907  7958 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:50.592362  8162 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.699461  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:50.700470  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:50.632728  8337 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:16:50.653712  8400 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.708360  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.700111  8442 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:50.675901  8322 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:50.744719  5369 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:50.737591  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:50.751984  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51611.4us
I20260709 13:16:50.724494  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.752882  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:50.714507  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.663818  8493 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.702826  8555 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:50.671927  8183 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:16:50.763185  5448 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:50.757515  5444 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.753010  5443 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.700897  8474 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:50.761261  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 61887.3us
I20260709 13:16:50.707767  8235 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:50.709622  8401 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.781112  5414 leader_election.cc:400] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
W20260709 13:16:50.774601  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 133253us
I20260709 13:16:50.784075  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:50.715754  8400 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:50.826390  5370 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:50.763121  8555 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.714413  8567 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:16:50.790989  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.785722  8459 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.788525  8445 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.793854  8557 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.841003  5444 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:50.794679  8493 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.790354  8270 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.798200  8474 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.802198  8285 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.802997  8238 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.804499  8484 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:50.806430  8235 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.791932  8333 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.745436  8566 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:16:50.812479  8488 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:50.813751  8521 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:50.800596  8184 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:16:50.780040  8390 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:50.903746  8390 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.904166  8390 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:50.905759  8557 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:50.822849  8576 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:50.767491  8556 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:50.848917  8484 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:50.914845  8581 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:50.915957  8484 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:50.920192  8574 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:16:50.923539  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:50.824764  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:50.760176  8439 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:50.825572  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 116125us
W20260709 13:16:50.828012  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 119748us
I20260709 13:16:50.938422  5370 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:50.939281  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.830502  8517 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:50.831369  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 388934us
W20260709 13:16:50.839793  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48902.9us
I20260709 13:16:50.794332  8162 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.841322  5443 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:50.761096  8322 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.827076  8400 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.836669  8303 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.710088  8399 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.020242  8303 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.021733  5367 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:51.022131  5367 pending_rounds.cc:85] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 5
I20260709 13:16:50.826563  8462 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:51.022734  8303 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.842952  8565 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.879341  8488 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:50.879906  5366 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:50.886524  8586 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:50.887719  8564 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.889860  8270 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.890882  5269 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 6 to 7, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 7 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.893841  8333 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:50.898164  8320 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:50.900821  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:50.944999  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.945500  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:51.036008  5448 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.947304  8401 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.947854  8556 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:50.954475  8397 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:50.933182  8439 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:50.958809  8238 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:51.076021  8439 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.076126  8397 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:51.076499  8238 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:51.076948  8238 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.077869  8238 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.079092  8238 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.032178  8586 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.076553  8397 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.082270  8586 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:51.082727  8397 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.083580  8586 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.083835  8397 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:51.085826  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.087769  8322 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:50.961156  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:51.089040  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 127977us
I20260709 13:16:50.903127  8521 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.089743  8555 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.090421  8521 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.091395  8521 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.091987  8555 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.068823  8401 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.092789  8401 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.097114  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:51.097486  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.962596  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 137910us
I20260709 13:16:50.966715  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:51.098589  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 131962us
I20260709 13:16:51.099141  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:50.853397  8474 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.977984  5520 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:50.978888  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:50.979844  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:51.107272  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:50.980782  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:50.982345  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:51.110661  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 128442us
I20260709 13:16:51.112118  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:50.985198  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:50.987250  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:51.115084  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:50.967803  5370 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:50.994972  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:50.995860  5375 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:16:51.004520  8578 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:51.008776  8484 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.011101  8445 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:51.012495  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:51.134814  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:51.150362  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:51.018415  8517 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:51.151429  8517 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:51.018989  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:51.022362  5367 pending_rounds.cc:107] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:51.030526  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:51.031450  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:51.153604  5367 raft_consensus.cc:2889] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:51.154044  5444 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.155084  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:51.027331  8390 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.159152  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:51.055527  5371 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:16:50.992431  8457 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.064563  5448 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:51.088325  8322 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:51.164578  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 102234us
I20260709 13:16:51.100564  5269 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 5 to 6, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 6 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.125833  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:51.127215  5524 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:51.054428  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:51.157562  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:51.158582  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:51.160038  5367 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:51.161649  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:51.168517  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:51.169135  5366 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:51.152827  8333 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:51.148897  8488 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.149132  8462 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.123801  8184 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:51.105536  8555 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.181152  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 126856us
I20260709 13:16:51.171855  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:51.159677  8202 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.172811  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:51.074291  8556 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.148805  8303 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.163514  5444 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:51.131808  8456 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:51.131235  8436 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:51.126546  8493 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:51.172931  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:51.184409  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:51.182037  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:51.185474  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:51.186334  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:51.170702  8525 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.162385  8579 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:51.149499  8294 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:16:51.186381  8568 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:51.149029  8445 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:51.214258  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:51.215145  5366 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:51.175130  8557 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.188364  8333 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.178390  8459 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:51.175590  8322 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.223609  5371 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:51.224655  5372 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:51.261997  5522 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:51.263231  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:51.264151  5516 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:51.266064  5517 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:51.207402  5367 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:51.189003  8235 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.188776  8563 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.223138  8565 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.189361  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:51.278132  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.211650  8436 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:51.221730  8493 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:51.282203  5366 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:51.231834  8567 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.286804  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:51.188053  8555 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.254202  8321 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.211488  8303 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.287598  8567 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.269014  8456 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:51.315114  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 141989us
I20260709 13:16:51.427407  5374 raft_consensus.cc:2410] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:51.310415  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:51.558523  5375 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:51.430080  5449 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:51.288703  8290 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:51.563349  8290 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.308121  8298 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:16:51.359256  8320 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.346490  8390 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:51.368085  8400 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.572805  8400 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:51.316826  8445 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:51.432935  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.271469  7958 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:16:51.574555  8445 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.575778  7958 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:51.576627  7958 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:51.576915  5521 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:51.314205  8270 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:51.314950  8459 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.578526  8459 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.288439  8493 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.283766  8565 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:51.586351  8565 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.594620  8290 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:51.595103  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.278491  8568 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.598605  8568 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.322954  8564 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:51.383613  8589 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 13:16:51.340292  8333 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:51.309607  8237 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.366667  8567 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:51.319018  8257 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:16:51.611547  8257 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:51.612056  8257 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:51.378324  8555 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.291811  8436 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.608793  8237 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.374706  8439 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.619135  8237 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:51.619365  8439 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.280040  8525 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.621151  8257 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:51.369215  8401 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.624539  8401 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:51.322093  8184 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:51.443480  8303 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:51.445981  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 165651us
I20260709 13:16:51.627219  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:51.456542  8557 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:51.459328  8321 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:51.629648  8557 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:51.629926  8321 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.630805  8257 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.631258  8557 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.632985  8557 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.634758  8184 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:51.465755  8592 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.122s	user 0.000s	sys 0.003s
I20260709 13:16:51.637972  8567 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:51.468268  8322 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:51.453544  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 183984us
I20260709 13:16:51.639242  8567 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.640381  8567 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:51.640780  8567 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:51.475452  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 285983us
I20260709 13:16:51.642278  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:51.644630  8390 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:51.482381  8556 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:51.645378  8390 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.645859  8556 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.646661  8390 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:51.499902  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet db91d6fa74dd4308ae267c81a83d8d5f: Illegal state: Replica 86b410d62f4040c39d33dc0698998562 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:16:51.504441  5367 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.541934  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:51.649487  8565 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.284040  8563 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:51.664456  8563 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.578529  8270 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.668819  8270 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.669656  5449 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:51.671677  8290 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:51.673110  8324 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:51.673609  8324 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:51.588901  8459 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.644973  8321 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.585029  7958 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.674772  8324 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.676544  8321 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.651357  8564 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.676446  8401 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:51.651218  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:51.678399  8324 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.678781  5517 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:51.652146  8556 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.475744  8517 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:51.652618  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111030us
I20260709 13:16:51.683837  8517 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.652668  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:51.657552  5521 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:16:51.686448  8465 consensus_queue.cc:1175] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:16:51.687412  7958 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.687168  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:51.688555  5449 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:51.689394  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.689685  8290 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.690688  8474 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:51.692916  8337 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:51.693490  8337 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:51.694613  8337 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.696444  8337 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.698194  8567 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.699733  8567 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.690997  8290 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.702454  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:51.704144  8579 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:51.706619  8579 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:51.707953  8564 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:51.708454  8564 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:51.709700  8564 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.712889  8290 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:51.715682  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:51.712795  8564 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.736141  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:51.737104  5372 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.641233  8493 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.737107  5374 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:51.767414  5449 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:16:51.778154  8579 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:16:51.783890  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:51.784459  5368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.014s	sys 0.047s
W20260709 13:16:51.784866  5368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.014s	sys 0.047s
I20260709 13:16:51.779024  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:51.799643  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 208807us
I20260709 13:16:51.810343  5523 raft_consensus.cc:606] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:51.811020  5523 raft_consensus.cc:614] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:51.811533  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:51.814210  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.819214  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:51.820634  8459 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.823035  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:51.827589  5518 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:51.828612  5449 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:51.813712  8525 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.834434  8303 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.863667  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.870438  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:51.876881  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:51.882302  8298 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.884228  8579 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:51.885640  8474 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:51.886144  8474 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:51.887281  8474 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:51.888749  8238 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.809s	user 0.006s	sys 0.011s
I20260709 13:16:51.888845  8474 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.889564  8322 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:51.890002  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 102829us
I20260709 13:16:51.889575  8488 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.890820  8488 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.893575  8525 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.894806  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1361) took 1311 ms. Trace:
I20260709 13:16:51.896564  8525 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.903419  8322 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:51.903980  8322 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:51.906075  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.906685  8493 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:51.907698  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "505e05548ee2401d969672320dea8a9b"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:51.908594  5516 raft_consensus.cc:606] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:51.909093  5516 raft_consensus.cc:614] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:51.910883  8436 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:51.912503  5445 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.895507  5368 rpcz_store.cc:276] 0709 13:16:50.646719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.698357 (+ 51638us) service_pool.cc:224] Handling call
0709 13:16:50.698723 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.035636 (+336913us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:51.096148 (+ 60512us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.809822 (+713674us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.851278 (+ 41456us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:51.864784 (+ 13506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.894273 (+ 29489us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b540015ccd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:51.894348 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.894702 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16924,"prepare.queue_time_us":61656,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":153,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":66651,"spinlock_wait_cycles":774357888,"thread_start_us":688795,"threads_started":1}
I20260709 13:16:51.919222  8556 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.923216  5449 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.929617  8436 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:51.935060  5338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.094s	sys 0.170s
I20260709 13:16:51.935734  8565 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:51.935544  5338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.094s	sys 0.171s
I20260709 13:16:51.938764  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:51.943068  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51126.8us
W20260709 13:16:51.939682  5269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.033s	sys 0.135s
W20260709 13:16:51.950022  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.950465  5444 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:51.947237  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:51.959542  8488 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.923645  8303 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:51.960631  8235 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.671s	user 0.012s	sys 0.004s
I20260709 13:16:51.961643  8235 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.962800  8303 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:51.967322  5517 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:51.968767  5369 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:51.954371  5269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.034s	sys 0.135s
I20260709 13:16:51.969498  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:51.970646  5446 raft_consensus.cc:2410] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:51.973640  8563 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:51.961585  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 142530us
I20260709 13:16:51.976854  5523 raft_consensus.cc:606] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:52.001718  5367 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.998402  8235 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:16:52.012202  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.013198  5447 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:52.014053  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.015883  5523 raft_consensus.cc:614] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:52.014277  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.025759  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.026746  5447 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:52.041697  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.042222  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 92604.2us
I20260709 13:16:52.043464  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.045473  8586 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:52.046214  8586 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.048777  8586 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:52.050434  5522 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:52.062227  8563 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:52.073879  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 64282.6us
I20260709 13:16:52.075349  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:52.077687  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.077802  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.078764  5523 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.079777  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:52.079958  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.080749  8445 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:52.080432  5522 raft_consensus.cc:606] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:52.081648  8459 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:52.082616  5522 raft_consensus.cc:614] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:52.082691  8459 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.081382  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.081897  8303 raft_consensus.cc:2764] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:16:52.080770  8337 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:16:52.088485  8303 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.088629  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.082028  8445 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:52.082132  8439 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.090241  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.090497  8439 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:52.091372  8598 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:52.091809  8598 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.092309  8598 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.083143  8459 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.089619  8445 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:52.093540  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:52.094774  8556 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:52.094130  8445 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.097536  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.097983  8568 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:52.098536  8555 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.098693  8400 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:52.098539  8568 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:52.089814  8237 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:52.100292  8568 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.101336  8270 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:52.103017  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.081851  8436 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:52.104532  8555 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:52.104492  8436 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:52.106088  5444 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.106220  8436 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.091704  8439 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.110981  8439 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.110756  8400 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:52.113000  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.089550  8337 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:52.118139  8337 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:52.119144  8337 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.120386  8337 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.121287  5444 raft_consensus.cc:2410] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:16:52.127594  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.125074  8598 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.129297  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.129438  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:52.130571  8324 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.132117  8324 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.132789  8324 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.132141  8598 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:52.137758  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52244.2us
W20260709 13:16:52.139089  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.146971  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:52.148056  5522 raft_consensus.cc:606] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:52.150013  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:52.160799  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:52.162185  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.162429  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.164398  5445 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:52.165802  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1768) took 1185 ms. Trace:
I20260709 13:16:52.166188  5445 rpcz_store.cc:276] 0709 13:16:50.980154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.980492 (+   338us) service_pool.cc:224] Handling call
0709 13:16:52.165601 (+1185109us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b540029e0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:52.165721 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845626240}
I20260709 13:16:52.168658  5443 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:52.170756  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.171770  5442 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:52.171566  8445 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.183876  5449 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:16:52.172855  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.176443  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:52.178645  8586 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:52.180487  8324 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.185312  8445 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.185873  8563 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.172901  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.189716  5444 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:16:52.125682  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.194639  5447 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:16:52.197257  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.198254  5444 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:52.203588  5523 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:52.212265  5367 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:52.213866  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.214083  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.194357  8598 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.220014  5442 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:52.194648  8556 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:52.219002  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.225834  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.199541  8303 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.236645  5442 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:52.246106  5369 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:16:52.217792  8564 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:52.248242  5442 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:52.218945  8557 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.257365  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:52.264717  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.256737  6073 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:52.232549  8598 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.233246  8563 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:52.271654  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:52.279486  8324 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:52.247092  8556 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.282037  8604 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:52.282214  8557 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.284459  6073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 110) took 1063 ms. Trace:
I20260709 13:16:52.298884  8162 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.303501  5449 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:52.282081  8322 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.310892  5366 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:52.313539  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.318758  5367 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:16:52.319630  5374 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
W20260709 13:16:52.330940  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.331889  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60364.8us
I20260709 13:16:52.258311  8564 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.334288  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.263092  8298 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:52.261839  8303 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:52.347774  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 137513us
I20260709 13:16:52.352816  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:52.337364  8474 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:52.357628  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:52.378307  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.378396  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:52.381068  5366 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.382330  8333 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.383014  8322 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.382886  8333 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.385047  8333 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:52.385732  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.387038  8556 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.389202  5443 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:52.391465  5450 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:52.375370  5372 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:16:52.386894  8324 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:52.403256  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.339131  8488 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:52.348939  8604 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:52.415962  5521 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.337455  6073 rpcz_store.cc:276] 0709 13:16:51.221359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.223106 (+  1747us) service_pool.cc:224] Handling call
0709 13:16:52.284133 (+1061027us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54005f23d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:52.284355 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249606912}
I20260709 13:16:52.392506  8474 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:52.378093  7958 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:52.422086  5368 raft_consensus.cc:2410] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:52.366565  8567 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:52.424340  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.424530  5450 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:52.410351  8586 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:52.367017  8162 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.356128  8298 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.431105  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:52.431839  5372 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:52.431895  5366 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:52.444393  8162 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:52.444522  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:52.445737  8235 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.446364  8235 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.446715  8322 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:52.439054  8488 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.447258  8298 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:52.459693  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.448611  8235 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.448896  8488 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.422751  8337 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.449589  8598 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.449632  8474 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.421048  8324 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:52.453460  8586 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:52.491230  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.455814  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.493985  5366 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:52.496829  5517 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:52.470429  8564 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.451859  8459 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.426059  7958 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.462049  5450 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:52.503118  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.469259  8465 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:52.469688  8488 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:52.508927  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.515717  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.468852  8337 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.523357  5448 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:52.517549  5443 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:52.519567  5447 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:16:52.520298  8557 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.501719  8565 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:52.510396  8601 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.515949  8397 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:16:52.538925  5366 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:52.513186  8563 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:52.547626  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.552606  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.553469  5450 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:52.556208  8601 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.537885  8465 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:52.564796  8465 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.498865  8604 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.568264  7958 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.573786  5368 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:16:52.526050  8303 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.516913  8488 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.578948  5450 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:52.527446  8320 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
I20260709 13:16:52.590214  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.587262  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.569708  8324 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.598572  5450 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:52.601135  5523 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:52.602514  5372 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 2.
I20260709 13:16:52.601974  5522 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
W20260709 13:16:52.593937  8627 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.139s	user 0.004s	sys 0.000s
I20260709 13:16:52.605769  5375 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:52.610114  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.611259  8439 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:52.612231  8439 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:52.613881  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:52.615032  8626 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:16:52.615562  5519 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:16:52.619913  8616 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.169s	user 0.003s	sys 0.000s
I20260709 13:16:52.611292  5515 raft_consensus.cc:2410] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:52.593014  8579 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.638355  5368 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:16:52.603271  8629 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:52.642364  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.574506  8565 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.643210  5523 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:16:52.644623  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.654467  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.657004  8601 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.657671  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.660427  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.661674  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.661747  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.661849  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.578215  8586 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.662705  5448 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:52.662864  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.663676  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.669062  5449 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:52.650239  8579 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.670328  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.671096  5522 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:52.671800  8579 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.671957  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.678241  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.679602  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.677992  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.673137  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.687554  5521 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:16:52.662730  8488 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.690963  5518 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:52.692426  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.696576  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.693455  5515 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:52.699261  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.700610  5366 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:52.701074  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.702373  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.703948  5522 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:52.708278  5515 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:52.708835  5515 pending_rounds.cc:85] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 3
I20260709 13:16:52.714775  5515 pending_rounds.cc:107] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:52.715201  5515 raft_consensus.cc:2889] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:52.714210  5516 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:52.712071  8565 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.716159  8459 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.697278  8322 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:52.727167  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:52.729202  5366 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.705124  8604 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.731709  8322 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:52.739940  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.742374  5516 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:52.742605  5366 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:52.743829  5449 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:52.744437  5443 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:52.745230  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.751394  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.739979  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.756162  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.756747  5521 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:52.727460  8235 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.753525  5520 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:52.764283  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:52.762108  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:52.766204  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:52.733599  8557 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.738343  8439 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:52.774799  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76241.3us
I20260709 13:16:52.773867  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.768008  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:52.776120  5449 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:52.769275  5339 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:52.771783  5516 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:52.737783  8645 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:52.764679  8556 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:52.778738  5366 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:52.784044  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.780377  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.784722  5441 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:52.735287  8604 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.788704  8321 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:52.789243  8321 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:52.789692  8321 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.795486  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:52.796802  8564 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.782073  8557 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:52.784358  8390 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.799875  8390 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.802359  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.803051  5449 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:52.803784  8556 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.804029  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:52.805375  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.806043  5372 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:52.809978  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.810758  5369 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:52.816601  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:52.817785  8298 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:52.819223  8645 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.782845  8459 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:52.768355  8235 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.823192  8235 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.809999  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:52.829038  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52108.7us
I20260709 13:16:52.829701  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:16:52.830011  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:52.831218  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50925.4us
I20260709 13:16:52.832120  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.768728  8579 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:52.837160  8397 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.837131  8579 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.837831  8397 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.839529  8579 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.839860  8397 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:52.840139  8436 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:52.842340  8465 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:52.842847  8465 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:52.843235  8465 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.799916  8557 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:52.821249  8459 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.846884  8459 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:52.847615  8390 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:52.802832  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:52.852944  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:52.855669  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.856395  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.858783  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.859494  5368 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:52.862170  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:52.864022  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:52.866806  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.868394  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.868759  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:52.869895  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 67108us
I20260709 13:16:52.870054  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:52.873593  5369 raft_consensus.cc:2368] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:16:52.875010  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:52.876278  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.880074  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.882637  5367 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:52.883898  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:52.881690  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:52.884500  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.886837  8568 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.887074  8566 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:16:52.889937  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 60062.5us
I20260709 13:16:52.891008  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:52.892688  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:52.894263  8631 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:16:52.894343  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.847738  8459 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:52.863654  8563 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.906070  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54977.9us
I20260709 13:16:52.911266  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:52.897532  5369 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
W20260709 13:16:52.911909  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.918794  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.934392  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.885599  8324 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:52.887146  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:52.879894  8564 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:52.897864  8601 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:52.957589  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:52.911726  8579 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.909161  8390 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:52.976528  5416 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:52.918147  8598 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:53.027928  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51591.5us
I20260709 13:16:53.028231  8557 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:53.028950  8557 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.029551  8557 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.030419  5367 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.029121  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.034696  8459 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.035069  8598 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.035547  8598 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.035912  8598 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:53.037595  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 145054us
I20260709 13:16:52.952402  8563 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.039534  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:53.040082  5372 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:53.040369  8564 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.043377  8557 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.049611  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:52.905180  8565 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:53.045164  8598 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.052383  8598 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.046478  5416 leader_election.cc:400] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:16:53.053099  5416 leader_election.cc:403] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:16:53.053859  8649 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:53.054279  8436 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:16:53.055071  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.046574  8563 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.056300  8436 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.057116  8436 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.057555  8436 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.057785  8557 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.061784  8298 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:52.954839  8397 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 13:16:53.064747  8397 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:53.066323  8436 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.069054  8436 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:53.024858  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 113642us
I20260709 13:16:53.025388  5370 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:53.065147  8397 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:53.071092  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.088300  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:53.089704  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:53.097920  5374 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:53.098652  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:53.050796  5371 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:53.102114  5372 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:53.103492  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.104635  8436 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.105039  8436 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:53.105398  8436 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:53.106676  8622 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.668s	user 0.004s	sys 0.001s
I20260709 13:16:53.108263  5443 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:53.109233  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:53.110471  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:53.026405  8601 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:53.112861  8601 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.115916  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.116649  5370 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.124547  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.125530  5374 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.125463  8397 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.126282  8556 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:53.127203  8598 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.125996  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.134517  8598 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:53.135025  8598 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.135389  8598 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.140926  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.141736  8579 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.142293  8579 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.142745  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.143625  5368 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.144562  8579 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.149681  8337 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.150962  8604 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:53.153012  5450 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:53.153808  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:53.154726  5372 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:16:53.157776  8621 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.705s	user 0.003s	sys 0.000s
I20260709 13:16:53.159024  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1611) took 1357 ms. Trace:
I20260709 13:16:53.159232  5372 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:16:53.160208  8643 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.481s	user 0.002s	sys 0.000s
I20260709 13:16:53.159395  5524 rpcz_store.cc:276] 0709 13:16:51.801477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.801909 (+   432us) service_pool.cc:224] Handling call
0709 13:16:51.858395 (+ 56486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.944055 (+ 85660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.944105 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.951969 (+  7864us) log.cc:844] Serialized 26 byte log entry
0709 13:16:52.262153 (+310184us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:52.262188 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.262240 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.157026 (+894786us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:53.158696 (+  1670us) raft_consensus.cc:1685] finished
0709 13:16:53.158717 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.158924 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43644,"raft.queue_time_us":52472,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"spinlock_wait_cycles":12379904,"thread_start_us":309626,"threads_started":1,"wal-append.queue_time_us":481266}
I20260709 13:16:53.162578  8465 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:53.164325  6070 raft_consensus.cc:2410] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:16:53.164759  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:53.166714  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:53.168146  8465 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.168910  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:53.142743  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:53.171257  5373 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:53.069402  8321 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.170960  8303 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.111492  5443 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:53.008795  8640 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.958607  8645 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:52.918497  8567 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.287s
I20260709 13:16:53.178617  5367 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:53.183526  8650 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.227s	user 0.002s	sys 0.001s
I20260709 13:16:53.179368  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:53.253935  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 74655.8us
I20260709 13:16:53.254998  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:16:53.184471  8651 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.212s	user 0.003s	sys 0.000s
I20260709 13:16:53.175763  5375 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:16:53.206008  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 96279.3us
I20260709 13:16:53.258716  8586 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:53.259327  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.261081  8586 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:53.261637  8586 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:53.261022  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.262473  8586 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.263514  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.263684  8586 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.219357  8337 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.192579  5374 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:53.218614  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.265393  5373 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:53.265642  8333 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:53.266088  8333 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.266564  8333 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.215610  8598 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.267535  5441 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:53.268180  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.269088  8237 raft_consensus.cc:993] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:16:53.178426  8321 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.269452  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.270109  5517 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:53.270308  8566 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:53.270696  8566 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:53.271057  8566 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.273861  8320 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:52.955787  8324 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:53.248811  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 207369us
I20260709 13:16:53.198714  5368 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:16:53.196750  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:53.257254  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 305116us
I20260709 13:16:53.239034  8568 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.281086  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84460.6us
I20260709 13:16:53.292249  8321 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:53.292718  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:53.220937  8640 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:53.280485  8557 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:53.293886  8397 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.294642  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.256446  8556 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:53.306267  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51387.6us
I20260709 13:16:53.264724  8436 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.312757  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.239563  8604 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:16:53.215703  8303 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:16:53.280788  8324 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.318094  8321 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.298224  5370 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:16:53.308153  8557 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.327842  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.312533  8390 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:53.328539  5518 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
W20260709 13:16:53.349996  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.350760  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.359622  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.367553  8653 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.374452  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58926.9us
I20260709 13:16:53.375824  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:53.375845  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111422us
I20260709 13:16:53.324556  6073 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:16:53.329120  8557 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:53.377393  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84836.9us
I20260709 13:16:53.308105  8568 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.331086  8400 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:16:53.384691  5369 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:53.385213  8640 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:53.386458  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:53.387349  5366 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
I20260709 13:16:53.389142  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:53.368692  8653 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.374413  8488 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.246404  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:53.432737  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.399259  8640 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:53.441279  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 160358us
I20260709 13:16:53.411794  8656 raft_consensus.cc:1081] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
W20260709 13:16:53.469336  8474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.014s	sys 0.009s
W20260709 13:16:53.470031  8474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.014s	sys 0.009s
I20260709 13:16:53.471462  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.471755  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:53.411047  8445 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:53.477857  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:53.411715  8601 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.456338  8626 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:53.447316  8640 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:53.484071  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 185152us
W20260709 13:16:53.487517  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 111764us
I20260709 13:16:53.485846  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:53.491303  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:53.494500  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.495101  8640 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.414539  8567 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:16:53.473062  8598 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.503680  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.505956  5516 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:53.498458  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:53.499326  8663 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:53.500079  8664 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:53.515748  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 104225us
I20260709 13:16:53.442842  8488 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.513650  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:53.517992  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.482142  8662 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:53.481627  8303 consensus_queue.cc:1243] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:53.501627  8474 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:53.507911  8663 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:16:53.549141  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57797.4us
I20260709 13:16:53.551440  5416 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.497970  8601 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:53.576020  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 73755.7us
W20260709 13:16:53.576623  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 146185us
I20260709 13:16:53.484417  8390 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.544104  8436 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.549440  8663 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:53.582283  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:53.538414  8670 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:53.538113  8662 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.591171  8640 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:53.592398  8320 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.592849  8320 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.598155  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.598964  5372 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.598726  8668 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:53.600191  8488 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.547899  8237 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:53.602979  5522 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.598255  8672 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.605664  8557 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.607928  8557 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.615345  8601 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.616598  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:53.595307  8669 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:53.621239  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:53.587421  8459 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.006s
I20260709 13:16:53.622356  8579 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:53.623571  8488 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.625077  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:53.626917  8474 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:53.627378  8474 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.627771  8474 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.627981  8640 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:53.634873  5518 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
W20260709 13:16:53.636744  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.645361  5339 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:53.647086  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:53.650105  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67917.4us
I20260709 13:16:53.650871  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.649161  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:53.673542  8321 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:53.674145  8321 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.674556  8321 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.675280  8604 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:53.675758  8604 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:53.686996  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 147236us
I20260709 13:16:53.642112  8670 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:53.689898  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.691164  8303 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:53.654894  8563 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.710057  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.710812  5515 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:53.712030  5522 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:53.712291  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.712699  8162 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.690549  8665 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:53.685920  8668 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:53.668393  8556 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:53.667326  8579 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:53.668840  8568 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:53.728744  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 149461us
I20260709 13:16:53.691372  8673 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:16:53.726547  8303 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:53.708205  8436 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:53.676949  8604 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.716569  8653 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:53.691978  8679 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:16:53.729594  8579 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:53.759042  5372 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
I20260709 13:16:53.754416  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.762229  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:53.762946  5367 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:53.762519  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 94328.3us
I20260709 13:16:53.764233  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.735821  5273 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.738376  8668 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:53.777398  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:53.784281  5366 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.719465  8563 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:53.780619  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 110959us
W20260709 13:16:53.786849  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 295607us
I20260709 13:16:53.736794  8645 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:16:53.775012  8333 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.002s
I20260709 13:16:53.736948  8669 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:16:53.728601  8566 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.750044  8556 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:53.797452  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:53.791503  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:53.763092  8579 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.727294  8162 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:53.730830  8665 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:53.793807  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57265.8us
I20260709 13:16:53.773439  8465 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:53.797163  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:53.807647  8445 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:53.807371  8556 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.808115  8445 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:53.808576  8586 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.007s
I20260709 13:16:53.810693  8669 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:53.811199  8663 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.815023  8162 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:53.815259  8563 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:53.815748  8639 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:53.805262  8488 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 13:16:53.816913  8684 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:53.817777  8685 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:53.818212  8685 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:53.819139  8685 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.820704  8683 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.822724  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.823524  5522 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:53.822726  8639 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:53.799685  8333 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.826656  5515 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:53.826215  8639 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:53.828337  8333 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:53.829151  8337 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:53.829643  8303 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.830256  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:53.830978  6073 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:53.831405  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:53.833681  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
W20260709 13:16:53.833868  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47193.9us
I20260709 13:16:53.811269  8669 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:53.794255  8675 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:53.840322  5372 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:53.842556  5367 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:16:53.845036  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:53.845821  5515 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:53.851189  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:53.853515  5366 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:53.779251  8672 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:16:53.863241  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:53.863947  5449 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.829640  8337 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:16:53.848093  8324 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.003s
I20260709 13:16:53.870720  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:53.891814  5367 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:53.846911  8653 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:53.893898  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:53.843683  8465 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:16:53.908758  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44221.6us
I20260709 13:16:53.857611  8488 raft_consensus.cc:2764] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:16:53.911490  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 114185us
I20260709 13:16:53.838106  8673 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:16:53.864573  8683 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:53.921607  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:53.935483  5449 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
I20260709 13:16:53.905580  8653 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.865470  8563 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:16:53.915483  8672 consensus_queue.cc:1243] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:53.918934  8675 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.975678  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 143377us
I20260709 13:16:53.907143  8324 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.800086  8670 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:53.963012  8653 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:54.020700  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 97601.9us
W20260709 13:16:54.016846  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 68601us
I20260709 13:16:54.023085  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:54.025664  8162 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.026453  8162 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:54.030546  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 79394.5us
I20260709 13:16:53.968477  8436 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:53.954123  8645 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:16:54.003060  8686 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:54.055766  8303 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:54.004498  8672 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.023512  8568 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.016414  8663 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:53.904659  8668 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.016831  8697 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.950577  8683 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.059139  8556 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:54.103117  5415 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:54.101692  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:54.083745  8598 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:54.107547  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 199082us
I20260709 13:16:54.005806  8675 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:54.110059  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 88702.5us
I20260709 13:16:54.005987  8337 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.113798  5443 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:54.113998  5448 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:54.121454  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:54.124408  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78869us
I20260709 13:16:54.125020  5449 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:54.126827  5449 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:54.100278  8702 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:16:54.132884  8397 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.817s	user 0.010s	sys 0.004s
I20260709 13:16:54.133893  8669 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:54.078300  8568 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.046516  8465 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:54.146219  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.151324  5447 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:54.101325  8665 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.083987  8672 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.170199  8672 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.111254  8598 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:54.154218  8445 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:54.179488  8445 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:54.160019  5446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:16:54.180491  5446 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:54.180899  5446 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:54.185807  8320 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 13:16:54.186268  8320 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.188354  8320 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:54.189353  8162 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:54.108089  8400 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:16:54.191339  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:54.191970  5441 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.192934  8683 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:54.195235  8688 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:16:54.196354  8672 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.197342  8701 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:54.198053  8683 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.198499  8703 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:16:54.198608  8683 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.199985  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.200616  5367 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:16:54.201932  5372 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:54.147168  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.203570  5450 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:54.161533  8693 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:54.205678  5367 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:54.163195  8677 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:16:54.208309  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.231020  5367 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:54.232313  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:54.170431  8704 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:54.200871  8683 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.233143  5367 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:54.236711  5374 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:54.196185  8702 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.253554  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.135700  8556 raft_consensus.cc:2764] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:54.254793  5367 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:54.250296  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 328817us
I20260709 13:16:54.256397  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:54.251471  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.252287  5371 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:16:54.259545  5371 pending_rounds.cc:85] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 4
I20260709 13:16:54.259817  5371 pending_rounds.cc:107] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:16:54.260073  5371 raft_consensus.cc:2889] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:54.239792  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:54.260843  5447 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.197120  8672 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.267256  8445 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.279961  5374 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:16:54.256352  8693 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:54.260214  8563 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.272940  8683 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:54.275949  8303 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:54.308523  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:54.311182  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 513840us
I20260709 13:16:54.315446  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:54.156193  8436 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.326248  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:54.338135  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.339587  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:54.340199  5374 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.261936  8702 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.290341  8696 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:54.348372  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.362313  5447 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:54.309827  8677 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.319185  8556 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.288028  8445 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.376364  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:54.379164  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.380934  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.382206  5371 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:54.323668  8683 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:54.383661  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.387167  5374 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:54.311863  8563 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.339169  8324 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:54.387353  8321 consensus_meta.cc:287] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.005s
I20260709 13:16:54.367086  8696 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:54.408372  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92284.4us
I20260709 13:16:54.323346  8303 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.430573  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.428321  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:54.434562  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:54.390800  8719 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.429549  8321 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.441521  5368 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:54.418644  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:54.445240  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.470036  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.428079  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.418887  8645 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.430413  8697 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.427070  8696 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.476022  8321 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.483188  8683 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.475907  5446 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:54.442946  8474 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.003s
I20260709 13:16:54.483420  8662 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:54.391238  8556 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.418754  8653 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:54.492728  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.498421  5516 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.391129  8677 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.477586  8672 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.480868  8729 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:54.484233  8397 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:54.512689  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.473610  8719 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.519467  8706 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.520263  8706 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.520679  8706 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.521354  8719 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.514922  8321 raft_consensus.cc:2764] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:54.522904  8563 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.438683  8693 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.531989  5518 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:54.488962  8697 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.487336  8645 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.531893  8672 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.491957  8474 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.548384  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.548408  5441 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:54.556766  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.560818  8714 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.556746  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.584915  5449 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:54.582860  5441 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:54.599192  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:54.533245  8397 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.586234  8714 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.629640  5369 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:54.649631  8689 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.650389  8689 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.549211  8445 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.657783  8731 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.658538  8731 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.659518  8474 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.544430  8669 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.660390  8669 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.660893  8731 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.570717  8556 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.662662  8669 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.573043  8728 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.663950  8728 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.666487  8728 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.610414  8696 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.667610  8702 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.662675  8706 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.673784  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:54.569176  8694 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.326s	user 0.002s	sys 0.001s
I20260709 13:16:54.649869  8690 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.590794  8563 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.674974  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.675812  5374 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:54.559083  8677 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.560269  8653 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:54.684839  5516 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
W20260709 13:16:54.637387  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 167428us
I20260709 13:16:54.688983  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:54.668469  8696 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.542147  8729 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.699405  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.700285  5515 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:54.669865  8303 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.706940  5339 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:54.667925  8735 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.709085  8579 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.872s	user 0.012s	sys 0.002s
I20260709 13:16:54.684342  8702 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.713536  8579 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.714109  8677 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:54.713832  8702 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.668784  8645 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.669340  8397 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:54.591648  8672 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.674633  8714 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.669137  8697 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.716210  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.724464  8742 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:54.726040  8723 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.348s	user 0.004s	sys 0.000s
I20260709 13:16:54.679106  8689 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:54.725839  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.720197  8579 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.725157  8742 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:54.727654  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.728536  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.733815  5515 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:54.734509  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.735356  5524 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.735775  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:54.700512  8563 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.728116  8716 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:54.739691  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.767933  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.777666  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.784005  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.785821  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.787951  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.789825  5442 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:54.789095  5450 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:54.793354  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.754262  8579 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:54.794327  5443 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:54.800968  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.803073  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.805033  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.806222  5443 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:54.804199  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:54.805008  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.806778  5443 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:54.757217  8716 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:54.774067  8729 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:54.792106  8714 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.809605  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:54.789471  8696 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.721071  8735 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.757079  8601 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:16:54.817191  6073 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:54.818198  5445 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:54.802249  8579 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:54.819702  5447 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:54.801872  8702 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.818363  8563 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.809041  8690 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.821528  5443 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.826016  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.736759  8742 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.830207  5441 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:54.820098  8436 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.831918  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:54.825013  8579 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.834349  8568 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:54.834899  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.836862  8700 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:54.830972  8690 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:54.838244  8721 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.535s	user 0.000s	sys 0.007s
I20260709 13:16:54.838986  8675 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.823443  8740 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:54.842583  5441 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:54.852599  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.853448  5445 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:54.853298  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:54.848990  8716 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.854259  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.854698  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.855875  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:54.848124  8700 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:54.856608  8604 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.843640  8436 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.848420  8566 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:54.857004  8700 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.858721  8700 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.859357  5441 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.854801  5445 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:16:54.826243  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.845474  5446 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:54.850540  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.860527  5515 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:54.862986  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:54.865826  8738 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:16:54.865926  8740 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:54.867252  8686 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:54.867740  8686 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.868151  8740 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:54.868589  8740 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.868932  8740 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:54.870550  8698 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.679s	user 0.002s	sys 0.000s
I20260709 13:16:54.871862  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1405) took 1117 ms. Trace:
I20260709 13:16:54.872289  5370 rpcz_store.cc:276] 0709 13:16:53.754526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.754994 (+   468us) service_pool.cc:224] Handling call
0709 13:16:53.778142 (+ 23148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.789203 (+ 11061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.789231 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.803434 (+ 14203us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.970209 (+166775us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:53.970248 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.970321 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.869884 (+899563us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:54.871501 (+  1617us) raft_consensus.cc:1685] finished
0709 13:16:54.871530 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.871796 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24414,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":136,"spinlock_wait_cycles":24710016,"thread_start_us":113771,"threads_started":1,"wal-append.queue_time_us":298164}
W20260709 13:16:54.875344  8695 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.776s	user 0.001s	sys 0.000s
I20260709 13:16:54.877784  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.877784  8672 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:54.887094  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.888084  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:54.889726  5370 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.890350  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.891718  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.894894  5448 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:54.895296  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:16:54.896585  8676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.000s	sys 0.008s
W20260709 13:16:54.896989  8676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.000s	sys 0.008s
I20260709 13:16:54.898218  5366 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:54.898280  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:54.899068  5445 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:54.899220  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.899596  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.899895  5446 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:54.900787  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.901697  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.902318  5373 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:16:54.902444  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.903330  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.904543  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.898393  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.905323  5371 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:16:54.900820  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:54.908720  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.903339  5366 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:54.910526  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.910621  5441 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:54.912358  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:54.913990  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.912530  5370 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:54.916006  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:54.916317  5441 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:54.916957  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.905273  8488 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.923123  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.923923  5516 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:54.926810  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.927644  5518 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:54.914841  8719 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:54.928598  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.929145  8719 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:54.931246  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.931584  5517 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:54.920847  8563 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.945783  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.915843  8742 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:54.915644  8696 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:54.966887  5524 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:54.961413  5445 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:54.948478  5273 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 4 to 6, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 6 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.971138  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.979802  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:54.953819  8707 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.791s	user 0.000s	sys 0.004s
I20260709 13:16:54.933903  8719 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.928517  8579 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:54.991156  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.992331  5516 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:54.992980  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.995687  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:54.998520  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:54.949124  8686 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.008088  5518 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:54.948788  8740 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.011817  8579 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.013911  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:55.014362  5516 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.021719  5515 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:55.023126  5373 raft_consensus.cc:2368] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:55.012655  8488 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:55.025377  8436 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.028810  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1652) took 1193 ms. Trace:
I20260709 13:16:55.029285  5522 rpcz_store.cc:276] 0709 13:16:53.835553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.835785 (+   232us) service_pool.cc:224] Handling call
0709 13:16:53.836175 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:53.909346 (+ 73171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.909381 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:53.914576 (+  5195us) log.cc:844] Serialized 52 byte log entry
0709 13:16:54.059527 (+144951us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:54.252063 (+192536us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.265608 (+ 13545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.265839 (+   231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.953032 (+687193us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:55.024265 (+ 71233us) raft_consensus.cc:1685] finished
0709 13:16:55.028536 (+  4271us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.028742 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24312,"prepare.queue_time_us":37606,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2620,"raft.queue_time_us":87711,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":17094,"spinlock_wait_cycles":99320064,"thread_start_us":211626,"threads_started":2,"wal-append.queue_time_us":199765}
I20260709 13:16:55.032516  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.036036  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.037179  8690 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.044837  5516 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:16:55.049845  8740 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.050766  8686 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.036137  8488 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:55.063347  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.064710  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.065984  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:55.066614  5523 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.067672  8598 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.069118  8598 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.070334  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.074538  5523 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:55.079072  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:55.080741  5515 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:55.081565  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:55.082675  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.086027  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.086313  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:55.088109  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:55.118093  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:55.106711  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.093324  5449 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:55.120184  5374 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:55.120185  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:55.118853  5516 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:55.122704  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:55.123502  5445 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:16:55.089735  5524 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:55.126041  5515 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:55.127157  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:55.127370  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:55.127544  5449 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:55.127794  5441 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.129616  5523 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:55.088871  8696 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:55.124311  8675 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:55.131029  8675 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.131419  8675 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.132097  8700 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:55.130034  5523 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:55.136524  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.135172  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47166.2us
I20260709 13:16:55.138338  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:55.139915  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:55.142786  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.147341  5516 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:55.088711  8459 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:16:55.156658  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:55.157330  5516 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:55.157752  5516 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:55.158124  5441 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:55.159417  5524 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:55.117499  8724 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:55.087195  8740 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.083693  8690 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.163250  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.085843  8162 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:55.163564  5444 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:55.133104  8702 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.161230  5523 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.166709  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:55.162804  8465 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:16:55.166584  8563 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:55.160226  8742 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:55.158952  8700 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:55.158959  5516 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.173578  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1895) took 1334 ms. Trace:
I20260709 13:16:55.273639  5368 rpcz_store.cc:276] 0709 13:16:53.839190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.850881 (+ 11691us) service_pool.cc:224] Handling call
0709 13:16:55.173303 (+1322422us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54001202d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:55.173487 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355102080}
I20260709 13:16:55.187673  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.275624  5515 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:55.191515  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.223160  5523 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:55.278389  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 86944us
I20260709 13:16:55.227412  5516 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:55.278585  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:55.259498  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.286134  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.211894  8337 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.293836  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:55.276278  8687 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:55.214107  8700 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.205914  8563 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:55.282532  8716 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:55.201196  8436 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:55.307364  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.324489  5516 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:55.190343  8724 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.326773  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:55.327142  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.191761  8474 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
W20260709 13:16:55.309859  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.329211  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.310444  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:55.317323  5523 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:16:55.330546  5523 pending_rounds.cc:85] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 3
I20260709 13:16:55.330879  5444 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:55.331000  5523 pending_rounds.cc:107] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:16:55.331391  5523 raft_consensus.cc:2889] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:55.332224  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.335815  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.339215  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:55.340664  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.251291  8579 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:16:55.300917  8687 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:55.206656  8162 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.323725  8716 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.341041  8436 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.187773  8702 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.349995  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:55.318090  8700 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.349790  8459 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:55.368921  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.359809  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.372594  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:55.357553  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.373133  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:55.438130  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65079.4us
W20260709 13:16:55.438472  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 65987.9us
I20260709 13:16:55.441758  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:55.442926  5446 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:55.444722  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:55.446259  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 88939.3us
I20260709 13:16:55.346570  8691 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.451342  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.334406  8724 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.349527  8677 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:55.356711  8726 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.835s	user 0.005s	sys 0.000s
I20260709 13:16:55.454561  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.167285  8690 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.355629  8162 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:55.346823  8739 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.361624  8656 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.353911  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:16:55.354241  8716 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:55.459422  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.461300  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:55.356237  8436 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.446916  8604 raft_consensus.cc:2764] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:55.444965  8566 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:55.470786  5441 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:55.456909  8691 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.455691  8459 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:55.357949  8663 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:16:55.503531  5446 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:55.467254  8739 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.505868  8739 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.456471  8724 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.472036  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1846) took 1164 ms. Trace:
I20260709 13:16:55.457712  8676 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:55.510039  8676 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.510628  8676 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.508846  8162 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:16:55.453792  8686 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.511623  8686 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.513984  8686 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.453977  8719 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.453075  8672 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:55.357810  8675 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.516698  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1402) took 1763 ms. Trace:
I20260709 13:16:55.517210  8719 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.517853  8675 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.464064  8303 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:55.519348  8303 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:55.492952  8759 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:16:55.519708  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:55.484668  8563 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.519407  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.522644  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.524073  8693 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.509924  5447 rpcz_store.cc:276] 0709 13:16:54.302270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.382440 (+ 80170us) service_pool.cc:224] Handling call
0709 13:16:54.382796 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.823583 (+440787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.466178 (+642595us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540033c7d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:55.466479 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004131072}
I20260709 13:16:55.526407  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:55.528046  8303 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:55.527935  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.528653  8303 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:55.529603  8303 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.530972  8303 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:55.537779  8693 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:55.538445  8693 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.538816  8690 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.538925  8693 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.517161  5369 rpcz_store.cc:276] 0709 13:16:53.753526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.763888 (+ 10362us) service_pool.cc:224] Handling call
0709 13:16:55.516506 (+1752618us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54003944d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:55.516643 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987702144}
I20260709 13:16:55.485638  8436 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:55.540736  8691 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.359020  8671 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.191s
I20260709 13:16:55.354334  8687 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.540818  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.468089  8656 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.568060  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:16:55.573151  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.564307  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.583002  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:55.585928  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.586350  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.581948  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.589013  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1911) took 1330 ms. Trace:
W20260709 13:16:55.559262  8758 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:16:55.590693  5368 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:55.591866  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:55.592700  5370 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:55.589386  5367 rpcz_store.cc:276] 0709 13:16:54.259111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.259260 (+   149us) service_pool.cc:224] Handling call
0709 13:16:54.285688 (+ 26428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.286128 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.286169 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.286756 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.420851 (+134095us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:54.420909 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.421005 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.277439 (+856434us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:55.561581 (+284142us) raft_consensus.cc:1685] finished
0709 13:16:55.561612 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.588953 (+ 27341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34802,"raft.queue_time_us":65933,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":15187,"spinlock_wait_cycles":51898240,"thread_start_us":102209,"threads_started":1,"wal-append.queue_time_us":220963}
I20260709 13:16:55.593240  5369 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:55.561846  8656 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.558857  8672 raft_consensus.cc:2764] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:55.595520  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:55.596860  5370 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:55.600201  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:55.602802  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:55.603869  5373 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:55.601306  5374 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:55.585239  8303 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.588327  8677 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:55.591682  8675 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:55.631508  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 191266us
I20260709 13:16:55.631537  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:55.633766  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:55.634068  5370 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:16:55.626780  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 187573us
I20260709 13:16:55.592754  8686 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:55.636045  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.637785  5370 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:55.585541  8598 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:55.637914  5368 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:55.639674  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:55.628690  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:55.649330  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:55.650135  5523 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:55.650130  5517 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.653338  5516 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:55.655332  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:55.629937  8687 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.664598  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:55.662067  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:55.665660  5370 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:55.657157  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.666181  5524 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:55.667636  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:55.641641  8672 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:55.653716  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:55.085579  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:55.674808  5368 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:55.651304  8337 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:55.651155  8459 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:55.650319  8675 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:55.685048  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:55.652966  8663 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:55.636055  8601 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:16:55.645824  8604 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:16:55.639731  8566 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:55.639204  8400 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:16:55.701433  8465 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:16:55.666796  8742 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.715301  8742 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.716516  8663 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:55.717536  8663 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.718526  8675 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.721005  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:55.703923  5518 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.638628  8686 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:55.688692  8337 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.677023  8672 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.674484  8690 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.672534  8671 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 13:16:55.706022  8725 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.174s	user 0.008s	sys 0.008s
W20260709 13:16:55.728468  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 138878us
I20260709 13:16:55.741357  5416 leader_election.cc:400] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:16:55.720669  8685 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.744103  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:55.715301  8400 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:55.745271  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 163407us
I20260709 13:16:55.735119  8337 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.759982  5518 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:55.737505  8672 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.737351  8474 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:55.747501  8664 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.015s	sys 0.030s
I20260709 13:16:55.731745  8693 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.764947  8742 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.788394  8400 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:55.807488  8400 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:55.808611  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 147285us
I20260709 13:16:55.812083  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:55.813861  8765 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:55.818216  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1904) took 1614 ms. Trace:
I20260709 13:16:55.818974  5372 rpcz_store.cc:276] 0709 13:16:54.204204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.207323 (+  3119us) service_pool.cc:224] Handling call
0709 13:16:54.207744 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.255403 (+ 47659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.255439 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.272765 (+ 17326us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.381042 (+108277us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:54.381083 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.381148 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.561467 (+1180319us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:55.817859 (+256392us) raft_consensus.cc:1685] finished
0709 13:16:55.817884 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.818144 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80910,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":31657,"spinlock_wait_cycles":33781632,"thread_start_us":70179,"threads_started":1,"wal-append.queue_time_us":196759}
I20260709 13:16:55.821846  8686 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:55.822363  8567 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:55.823134  8567 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:55.822952  5269 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 155) took 22604 ms (client timeout 15000 ms). Trace:
W20260709 13:16:55.824302  8762 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:16:55.824123  8567 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.826505  5443 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.836784  5517 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
W20260709 13:16:55.797729  8664 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.017s	sys 0.034s
I20260709 13:16:55.767359  8474 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:55.846423  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:55.819226  8716 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.830487  8436 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.843536  8567 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.840006  8771 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.869464  8773 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.852324  8690 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:55.804385  8722 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:16:55.869483  8566 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:55.872596  8604 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:55.911228  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 211987us
I20260709 13:16:55.927280  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:55.928350  5517 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:55.906502  8677 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.901051  8770 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.886292  8436 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.945303  5443 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:16:55.922031  8686 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.977911  8686 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.978114  8784 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:55.980563  8686 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:55.982061  8772 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:16:55.982595  8702 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.982993  5438 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b301483f19c4d508e00d917819ac039 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:58804
I20260709 13:16:55.938911  8677 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.984368  5449 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:55.955420  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1432) took 1163 ms. Trace:
I20260709 13:16:55.954128  8303 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.891726  8771 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:55.992801  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 146461us
W20260709 13:16:55.970700  8766 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:16:55.910106  8474 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:55.895668  8773 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.975447  8436 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.975200  8656 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.028172  8303 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:55.823668  5269 rpcz_store.cc:269] 0709 13:16:33.218550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.219052 (+   502us) service_pool.cc:224] Handling call
0709 13:16:55.822832 (+22603780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:51.896409 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:51.897375 (+   966us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:51.923040 (+ 25665us) write_op.cc:435] Acquired schema lock
0709 13:16:51.931474 (+  8434us) tablet.cc:662] Decoding operations
0709 13:16:51.963789 (+ 32315us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:51.963975 (+   186us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:51.964058 (+    83us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:51.964747 (+   689us) tablet.cc:701] Row locks acquired
0709 13:16:51.964804 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:16:51.965060 (+   256us) write_op.cc:270] Start()
0709 13:16:51.965272 (+   212us) write_op.cc:276] Timestamp: P: 1783603011964977 usec, L: 0
0709 13:16:51.965314 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:16:52.026020 (+ 60706us) log.cc:844] Serialized 918 byte log entry
0709 13:16:52.526770 (+500750us) op_driver.cc:464] REPLICATION: finished
0709 13:16:52.607857 (+ 81087us) write_op.cc:301] APPLY: starting
0709 13:16:52.608004 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:52.608170 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:52.608325 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:52.608818 (+   493us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:52.609099 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:52.609168 (+    69us) write_op.cc:312] APPLY: finished
0709 13:16:52.609496 (+   328us) log.cc:844] Serialized 28 byte log entry
0709 13:16:52.609697 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.609816 (+   119us) write_op.cc:454] Released schema lock
0709 13:16:52.609881 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:52.610404 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:52.610440 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22521,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":80591,"apply.run_cpu_time_us":2655,"apply.run_wall_time_us":2656,"num_ops":2,"prepare.queue_time_us":625705,"prepare.run_cpu_time_us":28706,"prepare.run_wall_time_us":317337,"raft.queue_time_us":81519,"raft.run_cpu_time_us":11607,"raft.run_wall_time_us":66556,"replication_time_us":561188,"thread_start_us":980138,"threads_started":4,"wal-append.queue_time_us":332968,"wal-append.run_cpu_time_us":13284,"wal-append.run_wall_time_us":1249316}]]}
I20260709 13:16:55.931357  8781 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.915163  8566 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:55.927552  8739 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.895241  8676 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:55.930763  8742 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:55.939424  8604 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:55.954775  8696 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:56.029218  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:55.957463  8557 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:16:55.986824  5443 rpcz_store.cc:276] 0709 13:16:54.791955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.805690 (+ 13735us) service_pool.cc:224] Handling call
0709 13:16:54.806054 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.826147 (+1020093us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5800446fd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3ce80aa 00007fc1d3d6a447 00007fc1d3d82fe7 00007fc1d3d847de 00007fc1d3d8eb49 00007fc1d3d8f416 00007fc1d3d8bd8f 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4
0709 13:16:55.955131 (+128984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.955360 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765897600}
I20260709 13:16:55.959443  8716 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.028810  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:56.036326  5522 raft_consensus.cc:2368] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:16:55.988631  8702 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.099073  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 70324.1us
I20260709 13:16:56.032086  8664 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:55.956651  8770 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:56.096165  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 155059us
W20260709 13:16:56.096055  8691 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.001s
I20260709 13:16:55.958618  8724 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.039824  8677 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:55.969368  8782 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:56.135673  8773 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:56.040313  8686 consensus_queue.cc:1175] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "53eb858bdf82438d83f1be6a01da2e0e" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 10 index: 9 } }
I20260709 13:16:56.050442  8474 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.137116  8303 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.137871  5367 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:56.139237  8337 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.135932  8782 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:56.142840  8739 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.144007  8782 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:56.096570  8775 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.129217  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.094990  8742 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.134101  8656 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:56.133774  8691 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.130931  8488 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:56.134936  8770 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.030081  8764 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:16:56.135926  8724 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.097674  8675 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:56.178072  8675 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.122974  8735 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.181898  8675 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.166158  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:56.171528  8337 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.129995  8702 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.172698  8742 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.146634  8693 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.167879  8579 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:16:56.099004  8740 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:56.166206  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 512519us
I20260709 13:16:56.134984  8566 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:56.097254  8604 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:56.188422  5445 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:56.189855  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:56.191316  8687 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:16:56.147802  8672 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.048362  8781 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.186234  8676 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:56.210067  8676 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:56.210606  8676 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:56.212545  8768 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.464s	user 0.005s	sys 0.006s
I20260709 13:16:56.212841  8676 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:56.188454  8788 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:56.191463  8740 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:56.216506  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 472477us
I20260709 13:16:56.202786  8162 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:56.202728  8771 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.190539  8474 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.221284  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:56.225783  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:56.233001  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:56.234302  5339 leader_election.cc:400] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
W20260709 13:16:56.222405  8700 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.771s	user 0.014s	sys 0.000s
I20260709 13:16:56.234826  5339 leader_election.cc:403] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:56.164551  8775 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.221755  8740 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:56.218155  8788 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:56.242121  8771 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:56.260953  5371 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:56.253734  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:56.225069  8716 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:56.225145  8337 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:56.265630  5374 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:16:56.265713  5524 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:56.268479  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:56.270241  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:56.254992  5366 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:56.270879  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:56.279633  5442 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:56.244998  8781 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:56.288506  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.290082  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.290779  5371 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:56.291006  5366 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:56.297623  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.297683  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.298748  5368 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:56.299896  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.301931  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:56.265640  8724 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.267016  8474 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:56.247167  8700 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.268844  8779 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:16:56.265245  8788 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:56.350034  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.310271  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:56.309435  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1450) took 1211 ms. Trace:
W20260709 13:16:56.339098  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55816.1us
I20260709 13:16:56.321326  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:56.330412  5374 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:56.374336  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 177008us
W20260709 13:16:56.370142  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 246246us
I20260709 13:16:56.305385  8665 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:56.434235  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:56.331508  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:56.249712  8696 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.306211  8685 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.373829  8735 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:16:56.435154  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:56.309829  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:56.281069  8337 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.337451  8563 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:56.280372  8663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.011s	sys 0.010s
I20260709 13:16:56.431901  5366 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:56.462656  5516 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:56.305341  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:56.281152  8727 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.527428  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59859.6us
I20260709 13:16:56.531711  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:56.409215  5448 rpcz_store.cc:276] 0709 13:16:55.098007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.098238 (+   231us) service_pool.cc:224] Handling call
0709 13:16:55.098705 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.099000 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:56.200864 (+1101864us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b18003dac20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf
0709 13:16:56.201919 (+  1055us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.309003 (+107084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.309063 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:56.309119 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.309206 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.309349 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183042,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":2193,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10453,"spinlock_wait_cycles":13384448,"thread_start_us":252851,"threads_started":2}
I20260709 13:16:56.481142  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.491210  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.569911  5373 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:56.570165  5366 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
W20260709 13:16:56.478773  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43706.2us
I20260709 13:16:56.570912  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.571419  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:56.320842  8716 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:56.574901  5447 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:56.580453  5442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1429) took 1793 ms (client timeout 2145 ms). Trace:
I20260709 13:16:56.576383  5374 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:56.577560  5446 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:56.583070  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:56.580879  5442 rpcz_store.cc:269] 0709 13:16:54.787191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.803892 (+ 16701us) service_pool.cc:224] Handling call
0709 13:16:56.580256 (+1776364us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540007e9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:56.580392 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3223963392}
I20260709 13:16:56.481120  8675 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.591176  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:56.592182  8604 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:56.533815  8663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.016s	sys 0.020s
I20260709 13:16:56.477135  8696 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.545476  8566 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:56.583918  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:56.478579  8579 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:56.595312  8789 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 13:16:56.465747  8691 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.490016  8459 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:56.614678  5446 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.594646  5374 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:56.434746  8665 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:56.480949  8488 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:56.536585  8337 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.632450  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:56.686637  5441 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:56.614298  8566 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:56.602154  8781 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:56.647905  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.610306  8696 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.604877  8805 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:56.678084  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:56.609334  8702 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.593645  8675 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:56.687409  8791 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:16:56.747911  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.748766  5372 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:56.750660  5372 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:16:56.688256  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 254496us
I20260709 13:16:56.450888  8724 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:56.695752  8796 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 13:16:56.672379  8459 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:56.698748  8804 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:56.699246  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:56.699952  8691 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.700248  8800 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:16:56.700636  8693 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:56.701181  8685 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:56.802137  8685 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:56.703974  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:56.706154  8775 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.638216  8672 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.708663  8665 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:56.575420  8727 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.685773  8488 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.809787  8488 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.711930  8716 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.712224  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:56.810982  5374 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:56.714499  5441 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:56.716279  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:56.813385  5445 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:56.600775  8601 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:16:56.722118  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:56.724725  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.816782  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:56.817819  8665 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:56.818802  8665 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.733955  8700 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.734865  8813 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:56.690613  8762 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.076s	user 0.001s	sys 0.003s
I20260709 13:16:56.737824  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:56.740979  8656 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:56.741935  8566 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.726624  8805 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.743754  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:56.680455  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:56.761044  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:56.858528  5444 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:56.858649  5443 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:56.764082  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:56.830229  8672 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:56.493605  8563 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.743896  8557 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.785249  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:56.792392  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:56.767638  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.841s (SENT) [suppressed 2 similar messages]
I20260709 13:16:56.832197  8656 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:16:56.772193  8740 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.006s
I20260709 13:16:56.797781  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:56.795322  5259 catalog_manager.cc:5028] TS b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): tablet 7b301483f19c4d508e00d917819ac039 (table test-workload [id=54c067332db640d79c6a4737498b4456]) successfully deleted
I20260709 13:16:56.806617  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:56.820192  8665 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:56.872267  5259 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 80023.7us
I20260709 13:16:56.768776  5446 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:16:56.766422  8812 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:16:56.872932  8601 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:56.822064  8685 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:56.793947  5371 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:16:56.865119  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 72830.7us
I20260709 13:16:56.874719  8740 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.875413  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:56.876569  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:56.876900  8740 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.877552  5373 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:56.878695  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:56.863502  8771 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:16:56.869675  5442 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:56.821007  8693 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.813256  8691 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.872334  8665 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:56.792716  8801 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.873991  8601 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:56.844514  8459 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.831987  8702 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:16:56.870283  8566 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.880736  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:56.931985  8400 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:56.932142  8687 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:56.933346  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50456.1us
I20260709 13:16:56.937007  8812 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:56.944748  8796 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:16:56.870613  8557 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.933923  8567 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:56.941166  8601 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:56.935406  8563 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:56.952724  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:16:56.947522  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66862.8us
I20260709 13:16:56.978927  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:56.857969  8805 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:56.950186  8740 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:56.860941  8672 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.972784  8691 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:57.000624  8803 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:16:56.990787  8563 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:57.001437  8705 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:57.001111  8816 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:57.003170  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 270) took 1090 ms. Trace:
I20260709 13:16:56.943991  8801 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.006459  8557 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.006448  5524 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:16:57.028753  5375 rpcz_store.cc:276] 0709 13:16:55.912713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.912868 (+   155us) service_pool.cc:224] Handling call
0709 13:16:55.913296 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:55.923785 (+ 10489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.923833 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:55.924580 (+   747us) log.cc:844] Serialized 52 byte log entry
0709 13:16:56.226003 (+301423us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:56.250100 (+ 24097us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.250397 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.250496 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.002943 (+752447us) raft_consensus.cc:1685] finished
0709 13:16:57.002968 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.003106 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23830,"prepare.queue_time_us":24668,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":10973,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":15551,"thread_start_us":239937,"threads_started":1,"wal-append.queue_time_us":371060}
I20260709 13:16:56.870728  8664 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:56.945405  8685 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:16:56.967092  8665 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:56.881394  8679 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:57.016707  5369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.002s	sys 0.015s
I20260709 13:16:57.028678  8816 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:57.008980  8700 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.015014  8672 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:56.998461  8567 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:16:57.028370  8563 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.016196  8735 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.999981  8771 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.044854  8162 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:57.032418  8705 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:57.018303  8740 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:57.015606  8601 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.112673  8601 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.990711  8656 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.104712  8557 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.116981  8557 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.119787  8557 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.122042  8740 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.087514  8665 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:57.077369  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.061s
I20260709 13:16:57.018558  8724 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.031464  8675 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:57.081542  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 253038us
I20260709 13:16:57.074115  8812 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:57.082808  8817 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.225s	user 0.000s	sys 0.002s
I20260709 13:16:57.080837  8700 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:57.104555  8162 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:57.133358  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.006s	sys 0.061s
W20260709 13:16:57.174337  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 628669us
I20260709 13:16:57.180738  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.181715  5372 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:57.184247  5371 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:57.139591  5373 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:16:57.144064  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 376566us
I20260709 13:16:57.083770  8563 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.150727  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:57.190485  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:16:57.068722  5369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.002s	sys 0.015s
I20260709 13:16:57.191455  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:57.195225  5374 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:16:57.088460  8735 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.104000  8696 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.199115  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:57.152740  8812 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:57.213023  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:57.166023  8400 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.210223  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:57.210419  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:57.166023  8693 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.157370  8724 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.254979  5374 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.197679  8488 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.198652  8675 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:57.263656  5366 raft_consensus.cc:2368] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11.
I20260709 13:16:57.203707  8742 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.203928  8337 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.205124  8831 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.248637  8686 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:57.249177  8691 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.211370  8771 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:57.254258  8459 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.274242  8675 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.301270  5374 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:57.307816  8700 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:57.158811  8816 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.288506  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:57.298349  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 73500.3us
I20260709 13:16:57.377374  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:57.335014  8686 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:57.287225  8831 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.376322  5371 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:57.271723  8724 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.318372  8691 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.320497  8459 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.284148  8488 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.349473  8675 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.352494  8775 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.287106  8742 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.374454  8716 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.286604  8337 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.383350  8801 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:57.383661  8843 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.382887  8700 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.395413  8740 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.340123  8771 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:57.396298  8691 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.310225  8812 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:16:57.415092  8788 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.930s	user 0.011s	sys 0.002s
I20260709 13:16:57.394495  8831 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.403191  8459 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:57.470067  8838 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:16:57.472514  8337 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.474205  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:57.452689  8788 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.475935  8771 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:57.476910  8820 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:16:57.477782  8788 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:57.478340  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1692) took 1202 ms. Trace:
I20260709 13:16:57.443954  8740 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.478722  5522 rpcz_store.cc:276] 0709 13:16:56.276459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.276790 (+   331us) service_pool.cc:224] Handling call
0709 13:16:56.310763 (+ 33973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.479608 (+168845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.479653 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.482961 (+  3308us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.983324 (+500363us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.983363 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.983432 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.478034 (+494602us) raft_consensus.cc:1685] finished
0709 13:16:57.478054 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.478267 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":231025,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"thread_start_us":594361,"threads_started":2,"wal-append.queue_time_us":547193}
I20260709 13:16:57.480823  8740 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.435662  8781 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:57.481828  8819 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:16:57.482172  8705 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.482551  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:57.483098  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1449) took 1127 ms. Trace:
I20260709 13:16:57.484185  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:57.418936  8775 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:57.486261  8830 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.486675  8830 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:16:57.487103  8474 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.084s	user 0.013s	sys 0.000s
I20260709 13:16:57.487437  8775 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:57.487811  8671 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:57.488099  8474 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:16:57.440783  8700 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.488756  8671 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:57.437935  8843 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.489981  8671 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.490384  8671 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:57.490751  8671 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.493207  8664 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:57.493641  8664 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:57.494110  8742 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.494480  8664 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.495734  8664 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.497664  8676 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:57.498064  8676 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:57.498338  8557 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:57.498862  8676 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.500339  8676 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.481841  8781 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.504501  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:16:57.506346  8829 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:57.507834  8765 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.508391  8765 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.509588  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:57.510588  8765 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:57.487056  8830 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.511503  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:57.511771  8814 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.800s	user 0.000s	sys 0.012s
I20260709 13:16:57.512977  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1435) took 1275 ms. Trace:
I20260709 13:16:57.430074  8716 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.513325  5367 rpcz_store.cc:276] 0709 13:16:56.237722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.238329 (+   607us) service_pool.cc:224] Handling call
0709 13:16:56.265675 (+ 27346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.273880 (+  8205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.273928 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.307405 (+ 33477us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.663052 (+355647us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:56.663113 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.663260 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.511152 (+847892us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:57.512672 (+  1520us) raft_consensus.cc:1685] finished
0709 13:16:57.512699 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.512915 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14383,"raft.queue_time_us":17631,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1715,"spinlock_wait_cycles":11678464,"thread_start_us":289482,"threads_started":1,"wal-append.queue_time_us":382095}
I20260709 13:16:57.515793  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.516379  5367 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
W20260709 13:16:57.458201  8826 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 13:16:57.460743  8693 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.463119  8818 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:57.463697  8702 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.465634  8836 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:16:57.476763  8771 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.483199  8812 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.453864  8488 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:57.459779  8835 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:16:57.552862  8727 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.544099  8702 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:57.554401  5372 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:57.555471  8702 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:16:57.524972  8788 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:57.557538  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1697) took 1256 ms. Trace:
I20260709 13:16:57.483810  5368 rpcz_store.cc:276] 0709 13:16:56.356177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.356369 (+   192us) service_pool.cc:224] Handling call
0709 13:16:56.356867 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.357266 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.357308 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.375704 (+ 18396us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.977552 (+601848us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.977594 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.977658 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.482817 (+505159us) raft_consensus.cc:1685] finished
0709 13:16:57.482848 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.483021 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15670,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":26001,"thread_start_us":441446,"threads_started":1,"wal-append.queue_time_us":646004}
I20260709 13:16:57.557729  8788 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.557967  5517 rpcz_store.cc:276] 0709 13:16:56.301155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.305803 (+  4648us) service_pool.cc:224] Handling call
0709 13:16:56.306107 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.600153 (+294046us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:56.979965 (+379812us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.157049 (+177084us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:57.157573 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.158645 (+  1072us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.158680 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.158752 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.557261 (+398509us) raft_consensus.cc:1685] finished
0709 13:16:57.557286 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.557476 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23171,"prepare.queue_time_us":210975,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":235650,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":9298,"thread_start_us":787156,"threads_started":3,"wal-append.queue_time_us":260039}
I20260709 13:16:57.559947  8788 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:57.548105  8771 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.566411  8488 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.567168  8735 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.567047  8488 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.568199  8700 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:57.566478  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.521612  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.520004  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:57.572008  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 194754us
I20260709 13:16:57.572312  5374 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:16:57.525520  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:57.533548  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.533674  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.535674  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.535755  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:57.532467  8693 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.498764  8724 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.588263  5369 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
W20260709 13:16:57.589210  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.589809  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.450640  8816 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.544540  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.546130  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.510705  8776 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:57.504565  8781 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.516453  8716 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.531502  8818 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:57.525485  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:16:57.576757  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.579315  5374 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: [10.4-10.4]
W20260709 13:16:57.601574  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83887.4us
I20260709 13:16:57.569240  8488 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.594679  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 257) took 1093 ms. Trace:
W20260709 13:16:57.611153  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 91236.4us
I20260709 13:16:57.600175  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.612932  5522 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:57.584307  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:57.614403  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:57.611678  5449 rpcz_store.cc:276] 0709 13:16:56.501311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.501535 (+   224us) service_pool.cc:224] Handling call
0709 13:16:56.574722 (+ 73187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.717921 (+143199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.717974 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.718030 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:56.718072 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.594367 (+876295us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54003bc254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:57.594431 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.594603 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328425216}
I20260709 13:16:57.575167  8847 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.620843  5374 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:57.618429  5518 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:57.613152  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:57.575309  8771 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.619841  5517 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:16:57.627097  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.628624  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:57.590770  8693 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.622152  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.598194  8776 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:57.630936  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.633453  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.635910  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.635902  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:57.635816  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:57.638702  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:57.616457  8705 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.640990  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.619459  8566 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:57.546788  8686 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.637691  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.646633  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1450) took 1290 ms. Trace:
I20260709 13:16:57.595721  8702 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:16:57.631376  8672 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.004s
I20260709 13:16:57.657032  5366 rpcz_store.cc:276] 0709 13:16:56.356594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.571134 (+214540us) service_pool.cc:224] Handling call
0709 13:16:57.646330 (+1075196us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400034dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:57.646525 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589654784}
I20260709 13:16:57.681938  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:57.688829  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.690122  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.694152  5517 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:57.697086  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.697748  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.697962  5517 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
W20260709 13:16:57.698705  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 85644.6us
I20260709 13:16:57.636492  8851 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.731652  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.625710  8801 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:16:57.643435  8843 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.707522  5446 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: [10.5-11.6]
I20260709 13:16:57.740200  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:57.741251  5444 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:57.741293  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:57.642966  8807 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:57.628811  8847 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.708846  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:57.748685  5445 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.709522  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:57.680099  8811 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.944s	user 0.011s	sys 0.007s
I20260709 13:16:57.643255  8705 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:57.707793  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:57.752760  5449 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:57.699100  8566 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:57.713500  5450 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:57.758708  5446 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:57.705312  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69500.1us
I20260709 13:16:57.736403  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:57.680075  8771 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.763988  5448 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:57.766786  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.767702  8843 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:57.732616  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:57.768064  8665 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:57.768270  8843 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:16:57.768668  8665 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.770955  8665 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:57.774470  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.732882  8567 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.777082  8567 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.777493  8567 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.777932  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.778805  5367 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:16:57.781198  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.761348  8705 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.783057  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1696) took 1482 ms. Trace:
I20260709 13:16:57.783480  5519 rpcz_store.cc:276] 0709 13:16:56.300735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.302692 (+  1957us) service_pool.cc:224] Handling call
0709 13:16:56.303162 (+   470us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:56.303616 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.303656 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:56.304427 (+   771us) log.cc:844] Serialized 52 byte log entry
0709 13:16:56.434807 (+130380us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:56.434855 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.434928 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.457209 (+1022281us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:16:57.782726 (+325517us) raft_consensus.cc:1685] finished
0709 13:16:57.782750 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.782998 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":238183,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":36026752,"thread_start_us":129928,"threads_started":1,"wal-append.queue_time_us":321511}
W20260709 13:16:57.745700  8796 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:57.708112  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:57.806582  5443 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.687841  8727 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:57.713017  8851 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.831656  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:57.790380  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.730197  8679 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.735193  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:57.833452  5519 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:16:57.815425  5445 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:57.835621  5443 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
W20260709 13:16:57.836850  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 102072us
I20260709 13:16:57.732837  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:57.695112  8672 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:57.854544  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.818454  5372 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:16:57.843545  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 190838us
I20260709 13:16:57.855649  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.769239  8843 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.788968  8675 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.865434  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.869673  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:57.761037  8852 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.730521  8671 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.882624  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:57.869738  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:57.877955  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:57.834820  8851 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.811532  8771 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:57.884644  8805 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.883s	user 0.000s	sys 0.013s
I20260709 13:16:58.231858  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:57.831245  8459 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.836047  8727 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.276755  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 1942) took 1086 ms. Trace:
I20260709 13:16:58.277434  5369 rpcz_store.cc:276] 0709 13:16:57.190161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.198757 (+  8596us) service_pool.cc:224] Handling call
0709 13:16:58.276508 (+1077751us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400331654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:58.276667 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649801984}
I20260709 13:16:57.867787  8679 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.897258  8852 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:57.852778  8740 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:58.159152  8781 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:58.161939  8831 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.709s	user 0.015s	sys 0.002s
I20260709 13:16:57.896833  8337 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.139s
W20260709 13:16:58.163158  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.162803  8705 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:58.163436  8675 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:58.163654  8850 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.471s	user 0.010s	sys 0.012s
I20260709 13:16:58.227948  8665 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:57.865373  8724 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:58.164629  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 282065us
I20260709 13:16:58.362443  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:58.022401  8566 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.165282  5444 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:58.168072  5519 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:16:58.169808  5441 raft_consensus.cc:2368] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
W20260709 13:16:58.173729  5368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.007s	sys 0.005s
W20260709 13:16:58.365181  5368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.007s	sys 0.005s
I20260709 13:16:58.365931  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1949) took 1083 ms. Trace:
I20260709 13:16:58.366328  5368 rpcz_store.cc:276] 0709 13:16:57.285609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.558353 (+272744us) service_pool.cc:224] Handling call
0709 13:16:57.558657 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.576685 (+ 18028us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:57.587381 (+ 10696us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.365598 (+778217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.365650 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:58.365689 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.365763 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.365880 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21073,"prepare.queue_time_us":955,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":16274,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":19728,"thread_start_us":777797,"threads_started":1}
W20260709 13:16:58.211853  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.367713  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:58.368137  8816 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.765s	user 0.015s	sys 0.021s
I20260709 13:16:58.369065  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.282054  8805 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.369689  5519 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:16:58.233451  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.370433  8865 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.370623  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.306632  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:58.339188  8812 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.370914  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:58.227710  8854 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.484s	user 0.000s	sys 0.006s
W20260709 13:16:58.251246  8563 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.053s	user 0.008s	sys 0.008s
I20260709 13:16:58.372043  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:58.372150  8563 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.373847  8459 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.374475  8563 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.178040  8488 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.375208  8488 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:58.249747  5373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.011s	sys 0.049s
I20260709 13:16:58.375671  8488 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:58.375869  5373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.011s	sys 0.049s
W20260709 13:16:58.376451  8691 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.924s	user 0.007s	sys 0.005s
W20260709 13:16:58.250826  8676 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.750s	user 0.013s	sys 0.004s
I20260709 13:16:58.377533  6070 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:16:58.339385  5445 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:58.378149  5524 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:16:58.215121  8848 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.744779  8776 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.356662  8781 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:58.378794  5375 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:58.252900  8702 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:58.375684  5516 raft_consensus.cc:2368] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:16:58.379472  8702 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.371372  8812 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.381313  5519 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:58.383060  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:58.383409  5489 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c06ab136607a405bbdfe9d04f533a566. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:58.364647  8665 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.390822  5519 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 3.
W20260709 13:16:58.391794  8567 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.001s
I20260709 13:16:58.392292  8665 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.392791  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:58.379284  8781 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.361308  8675 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.393838  8663 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.394130  8675 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.394311  8663 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:58.395018  8663 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.395088  8781 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.330778  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:58.370690  8775 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.381336  8771 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.383343  8727 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.396534  8771 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.396636  8675 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.374470  8459 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:58.397055  8771 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.395326  8488 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.385454  8671 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:58.317111  8740 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.384087  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1950) took 1085 ms. Trace:
I20260709 13:16:58.399576  5370 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 2.
I20260709 13:16:58.400061  8853 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:58.400656  8853 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:58.401540  8740 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.399931  5373 rpcz_store.cc:276] 0709 13:16:57.299241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.568177 (+268936us) service_pool.cc:224] Handling call
0709 13:16:57.568549 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.568754 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:57.569078 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.376989 (+807911us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.377180 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.377222 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:58.377264 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.377332 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.384021 (+  6689us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"prepare.queue_time_us":1065,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":6227,"raft.queue_time_us":2227,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":807255,"threads_started":1}
I20260709 13:16:58.376897  8691 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.373179  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.402556  5450 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.402693  5443 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:58.387729  8672 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.403761  8860 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.399401  8771 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.378727  8848 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.404194  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:58.404371  8860 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.392928  8665 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.406119  8848 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.405992  8665 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.366086  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:58.406698  8860 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.384673  8858 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:16:58.385102  8855 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.505s	user 0.000s	sys 0.021s
I20260709 13:16:58.381699  8702 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.398065  8459 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.403774  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.417519  5443 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:58.418784  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.419608  5443 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:58.420849  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.389441  8705 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:58.427341  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.002s	sys 0.014s
W20260709 13:16:58.428723  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.002s	sys 0.015s
W20260709 13:16:58.429680  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 729546us
I20260709 13:16:58.392396  8567 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.410583  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:58.391794  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.404433  8691 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.411404  8740 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.422283  5443 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:58.424341  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:16:58.461655  5373 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:58.324930  8831 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.449890  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.466938  5447 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:16:58.468178  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:58.469028  5447 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.454849  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.364416  8724 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.457850  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:58.448376  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:16:58.407389  8735 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.471218  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:58.474960  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.475147  5521 raft_consensus.cc:2368] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:16:58.476257  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.412317  8853 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:58.447741  8563 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.487363  5443 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:58.495193  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.499652  5447 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:16:58.500948  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:58.477100  8830 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.966s	user 0.012s	sys 0.003s
I20260709 13:16:58.424384  8671 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:16:58.414361  8865 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.476207  8724 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.424129  8858 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:58.481554  8735 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.481359  8740 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:58.558570  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.505292  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.559634  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:16:58.583971  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.586584  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.587038  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.583976  5447 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
W20260709 13:16:58.587555  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.511885  5443 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:58.585346  5373 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:58.587966  5444 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:58.589987  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:58.497932  8853 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:58.560905  8665 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.562026  8812 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:58.594111  8604 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:58.566238  8866 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:58.597087  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:58.516039  8693 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.877s	user 0.012s	sys 0.002s
I20260709 13:16:58.603366  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.610052  5447 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:58.606985  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:58.506603  8337 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.561681  8459 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.591837  8740 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.497320  8563 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.593405  8702 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.505506  8847 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.619939  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.621269  5447 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:58.591988  8870 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.636433  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.630101  8604 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:58.630141  8665 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.557934  8830 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.562515  8864 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:16:58.620849  8812 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.635030  8740 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.667366  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:58.668314  5446 raft_consensus.cc:2376] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12. Re-sending same reply.
I20260709 13:16:58.656665  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.674547  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.607199  8853 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:58.599474  8874 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:16:58.643277  8679 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:58.682037  5446 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:16:58.683451  5520 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:58.647171  8488 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.623728  8693 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.694831  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:58.653321  8691 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.631611  8337 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.641068  8702 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.699080  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.663348  8852 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.713055  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:58.708886  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:16:58.714128  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 256377us
I20260709 13:16:58.722198  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.696475  8874 consensus_queue.cc:1243] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 10.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:16:58.725906  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 271119us
I20260709 13:16:58.726914  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:58.727070  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:58.729737  5448 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:58.731669  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:58.733290  5518 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:58.734615  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.712679  8604 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:58.737649  8873 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:16:58.738490  8867 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:16:58.738580  8686 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.739136  8686 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.739492  8686 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.740398  8853 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:58.741580  8879 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.699206  8459 raft_consensus.cc:2764] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:16:58.754748  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:58.757681  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.753875  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:58.742399  8879 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.718176  8860 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.723596  8567 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:58.769593  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.745360  8488 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:58.748216  8685 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.772056  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.749680  8679 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.784412  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.774320  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:58.781031  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.785964  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:58.786303  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1524) took 1101 ms. Trace:
I20260709 13:16:58.762075  8852 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.770263  8864 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.768399  8879 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.807386  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.772609  8881 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.814102  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:58.810297  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.781483  8601 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:58.815891  5443 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:58.793709  8860 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.814167  8847 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.827469  5416 leader_election.cc:400] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11.
I20260709 13:16:58.794456  8852 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:58.868738  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:58.829523  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:58.869194  5443 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:58.869907  5444 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:58.831154  8693 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.784632  8488 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.832613  8830 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:58.793251  8877 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.783622  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:58.843638  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:16:58.824960  8696 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.839821  5446 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 3.
I20260709 13:16:58.792371  5518 rpcz_store.cc:276] 0709 13:16:57.684766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.769186 (+1084420us) service_pool.cc:224] Handling call
0709 13:16:58.786215 (+ 17029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.789320  8880 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:58.871551  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:58.832239  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1707) took 1299 ms. Trace:
I20260709 13:16:58.838920  8887 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:58.886366  5520 rpcz_store.cc:276] 0709 13:16:57.533147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.533296 (+   149us) service_pool.cc:224] Handling call
0709 13:16:58.831966 (+1298670us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400165dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:58.832124 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2549778304}
I20260709 13:16:58.891140  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:58.891189  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:58.820223  8864 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:58.858284  8781 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.872876  8852 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.869586  8858 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:16:58.887889  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 135545us
I20260709 13:16:58.870219  8860 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.860520  8865 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:58.873198  8685 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:58.893842  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 101403us
I20260709 13:16:58.876549  8877 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.873292  8847 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:16:58.895416  8888 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:16:58.896361  8781 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.899989  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.891004  8601 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:58.900801  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.897856  8864 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.902659  5446 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:58.911722  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1717) took 1027 ms. Trace:
I20260709 13:16:58.894498  8696 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.921336  5518 rpcz_store.cc:276] 0709 13:16:57.883971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.900486 (+1016515us) service_pool.cc:224] Handling call
0709 13:16:58.911664 (+ 11178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.896697  8880 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:58.856226  8881 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.921866  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:16:58.925724  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.906381  8847 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.927435  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.901859  8860 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:58.897989  8779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.014s	sys 0.033s
W20260709 13:16:58.934602  8876 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:16:58.934361  8779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.015s	sys 0.034s
W20260709 13:16:58.937635  8884 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:16:58.905189  8875 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:58.898736  8693 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.905786  8874 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:58.904966  8563 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.931044  5518 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:58.945897  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1534) took 1184 ms. Trace:
I20260709 13:16:58.946252  5518 rpcz_store.cc:276] 0709 13:16:57.761806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.927168 (+1165362us) service_pool.cc:224] Handling call
0709 13:16:58.945833 (+ 18665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.931504  8474 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.895846  8663 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:58.910826  8781 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.903645  8877 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.922408  8675 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:58.898662  8567 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:16:58.943338  8875 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.950197  8830 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:16:58.951575  8162 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:58.938930  8843 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.954886  8886 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:58.944782  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.957099  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.959450  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.960739  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.896504  8887 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.994927  5523 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:58.962886  5519 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:58.963347  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1469) took 1057 ms. Trace:
I20260709 13:16:58.928624  8601 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:16:58.924996  8696 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.961992  8880 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:58.993806  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49107.8us
I20260709 13:16:58.983645  8899 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.976955  8675 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.998186  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.038776  5523 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:16:58.989660  8679 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.975706  8865 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:58.963479  8474 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:58.981722  8893 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.998817  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1525) took 1313 ms. Trace:
I20260709 13:16:59.066514  5518 rpcz_store.cc:276] 0709 13:16:57.685001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.956828 (+1271827us) service_pool.cc:224] Handling call
0709 13:16:58.998748 (+ 41920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.067575  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.068229  5518 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:59.068831  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1535) took 1233 ms. Trace:
I20260709 13:16:59.069199  5518 rpcz_store.cc:276] 0709 13:16:57.835839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.067281 (+1231442us) service_pool.cc:224] Handling call
0709 13:16:59.068761 (+  1480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.070254  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:58.995708  5367 rpcz_store.cc:276] 0709 13:16:57.906364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.166402 (+260038us) service_pool.cc:224] Handling call
0709 13:16:58.166855 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.510180 (+343325us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:58.510235 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.575961 (+ 65726us) log.cc:844] Serialized 26 byte log entry
0709 13:16:58.838431 (+262470us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:58.838475 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.838559 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.963118 (+124559us) raft_consensus.cc:1685] finished
0709 13:16:58.963140 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.963289 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92835,"raft.queue_time_us":182098,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7998,"thread_start_us":415286,"threads_started":2,"wal-append.queue_time_us":361105}
I20260709 13:16:59.027604  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:58.999552  8337 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:58.980803  8685 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.991495  8702 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.043079  8679 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:59.065790  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 133022us
I20260709 13:16:59.041260  8675 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.020480  8459 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:59.039530  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1508) took 1415 ms. Trace:
I20260709 13:16:59.074438  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1713) took 1219 ms. Trace:
I20260709 13:16:59.075904  8474 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.989255  8843 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:58.990016  8830 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:59.094964  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.996438  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:16:59.095049  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:59.100030  5518 rpcz_store.cc:276] 0709 13:16:57.855183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.070007 (+1214824us) service_pool.cc:224] Handling call
0709 13:16:59.074372 (+  4365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:58.992440  8604 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:16:59.099139  5523 rpcz_store.cc:276] 0709 13:16:57.624319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.997852 (+1373533us) service_pool.cc:224] Handling call
0709 13:16:59.039446 (+ 41594us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:59.113078  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.114526  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 86997.7us
W20260709 13:16:59.115629  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.115866  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:59.117777  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.103228  8459 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:59.066920  8899 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.094244  8665 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:59.118003  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.118882  5523 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.131933  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:59.115514  8894 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:16:59.137737  8914 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.138409  8914 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.138816  8879 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.140094  8831 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.140748  8914 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.129143  8459 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:59.142441  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.111177  8663 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:59.075253  8865 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.126243  8875 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.094725  8685 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.132772  5518 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:16:59.128795  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 141893us
I20260709 13:16:59.083823  8893 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.130579  8898 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:59.140769  8879 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.172911  8685 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.164837  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.173746  8893 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.177944  8909 ts_tablet_manager.cc:933] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.132750  8665 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.216943  5523 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:59.275116  5518 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 3: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:16:59.278740  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.279541  5518 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:59.280179  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1722) took 1118 ms. Trace:
I20260709 13:16:59.280551  5518 rpcz_store.cc:276] 0709 13:16:58.161598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.278410 (+1116812us) service_pool.cc:224] Handling call
0709 13:16:59.280109 (+  1699us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.281925  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.283736  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1720) took 1122 ms. Trace:
I20260709 13:16:59.285112  5518 rpcz_store.cc:276] 0709 13:16:58.160931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.281373 (+1120442us) service_pool.cc:224] Handling call
0709 13:16:59.283671 (+  2298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.287156  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.290782  5518 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:16:59.291967  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1716) took 1421 ms. Trace:
I20260709 13:16:59.150710  8881 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.296208  8665 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:59.319739  5518 rpcz_store.cc:276] 0709 13:16:57.870781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.286803 (+1416022us) service_pool.cc:224] Handling call
0709 13:16:59.291892 (+  5089us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:59.299388  8906 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:16:59.247053  8898 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:16:59.297674  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.337415  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1518) took 1703 ms. Trace:
I20260709 13:16:59.114717  8601 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.321202  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.345271  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1719) took 1184 ms. Trace:
I20260709 13:16:59.345958  5518 rpcz_store.cc:276] 0709 13:16:58.160585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.320916 (+1160331us) service_pool.cc:224] Handling call
0709 13:16:59.345202 (+ 24286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.306850  8893 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:59.347160  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.295985  8830 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.339478  5523 rpcz_store.cc:276] 0709 13:16:57.634166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.297315 (+1663149us) service_pool.cc:224] Handling call
0709 13:16:59.337329 (+ 40014us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.349445  5518 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:59.358158  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.360348  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.361409  5518 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:16:59.362866  5523 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:16:59.371171  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1507) took 1747 ms. Trace:
I20260709 13:16:59.382441  8887 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.372232  5518 rpcz_store.cc:276] 0709 13:16:57.624014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.359997 (+1735983us) service_pool.cc:224] Handling call
0709 13:16:59.371063 (+ 11066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.387717  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.385911  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.392479  5523 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:59.394341  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1714) took 1538 ms. Trace:
I20260709 13:16:59.394785  5523 rpcz_store.cc:276] 0709 13:16:57.855681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.372287 (+1516606us) service_pool.cc:224] Handling call
0709 13:16:59.394142 (+ 21855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.402424  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:16:59.403067  5523 raft_consensus.cc:606] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:16:59.403352  5523 raft_consensus.cc:614] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.366606  8914 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:59.407198  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51720 (request call id 50) took 1102 ms. Trace:
I20260709 13:16:59.410780  8656 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.396180  8400 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:59.414045  8400 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.414335  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.414983  5517 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:16:59.415987  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.416177  8400 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.416564  5517 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
W20260709 13:16:59.418543  8839 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.997s	user 0.011s	sys 0.011s
I20260709 13:16:59.421860  8735 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.425540  8898 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.427150  8898 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.428635  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 1936) took 2250 ms. Trace:
W20260709 13:16:59.435976  8740 consensus_meta.cc:287] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.753s	user 0.008s	sys 0.004s
I20260709 13:16:59.436465  8740 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:59.437544  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:16:59.438722  8724 consensus_meta.cc:287] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.836s	user 0.007s	sys 0.006s
I20260709 13:16:59.439142  8724 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:16:59.354998  8893 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.443204  8893 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.443387  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.444551  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.447616  8893 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.448347  8893 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.451526  8488 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.451591  8893 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:16:59.455122  8869 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.811s	user 0.007s	sys 0.000s
W20260709 13:16:59.456712  5519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1530) took 1770 ms (client timeout 2043 ms). Trace:
W20260709 13:16:59.457165  5519 rpcz_store.cc:269] 0709 13:16:57.686235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.391504 (+705269us) service_pool.cc:224] Handling call
0709 13:16:59.456433 (+1064929us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b540025c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.456619 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171671424}
W20260709 13:16:59.458281  8905 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:59.458380  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.459755  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1483) took 1047 ms. Trace:
I20260709 13:16:59.385636  8696 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:59.441294  5524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1702) took 1932 ms (client timeout 1622 ms). Trace:
I20260709 13:16:59.460280  5444 rpcz_store.cc:276] 0709 13:16:58.412066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.878923 (+466857us) service_pool.cc:224] Handling call
0709 13:16:58.896976 (+ 18053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.897379 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.897475 (+    96us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.902072 (+  4597us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.117219 (+215147us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:59.117275 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.120631 (+  3356us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.459437 (+338806us) raft_consensus.cc:1685] finished
0709 13:16:59.459470 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.459678 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":214,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4607,"thread_start_us":189935,"threads_started":1,"wal-append.queue_time_us":440441}
W20260709 13:16:59.462888  5524 rpcz_store.cc:269] 0709 13:16:57.508632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.521117 (+ 12485us) service_pool.cc:224] Handling call
0709 13:16:59.441087 (+1919970us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b5400369554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.441225 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848191232}
I20260709 13:16:59.429100  5375 rpcz_store.cc:276] 0709 13:16:57.178439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.182871 (+  4432us) service_pool.cc:224] Handling call
0709 13:16:57.183328 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.379313 (+1195985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.428307 (+1048994us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400051ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:59.428540 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2748681600}
I20260709 13:16:59.467854  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.470027  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.459846  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.471045  5519 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:16:59.470981  5524 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:16:59.441294  8724 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.479035  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.478209  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:59.478166  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:59.467923  8843 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.474841  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.486747  5447 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:59.487280  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.481043  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.408571  5523 rpcz_store.cc:276] 0709 13:16:58.301258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.400193 (+1098935us) service_pool.cc:224] Handling call
0709 13:16:59.403677 (+  3484us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:59.491930  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.493687  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.494880  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.495558  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.462354  8914 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.499406  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:16:59.497737  8877 consensus_meta.cc:287] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
I20260709 13:16:59.500267  8899 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.500495  8917 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.472848  8459 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.500492  5517 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:16:59.501077  8851 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.220s	user 0.006s	sys 0.009s
W20260709 13:16:59.518620  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66545.9us
I20260709 13:16:59.492766  8865 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.643352  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.646288  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.650527  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.651693  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.651839  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1882) took 1420 ms. Trace:
I20260709 13:16:59.652376  5445 rpcz_store.cc:276] 0709 13:16:58.231736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.231877 (+   141us) service_pool.cc:224] Handling call
0709 13:16:58.232198 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.378222 (+146024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.651497 (+1273275us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540007f3d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:59.651756 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246036224}
I20260709 13:16:59.654105  5519 raft_consensus.cc:2410] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:59.481065  8675 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.655462  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.662345  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.661499  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.679275  5445 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:59.508322  8909 tablet_copy_client.cc:323] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.131:36363
I20260709 13:16:59.643740  8851 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.649999  8567 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.694023  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:59.727548  5444 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.715910  5523 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:59.740693  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1504) took 2119 ms. Trace:
I20260709 13:16:59.741268  5523 rpcz_store.cc:276] 0709 13:16:57.621202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.661143 (+2039941us) service_pool.cc:224] Handling call
0709 13:16:59.715664 (+ 54521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.740141 (+ 24477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.740616 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:59.698611  8686 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.959s	user 0.015s	sys 0.000s
W20260709 13:16:59.684103  8864 consensus_meta.cc:287] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.744s	user 0.013s	sys 0.000s
I20260709 13:16:59.521297  8877 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.717473  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:16:59.745414  5518 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:59.749143  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:16:59.718120  8474 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.006s
I20260709 13:16:59.750489  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.751713  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1877) took 2020 ms. Trace:
I20260709 13:16:59.717893  8831 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.752166  5450 rpcz_store.cc:276] 0709 13:16:57.730804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.759179 (+ 28375us) service_pool.cc:224] Handling call
0709 13:16:57.759559 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.402977 (+643418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.751459 (+1348482us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b540029dbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:59.751647 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478270848}
I20260709 13:16:59.755851  5449 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.754814  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.756538  5445 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:16:59.727440  8740 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:59.760107  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.762394  8675 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.758039  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.758737  5523 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:59.526310  8917 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.765250  5445 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:16:59.765241  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1513) took 2133 ms. Trace:
W20260709 13:16:59.758117  8919 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:16:59.766625  5523 rpcz_store.cc:276] 0709 13:16:57.631990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.748362 (+2116372us) service_pool.cc:224] Handling call
0709 13:16:59.758468 (+ 10106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.764962 (+  6494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.765182 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.767531  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.769033  5445 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:16:59.771845  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:16:59.772778  5444 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
W20260709 13:16:59.774181  8781 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.000s
I20260709 13:16:59.774484  5445 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.774614  8781 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.776715  8781 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.777333  8459 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.748142  8665 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.778312  8671 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.778882  8671 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.779772  8665 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.780609  5450 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 4: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:16:59.780826  8805 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.783237  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1728) took 1367 ms. Trace:
I20260709 13:16:59.783690  5518 rpcz_store.cc:276] 0709 13:16:58.415428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.385604 (+970176us) service_pool.cc:224] Handling call
0709 13:16:59.783021 (+397417us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400378cd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.783173 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810417536}
I20260709 13:16:59.783759  8705 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:59.788475  8877 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:59.795614  8847 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.855s	user 0.012s	sys 0.000s
I20260709 13:16:59.796169  8847 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.800079  8914 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.747016  8567 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.747709  8686 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.800745  8917 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.756682  8474 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:16:59.798609  8852 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.893s	user 0.010s	sys 0.003s
I20260709 13:16:59.747529  8864 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:59.839710  5444 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.816123  8852 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:59.817364  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1866) took 2111 ms. Trace:
I20260709 13:16:59.841776  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1876) took 2111 ms. Trace:
I20260709 13:16:59.842175  5449 rpcz_store.cc:276] 0709 13:16:57.730525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.753902 (+ 23377us) service_pool.cc:224] Handling call
0709 13:16:57.754318 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.756279 (+2001961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.841523 (+ 85244us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540028c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:59.841715 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4602599808}
I20260709 13:16:59.841712  5442 rpcz_store.cc:276] 0709 13:16:57.705813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.705929 (+   116us) service_pool.cc:224] Handling call
0709 13:16:57.706206 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:57.755415 (+ 49209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.755446 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.503438 (+1747992us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b2c0003b228. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:16:59.503920 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.716706 (+212786us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:59.716770 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.717117 (+   347us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.816686 (+ 99569us) raft_consensus.cc:1685] finished
0709 13:16:59.816724 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.817131 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13296,"raft.queue_time_us":37458,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":4633984,"thread_start_us":212342,"threads_started":1,"wal-append.queue_time_us":299755}
W20260709 13:16:59.824540  6070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 118) took 2144 ms (client timeout 1671 ms). Trace:
W20260709 13:16:59.843983  5516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1704) took 2334 ms (client timeout 2156 ms). Trace:
W20260709 13:16:59.843752  6070 rpcz_store.cc:269] 0709 13:16:57.680154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.687583 (+  7429us) service_pool.cc:224] Handling call
0709 13:16:59.824200 (+2136617us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54005f23d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.824400 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1371894144}
W20260709 13:16:59.844516  5516 rpcz_store.cc:269] 0709 13:16:57.509175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.509288 (+   113us) service_pool.cc:224] Handling call
0709 13:16:59.843751 (+2334463us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54001649d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.843887 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990009728}
W20260709 13:16:59.844830  5372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1463) took 2070 ms (client timeout 1953 ms). Trace:
I20260709 13:16:59.829546  8679 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.845204  8686 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.846243  5516 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:59.847103  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1711) took 1992 ms. Trace:
I20260709 13:16:59.847508  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1883) took 1615 ms. Trace:
I20260709 13:16:59.847849  5445 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:59.845261  5372 rpcz_store.cc:269] 0709 13:16:57.774050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.774211 (+   161us) service_pool.cc:224] Handling call
0709 13:16:59.844646 (+2070435us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b54001851d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.844763 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98882432}
I20260709 13:16:59.843766  8852 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:59.847914  5448 rpcz_store.cc:276] 0709 13:16:58.232057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.232408 (+   351us) service_pool.cc:224] Handling call
0709 13:16:58.232686 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.730341 (+497655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.847251 (+1116910us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54003bd154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:16:59.847447 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142582016}
W20260709 13:16:59.858451  5370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1468) took 1981 ms (client timeout 1995 ms). Trace:
W20260709 13:16:59.859020  5370 rpcz_store.cc:269] 0709 13:16:57.877349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.877581 (+   232us) service_pool.cc:224] Handling call
0709 13:16:59.858227 (+1980646us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540009d8d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.858371 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553093376}
I20260709 13:16:59.860025  5449 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.860461  5442 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:59.847514  5516 rpcz_store.cc:276] 0709 13:16:57.854467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.845309 (+1990842us) service_pool.cc:224] Handling call
0709 13:16:59.845719 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.846769 (+  1050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.847030 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.863334  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 222) took 1998 ms. Trace:
W20260709 13:16:59.864069  5414 leader_election.cc:336] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.841s (SENT)
I20260709 13:16:59.863667  5516 rpcz_store.cc:276] 0709 13:16:57.865294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.862674 (+1997380us) service_pool.cc:224] Handling call
0709 13:16:59.862928 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.863071 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.863093 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.863129 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:59.863155 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.863200 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.863283 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.830876  8567 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.832398  8851 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:16:59.832858  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1504) took 1172 ms. Trace:
I20260709 13:16:59.836709  8474 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:59.838419  8831 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:59.838636  8847 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:16:59.830706  5441 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1872) took 2122 ms (client timeout 2120 ms). Trace:
I20260709 13:16:59.882331  5446 rpcz_store.cc:276] 0709 13:16:58.660042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.923219 (+263177us) service_pool.cc:224] Handling call
0709 13:16:58.923607 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:58.932571 (+  8964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.932603 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:58.941202 (+  8599us) log.cc:844] Serialized 52 byte log entry
0709 13:16:59.079286 (+138084us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:59.103686 (+ 24400us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.805832 (+702146us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b18000cc040. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:16:59.832038 (+ 26206us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b18000cc040. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:16:59.832281 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.832528 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.832610 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.832657 (+    47us) raft_consensus.cc:1685] finished
0709 13:16:59.832667 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.832801 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":726590,"prepare.queue_time_us":763666,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":77,"raft.queue_time_us":24089,"raft.run_cpu_time_us":500,"raft.run_wall_time_us":6582,"spinlock_wait_cycles":20894336,"thread_start_us":124677,"threads_started":1,"wal-append.queue_time_us":164984}
I20260709 13:16:59.866271  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:16:59.866758  5516 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.841295  8864 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:16:59.888545  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 223) took 2019 ms. Trace:
I20260709 13:16:59.888749  8705 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:59.888948  5516 rpcz_store.cc:276] 0709 13:16:57.868852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.866113 (+1997261us) service_pool.cc:224] Handling call
0709 13:16:59.866515 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.888265 (+ 21750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.888489 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.881768  8900 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:59.890058  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.890229  8900 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:16:59.892105  8860 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.949s	user 0.007s	sys 0.005s
I20260709 13:16:59.892518  8860 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.892542  8900 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:16:59.894246  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:16:59.887247  5441 rpcz_store.cc:269] 0709 13:16:57.708281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.709389 (+  1108us) service_pool.cc:224] Handling call
0709 13:16:59.830453 (+2121064us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540029ead4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.830590 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384846208}
I20260709 13:16:59.895913  5443 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:59.896222  8705 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:59.896554  8705 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:16:59.897684  8705 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:16:59.899017  8705 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.902884  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:59.895149  5516 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:16:59.904739  5521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1529) took 2218 ms (client timeout 1841 ms). Trace:
I20260709 13:16:59.905071  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:59.905920  5523 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:59.905157  5521 rpcz_store.cc:269] 0709 13:16:57.685987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.763322 (+ 77335us) service_pool.cc:224] Handling call
0709 13:16:59.904480 (+2141158us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54002774d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.904662 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477247360}
I20260709 13:16:59.871358  8852 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:59.917280  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:59.917230  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.919938  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:59.919971  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.922509  5516 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.924368  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.922364  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:16:59.926019  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.926513  5521 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:59.915589  8851 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:59.928939  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.916142  8691 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:59.935504  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.936354  5521 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:16:59.937453  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:16:59.938040  5521 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:16:59.939359  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 224) took 2057 ms. Trace:
I20260709 13:16:59.939661  5521 rpcz_store.cc:276] 0709 13:16:57.881737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.938686 (+2056949us) service_pool.cc:224] Handling call
0709 13:16:59.938978 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.939148 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.939164 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.939198 (+    34us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:59.939216 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.939249 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.939319 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.940886  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1723) took 1779 ms. Trace:
I20260709 13:16:59.933518  8851 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.947190  8851 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:59.915360  8864 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:59.929225  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:59.947809  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1521) took 2264 ms. Trace:
I20260709 13:16:59.948251  5523 rpcz_store.cc:276] 0709 13:16:57.683987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.768494 (+2084507us) service_pool.cc:224] Handling call
0709 13:16:59.905713 (+137219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.914425 (+  8712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.947572 (+ 33147us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54002774d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:16:59.947744 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292179328}
I20260709 13:16:59.950230  5523 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:59.950984  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1724) took 1788 ms. Trace:
I20260709 13:16:59.923421  8878 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:59.951327  5523 rpcz_store.cc:276] 0709 13:16:58.162231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.949136 (+1786905us) service_pool.cc:224] Handling call
0709 13:16:59.949749 (+   613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.950653 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.950913 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:59.951450  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:16:59.928707  8557 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:59.933585  8665 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:59.922569  8852 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:16:59.941154  5521 rpcz_store.cc:276] 0709 13:16:58.161920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.940346 (+1778426us) service_pool.cc:224] Handling call
0709 13:16:59.940561 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.940681 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.940695 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.940722 (+    27us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:59.940739 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.940770 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.940838 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:59.978948  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 883893us
W20260709 13:16:59.989636  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.992835  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:16:59.993655  5521 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.957409  5516 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:16:59.999033  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.003311  5516 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:00.021802  5414 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.604s (SENT)
I20260709 13:17:00.022522  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:00.031119  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44203.5us
W20260709 13:17:00.032680  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.033890  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.036110  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 265) took 1044 ms. Trace:
I20260709 13:17:00.037801  5449 rpcz_store.cc:276] 0709 13:16:58.991277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.860782 (+869505us) service_pool.cc:224] Handling call
0709 13:16:59.861042 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.861234 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:59.861585 (+   351us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.035218 (+173633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.035685 (+   467us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:00.035752 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.035846 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.036029 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315,"prepare.queue_time_us":221,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":172322,"threads_started":1}
I20260709 13:17:00.030659  8880 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:59.959354  8459 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:59.980159  8881 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.982685  8488 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:00.067814  5371 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:00.091490  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99242.4us
I20260709 13:17:00.068588  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:16:59.964212  8691 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:59.979323  8875 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:16:59.962311  8557 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:16:59.963810  8878 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:00.074234  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.077673  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.080053  5373 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:00.033457  8724 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:16:59.979171  8907 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.095793  5372 raft_consensus.cc:2368] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 11. Current term is 12.
I20260709 13:17:00.096918  5516 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:00.057727  8665 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:00.093073  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1532) took 2362 ms. Trace:
I20260709 13:17:00.111862  5373 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:00.115221  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:00.116905  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.121848  5519 rpcz_store.cc:276] 0709 13:16:57.731125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.826367 (+2095242us) service_pool.cc:224] Handling call
0709 13:16:59.826911 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.827198 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:59.916432 (+ 89234us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.092131 (+175699us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.092757 (+   626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.092804 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:00.092846 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.092911 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.093022 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32143,"prepare.queue_time_us":190473,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":1940,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":29999,"spinlock_wait_cycles":64791680,"thread_start_us":230235,"threads_started":2}
I20260709 13:17:00.126762  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.066632  8459 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:00.129957  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.091197  8337 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:00.095168  8691 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:00.133388  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.135470  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.124485  5521 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:00.099411  8557 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.140623  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 1894) took 1192 ms. Trace:
I20260709 13:17:00.146224  5450 rpcz_store.cc:276] 0709 13:16:58.948188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.759867 (+811679us) service_pool.cc:224] Handling call
0709 13:17:00.140329 (+380462us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b540029d1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:00.140540 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45429120}
I20260709 13:17:00.143646  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:00.151640  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:00.146472  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.153188  5375 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:00.165181  5516 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:00.126472  8696 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.126776  8907 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.174680  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.175040  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:00.137327  8459 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.066840  8880 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:00.129864  8474 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:00.094758  8881 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.185364  5366 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.211794  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.135756  8781 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:00.198717  5374 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.097916  8488 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.206152  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.149674  8691 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.118743  8875 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:00.148190  8716 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:00.144217  8686 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:17:00.191220  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.126888  8724 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.182770  8665 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.251281  8724 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.251155  8665 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:00.220026  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.252461  5369 raft_consensus.cc:2368] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:00.253289  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.254487  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:00.254626  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.255151  5522 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:00.220777  5534 tablet_copy_service.cc:140] P 544c82a50cc4477886bb6f7d58f455ca: Received BeginTabletCopySession request for tablet c06ab136607a405bbdfe9d04f533a566 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:34858)
I20260709 13:17:00.256222  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.186299  8907 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.224774  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:00.179868  8924 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:17:00.199730  8864 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:00.226657  8716 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:00.232218  8852 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.232499  8488 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.238538  8860 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.240424  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.243039  8875 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:00.243752  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.295815  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.244868  8880 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:00.297209  8933 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:00.245290  8878 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.207271  8702 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:00.248070  5366 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:00.248431  8671 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:00.250957  8818 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.255764  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.307152  5372 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:00.311117  5369 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:00.312338  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.313037  5369 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.189460  8831 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:00.256340  5534 tablet_copy_service.cc:161] P 544c82a50cc4477886bb6f7d58f455ca: Beginning new tablet copy session on tablet c06ab136607a405bbdfe9d04f533a566 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:34858: session id = 53eb858bdf82438d83f1be6a01da2e0e-c06ab136607a405bbdfe9d04f533a566
I20260709 13:17:00.147871  8337 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.322099  8337 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.258582  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 261) took 1345 ms. Trace:
I20260709 13:17:00.322935  8459 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.323202  5444 rpcz_store.cc:276] 0709 13:16:58.912700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.773534 (+860834us) service_pool.cc:224] Handling call
0709 13:16:59.773843 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.840180 (+ 66337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.258355 (+418175us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b54003223d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:00.258522 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151038208}
I20260709 13:17:00.323453  8691 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.324735  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:00.222939  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 233815us
I20260709 13:17:00.322952  5375 raft_consensus.cc:2410] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:17:00.325654  8691 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.264550  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:00.262441  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1501) took 1610 ms. Trace:
I20260709 13:17:00.326620  8831 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:00.266067  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:00.326996  5449 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:00.327124  8831 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.326797  5443 rpcz_store.cc:276] 0709 13:16:58.652417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.892110 (+239693us) service_pool.cc:224] Handling call
0709 13:16:58.892476 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.896328 (+1003852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.262150 (+365822us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540007e9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:00.262368 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307219200}
I20260709 13:17:00.269917  5448 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:00.328459  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:00.329264  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:00.329632  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:00.330056  5448 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:00.330190  8860 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:00.270648  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:00.272086  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 229438us
I20260709 13:17:00.269622  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:00.212692  8675 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:17:00.299526  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1897) took 1350 ms. Trace:
I20260709 13:17:00.215446  8781 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:00.300431  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.297261  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.332896  5447 rpcz_store.cc:276] 0709 13:16:58.948653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.810721 (+862068us) service_pool.cc:224] Handling call
0709 13:16:59.833847 (+ 23126us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:59.834270 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.834304 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:59.853658 (+ 19354us) log.cc:844] Serialized 52 byte log entry
0709 13:17:00.062920 (+209262us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:00.063159 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.063249 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.299247 (+235998us) raft_consensus.cc:1685] finished
0709 13:17:00.299269 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.299459 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":905,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":206546,"threads_started":1,"wal-append.queue_time_us":279662}
I20260709 13:17:00.216284  8474 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:00.314546  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52444.2us
I20260709 13:17:00.319720  8566 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:00.326159  8818 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.268230  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:00.365582  5446 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
W20260709 13:17:00.246070  8932 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:17:00.308588  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:00.335525  5450 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:00.336373  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.374723  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.375754  5366 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:00.376799  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.334687  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.378502  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.267174  8864 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.359714  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:00.360998  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.367002  5367 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:00.294415  8716 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.388526  5522 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:00.390395  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.399940  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.387010  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.392344  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:00.317291  8852 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:00.410913  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.266497  8858 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:17:00.330617  8860 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:00.358042  8781 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:00.423440  8934 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:17:00.364782  8459 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.417224  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.430289  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:00.425508  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65877.4us
I20260709 13:17:00.432749  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:00.409129  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:00.406168  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:00.408314  5369 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:00.426157  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.443285  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:00.383172  8880 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.439853  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 323027us
I20260709 13:17:00.453042  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.454800  5339 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.444404  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.444633  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1725) took 2282 ms. Trace:
I20260709 13:17:00.395641  8864 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.437296  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.448071  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.461078  5522 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
I20260709 13:17:00.415616  8691 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.449666  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:00.455663  5523 rpcz_store.cc:276] 0709 13:16:58.162531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.959157 (+1796626us) service_pool.cc:224] Handling call
0709 13:16:59.959617 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.960651 (+  1034us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:00.137193 (+176542us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.444235 (+307042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.444297 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:00.444342 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.444437 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.444577 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8394,"prepare.queue_time_us":19873,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":9935,"thread_start_us":468512,"threads_started":2}
I20260709 13:17:00.457345  5369 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.468614  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.469609  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:00.462285  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.471472  5367 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:00.462607  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.409713  8852 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:00.473937  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.454677  8900 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:00.475819  5339 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.424204  8557 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:00.549784  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 74116.1us
I20260709 13:17:00.474699  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.462531  8162 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:00.480347  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.414124  8927 consensus_queue.cc:1059] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:17:00.482986  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:00.449095  8663 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:00.490315  5367 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.433888  8671 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.470767  8566 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:17:00.462808  8459 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.496501  5534 tablet_copy_source_session.cc:215] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:00.467475  8691 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.464550  8880 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.499366  8902 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:00.503238  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.506340  8852 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:00.510648  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.512817  5369 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:17:00.590581  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.590953  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.591113  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.526880  8907 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.542953  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.487794  8702 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:00.545900  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 353269us
I20260709 13:17:00.551074  5366 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:00.480556  8851 consensus_meta.cc:287] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.000s
I20260709 13:17:00.469966  8686 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:00.424914  8942 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 13:17:00.558274  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 425524us
I20260709 13:17:00.562443  8162 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:00.564730  5273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 40) took 16512 ms (client timeout 15000 ms). Trace:
I20260709 13:17:00.586918  8691 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.567178  5522 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:00.473026  8488 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.567847  5339 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.482386  8337 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.480165  8675 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:00.608510  8337 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:00.461103  8567 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:17:00.559432  8735 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.558916  8900 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:00.560235  8875 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.630138  8162 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:00.630999  8474 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.587046  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:00.591322  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.533366  8781 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.591898  5369 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:00.524356  8831 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.592604  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.593156  5367 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:00.568890  8663 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:00.595767  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 262695us
I20260709 13:17:00.571062  8881 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.598628  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.601750  8851 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:00.659510  5366 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:00.646682  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.660647  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:00.655552  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:00.565590  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1514) took 2933 ms (client timeout 1613 ms). Trace:
I20260709 13:17:00.588394  8902 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:17:00.601974  5273 rpcz_store.cc:269] 0709 13:16:44.052550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.063598 (+ 11048us) service_pool.cc:224] Handling call
0709 13:17:00.564633 (+16501035us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:55.984307 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:55.984875 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:55.984916 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:16:55.984936 (+    20us) tablet.cc:662] Decoding operations
0709 13:16:56.032016 (+ 47080us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:56.034449 (+  2433us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:56.038616 (+  4167us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:56.131550 (+ 92934us) tablet.cc:701] Row locks acquired
0709 13:16:56.131578 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:16:56.148324 (+ 16746us) write_op.cc:270] Start()
0709 13:16:56.166888 (+ 18564us) write_op.cc:276] Timestamp: P: 1783603016147137 usec, L: 0
0709 13:16:56.166932 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:16:56.195970 (+ 29038us) log.cc:844] Serialized 912 byte log entry
0709 13:16:57.517175 (+1321205us) op_driver.cc:464] REPLICATION: finished
0709 13:16:57.804236 (+287061us) write_op.cc:301] APPLY: starting
0709 13:16:57.817005 (+ 12769us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:57.866368 (+ 49363us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:57.897680 (+ 31312us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:58.360757 (+463077us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:58.425096 (+ 64339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:58.460712 (+ 35616us) write_op.cc:312] APPLY: finished
0709 13:16:58.480828 (+ 20116us) log.cc:844] Serialized 28 byte log entry
0709 13:16:58.689847 (+209019us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:58.696614 (+  6767us) write_op.cc:454] Released schema lock
0709 13:16:58.699196 (+  2582us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:58.747468 (+ 48272us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:58.750519 (+  3051us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2243873,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":215461,"apply.run_cpu_time_us":32726,"apply.run_wall_time_us":911339,"num_ops":2,"prepare.queue_time_us":234716,"prepare.run_cpu_time_us":16739,"prepare.run_wall_time_us":474671,"raft.queue_time_us":369185,"raft.run_cpu_time_us":39476,"raft.run_wall_time_us":280193,"replication_time_us":1266744,"thread_start_us":815983,"threads_started":5,"wal-append.queue_time_us":825223,"wal-append.run_cpu_time_us":12674,"wal-append.run_wall_time_us":2711822}]]}
I20260709 13:17:00.605873  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:00.661661  5515 rpcz_store.cc:269] 0709 13:16:57.633106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.635115 (+  2009us) service_pool.cc:224] Handling call
0709 13:17:00.565308 (+2930193us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54002788d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:00.565495 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4890132352}
I20260709 13:17:00.606598  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.610162  8686 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:00.570516  8860 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.667333  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.611270  8927 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:00.611717  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:00.571718  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 88869.6us
I20260709 13:17:00.601841  8852 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.644968  8663 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.673645  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.674808  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.617466  6043 leader_election.cc:400] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 11. Current term is 12.
I20260709 13:17:00.626960  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1505) took 3005 ms. Trace:
I20260709 13:17:00.613252  8337 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.660763  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.576924  8853 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:00.661515  5366 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:00.600379  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.645514  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.605749  5368 raft_consensus.cc:2368] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:17:00.633288  8776 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.666061  5373 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 3.
I20260709 13:17:00.633582  8900 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.667294  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:00.668707  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.667344  5370 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:00.579527  8671 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.671761  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:00.675639  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:00.665053  8902 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:00.638054  8735 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.952756  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.675843  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:00.816697  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.955801  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 284087us
I20260709 13:17:00.861243  5524 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:00.945299  6043 leader_election.cc:403] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:00.802649  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.969475  5523 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.678326  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.804430  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:00.686103  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 74449.6us
I20260709 13:17:00.720677  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:00.977581  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:00.974318  5521 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:00.945369  5522 raft_consensus.cc:2376] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10. Re-sending same reply.
W20260709 13:17:00.937485  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 488457us
I20260709 13:17:00.976195  5367 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:00.975463  5371 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:00.767350  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.975060  5369 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:00.743391  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:00.980017  5519 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.735913  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c06ab136607a405bbdfe9d04f533a566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:00.978515  8664 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.730782  8860 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.992329  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1732) took 2428 ms. Trace:
I20260709 13:17:00.976007  5517 rpcz_store.cc:276] 0709 13:16:57.623245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.682334 (+2059089us) service_pool.cc:224] Handling call
0709 13:16:59.715369 (+ 33035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.817189 (+101820us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:59.916969 (+ 99780us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.153954 (+236985us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.180442 (+ 26488us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.180920 (+   478us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:00.180988 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.448181 (+267193us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x7b540025d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:00.448233 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.626623 (+178390us) raft_consensus.cc:1685] finished
0709 13:17:00.626714 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.626877 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11152,"prepare.queue_time_us":135702,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"raft.queue_time_us":28240,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":9295,"spinlock_wait_cycles":226147712,"thread_start_us":296762,"threads_started":2,"wal-append.queue_time_us":542537}
I20260709 13:17:00.982084  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:01.011396  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1558) took 1577 ms. Trace:
W20260709 13:17:01.044513  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62881.1us
I20260709 13:17:00.850045  8907 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.983610  5516 raft_consensus.cc:606] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:00.937060  8949 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:00.845337  8948 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:17:00.980697  5443 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:00.978976  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:01.107456  5370 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
W20260709 13:17:00.746737  8928 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.539s	user 0.005s	sys 0.000s
I20260709 13:17:00.979774  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.816208  8944 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:01.118923  5366 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:00.980623  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:01.120673  5372 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
W20260709 13:17:00.980260  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 379927us
I20260709 13:17:00.756702  8781 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.774006  8557 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.954319  8899 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.014698  8664 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.018872  5522 rpcz_store.cc:276] 0709 13:16:58.563600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.991210 (+2427610us) service_pool.cc:224] Handling call
0709 13:17:00.991584 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.991766 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.991791 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.991993 (+   202us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:00.992042 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.992117 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.992254 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.135068  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 227) took 2419 ms. Trace:
I20260709 13:17:00.986960  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:00.768462  8913 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:00.727322  8775 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.771999  8676 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:00.817950  8851 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:17:00.683678  8696 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:01.047178  8702 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:01.045284  5524 rpcz_store.cc:276] 0709 13:16:59.433887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.509302 (+ 75415us) service_pool.cc:224] Handling call
0709 13:17:01.011232 (+1501930us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002db754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:01.011332 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2796628224}
W20260709 13:17:01.139914  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154402us
I20260709 13:17:01.049711  8879 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:01.050145  8735 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.738519  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:01.047556  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:01.054180  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.682271  8880 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.843758  8716 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.046474  5516 raft_consensus.cc:614] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:00.992110  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1727) took 2579 ms. Trace:
I20260709 13:17:01.151098  5521 rpcz_store.cc:276] 0709 13:16:58.412578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.990836 (+2578258us) service_pool.cc:224] Handling call
0709 13:17:00.991284 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.991654 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.991694 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.991748 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:00.991791 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.991867 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.992037 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.068775  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:01.070025  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:00.735824  8813 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.772647  8941 raft_consensus.cc:3055] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.819479  8459 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:00.860488  8831 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:00.957549  8852 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:01.077750  5373 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:00.750412  8945 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.984354  8567 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.736572  8886 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:00.987033  8675 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:01.192111  5270 catalog_manager.cc:5697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.192185  8567 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:00.742417  8864 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.196086  8567 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.195349  5270 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 9 to 10, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.012570  8853 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:00.987435  8686 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:17:01.081842  8942 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:01.074244  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 461825us
I20260709 13:17:01.109895  5523 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:01.075225  8566 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:01.145895  8702 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.135553  5522 rpcz_store.cc:276] 0709 13:16:58.715512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.133997 (+2418485us) service_pool.cc:224] Handling call
0709 13:17:01.134434 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.134655 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.134694 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.134753 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:01.134798 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.134861 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.135002 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:01.138067  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 151663us
I20260709 13:17:01.210508  5522 pending_rounds.cc:85] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 3
I20260709 13:17:01.212102  5522 pending_rounds.cc:107] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 10.4
I20260709 13:17:01.212428  5522 raft_consensus.cc:2889] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:01.211438  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:01.141244  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:01.144707  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 97664.1us
I20260709 13:17:01.217764  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:01.118530  8944 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:01.130795  8940 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.148456  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 166036us
I20260709 13:17:01.164882  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51720 (request call id 51) took 1018 ms. Trace:
W20260709 13:17:01.157604  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.166994  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1531) took 3480 ms. Trace:
I20260709 13:17:01.142743  8557 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:01.140642  8676 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:01.226197  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:01.169999  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.138852  8913 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:01.233268  5367 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:01.150698  8781 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:01.166852  8671 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.238430  8781 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.238929  8781 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:01.185514  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.198598  8945 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:01.146929  8691 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.002s
I20260709 13:17:01.172785  5519 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:01.240240  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1749) took 1253 ms. Trace:
I20260709 13:17:01.187796  5373 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:01.177155  5370 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:01.193259  8886 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:01.083993  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1733) took 2518 ms. Trace:
I20260709 13:17:01.243507  5517 rpcz_store.cc:276] 0709 13:16:58.565400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.043696 (+2478296us) service_pool.cc:224] Handling call
0709 13:17:01.083343 (+ 39647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.083555 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.083592 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.083648 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:01.083691 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.083766 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.083914 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.155315  8813 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:01.254266  5367 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:01.136099  8899 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.164842  8941 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:01.202502  5270 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 6 to 8, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.123365  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:01.225749  8864 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.222940  5516 rpcz_store.cc:276] 0709 13:17:00.132257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.743226 (+610969us) service_pool.cc:224] Handling call
0709 13:17:01.150915 (+407689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.223204  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:01.267076  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43963.4us
I20260709 13:17:01.267727  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1736) took 1396 ms. Trace:
I20260709 13:17:01.267885  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:01.222296  5518 rpcz_store.cc:276] 0709 13:16:57.686461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.784713 (+2098252us) service_pool.cc:224] Handling call
0709 13:16:59.785095 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.785720 (+   625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.785768 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.786520 (+   752us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.918705 (+132185us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:00.186046 (+267341us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.200446 (+ 14400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.200554 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.745700 (+545146us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:01.155509 (+409809us) raft_consensus.cc:1685] finished
0709 13:17:01.166732 (+ 11223us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.166927 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14093,"prepare.queue_time_us":61659,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":27953,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":6937,"spinlock_wait_cycles":43499392,"thread_start_us":382066,"threads_started":2,"wal-append.queue_time_us":335845}
I20260709 13:17:01.268343  5516 rpcz_store.cc:276] 0709 13:16:59.871490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.266890 (+1395400us) service_pool.cc:224] Handling call
0709 13:17:01.267220 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.267398 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.267424 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.267477 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:01.267504 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.267564 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.267669 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.240795  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:01.240594  5519 rpcz_store.cc:276] 0709 13:16:59.987228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.677955 (+690727us) service_pool.cc:224] Handling call
0709 13:17:01.240178 (+562223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.256457  5373 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:01.272229  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:01.273052  5373 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:17:01.219657  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 78527.4us
I20260709 13:17:01.231663  8459 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.278757  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:01.277093  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:01.282217  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:01.283309  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57959.3us
I20260709 13:17:01.284072  8831 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:01.284610  8675 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:01.207188  8663 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.259418  8775 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.287312  5367 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:01.243520  8696 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:01.242203  8557 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:01.284837  5270 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:01.287250  5490 leader_election.cc:400] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:01.293042  5517 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:01.254062  8955 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:01.290521  8907 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:01.275887  8852 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.254660  8567 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:17:01.235232  8940 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:01.295234  8686 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:01.295034  5416 leader_election.cc:400] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:17:01.257716  8879 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:17:01.290014  8566 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:01.275583  8735 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.243597  8691 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.292852  8944 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:01.298270  8675 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:01.371881  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1500) took 1121 ms. Trace:
I20260709 13:17:01.303689  8664 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.305491  5368 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:01.308561  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1726) took 3145 ms. Trace:
I20260709 13:17:01.312692  5490 leader_election.cc:403] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:01.375049  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1479) took 1139 ms. Trace:
I20260709 13:17:01.313073  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1554) took 1880 ms. Trace:
I20260709 13:17:01.313654  5270 catalog_manager.cc:5697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:01.317855  5519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:01.375699  5369 rpcz_store.cc:276] 0709 13:17:00.235314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.082441 (+847127us) service_pool.cc:224] Handling call
0709 13:17:01.082774 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.085294 (+  2520us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:01.262279 (+176985us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.374403 (+112124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.374460 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:01.374501 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.374832 (+   331us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.374987 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39886,"prepare.queue_time_us":236929,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"thread_start_us":231621,"threads_started":2}
I20260709 13:17:01.345678  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1488) took 1099 ms. Trace:
I20260709 13:17:01.346694  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.333137  8818 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:01.315902  8907 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:01.379391  8818 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:01.338447  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1570) took 1079 ms. Trace:
I20260709 13:17:01.380016  5523 rpcz_store.cc:276] 0709 13:17:00.259360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.601287 (+341927us) service_pool.cc:224] Handling call
0709 13:17:01.338177 (+736890us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002783d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:01.338363 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702936960}
I20260709 13:17:01.313500  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1560) took 1085 ms. Trace:
I20260709 13:17:01.323943  8899 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.333940  8337 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.378048  5370 rpcz_store.cc:276] 0709 13:17:00.246607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.115878 (+869271us) service_pool.cc:224] Handling call
0709 13:17:01.116298 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.241145 (+124847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.345347 (+104202us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b54000f96d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:01.345607 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138982784}
I20260709 13:17:01.376412  5521 rpcz_store.cc:276] 0709 13:16:59.432541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.152160 (+1719619us) service_pool.cc:224] Handling call
0709 13:17:01.152520 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.152967 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.153009 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.237137 (+ 84128us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b2c00108f48. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:17:01.237677 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.248624 (+ 10947us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:01.248689 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.248798 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.312750 (+ 63952us) raft_consensus.cc:1685] finished
0709 13:17:01.312778 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.313012 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40117,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":6304640,"thread_start_us":10508,"threads_started":1,"wal-append.queue_time_us":56725}
I20260709 13:17:01.380318  8818 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.340809  5371 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:01.385344  8337 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.315227  8945 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.377269  5519 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:01.374745  5515 rpcz_store.cc:276] 0709 13:16:58.162852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.988385 (+2825533us) service_pool.cc:224] Handling call
0709 13:17:01.048560 (+ 60175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.048773 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:01.200576 (+151803us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.308167 (+107591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.308220 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:01.308262 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.308327 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.308484 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12536,"prepare.queue_time_us":295609,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":12679,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"thread_start_us":245915,"threads_started":2}
I20260709 13:17:01.386256  5366 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:01.386451  5519 raft_consensus.cc:614] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:01.381199  5517 rpcz_store.cc:276] 0709 13:17:00.228365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.267051 (+1038686us) service_pool.cc:224] Handling call
0709 13:17:01.292642 (+ 25591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.313212 (+ 20570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.313412 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.372529  5374 rpcz_store.cc:276] 0709 13:17:00.250590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.115916 (+865326us) service_pool.cc:224] Handling call
0709 13:17:01.116298 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.116660 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:01.285055 (+168395us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.371279 (+ 86224us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.371467 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.371520 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:01.371583 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.371657 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.371809 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25223,"prepare.queue_time_us":207327,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":71,"raft.queue_time_us":165,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":164,"spinlock_wait_cycles":40192,"thread_start_us":215568,"threads_started":2}
I20260709 13:17:01.380048  8907 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.372731  8675 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.387691  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1505) took 1135 ms. Trace:
W20260709 13:17:01.370420  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.388048  5366 rpcz_store.cc:276] 0709 13:17:00.252308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.119731 (+867423us) service_pool.cc:224] Handling call
0709 13:17:01.120050 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.386731 (+266681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.387472 (+   741us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400144e54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:01.387637 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611747712}
I20260709 13:17:01.345088  5416 leader_election.cc:403] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:17:01.389881  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 95041.7us
I20260709 13:17:01.391203  5519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:01.392668  5270 catalog_manager.cc:5697] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 9, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 9 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:01.371187  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73790us
I20260709 13:17:01.385203  8818 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.297886  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1476) took 1063 ms. Trace:
I20260709 13:17:01.390612  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:01.419761  5519 raft_consensus.cc:606] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:01.420373  5519 raft_consensus.cc:614] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:01.417601  5270 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 8, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:01.421059  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.421679  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1506) took 1169 ms. Trace:
I20260709 13:17:01.421657  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1735) took 2704 ms. Trace:
I20260709 13:17:01.422658  5524 rpcz_store.cc:276] 0709 13:16:58.717827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.140397 (+2422570us) service_pool.cc:224] Handling call
0709 13:17:01.155443 (+ 15046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.155676 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:01.369946 (+214270us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.378588 (+  8642us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.419558 (+ 40970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.419616 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:01.419659 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.420904 (+  1245us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.421594 (+   690us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":209290,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":103,"thread_start_us":198841,"threads_started":2}
W20260709 13:17:01.428053  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 140952us
I20260709 13:17:01.429247  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:01.430955  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:01.419559  5375 rpcz_store.cc:276] 0709 13:17:00.234539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.071606 (+837067us) service_pool.cc:224] Handling call
0709 13:17:01.072178 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.072401 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:01.257876 (+185475us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.290692 (+ 32816us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.290814 (+   122us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:01.290904 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.291989 (+  1085us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.297800 (+  5811us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":844,"prepare.queue_time_us":249521,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":12222,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":168984,"threads_started":2,"wal-append.queue_time_us":76627}
I20260709 13:17:01.422489  5372 rpcz_store.cc:276] 0709 13:17:00.252571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.121454 (+868883us) service_pool.cc:224] Handling call
0709 13:17:01.121783 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.122026 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:01.257662 (+135636us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.421009 (+163347us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.421259 (+   250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.421308 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:01.421352 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.421482 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.421606 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4760,"prepare.queue_time_us":200001,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"thread_start_us":278156,"threads_started":2}
I20260709 13:17:01.299803  8663 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.440659  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:01.306584  8775 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.307874  8864 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.330543  8902 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.302212  8913 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.345736  8735 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:01.345268  8940 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.305814  8702 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.347479  8691 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.455466  8955 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:17:01.312323  8557 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.460465  8966 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.458668  8913 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.325609  8853 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.355106  8941 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:01.483628  8941 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.484756  8852 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.309528  8956 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.179s
I20260709 13:17:01.419374  8860 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:01.311363  8696 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.443507  8851 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:01.313621  8676 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.474546  8735 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.453893  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:01.471105  8775 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.460268  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:01.344007  8686 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:01.347905  8944 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.443149  8566 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
W20260709 13:17:01.503631  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 380322us
W20260709 13:17:01.537845  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 265666us
W20260709 13:17:01.538251  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.435376  8831 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:01.548110  8831 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.548519  8831 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.391993  8945 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.549631  8949 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:01.507208  8860 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.551180  8676 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.313216  8813 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.301709  8886 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:01.487567  8966 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:01.553328  8886 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.553609  8966 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:01.554056  8686 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:01.510967  8852 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:17:01.554929  8966 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.555598  8852 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:01.555968  8852 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:01.556442  8966 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.557039  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:01.510656  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57028.3us
I20260709 13:17:01.559734  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:01.330070  8567 consensus_queue.cc:1243] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:01.563911  5443 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:01.563961  5450 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:01.466882  8942 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 11. Current term is 12.
I20260709 13:17:01.450511  8878 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:01.463788  8893 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.464596  6073 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:01.444185  8459 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:17:01.581705  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.583077  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:17:01.530906  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 70739.8us
I20260709 13:17:01.443099  8900 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.540844  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:01.541071  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:01.541453  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:01.543512  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:01.543723  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:01.590010  8974 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:01.543962  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:01.547581  8691 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:01.581095  8735 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.590809  8974 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:01.591271  8691 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.527966  8955 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:01.593699  8955 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.593850  8974 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:01.594244  8955 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.507570  8696 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.598400  8735 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.314504  8716 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.557519  8702 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:01.602021  8893 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.603077  8945 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:17:01.538525  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:01.604355  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65906.8us
I20260709 13:17:01.574316  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:01.573814  5375 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.537209  8776 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:01.564309  8813 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.564472  8665 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.577927  8781 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.578826  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:01.579747  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:01.580678  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:01.585013  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:01.611835  5369 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:01.568279  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.564666  8675 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:01.612425  5450 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:17:01.612586  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:01.614396  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.615195  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.622016  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.622251  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.622818  5445 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:01.623600  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.625085  5450 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:01.604826  8567 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:01.627414  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.627471  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.628523  5445 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:01.628657  5442 raft_consensus.cc:2410] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:01.629303  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.629987  5445 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:01.610536  8716 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:01.630722  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.638798  5447 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:01.635048  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:01.635207  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:01.636598  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.641942  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.573834  8949 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:17:01.646101  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:01.647603  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:01.648644  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:01.649605  5517 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.651039  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.651846  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:01.652365  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:01.653290  5523 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.655076  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.655922  5524 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:01.657136  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.660326  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.660240  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.661983  5444 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:17:01.633512  8567 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.651629  5449 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:01.664294  5445 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:17:01.632663  8913 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.611934  8665 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.632965  8957 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.650902  8671 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:01.667470  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:01.667637  8976 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:17:01.668061  8893 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.652633  8818 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:01.676378  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:01.676744  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.685681  5520 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:01.626009  8675 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.682732  5523 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:01.661314  8691 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.652112  8716 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:01.666339  8664 raft_consensus.cc:2764] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:17:01.666219  8567 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.689934  5517 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:01.694154  8716 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:01.694401  8965 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:01.698414  8665 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.698940  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1556) took 2265 ms. Trace:
I20260709 13:17:01.699451  5515 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:01.699363  5522 rpcz_store.cc:276] 0709 13:16:59.433220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.209645 (+1776425us) service_pool.cc:224] Handling call
0709 13:17:01.210200 (+   555us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:01.215228 (+  5028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.215274 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:01.216011 (+   737us) log.cc:844] Serialized 52 byte log entry
0709 13:17:01.432997 (+216986us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:01.433235 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.446096 (+ 12861us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.698593 (+252497us) raft_consensus.cc:1685] finished
0709 13:17:01.698617 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.698860 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":12575,"thread_start_us":216533,"threads_started":1,"wal-append.queue_time_us":367946}
I20260709 13:17:01.695959  8900 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.708525  5518 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:01.710438  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.712083  5519 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:01.678453  8957 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.714118  8957 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.697044  8781 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.716919  6070 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:01.721276  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:01.722088  5524 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.673084  8696 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.724874  8696 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.727058  8952 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:01.734445  8864 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.735736  8945 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:01.758880  8952 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:01.759467  8945 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:01.760124  8952 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.737277  8955 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.740522  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59508 (request call id 108) took 2782 ms. Trace:
I20260709 13:17:01.739481  8860 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.745574  8675 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.752918  8831 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:01.757288  8972 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.227s	user 0.000s	sys 0.003s
W20260709 13:17:01.756186  5520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1536) took 3364 ms (client timeout 1604 ms). Trace:
I20260709 13:17:01.760471  8945 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.740458  8775 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.761090  6077 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:17:01.742978  8852 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.761662  8909 rpcz_store.cc:276] 0709 13:16:58.958349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.961278 (+  2929us) service_pool.cc:224] Handling call
0709 13:16:59.304492 (+343214us) ts_tablet_manager.cc:934] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
0709 13:17:00.734349 (+1429857us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:01.361140 (+626791us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:01.361266 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:01.739625 (+378359us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:01.739980 (+   355us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:01.740357 (+   377us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:01.740430 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":20945,"tablet-copy.queue_time_us":149183,"thread_start_us":205552,"threads_started":2}
I20260709 13:17:01.777691  8852 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.778208  8909 tablet_copy_client.cc:806] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:01.778932  8909 tablet_copy_client.cc:670] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:01.779280  8831 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.772326  8952 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.782236  8955 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.786540  8567 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.787472  8775 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.788993  8567 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:01.780794  8945 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.791177  8957 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.793489  8957 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:01.612037  5340 connection.cc:256] RPC call timeout handler was delayed by -2.4124277380001331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:17:01.847030  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 240560us
I20260709 13:17:01.837813  5270 catalog_manager.cc:5697] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 5 to 10, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.849510  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:01.850934  5270 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 5 to 10, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.854249  5373 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:01.665498  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.864424  8696 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:01.865908  8696 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.866943  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:01.764300  5520 rpcz_store.cc:269] 0709 13:16:58.391276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.890861 (+499585us) service_pool.cc:224] Handling call
0709 13:17:01.755862 (+2865001us) spinlock_profiling.cc:243] Waited 2.71 s on lock 0x7b540025dad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:01.756066 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6237782400}
I20260709 13:17:01.870472  8852 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.872063  8775 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:01.861181  5448 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.872233  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.873543  5444 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:01.871711  8852 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.875242  8675 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:01.875690  8831 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.876147  8675 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.876724  8831 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.877789  8852 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.878109  8775 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:01.878588  8852 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.879102  8675 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.879541  8831 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.879721  8775 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.880770  5446 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:01.881111  8696 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.763834  5524 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:01.882128  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.883662  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.875231  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.879367  8852 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.890890  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.879776  8675 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.902908  5449 raft_consensus.cc:2368] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
I20260709 13:17:01.904523  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.903235  5270 catalog_manager.cc:5697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:01.906574  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.908324  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.918437  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.919996  5524 raft_consensus.cc:2376] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10. Re-sending same reply.
I20260709 13:17:01.920428  5448 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:17:01.921586  5449 raft_consensus.cc:2368] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:17:01.922857  5520 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:01.925222  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.927439  8831 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:01.928346  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:01.928764  8831 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:01.922694  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.930747  5449 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:01.931672  8675 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:01.932399  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.933668  5519 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:01.934428  8675 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.934711  5447 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.937618  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:01.938081  6073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59492 (request call id 125) took 1605 ms (client timeout 1980 ms). Trace:
W20260709 13:17:01.938657  6073 rpcz_store.cc:269] 0709 13:17:00.332476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.358095 (+ 25619us) service_pool.cc:224] Handling call
0709 13:17:00.738317 (+380222us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800004598. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:17:01.937562 (+1199245us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400409f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:01.937841 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465420416}
I20260709 13:17:01.899153  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.941991  8852 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:01.944267  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.951269  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.953713  5518 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:01.953588  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:01.929822  5444 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:01.952229  5445 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:01.952852  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.946071  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:01.959378  8852 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:01.960062  8852 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:01.964123  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.963748  8852 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:01.966634  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.972391  5445 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.972466  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.973672  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:01.976347  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:01.976493  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.977243  5443 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:01.978790  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.979923  5443 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:01.980913  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.970803  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:01.993758  5442 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.996686  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.997937  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.998942  5446 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:01.966678  8735 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:02.001575  5450 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:02.002559  8831 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:02.003399  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.001809  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.012781  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:02.013685  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.001911  8735 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:02.020394  5450 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:02.019980  8735 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.021955  5520 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:02.024108  8735 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.024518  8952 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.024948  8952 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.025334  8952 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.025640  5448 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:02.027045  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:02.028050  5448 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:02.028991  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:02.029732  8957 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:02.024152  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:02.033907  8981 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:02.034600  8981 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:02.040081  5448 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:02.007969  5441 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:02.017243  5375 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:02.046000  5445 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:02.047673  5449 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:02.049721  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:01.945288  5270 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 8, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 8 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:02.036250  8981 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:02.051808  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:02.053552  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:02.053059  5442 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:02.056043  5519 raft_consensus.cc:2368] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:17:02.056833  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.062459  5446 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:02.067226  5448 raft_consensus.cc:2368] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:02.070024  5448 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:02.073997  5444 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:02.074934  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.076602  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.077103  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.079377  5522 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:02.080768  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.081018  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.082252  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.083956  5518 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:02.090711  5524 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:02.091706  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 444021us
I20260709 13:17:02.094205  5520 raft_consensus.cc:2368] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:17:02.097694  5444 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:02.097995  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:02.099310  5445 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:02.100989  5445 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:02.093063  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.105717  5450 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.109916  5519 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:02.121639  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:02.122819  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.672s (SENT) [suppressed 20 similar messages]
I20260709 13:17:02.130366  5449 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:02.151901  5524 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:02.156738  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.162655  5270 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 6 to 7, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.174814  5446 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:02.167177  8992 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:02.176045  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53425.1us
I20260709 13:17:02.179620  5445 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:02.180866  8990 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:02.181696  5449 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:02.177595  8567 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:02.183504  8567 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.183928  8567 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:02.185945  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.186923  5518 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:02.188403  8990 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.188918  8990 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.193392  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.194357  5522 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.195010  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.195777  5517 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:17:02.197224  5517 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:02.198357  8982 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:02.199548  8982 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:02.199980  8982 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:02.198431  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.202629  5516 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:02.203974  8735 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.204583  8981 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:02.198860  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.207361  5515 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:02.201139  8982 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.210156  8952 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.211934  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.220655  5450 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:02.221817  5448 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [6.4-9.6]
I20260709 13:17:02.212328  8982 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.227980  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:02.236956  8941 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:02.239727  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:02.237558  8941 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.242923  8852 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.243526  5448 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:02.242944  5445 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:02.250283  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 157434us
I20260709 13:17:02.251448  5447 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:02.232676  8952 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:02.256868  5524 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:02.250394  8852 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.258327  8735 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:02.247826  8941 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.270344  5522 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:02.276945  5446 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:02.288853  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49233.6us
I20260709 13:17:02.296136  5449 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:02.297640  5523 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:02.300750  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.302109  8957 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:02.293960  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.303164  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.295019  5270 catalog_manager.cc:5697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.305326  5443 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:02.312083  8735 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:02.319008  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.317829  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.317562  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.324757  8675 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.326179  8663 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:02.326879  8663 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:02.322628  8957 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:02.328190  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:02.338027  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.338446  8955 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:02.339143  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.329170  8957 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:02.328279  8663 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.341742  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.334168  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.345963  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.347643  8957 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.348274  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.349217  8852 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.349838  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.327849  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:02.325085  5489 leader_election.cc:400] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:02.352020  5489 leader_election.cc:403] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:02.354229  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.360980  5369 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:02.368355  5518 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
W20260709 13:17:02.371897  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47060.1us
I20260709 13:17:02.372141  8981 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.373296  8992 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:02.374908  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.373896  5270 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 6 to 7, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:02.376441  8992 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:02.377657  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:02.377490  5270 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 5 to 8, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 8 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:02.378588  5522 raft_consensus.cc:606] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.378765  5490 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.384495  8990 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.379325  8952 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:02.379483  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.396965  5370 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:02.397338  8990 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:02.379842  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52175.7us
I20260709 13:17:02.398177  8990 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:02.398662  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.380300  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.400563  5372 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:02.401443  8675 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:02.363329  8955 raft_consensus.cc:2764] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:17:02.380344  8852 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.381093  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.370357  5375 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:02.403666  8955 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:02.388074  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.404376  8955 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:02.404731  8955 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:02.404821  8735 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:02.406076  8955 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.406867  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.408196  8735 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:02.408674  8735 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.409077  8735 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.410313  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.411521  8985 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:02.389460  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65953.5us
I20260709 13:17:02.415443  5339 leader_election.cc:400] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:17:02.416033  5339 leader_election.cc:403] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:02.417236  8985 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:17:02.419996  5339 leader_election.cc:400] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:17:02.414209  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:02.421990  8985 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:02.422484  8985 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:02.422868  8985 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.424471  8735 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.425990  8949 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:02.420558  5339 leader_election.cc:403] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:17:02.442772  8949 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:02.453192  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51301.2us
I20260709 13:17:02.453388  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.457844  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:02.458261  9001 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.458964  9001 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:02.439031  8567 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.441848  8775 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:17:02.465509  5375 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:02.455884  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.470559  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.472247  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:02.490746  8982 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:02.500783  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:02.500566  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50825.1us
I20260709 13:17:02.504035  9001 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.504995  5340 leader_election.cc:400] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
W20260709 13:17:02.506480  8998 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:02.472304  8775 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:02.509817  8775 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:02.510860  8775 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.512231  8775 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:02.513604  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44220.1us
I20260709 13:17:02.516047  5373 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:02.516280  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:02.527817  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 81459.5us
I20260709 13:17:02.518582  8981 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.535395  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:02.529176  8831 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:02.552801  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48077.4us
I20260709 13:17:02.538931  8831 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:02.552291  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 175759us
I20260709 13:17:02.564806  8982 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:02.558488  8831 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.576660  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.549912  8941 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:02.571163  8982 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:02.568614  8735 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.566224  8663 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.578794  8949 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:17:02.591192  8567 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:02.613552  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 142553us
I20260709 13:17:02.630893  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.632557  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:02.633908  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 105165us
I20260709 13:17:02.635017  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:02.624583  8992 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:02.604453  8663 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:02.640035  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66364.2us
I20260709 13:17:02.639729  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:02.645300  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:02.648756  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.636376  8949 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.659416  5445 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:02.656132  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 277506us
I20260709 13:17:02.617228  8985 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.664425  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.670473  8945 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:02.671098  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.667570  8982 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.672132  8909 tablet_copy_client.cc:538] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:17:02.673753  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.676198  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.677251  5518 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:02.677513  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.677968  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.678318  5515 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:02.679308  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.679708  8985 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.680313  5519 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:02.686553  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.691219  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.691870  8567 raft_consensus.cc:2764] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:02.671252  8945 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:02.690940  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.697741  8992 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.698566  8567 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:02.694685  8945 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.693040  5445 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:02.710323  8941 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.711886  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:02.712754  5523 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.708144  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:02.711138  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 114616us
I20260709 13:17:02.665539  8949 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:02.727290  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.730016  8852 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:02.733405  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85482.4us
I20260709 13:17:02.749135  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.752985  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:02.753202  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45505us
I20260709 13:17:02.754236  5519 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:02.754907  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.729130  8955 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:02.757090  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99006.2us
I20260709 13:17:02.720492  8985 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.733757  8957 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:02.759889  9007 raft_consensus.cc:2764] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:02.761883  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.763098  8982 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:02.720834  8949 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:02.765305  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:02.718950  8735 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:02.777931  5519 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:02.779567  5524 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:02.775242  8949 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.781770  8663 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:02.787285  8675 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:02.789228  9018 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:02.789727  9018 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.790162  9018 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:02.794675  5340 leader_election.cc:400] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 3 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 3. Current term is 4.
I20260709 13:17:02.770104  8957 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:02.801229  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.795003  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.803275  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.810215  9007 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.810868  9007 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.812189  8831 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.813231  5447 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.819496  8909 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:17:02.826218  5447 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
W20260709 13:17:02.827394  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66113.3us
I20260709 13:17:02.832070  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.834981  5523 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10.
I20260709 13:17:02.793709  9021 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:02.808178  8985 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:02.841848  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65851.7us
I20260709 13:17:02.844067  5445 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:02.836478  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:17:02.813352  9007 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:02.848600  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:02.851094  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:02.851095  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69856.4us
I20260709 13:17:02.854302  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.841619  8985 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:02.856421  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:02.857800  9012 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.857910  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:02.858114  9022 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:02.859575  5444 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:02.859901  6077 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:02.860057  9022 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:02.860584  9022 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.861135  9005 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:02.861869  9012 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.864219  9012 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:02.866456  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.866848  9014 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:02.867380  9014 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.867199  8957 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.867415  9020 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.868644  8957 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.858474  9007 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:02.867900  9014 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.886834  5445 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:17:02.871829  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.873791  9016 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:02.889588  9016 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.890034  9016 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.890599  8831 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.869880  9007 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:02.892000  9007 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.852756  9001 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:02.893874  9001 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:02.894912  9001 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:02.870641  8735 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:17:02.874785  8852 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:17:02.875711  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 148576us
I20260709 13:17:02.899521  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.900846  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.878121  8985 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:02.902422  8985 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.881043  9019 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:02.906937  8990 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:02.883633  8949 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.887722  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:02.870003  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:02.911006  5444 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:02.908064  8952 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:02.912482  9005 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:02.914330  8663 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:02.916508  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:02.921881  8952 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:02.926905  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.927040  9014 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.927795  5366 raft_consensus.cc:2368] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:02.927850  8852 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:02.928751  8852 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:02.923658  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.928817  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.924999  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.932137  5371 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:02.927255  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.925859  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.933034  5369 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:02.933614  5373 raft_consensus.cc:2410] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:02.926017  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.934710  5374 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:02.926581  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.936113  5372 raft_consensus.cc:2410] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:02.923092  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.924006  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.937897  5367 raft_consensus.cc:2376] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9. Re-sending same reply.
I20260709 13:17:02.938458  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.929209  8852 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:02.939303  9019 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.939431  8852 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.940111  9019 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:02.940559  9018 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.941988  5449 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:02.928874  9009 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:02.942505  9009 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:02.943562  9009 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.944705  9018 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.929958  9014 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.930426  5368 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:02.931125  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.871563  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:02.945235  9009 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.968055  5370 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:02.965762  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.966159  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.969235  5373 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:02.966678  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.969904  5372 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.970778  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.970615  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.971755  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:02.973289  5374 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:02.973462  5367 raft_consensus.cc:2410] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:17:02.974941  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 123139us
I20260709 13:17:02.977175  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:02.901221  9022 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.972328  8990 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:02.983279  5375 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:02.980049  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.982764  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:02.988845  9008 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:02.989745  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.989665  9008 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.990667  5443 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:02.991284  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.992312  9008 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:02.994047  9012 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:02.994424  9016 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:02.994642  9012 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:02.990201  9022 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:02.977741  8981 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:02.999760  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:02.992988  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.976311  8992 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.995944  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 146112us
I20260709 13:17:03.003559  5370 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:03.000849  8831 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:02.979187  8775 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:17:03.005524  8992 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:03.008090  8992 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:03.012280  8949 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:03.013821  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:02.981774  8990 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.001897  5368 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:02.994424  9015 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:02.978971  9005 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:17:03.020232  5372 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:02.992990  9008 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:03.024446  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.019330  8831 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:03.027426  8949 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:03.032657  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 162866us
I20260709 13:17:03.032188  8831 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.033783  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:03.035887  5449 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:03.009249  9027 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.021178  8990 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:02.999045  9020 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.051230  5519 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:03.052376  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.019064  9019 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:03.022706  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44503.2us
I20260709 13:17:03.024055  8945 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:03.048039  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.026860  9008 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.049117  8949 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.056265  5375 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:03.063271  5517 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:03.063928  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.079175  8982 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:03.036839  8775 consensus_queue.cc:1243] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:03.066721  9012 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:03.025571  8981 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.024262  9022 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:03.045819  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.022310  9015 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.048206  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.077108  9008 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.076848  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:03.119200  5368 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:03.063912  5373 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:03.080947  5367 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:03.081215  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.081300  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:03.079813  8982 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.076988  9019 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:03.125670  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44445.1us
I20260709 13:17:03.120924  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:03.110448  5522 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:03.113963  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:03.090260  9018 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.122826  5369 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:03.138684  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:03.083577  9001 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.074163  5370 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:17:03.131002  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 97371us
I20260709 13:17:03.143877  5371 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:03.145493  5490 leader_election.cc:400] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:03.148101  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:03.150331  5442 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:03.145155  9007 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:03.147655  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:03.154407  6077 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:03.154711  5369 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:03.155936  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:03.157193  5368 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:03.158033  9019 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:03.117210  8981 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.148088  5449 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
I20260709 13:17:03.154206  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:03.154711  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:03.162106  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 148389us
I20260709 13:17:03.163981  5446 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:03.165691  9022 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:03.166565  9022 consensus_queue.cc:1243] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 53eb858bdf82438d83f1be6a01da2e0e log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:03.167171  9022 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:03.167500  9022 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:03.168900  5444 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:03.173695  5371 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:03.173506  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:03.176599  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:03.177603  5450 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:03.180684  5520 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:17:03.182531  5372 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:03.182958  5372 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.180764  5374 raft_consensus.cc:2368] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:17:03.166577  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:03.193022  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:03.165259  9007 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:03.117925  8949 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.203457  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.216869  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:03.218120  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:03.222283  5371 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.219230  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:03.232972  6070 raft_consensus.cc:2410] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:03.234279  9020 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:03.234431  9033 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.271s	user 0.005s	sys 0.000s
I20260709 13:17:03.235261  9020 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.196585  8990 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:03.237612  9042 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:03.168740  9018 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.231287  5372 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.164927  9001 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:03.217195  8567 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:03.206310  8831 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:03.269057  9035 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:17:03.279245  9018 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:03.236747  9020 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.192613  8675 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:17:03.281782  5372 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:03.290213  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59474.1us
I20260709 13:17:03.297199  5371 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
W20260709 13:17:03.305263  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 131069us
I20260709 13:17:03.310287  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.262841  8952 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:03.215350  9022 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:03.311034  5441 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:17:03.314010  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 122221us
I20260709 13:17:03.319152  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:03.302523  8957 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:03.312247  8675 consensus_queue.cc:1243] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:03.263748  8982 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.309830  6077 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:17:03.323112  9035 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.396116  9035 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.267374  9015 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.397048  9002 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:03.373696  8957 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:03.370893  9036 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.395203  5517 raft_consensus.cc:1217] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Deduplicated request from leader. Original: 8.4->[10.5-12.6]   Dedup: 10.5->[12.6-12.6]
I20260709 13:17:03.376508  8663 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:03.402011  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 98586.2us
I20260709 13:17:03.405601  5517 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 13:17:03.316859  8567 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.397482  9015 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.405088  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.398233  9022 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.447495  5372 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:03.323880  9007 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.402909  8945 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.454927  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49948.2us
I20260709 13:17:03.456282  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.418974  8990 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:03.451581  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.426339  8735 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:03.477855  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 95918.9us
W20260709 13:17:03.489444  9014 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:17:03.499390  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:03.500321  5445 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:03.501410  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.457433  9018 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:03.529488  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 144118us
W20260709 13:17:03.530804  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.541328  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85100.6us
I20260709 13:17:03.452987  8955 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:17:03.460625  9040 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:03.548561  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 235477us
W20260709 13:17:03.554466  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 102997us
I20260709 13:17:03.554744  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:03.438359  9036 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.563983  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.579525  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.530982  9018 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:03.528640  8735 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.579763  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.472009  9025 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:17:03.545933  8952 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.546684  9005 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.577060  9021 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.581885  9035 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:03.614413  9051 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:17:03.580224  8993 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:03.593008  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:03.594897  9048 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:17:03.594995  9050 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:17:03.595432  9032 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:03.595774  9044 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.596632  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:03.556445  9045 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:03.586340  9018 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:03.595005  9043 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:17:03.590061  9027 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.614078  9021 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.592165  8985 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:03.649875  5445 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:03.598886  8735 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:03.651543  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64706.6us
I20260709 13:17:03.529778  8945 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:03.652931  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.641146  9044 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.650851  9035 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.659543  9038 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.587598  9037 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.253s
I20260709 13:17:03.660988  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.547605  8957 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.668705  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:03.672111  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 115856us
I20260709 13:17:03.652626  9001 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:03.637168  9005 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:03.678776  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99318.9us
W20260709 13:17:03.683578  8981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.018s	sys 0.020s
W20260709 13:17:03.684243  8981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.018s	sys 0.020s
I20260709 13:17:03.658113  9032 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:03.671499  8831 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.690716  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.695415  8567 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:03.661011  9016 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:03.700549  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 122771us
I20260709 13:17:03.699216  9002 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:03.707453  9002 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.709352  8567 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:03.692956  9027 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:17:03.710177  9027 consensus_queue.cc:1243] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:03.710140  8567 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:03.711694  8567 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.712127  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.711724  9037 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:03.713696  9005 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:03.714279  9025 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.714849  8955 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.714182  9037 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.673991  9038 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:03.743077  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:03.693874  9040 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:03.753724  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:03.760398  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.764496  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:03.767302  9035 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.767944  9035 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.770625  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.771565  5520 raft_consensus.cc:2376] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4. Re-sending same reply.
I20260709 13:17:03.743099  9021 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:03.773751  8955 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:03.774201  8955 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.774575  8955 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.773087  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.775923  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:03.776189  5520 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:03.777824  5447 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:03.783571  5523 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:17:03.788367  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.667380  9045 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.785085  5523 pending_rounds.cc:85] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 5
I20260709 13:17:03.744670  8981 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:03.796444  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.806615  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:03.807291  5518 raft_consensus.cc:2376] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10. Re-sending same reply.
I20260709 13:17:03.809914  9066 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:03.810655  9066 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.811765  9066 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.801906  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:03.785001  9005 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:03.826713  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.838881  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.840531  8663 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.841171  5490 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.843185  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:03.844111  5518 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:17:03.792557  8985 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:03.793789  5523 pending_rounds.cc:107] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 10.6
I20260709 13:17:03.836530  9040 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.862006  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:03.864817  5523 raft_consensus.cc:2917] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Aborting config change with OpId 10.6: Aborted: Op aborted by new leader
I20260709 13:17:03.829066  8981 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:03.859517  9009 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.887s	user 0.013s	sys 0.000s
I20260709 13:17:03.849515  8567 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:03.903270  5523 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.818928  9002 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:03.915814  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:03.907400  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61632.9us
I20260709 13:17:03.922547  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:03.929840  9057 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:17:03.930673  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.932050  9019 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:03.932597  9019 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:03.933280  9061 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:17:03.933596  9019 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.934891  8831 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:03.933216  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:03.942752  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:03.850303  9005 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.958221  5517 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:03.930677  8981 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:03.974421  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:03.975175  5518 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:03.977962  5449 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:03.945600  9035 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:03.945008  9021 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.951025  8831 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.031404  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.026113  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:03.972829  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 130086us
I20260709 13:17:03.950851  8945 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:04.027676  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 105268us
I20260709 13:17:04.017395  8985 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.039845  5517 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:04.042245  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.031774  5518 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:04.047219  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:04.051131  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.051851  5449 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:04.041513  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34856 (request call id 6) took 7034 ms. Trace:
W20260709 13:17:04.042320  9015 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260709 13:17:04.020064  9044 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.027830  9025 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:04.074604  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.029161  9037 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.078712  5372 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:04.031867  8831 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.075302  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.074263  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.081190  5369 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:04.072206  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:04.044934  9009 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.082165  5373 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.023713  8982 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:04.083103  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.083860  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.087793  5368 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:04.089591  5521 raft_consensus.cc:1217] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-11.7]   Dedup: 8.5->[9.6-11.7]
I20260709 13:17:04.090124  5521 pending_rounds.cc:85] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 5
I20260709 13:17:04.066061  8567 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:04.070997  8945 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:04.091565  5366 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:04.094099  5521 pending_rounds.cc:107] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:04.094473  5521 raft_consensus.cc:2889] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.083586  8831 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.055253  5523 rpcz_store.cc:276] 0709 13:16:56.994702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.994876 (+   174us) service_pool.cc:224] Handling call
0709 13:16:57.080495 (+ 85619us) log.cc:844] Serialized 499 byte log entry
0709 13:16:57.475708 (+395213us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b18001602a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3ce5b0b 00007fc1d3d6ab63 00007fc1d3d92752 00007fc1d8d52d29
0709 13:16:58.597919 (+1122211us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b24001f93b8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0b259c4 00007fc1d0b23acb 00007fc1d0cdedc9 00007fc1d0cdea55 00007fc1d0cddfb0 00007fc1d3954488 00007fc1d3954be8 00007fc1d392c398 00007fc1d392776a 00007fc1d3926bb6
0709 13:17:03.973092 (+5375173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81333,"raft.queue_time_us":267604,"raft.run_cpu_time_us":2403,"raft.run_wall_time_us":166112,"spinlock_wait_cycles":182414080,"thread_start_us":134365,"threads_started":1,"wal-append.queue_time_us":242574,"wal-append.run_cpu_time_us":7779,"wal-append.run_wall_time_us":2294841}
I20260709 13:17:04.095885  8945 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:04.107338  9008 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.960s	user 0.014s	sys 0.001s
I20260709 13:17:04.107646  8567 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:04.110140  9083 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:17:04.107892  9008 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.112442  9085 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:17:04.113180  9085 consensus_queue.cc:1243] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:04.107271  8945 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.113369  9008 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:04.113459  9022 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.005s
I20260709 13:17:04.123847  5518 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:04.088790  9009 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:04.145278  5373 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:04.160776  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65290.4us
I20260709 13:17:04.160636  9087 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:17:04.161825  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:04.164187  9057 raft_consensus.cc:2764] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:17:04.164978  9057 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:04.166582  9057 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:04.168200  9071 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.165274  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:04.092547  9044 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:04.135327  9002 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.137307  9009 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.186224  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:04.188568  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.140615  9045 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.085099  9025 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.168629  9071 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:04.206511  5516 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:04.235076  9087 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:04.239708  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:04.288313  9087 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:04.238698  8852 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.298s	user 0.016s	sys 0.002s
I20260709 13:17:04.289686  8852 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.250006  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:04.290971  5366 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.291416  9087 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.235895  9021 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.240119  9085 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.239941  9007 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.292809  9021 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.225447  8567 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.294755  8567 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.296120  9021 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:04.246532  9075 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:17:04.241381  8663 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:04.295759  8852 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.297856  9007 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.272365  9025 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:04.292521  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52910.1us
I20260709 13:17:04.301679  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1557) took 1278 ms. Trace:
I20260709 13:17:04.302167  5447 rpcz_store.cc:276] 0709 13:17:03.023270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.023418 (+   148us) service_pool.cc:224] Handling call
0709 13:17:03.044069 (+ 20651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.778336 (+734267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.301376 (+523040us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540007dad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:04.301590 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686997376}
I20260709 13:17:04.303551  5373 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:04.280251  9074 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.439s	user 0.000s	sys 0.004s
I20260709 13:17:04.236908  9005 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.310662  6073 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:04.312870  6077 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:04.314896  9005 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.315862  9005 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:04.320564  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:04.299477  9072 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.462s	user 0.000s	sys 0.006s
I20260709 13:17:04.254411  9071 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.295899  9085 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.321141  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:04.251107  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.342190  9007 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.343374  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.343678  9087 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:04.344264  9087 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:04.345844  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:04.346474  9084 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:04.346927  9084 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:04.347466  9084 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.349782  9093 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.250742  5367 pending_rounds.cc:85] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 5
I20260709 13:17:04.350837  5367 pending_rounds.cc:107] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:17:04.351173  5367 raft_consensus.cc:2889] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.344172  9008 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:04.342083  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.351814  5523 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:04.345177  5369 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:04.352497  5369 pending_rounds.cc:85] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 5
I20260709 13:17:04.352783  5369 pending_rounds.cc:107] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:04.353060  5369 raft_consensus.cc:2889] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:04.353086  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.329599  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 152099us
I20260709 13:17:04.350325  9093 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.343128  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:04.283401  8955 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.001s
I20260709 13:17:04.361189  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.361301  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.356029  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:04.338371  9012 raft_consensus.cc:993] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:17:04.297294  8567 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.343098  9085 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.357647  9093 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.382481  5369 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:04.355664  9002 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.345917  9087 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.401065  9002 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:04.350559  9007 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:17:04.405719  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.406338  8567 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:04.366436  8949 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.408278  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:04.407594  9085 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:04.375715  9001 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.413292  9008 raft_consensus.cc:1081] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:17:04.411010  9002 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.415910  5516 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:04.368643  8955 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.407572  8981 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:04.442479  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 74465.4us
I20260709 13:17:04.448298  9100 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:17:04.449021  9005 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.449640  9005 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.449968  8955 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:04.437686  9018 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.002s
I20260709 13:17:04.451345  5519 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:04.455595  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 95267.6us
I20260709 13:17:04.414909  6070 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:17:04.450167  9005 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.459225  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:04.451814  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:04.427291  8831 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.460458  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:04.439411  8852 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:04.461714  9018 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.424034  8945 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.468519  5373 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:17:04.469830  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.473523  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.483247  5366 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:04.483472  5374 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:04.481300  5369 pending_rounds.cc:85] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 4
I20260709 13:17:04.484686  5369 pending_rounds.cc:107] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:04.484890  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.482091  5373 pending_rounds.cc:85] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 4
I20260709 13:17:04.488413  5373 pending_rounds.cc:107] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:04.488716  5373 raft_consensus.cc:2889] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.489809  9086 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:04.491288  9005 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.493121  9018 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.497110  9040 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.498039  9040 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.437870  9001 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:04.503310  9098 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:17:04.455634  8981 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.425321  8949 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:04.513249  8949 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:04.516630  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52203.6us
I20260709 13:17:04.463449  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:04.478196  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.485008  5369 raft_consensus.cc:2889] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:04.532480  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 69114.9us
I20260709 13:17:04.490717  9064 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 13:17:04.542634  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:04.543823  5449 raft_consensus.cc:2368] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:17:04.544760  9106 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:04.545291  9106 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.545754  9106 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.547910  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:04.500674  9040 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.480062  8852 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.550325  9036 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.552155  9018 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.552237  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.552968  9018 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.549304  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:04.553797  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:04.554607  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:04.555030  5442 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:04.557693  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.558524  5449 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:17:04.558944  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.559679  5450 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:17:04.559142  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:04.560771  5522 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:04.560731  5449 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:17:04.561777  5449 pending_rounds.cc:85] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 8
I20260709 13:17:04.562170  5449 pending_rounds.cc:107] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:17:04.562489  5449 raft_consensus.cc:2889] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.563378  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:04.564016  5366 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:04.481942  8663 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:04.511255  8981 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.567109  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:04.567611  5445 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:04.577003  5449 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.553237  9022 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:04.568037  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:04.570204  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:04.570422  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:04.578810  5446 raft_consensus.cc:2368] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
I20260709 13:17:04.578835  5447 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:04.582257  5416 leader_election.cc:400] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:17:04.582788  5416 leader_election.cc:403] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:04.552230  8852 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.585165  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.588135  5445 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:17:04.545684  9058 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:17:04.595131  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:04.567512  8663 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.531944  9044 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:17:04.566824  8567 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:04.598542  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:04.539346  9009 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:04.583701  8981 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:04.623469  5517 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:04.598395  9064 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.602427  8663 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:04.628579  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 93789.3us
I20260709 13:17:04.604437  9040 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10.
I20260709 13:17:04.608253  9014 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:04.636806  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58996.5us
I20260709 13:17:04.632586  5518 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:17:04.590026  9022 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:04.622217  9019 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:04.645855  5449 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
I20260709 13:17:04.632216  9118 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.648818  9005 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:04.635110  9064 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.642011  8831 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.683892  9064 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.685108  9005 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:04.668540  8985 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:04.667560  9019 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:04.686249  9005 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.687125  9019 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.677991  8945 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.647331  8567 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:04.692771  8567 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.629875  8981 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.698601  8909 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:17:04.670653  9118 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.646728  9014 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.722667  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.686257  8985 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.740708  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:04.741617  5372 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.743925  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.744994  5370 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:04.663609  9108 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:17:04.709239  9044 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:04.751832  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 120444us
I20260709 13:17:04.751997  5370 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:04.764858  8945 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:04.766022  9009 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:04.766196  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:04.766245  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.710902  9093 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.775629  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.793573  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:04.797269  5366 raft_consensus.cc:2410] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:04.797304  5449 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.748109  9018 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:04.751444  9022 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:04.837217  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.801745  8909 tablet_bootstrap.cc:492] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:17:04.849329  5445 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:04.850329  5372 raft_consensus.cc:2410] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:04.853500  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:04.854465  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.855278  5445 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:04.856655  5516 raft_consensus.cc:2368] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:17:04.859781  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.860700  5447 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:04.821756  8675 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.795943  9044 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.794543  9109 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:17:04.835229  9019 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:04.817785  8852 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:17:04.857693  9009 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.886677  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.819217  9058 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:17:04.874140  9080 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.864480  9022 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.890985  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:04.856802  9014 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:04.895061  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 72104.2us
I20260709 13:17:04.923240  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:04.895829  5449 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:04.915136  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 293320us
I20260709 13:17:04.927980  5446 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:04.882357  8735 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.894013  8909 ts_tablet_manager.cc:1403] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 2.075s	user 0.042s	sys 0.053s
I20260709 13:17:04.853032  9106 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.886473  8949 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:04.949834  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:04.942344  9102 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:17:04.961807  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 109090us
I20260709 13:17:04.961076  5524 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:04.880802  8675 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:04.975040  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:04.944307  9084 consensus_meta.cc:287] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.596s	user 0.006s	sys 0.014s
I20260709 13:17:04.945974  8831 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:04.893779  9019 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.941049  9040 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:04.994035  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:04.920712  9009 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.000340  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:05.000662  9114 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:17:05.001077  5524 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:05.002046  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:05.002611  5524 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.935590  9080 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.943943  8735 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:04.941958  9022 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:05.025743  9053 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.479s	user 0.008s	sys 0.001s
W20260709 13:17:05.032784  9129 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:17:05.035626  9127 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:17:05.037689  9123 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:17:05.044236  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:17:05.053887  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet c06ab136607a405bbdfe9d04f533a566: Aborted: Op aborted by new leader
W20260709 13:17:05.057823  9126 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:17:05.062461  9135 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:05.063319  9135 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.068111  9093 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.070909  9106 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.076637  9009 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:04.995841  8831 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.081840  8831 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.086089  8663 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:05.088569  9097 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.641s	user 0.001s	sys 0.000s
I20260709 13:17:05.091197  9019 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.091641  8981 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.092854  8985 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.094842  9044 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:05.096148  9112 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.375s	user 0.002s	sys 0.000s
I20260709 13:17:05.099215  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:05.100154  5517 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:05.101658  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:05.102468  5442 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:05.103688  5450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:17:05.104390  5450 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:05.104740  5450 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.106278  9020 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:05.106696  9020 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:04.966776  8949 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.107657  9020 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.108644  9020 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.109895  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.111430  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.112201  5441 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:05.112247  9080 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.111430  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:05.114786  5516 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.115665  8735 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.017673  9118 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.118538  9071 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:05.118443  6041 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
W20260709 13:17:05.119510  9132 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:17:05.121704  9102 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:17:05.124528  9022 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:05.127807  9134 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:05.105947  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.134718  8909 raft_consensus.cc:359] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:05.136004  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 206938us
I20260709 13:17:05.136226  5447 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:05.140738  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.130661  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1800) took 1372 ms. Trace:
I20260709 13:17:05.129319  6077 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:17:05.101347  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:05.089107  8663 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.171346  5340 leader_election.cc:400] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8.
I20260709 13:17:05.142170  5515 rpcz_store.cc:276] 0709 13:17:03.758164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.758334 (+   170us) service_pool.cc:224] Handling call
0709 13:17:03.758881 (+   547us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:03.777039 (+ 18158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.777087 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:03.809103 (+ 32016us) log.cc:844] Serialized 52 byte log entry
0709 13:17:03.900364 (+ 91261us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:03.912614 (+ 12250us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.129706 (+1217092us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b180040db60. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287
0709 13:17:05.129901 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.129993 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.130058 (+    65us) raft_consensus.cc:1685] finished
0709 13:17:05.130189 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.130535 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12072,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2952,"raft.queue_time_us":88452,"raft.run_cpu_time_us":1803,"raft.run_wall_time_us":22822,"spinlock_wait_cycles":6197504,"thread_start_us":154251,"threads_started":2,"wal-append.queue_time_us":110137,"wal-append.run_cpu_time_us":4842,"wal-append.run_wall_time_us":1170136}
I20260709 13:17:05.138476  8949 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.173580  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:04.997174  9084 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.167634  5450 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.180590  5447 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:05.145473  9002 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.200691  9143 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:05.200423  9100 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:05.209393  9135 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.210798  9008 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:05.211391  9008 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.212698  9107 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.214875  9086 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:05.215358  9086 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.217578  9055 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.217775  8663 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:05.218386  8663 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:05.219920  9137 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:17:05.168601  9022 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:05.237409  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1555) took 1512 ms. Trace:
I20260709 13:17:05.237990  5375 rpcz_store.cc:276] 0709 13:17:03.723818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.738272 (+ 14454us) service_pool.cc:224] Handling call
0709 13:17:05.235080 (+1496808us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54000e0bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:05.235312 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861112064}
W20260709 13:17:05.255859  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 119668us
W20260709 13:17:05.262209  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 432745us
I20260709 13:17:05.266477  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:05.221870  8949 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:05.269073  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 95605.7us
I20260709 13:17:05.217613  8567 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.271739  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:05.272787  5524 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:05.277412  5450 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.279817  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.281690  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:05.282968  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.283107  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.287386  5446 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:05.290688  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.292248  5447 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:05.294646  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.272300  8909 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:17:05.298095  5443 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:05.296133  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.298635  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.322506  9111 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:05.388055  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92023.9us
I20260709 13:17:05.389660  5340 leader_election.cc:400] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
I20260709 13:17:05.390091  5340 leader_election.cc:403] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:05.391462  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.296886  9055 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:05.370397  9008 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:05.401201  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 102637us
I20260709 13:17:05.292557  8567 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:17:05.363633  8909 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:05.337244  9027 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.338173  9012 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:05.291587  9100 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:05.347397  5441 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:05.345276  5516 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:05.359565  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.378466  5415 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.417560  5518 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:05.382902  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101292us
I20260709 13:17:05.367071  8663 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:05.334082  9063 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.591s	user 0.003s	sys 0.007s
I20260709 13:17:05.335851  9002 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.349161  5446 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.213299  9107 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.350051  5447 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:05.324409  9105 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:05.349668  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49825.6us
I20260709 13:17:05.346637  5448 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:05.393085  9108 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:05.402637  9025 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.400208  5524 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:05.336628  8949 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:05.402097  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.439299  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:05.422384  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.422101  5441 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:05.394033  9111 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.430318  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.414858  9147 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.415766  9035 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:05.416385  9012 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:05.422144  9015 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.421751  8955 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:05.422103  9019 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:05.454061  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.493455  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:05.494225  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1600) took 1723 ms. Trace:
I20260709 13:17:05.500557  9124 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.482015  9100 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:17:05.500134  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46163.7us
I20260709 13:17:05.502077  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.482963  5518 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:05.454923  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52930.3us
I20260709 13:17:05.504889  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.428815  9020 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:05.495015  9135 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.494709  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.492172  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:05.517993  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:05.518275  5447 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.487028  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.403743  9055 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.519784  5443 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:05.499927  5441 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.500061  5519 rpcz_store.cc:276] 0709 13:17:03.771266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.776153 (+  4887us) service_pool.cc:224] Handling call
0709 13:17:03.802842 (+ 26689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.461817 (+658975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.493890 (+1032073us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54002b9654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:05.494148 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490895104}
I20260709 13:17:05.433907  9002 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.404214  9080 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:05.431749  9105 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:05.564245  5373 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:05.523718  5446 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:05.450990  8735 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.524519  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.567740  5450 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:05.525405  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:05.415324  9139 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:17:05.533676  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:05.534276  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.534442  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:05.502202  9019 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.576303  5369 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.532780  9058 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:05.535750  9118 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:05.536142  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.536387  9065 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.189s
W20260709 13:17:05.574703  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 145262us
I20260709 13:17:05.537714  5372 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:05.538828  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:05.541172  9153 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:05.541601  9018 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:05.550724  9012 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.501195  9008 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:05.555882  9138 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:05.557392  9080 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.511173  9125 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.455574  9044 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:17:05.561825  9055 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.450147  9111 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.438993  8949 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.564807  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.565379  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.477631  9045 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:05.522151  9015 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.452139  9035 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.418965  9027 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:05.675866  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 74792.6us
W20260709 13:17:05.676718  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 143944us
I20260709 13:17:05.596974  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:05.597781  5414 leader_election.cc:400] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:17:05.678270  5414 leader_election.cc:403] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:05.598467  5450 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:05.599036  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:05.454741  8985 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:17:05.604676  9008 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:05.641980  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:05.689980  5368 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.517798  9014 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.473074  9001 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.605089  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.526342  9084 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.638636  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:05.653730  9012 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.648386  5446 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.571167  9105 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.533507  9141 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:05.572697  9085 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.563413  9020 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.638669  8663 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:05.688536  5518 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:05.696823  5519 raft_consensus.cc:2410] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:05.647747  5441 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:05.529098  9135 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.675706  9035 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.602711  9019 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.605325  9018 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:05.703544  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 138813us
I20260709 13:17:05.659305  8949 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.455869  9147 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.698020  9008 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.657677  9045 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:05.600193  9108 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:17:05.642962  9007 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:17:05.751543  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.754619  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.650089  9125 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:05.738166  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53931us
I20260709 13:17:05.717706  5447 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:05.794536  5445 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:05.744621  5369 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:05.605501  9086 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.735270  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.740893  9018 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:05.798079  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46693.9us
W20260709 13:17:05.801795  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66669.1us
I20260709 13:17:05.747728  9005 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.690152  9138 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:17:05.807080  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1617) took 1488 ms. Trace:
I20260709 13:17:05.813589  5523 rpcz_store.cc:276] 0709 13:17:04.319103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.321451 (+  2348us) service_pool.cc:224] Handling call
0709 13:17:04.321870 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.352348 (+ 30478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.799331 (+1446983us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5400368b54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:05.806998 (+  7667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67868544}
I20260709 13:17:05.758625  8909 ts_tablet_manager.cc:1434] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.813s	user 0.011s	sys 0.019s
I20260709 13:17:05.816773  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.804382  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.820546  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.746990  9087 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:17:05.794409  9149 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:17:05.737669  8663 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.818879  9005 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.690280  9100 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:05.816623  9152 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.810523  9110 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:05.817246  8909 ts_tablet_manager.cc:1467] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Tablet startup took 874ms
I20260709 13:17:05.826777  9107 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.849040  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.838872  9007 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:05.864274  9161 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:05.864770  9161 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.865137  9161 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.892719  9080 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.894268  9027 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.899173  8663 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:05.902385  9071 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.783s	user 0.016s	sys 0.001s
I20260709 13:17:05.904241  5370 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:17:05.863461  9007 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.906021  9007 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.907186  9086 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.908664  9140 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.843281  9045 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:05.910207  9045 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.910521  9135 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.910851  9015 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.911867  9125 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:05.914129  9166 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:05.909543  9147 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.915131  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:05.916006  9163 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:05.916273  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 1977) took 1938 ms. Trace:
I20260709 13:17:05.861347  9084 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:17:05.916661  5444 rpcz_store.cc:276] 0709 13:17:03.977991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.978111 (+   120us) service_pool.cc:224] Handling call
0709 13:17:04.027227 (+ 49116us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:04.041627 (+ 14400us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:04.136261 (+ 94634us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.504294 (+1368033us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b1800368980. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a
0709 13:17:05.504524 (+   230us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:05.530612 (+ 26088us) log.cc:844] Serialized 78 byte log entry
0709 13:17:05.686966 (+156354us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:05.687030 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.687132 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.915915 (+228783us) raft_consensus.cc:1685] finished
0709 13:17:05.916033 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.916206 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":297111,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":23396,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":11679,"spinlock_wait_cycles":35399296,"thread_start_us":458397,"threads_started":3,"wal-append.queue_time_us":562495,"wal-append.run_cpu_time_us":1709,"wal-append.run_wall_time_us":1038204}
I20260709 13:17:05.918561  9025 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
W20260709 13:17:05.848814  8909 ts_tablet_manager.cc:1469] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Trace:
0709 13:16:58.958349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.961278 (+  2929us) service_pool.cc:224] Handling call
0709 13:16:59.304492 (+343214us) ts_tablet_manager.cc:934] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
0709 13:17:00.734349 (+1429857us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:01.361140 (+626791us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:01.361266 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:01.739625 (+378359us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:01.739980 (+   355us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:01.740357 (+   377us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:01.740430 (+    73us) inbound_call.cc:177] Queueing success response
0709 13:17:02.818941 (+1078511us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:17:04.962777 (+2143836us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:17:05.129447 (+166670us) tablet_replica.cc:261] Starting instrumentation
0709 13:17:05.130493 (+  1046us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":20945,"raft.queue_time_us":5067,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":11326,"tablet-copy.queue_time_us":149183,"tablet-download-pool.queue_time_us":261,"tablet-download-pool.run_cpu_time_us":1562,"tablet-download-pool.run_wall_time_us":862721,"thread_start_us":205552,"threads_started":2}
W20260709 13:17:05.863745  8831 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.013s
I20260709 13:17:05.924072  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:05.927933  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82891us
I20260709 13:17:05.935902  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:05.937922  5375 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:05.939967  5534 tablet_copy_service.cc:342] P 544c82a50cc4477886bb6f7d58f455ca: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-c06ab136607a405bbdfe9d04f533a566 received from {username='slave'} at 127.0.0.1:34858
I20260709 13:17:05.940744  5534 tablet_copy_service.cc:434] P 544c82a50cc4477886bb6f7d58f455ca: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-c06ab136607a405bbdfe9d04f533a566 on tablet c06ab136607a405bbdfe9d04f533a566 with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:05.945834  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:05.947273  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:05.948485  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.949147  5367 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
W20260709 13:17:05.961046  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 392033us
I20260709 13:17:05.924466  9133 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.925006  9020 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:05.966167  5519 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:05.960968  9140 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.972911  9140 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:05.975075  9140 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:05.924273  9144 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:05.926215  9005 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.968899  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:05.968822  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:05.983609  5368 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:05.985101  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.988102  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.992399  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.993882  5368 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:05.996652  6070 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:05.997179  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:05.986827  9133 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.005934  5371 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:06.006247  9008 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.008106  9144 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.008528  9002 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:06.006325  9007 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.010687  9144 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:05.926523  8831 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.041754  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:06.044195  5523 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:06.046279  5367 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:06.043278  9147 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:05.996029  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:06.119124  5367 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:06.122275  5519 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:06.067658  5442 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:06.049724  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.050088  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.048085  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.135552  5367 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:06.135676  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.136410  5523 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:06.137528  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.138548  5519 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:06.139791  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.140873  5519 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 4.
W20260709 13:17:06.144635  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 148711us
I20260709 13:17:06.151574  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.154702  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:06.155575  5522 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:06.155958  5522 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:06.090021  9008 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:06.159983  5367 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:06.161979  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.162006  5367 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:06.162789  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:06.163374  5449 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.117295  9007 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:06.153780  9147 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.156934  5522 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.185576  5522 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:06.188969  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 142858us
I20260709 13:17:06.191432  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:06.194183  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:06.195910  9176 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:06.196732  9176 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.184603  9002 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:06.197914  9135 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:06.200110  9176 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:06.204689  9018 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.206543  8831 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:06.206909  9135 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:06.207485  9018 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:06.172041  9111 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:06.207942  9135 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.209569  9175 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.210165  9111 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:06.210105  9175 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.212141  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:06.212440  9175 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:06.214048  9176 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:06.214564  9176 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:06.215251  5369 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:06.215487  9176 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.219893  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:06.222252  9035 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.222553  9045 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:06.222623  9175 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:06.223356  9045 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:06.224675  9035 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:06.225661  5517 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:06.225994  9045 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:06.226692  9027 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:06.227245  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1820) took 1018 ms. Trace:
I20260709 13:17:06.227626  5517 rpcz_store.cc:276] 0709 13:17:05.208528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.448618 (+240090us) service_pool.cc:224] Handling call
0709 13:17:05.502218 (+ 53600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.226133 (+723915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.226984 (+   851us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540025c1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:06.227186 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1663169920}
I20260709 13:17:06.229396  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:06.230331  9175 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:06.231415  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:06.231437  9175 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:06.232391  9175 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.232661  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:06.232815  9175 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.159106  9105 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.235509  9105 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:06.231571  9145 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:06.236055  9145 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:06.236976  9145 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.238196  9145 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.230316  8949 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.239292  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:06.242311  5374 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:06.242532  8831 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:06.243213  8949 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:06.243474  8831 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:06.244719  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:06.245415  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.238252  9012 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 13:17:06.247339  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:06.254894  5524 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:06.249697  5522 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:06.243942  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:06.257498  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:06.258045  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.258107  5521 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.258942  5519 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:06.243877  8831 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.222707  9147 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:06.260510  8831 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.261780  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.261509  9175 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.262938  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:06.263829  5523 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:06.276253  9149 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:06.276966  9149 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.277516  9149 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.277591  8949 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:06.278781  9159 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.793s	user 0.006s	sys 0.007s
I20260709 13:17:06.664733  8675 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:06.674463  9044 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:06.318998  9147 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:06.842973  9044 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:06.496665  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:06.844108  9044 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.845495  9044 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.845589  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:06.863526  5444 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:06.663127  8955 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:06.864351  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.850188  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:06.518049  5447 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:06.853133  9135 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.010s	sys 0.012s
I20260709 13:17:06.843108  9147 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:06.740914  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1631) took 1701 ms. Trace:
I20260709 13:17:06.301596  5449 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
W20260709 13:17:06.857281  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.858461  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2072) took 1289 ms. Trace:
I20260709 13:17:06.840641  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1579) took 1296 ms. Trace:
W20260709 13:17:06.691044  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.597575  8957 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.894233  5515 rpcz_store.cc:276] 0709 13:17:05.040559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.417518 (+376959us) service_pool.cc:224] Handling call
0709 13:17:05.417903 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.562483 (+144580us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:05.719110 (+156627us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.211182 (+492072us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b180014ac40. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a
0709 13:17:06.211399 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.211453 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.211516 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.740569 (+529053us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001649d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:06.740639 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.740837 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13377,"prepare.queue_time_us":249626,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":13929,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":339582208,"thread_start_us":275069,"threads_started":2,"wal-append.queue_time_us":246881}
I20260709 13:17:06.893141  5372 rpcz_store.cc:276] 0709 13:17:05.568741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.254402 (+685661us) service_pool.cc:224] Handling call
0709 13:17:06.857716 (+603314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.857985 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.858026 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.858088 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:06.858135 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.858217 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.858380 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:06.896925  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.278959  8949 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:06.898128  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.282655  9161 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.906822  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:06.908394  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:06.909332  5442 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:06.909591  5518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.007s	sys 0.021s
I20260709 13:17:06.598876  8735 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:06.909976  5518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.007s	sys 0.021s
I20260709 13:17:06.497694  9018 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.908615  9161 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:06.891973  5371 rpcz_store.cc:276] 0709 13:17:05.544274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.006807 (+462533us) service_pool.cc:224] Handling call
0709 13:17:06.007244 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.043757 (+ 36513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.043790 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.047804 (+  4014us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.178852 (+131048us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:06.178900 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.178975 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.336603 (+157628us) raft_consensus.cc:1685] finished
0709 13:17:06.336634 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.840566 (+503932us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11713,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4165,"thread_start_us":88299,"threads_started":1,"wal-append.queue_time_us":232199}
I20260709 13:17:06.917862  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.922194  5515 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:06.281311  9019 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:06.889801  9135 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.011s	sys 0.012s
I20260709 13:17:06.332554  9021 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:06.910697  8945 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.002s	sys 0.016s
I20260709 13:17:06.939031  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:06.953487  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:06.955035  5371 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 4.
I20260709 13:17:06.892107  8955 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.946431  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:06.946777  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.947420  5521 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.000s
W20260709 13:17:06.979022  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.918099  8735 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:06.931766  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 81698.4us
I20260709 13:17:06.943979  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.976903  8981 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:06.978370  5521 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:06.987200  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.988871  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.958529  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:06.980499  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.983526  5441 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:17:06.979758  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.991587  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.992045  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.991565  5515 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:06.995222  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.992672  5518 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:06.997543  5446 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:06.997987  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:06.999233  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1630) took 1962 ms. Trace:
I20260709 13:17:06.945638  8852 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.945397  8952 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.905284  8949 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:06.999760  5516 rpcz_store.cc:276] 0709 13:17:05.037317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.416371 (+379054us) service_pool.cc:224] Handling call
0709 13:17:05.416710 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.428101 (+ 11391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.428137 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.428650 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.486173 (+ 57523us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:05.486219 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.486288 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.278100 (+791812us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:06.982868 (+704768us) raft_consensus.cc:1685] finished
0709 13:17:06.982894 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.999140 (+ 16246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4409,"raft.queue_time_us":6898,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8011,"spinlock_wait_cycles":34060160,"thread_start_us":32808,"threads_started":1,"wal-append.queue_time_us":53768}
W20260709 13:17:06.948297  8945 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.003s	sys 0.016s
I20260709 13:17:06.928014  9018 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.068447  5521 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:07.071955  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:06.945165  9021 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:07.073210  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:06.983739  9143 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.955986  9036 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:06.986032  8981 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:06.948751  9027 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:07.004485  9035 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:07.054335  9135 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:07.066682  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:06.981143  8775 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:06.949463  9009 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:07.001525  9066 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.092340  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:07.091238  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:07.002012  9175 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:07.150815  5523 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:07.124022  5371 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:07.091956  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:07.136696  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:07.155916  5516 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:07.078423  8852 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:07.153482  5416 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.735s (SENT) [suppressed 3 similar messages]
I20260709 13:17:07.126961  9143 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:07.176980  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:07.083578  8952 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.078527  9147 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.200593  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:07.197114  5523 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:07.203656  5444 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:07.197997  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:07.137718  9036 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.152169  9009 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.154728  9066 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.168699  8775 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:07.237294  6042 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:07.153411  9135 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.159348  9035 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.167680  8735 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.208309  9040 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:07.159500  8949 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:07.245321  8831 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.984s	user 0.010s	sys 0.003s
I20260709 13:17:07.262014  5371 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:07.246912  5523 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:07.256006  6077 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:07.272583  5444 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:07.248966  9190 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:07.249112  9156 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:07.447813  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:07.449554  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.254518  8735 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:07.462723  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.421769  9185 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:17:07.464572  5413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.129s	sys 0.170s
W20260709 13:17:07.471823  5413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.129s	sys 0.170s
W20260709 13:17:07.465690  9182 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:17:07.264953  9040 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:07.257920  9019 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:07.422127  8949 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.252449  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:07.269901  8831 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.444775  9018 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:07.498708  5523 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:07.490193  9186 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:17:07.474502  9156 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:07.497390  8981 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:07.502584  8775 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:07.503026  9035 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:07.498391  9019 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.503839  8831 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:07.510754  9036 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:07.511297  5450 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:07.510842  9191 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:07.534336  9019 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.501545  9018 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.538867  5488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.006s	sys 0.009s
W20260709 13:17:07.539530  5488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.006s	sys 0.010s
I20260709 13:17:07.530526  8981 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.540364  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 473724us
W20260709 13:17:07.545614  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.001s	sys 0.014s
I20260709 13:17:07.529594  8992 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.545406  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.007s	sys 0.008s
W20260709 13:17:07.554806  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.008s
I20260709 13:17:07.498020  9130 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:07.550529  5372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.002s	sys 0.014s
I20260709 13:17:07.540622  9036 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.541924  9189 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 13:17:07.559989  5519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.004s	sys 0.012s
W20260709 13:17:07.561180  5519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.004s	sys 0.012s
W20260709 13:17:07.562314  5517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.004s	sys 0.012s
W20260709 13:17:07.562902  5517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.005s	sys 0.012s
W20260709 13:17:07.554831  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.006s	sys 0.010s
I20260709 13:17:07.538998  8831 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.534578  9191 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:07.558524  5372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.002s	sys 0.014s
W20260709 13:17:07.550273  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.002s	sys 0.014s
W20260709 13:17:07.540227  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.540361  9143 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:07.564314  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1584) took 1243 ms. Trace:
W20260709 13:17:07.574663  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 681188us
I20260709 13:17:07.549957  8852 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:07.564246  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.006s	sys 0.010s
W20260709 13:17:07.566120  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 570628us
I20260709 13:17:07.574050  5442 rpcz_store.cc:276] 0709 13:17:06.320511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.320657 (+   146us) service_pool.cc:224] Handling call
0709 13:17:06.846514 (+525857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.909875 (+ 63361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.564056 (+654181us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b540033d6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:07.564251 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143865600}
I20260709 13:17:07.576972  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:17:07.577662  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.580266  6077 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
W20260709 13:17:07.580585  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.580899  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 427467us
W20260709 13:17:07.587633  5449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.022s	sys 0.030s
W20260709 13:17:07.588155  5449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.022s	sys 0.030s
I20260709 13:17:07.556939  9035 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:07.592393  5368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.008s	sys 0.011s
I20260709 13:17:07.614156  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:07.621075  5522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.021s
W20260709 13:17:07.623075  5443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.007s	sys 0.019s
W20260709 13:17:07.623822  5443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.007s	sys 0.019s
I20260709 13:17:07.544775  9018 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.591557  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:07.622136  5368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.010s	sys 0.016s
W20260709 13:17:07.623188  5522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.000s	sys 0.022s
W20260709 13:17:07.625857  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67452.5us
I20260709 13:17:07.547853  8981 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:07.630996  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.632505  5373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.011s	sys 0.016s
W20260709 13:17:07.633167  5373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.011s	sys 0.016s
W20260709 13:17:07.634753  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.530715  9156 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:07.580662  9027 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:07.560077  8992 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.590080  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:07.565042  9036 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.570737  9130 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.559790  9040 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.680258  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 307) took 1748 ms. Trace:
I20260709 13:17:07.693272  5375 rpcz_store.cc:276] 0709 13:17:05.932051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.679229 (+1747178us) service_pool.cc:224] Handling call
0709 13:17:07.679574 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.679807 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.679845 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.679906 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.679963 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.680037 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.680179 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:07.665755  5366 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.005s	sys 0.017s
W20260709 13:17:07.695072  5366 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.006s	sys 0.018s
I20260709 13:17:07.586273  8567 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:07.700369  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1574) took 2151 ms. Trace:
W20260709 13:17:07.696734  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.637866  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:07.573052  9066 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:07.702903  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:07.701015  5373 rpcz_store.cc:276] 0709 13:17:05.542866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.999227 (+456361us) service_pool.cc:224] Handling call
0709 13:17:05.999515 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.999690 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:06.167331 (+167641us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.693443 (+1526112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.693505 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.693549 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.693616 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.693744 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":414376,"prepare.queue_time_us":191432,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":368926,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":17270,"thread_start_us":1282850,"threads_started":3,"wal-append.queue_time_us":918331}
I20260709 13:17:07.669832  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:07.619854  9110 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:07.664040  8952 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:07.706421  9080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.037s	sys 0.038s
I20260709 13:17:07.740406  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:07.638679  9143 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:07.623373  9009 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:07.591485  8852 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.699849  8567 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:07.691622  9065 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:07.712754  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:07.743959  9080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.037s	sys 0.038s
I20260709 13:17:07.578960  8831 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.775789  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:07.776497  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:07.712091  9066 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.633927  9035 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:07.749362  8945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.019s
I20260709 13:17:07.756371  8952 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.799948  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:07.800625  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:07.803270  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 208526us
I20260709 13:17:07.802507  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:07.858757  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:07.751368  9110 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:07.859601  5373 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
W20260709 13:17:07.799865  8945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.012s	sys 0.019s
I20260709 13:17:07.782673  9211 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.772058  9143 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:07.816409  9149 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.538s	user 0.012s	sys 0.003s
I20260709 13:17:07.873440  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:07.883594  5375 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.874004  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1575) took 2572 ms. Trace:
I20260709 13:17:07.877650  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:07.780643  8852 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:07.877686  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.808812  9204 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:07.803464  9197 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:07.782334  9065 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:07.865968  9118 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:07.884944  5445 rpcz_store.cc:276] 0709 13:17:05.299041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.323196 (+ 24155us) service_pool.cc:224] Handling call
0709 13:17:05.337720 (+ 14524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.805625 (+467905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.867061 (+2061436us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54003bcc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:07.868936 (+  1875us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942423936}
I20260709 13:17:07.888389  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:07.888705  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 297195us
I20260709 13:17:07.859297  9161 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:07.932211  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:07.887929  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.797290  9066 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.807921  8952 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.944283  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:07.947103  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 134835us
I20260709 13:17:07.955777  5445 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:07.957811  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 254983us
I20260709 13:17:07.970067  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:07.868175  9195 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:17:07.972697  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:07.975124  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:07.975580  9014 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:07.978056  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1650) took 1712 ms. Trace:
I20260709 13:17:07.882527  9211 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.931582  9199 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:07.978515  5367 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:17:07.953923  9161 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:07.960356  8981 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:07.987406  5375 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:07.989470  5445 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:07.872584  9196 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:17:07.872678  9212 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:17:07.909864  9207 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:08.001762  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.991080  5519 rpcz_store.cc:276] 0709 13:17:06.265496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.266354 (+   858us) service_pool.cc:224] Handling call
0709 13:17:06.844617 (+578263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.579813 (+735196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.580594 (+   781us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.624397 (+ 43803us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.860815 (+236418us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:07.860867 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.860950 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.977796 (+116846us) raft_consensus.cc:1685] finished
0709 13:17:07.977821 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.977989 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89409,"raft.queue_time_us":136175,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":17890,"thread_start_us":821721,"threads_started":2,"wal-append.queue_time_us":319758}
I20260709 13:17:07.864650  9027 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.025149  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:07.978075  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:08.052208  5448 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:08.022794  5367 pending_rounds.cc:85] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 5
I20260709 13:17:07.963649  9191 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.052732  5367 pending_rounds.cc:107] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 13:17:08.041868  5489 consensus_peers.cc:597] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9d883e5d309d4113a821624777a85d05. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.895856  9149 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.042148  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:08.044734  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 430667us
W20260709 13:17:08.046466  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 89657.4us
I20260709 13:17:08.045801  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:08.053205  5367 raft_consensus.cc:2889] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:08.053853  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 80708.6us
I20260709 13:17:07.945808  9118 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.984345  9018 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:07.932649  9197 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:07.994959  9122 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:08.075716  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 130529us
W20260709 13:17:08.077646  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.985523  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59508 (request call id 115) took 2683 ms. Trace:
I20260709 13:17:08.057454  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.081025  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:08.082672  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.083917  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:07.993147  9117 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:07.905853  9204 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.050861  9130 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:07.938249  8567 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:08.115532  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.116628  5442 raft_consensus.cc:2368] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6.
I20260709 13:17:08.075771  9212 consensus_queue.cc:1243] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:08.119278  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.146008  5450 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 4.
I20260709 13:17:08.116842  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.119611  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.147222  5448 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
W20260709 13:17:08.119949  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67603.1us
W20260709 13:17:08.121001  9193 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:17:08.157687  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1649) took 1892 ms. Trace:
I20260709 13:17:08.158198  5517 rpcz_store.cc:276] 0709 13:17:06.265161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.265817 (+   656us) service_pool.cc:224] Handling call
0709 13:17:06.319829 (+ 54012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.854998 (+535169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.855038 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.856012 (+   974us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.563536 (+707524us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:07.563578 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.563643 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.157360 (+593717us) raft_consensus.cc:1685] finished
0709 13:17:08.157389 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.157607 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":614886,"raft.queue_time_us":534842,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":30921,"thread_start_us":647354,"threads_started":1,"wal-append.queue_time_us":989784}
I20260709 13:17:08.092664  9122 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:08.123793  9036 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:08.125296  9216 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:17:08.135685  8957 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.238s	user 0.012s	sys 0.002s
I20260709 13:17:08.137470  9118 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.138368  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:08.098647  6070 rpcz_store.cc:276] 0709 13:17:05.279215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.289878 (+ 10663us) service_pool.cc:224] Handling call
0709 13:17:05.346368 (+ 56490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.997397 (+651029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.936278 (+1938881us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b5400406d54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:07.962633 (+ 26355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1466849664}
I20260709 13:17:08.155300  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.164731  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.167111  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:08.167724  5373 raft_consensus.cc:2376] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8. Re-sending same reply.
I20260709 13:17:08.168660  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.022014  9021 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.176384  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.177695  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1592) took 1205 ms. Trace:
I20260709 13:17:08.179720  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:08.140208  9130 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.178239  5441 rpcz_store.cc:276] 0709 13:17:06.972391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.972616 (+   225us) service_pool.cc:224] Handling call
0709 13:17:06.977528 (+  4912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.991362 (+ 13834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.177379 (+1186017us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b54001798d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:08.177613 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12936576}
I20260709 13:17:08.121693  9199 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:08.173032  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:08.165979  9044 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.274s	user 0.007s	sys 0.007s
I20260709 13:17:08.127082  9133 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:08.198282  5368 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.002s	sys 0.007s
I20260709 13:17:08.117282  8981 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:17:08.074510  9207 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.148984  8992 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.196194  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.169700  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:08.176819  9203 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:17:08.161646  8567 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.218312  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:08.166334  9122 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.121351  9223 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:17:08.229527  5516 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.226742  5373 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:08.237203  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.239161  5373 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:08.183804  9036 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:08.219713  5368 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.003s	sys 0.008s
I20260709 13:17:08.118235  9117 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.210371  9199 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.201481  8831 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.219767  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.240772  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.184211  9084 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:17:08.210203  9018 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.246022  9200 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:17:08.218719  9035 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:08.240723  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 117565us
I20260709 13:17:08.245925  9036 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:08.183722  8675 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:17:08.242290  9143 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.169340  9201 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:17:08.228987  9110 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:08.234333  9239 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.336166  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.270927  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.254437  9142 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.273370  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1824) took 1407 ms. Trace:
I20260709 13:17:08.274523  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.275207  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.264983  9212 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:17:08.279361  9117 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.264497  9199 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.281634  9018 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:08.284699  9198 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:08.286662  9221 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:08.288156  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 306) took 2523 ms. Trace:
W20260709 13:17:08.288350  9220 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:17:08.289139  9227 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:08.289258  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:08.238809  8852 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.325783  5516 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:08.355583  5375 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.356511  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.290429  6073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59510 (request call id 127) took 1040 ms. Trace:
I20260709 13:17:08.214200  9130 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.328105  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1605) took 1200 ms. Trace:
I20260709 13:17:08.362675  5444 rpcz_store.cc:276] 0709 13:17:07.127686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.460615 (+332929us) service_pool.cc:224] Handling call
0709 13:17:07.487834 (+ 27219us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:07.793911 (+306077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.793995 (+    84us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:07.871679 (+ 77684us) log.cc:844] Serialized 52 byte log entry
0709 13:17:08.079393 (+207714us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:08.079529 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.079747 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.327875 (+248128us) raft_consensus.cc:1685] finished
0709 13:17:08.327895 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.328043 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2509,"raft.queue_time_us":98380,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":32132,"thread_start_us":409563,"threads_started":2,"wal-append.queue_time_us":374386}
I20260709 13:17:08.253177  5520 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:08.333138  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:08.337517  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 184899us
W20260709 13:17:08.270571  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 113957us
I20260709 13:17:08.339982  5373 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:08.370883  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.371528  5373 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:08.372581  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.313776  9019 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.249611  9196 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:17:08.341992  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.342664  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2076) took 2490 ms. Trace:
W20260709 13:17:08.329886  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 156955us
I20260709 13:17:08.301553  9066 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.340582  5518 rpcz_store.cc:276] 0709 13:17:06.866150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.997033 (+130883us) service_pool.cc:224] Handling call
0709 13:17:06.997399 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.245100 (+247701us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:07.245133 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.256519 (+ 11386us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.749833 (+493314us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:07.749899 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.981894 (+231995us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400369f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:07.981945 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.256678 (+274733us) raft_consensus.cc:1685] finished
0709 13:17:08.256712 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.273268 (+ 16556us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6447,"spinlock_wait_cycles":568647552,"thread_start_us":485387,"threads_started":1,"wal-append.queue_time_us":626089}
W20260709 13:17:08.331756  9145 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 2.093s	user 0.010s	sys 0.008s
W20260709 13:17:08.334424  9215 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 13:17:08.331101  9036 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:08.349048  9224 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:17:08.348944  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:08.351482  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.386947  5524 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:08.387135  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.346236  5370 rpcz_store.cc:276] 0709 13:17:05.764579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.269665 (+505086us) service_pool.cc:224] Handling call
0709 13:17:08.287358 (+2017693us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:17:08.287594 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.287771 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.287798 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.287850 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:08.287899 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.287977 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.288098 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20264704}
I20260709 13:17:08.360706  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.353008  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2074) took 2547 ms. Trace:
I20260709 13:17:08.375936  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1652) took 2109 ms. Trace:
I20260709 13:17:08.377224  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:08.360067  9211 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.412113  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.413025  5444 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:08.379781  5518 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:08.381537  5448 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:08.381332  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.376377  5369 rpcz_store.cc:276] 0709 13:17:05.851926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.341899 (+2489973us) service_pool.cc:224] Handling call
0709 13:17:08.342182 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.342348 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.342370 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.342411 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:08.342439 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.342489 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.342603 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.331617  9040 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:17:08.383430  5445 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:08.425199  5370 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:08.337148  9226 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:17:08.378978  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.391824  5375 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:08.389189  5522 rpcz_store.cc:276] 0709 13:17:06.266130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.571421 (+305291us) service_pool.cc:224] Handling call
0709 13:17:06.571832 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.920094 (+348262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.920126 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.935268 (+ 15142us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.626482 (+691214us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:07.626541 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.626637 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.375720 (+749083us) raft_consensus.cc:1685] finished
0709 13:17:08.375743 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.375866 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":375463,"raft.queue_time_us":352972,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8312,"thread_start_us":555172,"threads_started":1,"wal-append.queue_time_us":819161}
I20260709 13:17:08.375001  9161 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:08.443840  5370 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:17:08.444247  5370 pending_rounds.cc:85] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 3
I20260709 13:17:08.444567  5370 pending_rounds.cc:107] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 7.4
W20260709 13:17:08.444753  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65889.5us
I20260709 13:17:08.444819  5370 raft_consensus.cc:2889] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:08.445468  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.445999  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.384290  5373 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:08.430040  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2085) took 1224 ms. Trace:
I20260709 13:17:08.388226  5374 rpcz_store.cc:276] 0709 13:17:05.805919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.870143 (+1064224us) service_pool.cc:224] Handling call
0709 13:17:06.872805 (+  2662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.958864 (+ 86059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.958910 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.959480 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.548823 (+589343us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:07.548883 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.548976 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.352764 (+803788us) raft_consensus.cc:1685] finished
0709 13:17:08.352784 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.352948 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85590,"raft.queue_time_us":653542,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":463626,"threads_started":1,"wal-append.queue_time_us":1228292}
I20260709 13:17:08.447320  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2086) took 1190 ms. Trace:
I20260709 13:17:08.447753  5373 rpcz_store.cc:276] 0709 13:17:07.256883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.383855 (+1126972us) service_pool.cc:224] Handling call
0709 13:17:08.384152 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.447061 (+ 62909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.447275 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.385857  9120 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.458714  9130 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.359815  6073 rpcz_store.cc:276] 0709 13:17:07.249900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.250065 (+   165us) service_pool.cc:224] Handling call
0709 13:17:07.250588 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.775095 (+524507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.780240 (+  5145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.954002 (+173762us) log.cc:844] Serialized 26 byte log entry
0709 13:17:08.216677 (+262675us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:08.218570 (+  1893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.232385 (+ 13815us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.290080 (+ 57695us) raft_consensus.cc:1685] finished
0709 13:17:08.290129 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.290345 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8661,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":722139,"threads_started":2,"wal-append.queue_time_us":327375}
I20260709 13:17:08.461619  9206 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.462182  9206 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.462946  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:08.465737  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1595) took 1462 ms. Trace:
I20260709 13:17:08.466456  9246 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.466151  9149 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.466164  5446 rpcz_store.cc:276] 0709 13:17:07.003129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.003301 (+   172us) service_pool.cc:224] Handling call
0709 13:17:07.077712 (+ 74411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.563070 (+485358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.563110 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.587147 (+ 24037us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.909506 (+322359us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:07.909606 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.909807 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.465510 (+555703us) raft_consensus.cc:1685] finished
0709 13:17:08.465534 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.465674 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98431,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7181,"thread_start_us":686203,"threads_started":2,"wal-append.queue_time_us":567952}
I20260709 13:17:08.468773  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:08.471853  8952 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.458766  9120 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.387161  9197 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.429247  9019 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.441865  5448 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:08.475529  6070 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:08.476869  5448 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:08.447466  5371 rpcz_store.cc:276] 0709 13:17:07.205385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.483116 (+277731us) service_pool.cc:224] Handling call
0709 13:17:07.493226 (+ 10110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.493661 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.493702 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.528767 (+ 35065us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.901333 (+372566us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.901409 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.901540 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.429760 (+528220us) raft_consensus.cc:1685] finished
0709 13:17:08.429790 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.429969 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38007,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6517,"thread_start_us":342027,"threads_started":1,"wal-append.queue_time_us":546969}
I20260709 13:17:08.425773  9110 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:08.452852  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1596) took 1448 ms. Trace:
I20260709 13:17:08.477612  9110 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:08.478101  9110 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:08.478849  8949 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.985s	user 0.012s	sys 0.000s
I20260709 13:17:08.458752  9018 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:08.421240  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 88194.7us
I20260709 13:17:08.341327  9239 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:08.443171  8955 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.426s	user 0.015s	sys 0.000s
I20260709 13:17:08.457959  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1594) took 1473 ms. Trace:
I20260709 13:17:08.481133  8955 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.466107  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:08.482205  5444 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:08.483098  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1606) took 1330 ms. Trace:
I20260709 13:17:08.481740  5443 rpcz_store.cc:276] 0709 13:17:06.984740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.984902 (+   162us) service_pool.cc:224] Handling call
0709 13:17:07.067061 (+ 82159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.624419 (+557358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.624462 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.692428 (+ 67966us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.965352 (+272924us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:07.965412 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.965606 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.457638 (+492032us) raft_consensus.cc:1685] finished
0709 13:17:08.457666 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.457874 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87818,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":12905,"thread_start_us":765273,"threads_started":2,"wal-append.queue_time_us":696630}
I20260709 13:17:08.483461  5444 rpcz_store.cc:276] 0709 13:17:07.152567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.431448 (+1278881us) service_pool.cc:224] Handling call
0709 13:17:08.481871 (+ 50423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.482836 (+   965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.483039 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.485702  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:08.486351  5522 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:08.453979  8735 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.979s	user 0.013s	sys 0.000s
I20260709 13:17:08.489120  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.492911  9250 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.493544  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.489578  5524 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:08.477790  5449 rpcz_store.cc:276] 0709 13:17:07.005336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.005708 (+   372us) service_pool.cc:224] Handling call
0709 13:17:07.081174 (+ 75466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.588589 (+507415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.588637 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.620841 (+ 32204us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.968403 (+347562us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:07.968656 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.974400 (+  5744us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.284397 (+309997us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:08.452498 (+168101us) raft_consensus.cc:1685] finished
0709 13:17:08.452524 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.452785 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5929,"raft.queue_time_us":76749,"raft.run_cpu_time_us":3310,"raft.run_wall_time_us":1116933,"spinlock_wait_cycles":9023872,"thread_start_us":783745,"threads_started":2,"wal-append.queue_time_us":421525}
I20260709 13:17:08.496603  9226 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.491839  9247 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.498646  9021 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.500721  9229 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.501866  5449 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:08.507253  9036 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.508558  5523 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:08.509348  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:08.513144  5518 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:08.513479  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:08.514760  9226 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:08.493552  9250 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.515522  9226 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:08.516952  9226 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.517403  9250 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.518157  9247 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.520382  9036 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.521916  9018 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.526113  9239 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.517258  9206 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.518716  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.530253  9239 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.530540  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.531430  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.532299  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:08.533962  9036 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:08.534631  9009 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:08.534022  9001 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.535106  9009 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.535506  9009 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.537657  9247 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:08.538187  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:08.537608  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.537573  9250 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:08.539762  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.540570  5521 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:08.525094  9122 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.546741  5370 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:08.549319  9122 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.550782  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.551801  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.553282  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.474812  9135 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.556187  5443 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:08.559810  5515 raft_consensus.cc:3055] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:08.560267  5515 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:08.561179  5515 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:08.562211  5515 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:08.564905  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.566561  9199 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.567760  5450 raft_consensus.cc:2368] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13.
I20260709 13:17:08.573665  5441 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:08.573920  5515 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:17:08.570752  5443 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:08.575423  5450 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:08.574321  5515 pending_rounds.cc:85] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 7
I20260709 13:17:08.576784  5515 pending_rounds.cc:107] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:17:08.577126  5515 raft_consensus.cc:2889] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:08.582894  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.585179  5444 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:08.593700  9065 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:08.589530  9156 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:17:08.602062  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.606153  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.581581  9199 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:08.608785  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 515240us
W20260709 13:17:08.609328  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 494350us
I20260709 13:17:08.616961  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.618196  5519 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:08.624210  9001 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:08.627730  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:08.629007  9120 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.615097  9021 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:08.632583  9021 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.610425  9014 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.634143  9014 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.614531  9195 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:08.638266  9195 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:08.637259  9009 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.639298  9195 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:08.640322  5524 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:08.635076  9021 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.640890  9195 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.650442  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:08.651952  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:08.656584  9255 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:17:08.610752  9232 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:08.656519  9208 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:08.658465  9208 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:08.658905  9208 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.664719  9014 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.672614  9035 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:08.672724  5520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1606) took 4899 ms (client timeout 1717 ms). Trace:
I20260709 13:17:08.676129  9204 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:08.675819  5520 rpcz_store.cc:269] 0709 13:17:03.772930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.787883 (+ 14953us) service_pool.cc:224] Handling call
0709 13:17:08.672442 (+4884559us) spinlock_profiling.cc:243] Waited 4.38 s on lock 0x7b540025d5d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:08.672596 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10076331264}
I20260709 13:17:08.655792  9009 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.679803  9110 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.680425  9147 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.681257  5521 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:08.682626  9110 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.684114  9207 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.685230  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2092) took 1023 ms. Trace:
I20260709 13:17:08.694031  5370 rpcz_store.cc:276] 0709 13:17:07.661489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.462846 (+801357us) service_pool.cc:224] Handling call
0709 13:17:08.463166 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.547299 (+ 84133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.684949 (+137650us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b5400259ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:08.685164 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191613824}
I20260709 13:17:08.694723  5518 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:08.689972  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 249) took 1064 ms. Trace:
I20260709 13:17:08.690105  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:07.905522  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:08.696026  5523 rpcz_store.cc:276] 0709 13:17:07.625299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.667321 (+ 42022us) service_pool.cc:224] Handling call
0709 13:17:07.688789 (+ 21468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.508975 (+820186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.689702 (+180727us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b540025c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:08.689913 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884480384}
W20260709 13:17:08.701916  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 74243.9us
I20260709 13:17:08.704031  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:08.709021  5524 pending_rounds.cc:85] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 5
I20260709 13:17:08.709585  5524 pending_rounds.cc:107] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:08.709971  5524 raft_consensus.cc:2889] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.715890  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.719197  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2017) took 1165 ms. Trace:
I20260709 13:17:08.719868  5442 rpcz_store.cc:276] 0709 13:17:07.553332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.460716 (+907384us) service_pool.cc:224] Handling call
0709 13:17:08.461043 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.461244 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:08.494479 (+ 33235us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.603276 (+108797us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.647483 (+ 44207us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:08.718862 (+ 71379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.718919 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:08.718959 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.719023 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.719143 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176224,"prepare.queue_time_us":33947,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":868,"raft.queue_time_us":2552,"raft.run_cpu_time_us":2435,"raft.run_wall_time_us":39779,"spinlock_wait_cycles":13606784,"thread_start_us":107885,"threads_started":1,"wal-append.queue_time_us":152115}
I20260709 13:17:08.722241  5446 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:08.723163  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1585) took 3165 ms. Trace:
I20260709 13:17:08.723554  5367 rpcz_store.cc:276] 0709 13:17:05.551109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.167503 (+616394us) service_pool.cc:224] Handling call
0709 13:17:06.167813 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.071756 (+1903943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.714294 (+642538us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54002b3254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:08.714510 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4163201920}
I20260709 13:17:08.727255  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:08.729642  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:08.730398  5520 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:08.731261  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.732147  5519 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:08.735953  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:08.737040  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.737232  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.739084  5518 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:08.741863  8852 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:08.742370  8852 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.743106  8852 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.744894  9207 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:08.749701  5520 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:17:08.713924  8945 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:08.761682  8981 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:08.754359  9208 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.762297  8981 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:08.763628  5522 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.764420  9223 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:08.767236  5519 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:08.755734  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.756326  9206 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:08.758472  8955 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:08.758642  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2023) took 1079 ms. Trace:
I20260709 13:17:08.760227  9109 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:08.773221  5446 rpcz_store.cc:276] 0709 13:17:07.679398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.468418 (+789020us) service_pool.cc:224] Handling call
0709 13:17:08.721826 (+253408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.722683 (+   857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.758444 (+ 35761us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540032f5d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:08.758585 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581977344}
I20260709 13:17:08.774271  5521 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:08.764905  9223 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:08.783823  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.788573  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:08.789577  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.762252  8945 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:08.792337  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2071) took 3252 ms. Trace:
I20260709 13:17:08.792896  5368 rpcz_store.cc:276] 0709 13:17:05.540090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.994946 (+454856us) service_pool.cc:224] Handling call
0709 13:17:05.995501 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.996073 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:06.190943 (+194870us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.248065 (+2057122us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.791982 (+543917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.792049 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:08.792096 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.792170 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.792280 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":885059,"prepare.queue_time_us":499025,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":5624,"raft.queue_time_us":348048,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":14568,"thread_start_us":1855561,"threads_started":4,"wal-append.queue_time_us":965397}
I20260709 13:17:08.801200  5445 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:08.806336  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1596) took 2576 ms. Trace:
I20260709 13:17:08.808246  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:08.809053  5443 raft_consensus.cc:2376] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9. Re-sending same reply.
I20260709 13:17:08.810933  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:08.813803  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:08.815272  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.816335  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.776116  9206 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:08.819278  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.820924  5515 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:08.824401  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:08.834440  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1599) took 1275 ms. Trace:
I20260709 13:17:08.836161  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.836311  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.834878  5369 rpcz_store.cc:276] 0709 13:17:07.559472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.419732 (+860260us) service_pool.cc:224] Handling call
0709 13:17:08.420060 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.834077 (+414017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.834108 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.834155 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:08.834184 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.834247 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.834369 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":413581,"raft.queue_time_us":413828,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129}
I20260709 13:17:08.837399  5443 raft_consensus.cc:2368] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6.
I20260709 13:17:08.839053  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1588) took 2884 ms. Trace:
W20260709 13:17:08.840121  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.840008  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 223948us
I20260709 13:17:08.839730  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.842135  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.842996  5367 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:08.843576  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.843911  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.844921  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:08.845588  5374 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:08.845657  9232 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:08.847105  9014 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:08.848381  9044 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.849195  9044 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.851953  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.852720  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:08.853327  5450 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11. Re-sending same reply.
W20260709 13:17:08.853582  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 237306us
I20260709 13:17:08.854012  9044 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:08.854285  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.854817  9044 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.854913  5450 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:08.856791  9066 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:08.839460  5366 rpcz_store.cc:276] 0709 13:17:05.954923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.884625 (+929702us) service_pool.cc:224] Handling call
0709 13:17:06.885091 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.885362 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:07.695629 (+810267us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.054905 (+359276us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.606949 (+552044us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b18002e5e20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:17:08.607285 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.758224 (+150939us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b18002e5e20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d7c6058f 00007fc1d0c9f571 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd
0709 13:17:08.838504 (+ 80280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.838609 (+   105us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:08.838663 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.838744 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.838988 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":755998,"prepare.queue_time_us":898332,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":137,"raft.queue_time_us":1123137,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":18226,"spinlock_wait_cycles":17503360,"thread_start_us":1123336,"threads_started":3,"wal-append.queue_time_us":342759}
I20260709 13:17:08.853237  5339 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.859678  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.859081  9066 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:08.860714  5339 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.860986  5370 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:08.861086  9066 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:08.861614  9238 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.862002  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.862447  9238 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:08.862599  5370 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:08.863487  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:08.862759  9066 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.863777  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.864565  9211 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.864713  9066 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.856961  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:08.866278  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.865852  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:08.866600  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:08.866681  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.867589  9211 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:08.868080  9211 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:08.869057  9211 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.869092  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.868129  9014 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.871857  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.872619  5446 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:08.825734  5442 raft_consensus.cc:2376] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11. Re-sending same reply.
I20260709 13:17:08.872704  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:08.873517  5515 raft_consensus.cc:606] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.800384  8945 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.873850  5515 raft_consensus.cc:614] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:08.868619  9238 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:08.875097  5522 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:08.777139  9156 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:17:08.831594  9191 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:08.885262  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85350.3us
I20260709 13:17:08.823987  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:08.796052  8775 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:08.841869  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:08.821936  9206 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:08.913164  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.914765  9238 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:08.871095  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:08.915102  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101651us
I20260709 13:17:08.927013  5444 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:08.923628  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.932277  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:08.918264  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52490.3us
I20260709 13:17:08.905829  9027 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.931051  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.932578  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:08.933629  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.940879  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:08.941794  5515 raft_consensus.cc:606] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:08.925482  9191 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:08.953604  5271 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 7 to 10, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:08.954044  9191 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.956054  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.957113  5442 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:08.904160  8981 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.958503  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:08.959266  5443 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:08.959472  5489 leader_election.cc:400] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13.
I20260709 13:17:08.930717  9238 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.918735  9001 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:08.933843  9219 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:17:08.990790  5370 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:08.992106  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.992803  5370 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:08.994583  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.995157  5370 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
W20260709 13:17:08.997359  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 63813us
I20260709 13:17:08.998665  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:09.000823  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 187101us
I20260709 13:17:09.001693  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:08.777218  9109 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.846386  9232 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.007939  9232 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:09.009516  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.931471  8775 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.014533  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.027494  5366 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:09.028743  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:08.978353  9237 consensus_queue.cc:1175] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 11 status { last_received { term: 8 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.5-10.5]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:17:09.016258  9261 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:08.806780  5372 rpcz_store.cc:276] 0709 13:17:06.229462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.909702 (+680240us) service_pool.cc:224] Handling call
0709 13:17:06.910043 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.910538 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:07.574197 (+663659us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.286945 (+712748us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b18002b03c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a
0709 13:17:08.805966 (+519021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.806031 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:08.806075 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.806139 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.806274 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":525086,"prepare.queue_time_us":956856,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":5755,"raft.queue_time_us":518860,"spinlock_wait_cycles":99182464,"thread_start_us":967631,"threads_started":2,"wal-append.queue_time_us":576286}
I20260709 13:17:09.039496  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.018121  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.019584  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.046269  5373 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:09.020884  9247 raft_consensus.cc:993] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:17:09.007894  9206 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:08.903887  9223 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.030336  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.050009  5366 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:09.051234  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.008293  9133 raft_consensus.cc:2764] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:08.994874  9207 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:09.068580  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 70006.2us
I20260709 13:17:09.073786  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:09.035045  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73790.4us
I20260709 13:17:09.040856  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.076129  5367 raft_consensus.cc:2376] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10. Re-sending same reply.
I20260709 13:17:09.027323  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:09.042520  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:09.077929  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50995.2us
I20260709 13:17:09.079073  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:09.017252  9259 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:17:09.046875  5370 raft_consensus.cc:2376] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12. Re-sending same reply.
I20260709 13:17:09.089377  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.090518  5370 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:09.046111  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.047825  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:08.949905  9027 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.068867  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.083098  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:09.087296  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.125099  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.124626  5366 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:09.124125  5373 raft_consensus.cc:2410] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:09.127450  5371 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:09.132175  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.133013  5370 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:09.150439  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65518.2us
I20260709 13:17:09.050954  9208 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:09.151604  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:09.154923  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:09.154968  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 72023.4us
I20260709 13:17:09.067585  9110 raft_consensus.cc:1081] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:17:09.161283  9135 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:09.163077  9206 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.163805  9027 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.122275  9176 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:09.167256  8775 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.169332  5370 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:09.170611  8957 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:09.173449  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:09.261804  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 88457.8us
I20260709 13:17:09.151705  9223 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.157007  8949 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.181840  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:09.182219  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 108578us
I20260709 13:17:09.269721  5339 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:09.182742  9122 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:09.185549  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:09.194096  5271 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 9 to 10, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 10 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.030881  9199 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:17:09.085834  9109 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.272799  5443 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:09.274461  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:09.210033  9265 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:09.029924  8852 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.130625  9021 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:09.283571  5339 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:09.284744  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:09.260277  5374 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:17:09.262858  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:09.174010  8955 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:09.266412  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.298247  5370 raft_consensus.cc:2368] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:09.151068  9133 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:09.264155  9206 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:09.231781  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:09.251857  9161 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:09.251413  9204 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:09.299276  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.307101  5489 leader_election.cc:400] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6.
I20260709 13:17:09.359822  5489 leader_election.cc:403] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:09.207394  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.360512  5368 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:09.315032  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.362592  5445 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 13:17:09.363425  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44742.9us
I20260709 13:17:09.272547  9122 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.270445  9214 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:09.275388  9009 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:09.272927  9176 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:09.359174  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.443513  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.443235  9176 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.446720  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:09.316666  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.370831  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:09.448221  9273 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:09.448571  5367 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:09.449573  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.449770  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:09.449846  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.450608  9027 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:09.450683  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.451370  5367 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:09.452172  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.452543  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:09.382652  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:09.301718  9210 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.406205  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.302652  9021 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.399449  5375 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:09.464145  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.392271  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.397688  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.328109  9206 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.484158  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.319132  9035 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.416069  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.417965  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.490382  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.364615  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:09.297281  9066 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:17:09.362737  9161 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.438257  9110 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:09.440093  8675 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:09.444444  5370 raft_consensus.cc:2368] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13.
I20260709 13:17:09.487726  9214 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:09.510237  5370 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:17:09.510623  5370 pending_rounds.cc:85] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 4
I20260709 13:17:09.510840  5370 pending_rounds.cc:107] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:09.283246  8775 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:09.447820  9135 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:09.450868  5516 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:09.453212  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.363274  8955 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.583370  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:09.448597  5374 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:09.455504  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:09.433373  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:09.453615  9027 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:09.394146  9122 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.459312  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:09.417582  9195 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.006s
I20260709 13:17:09.591037  9204 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:09.324751  9219 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:17:09.325150  9133 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.410862  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.602526  5521 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:09.603761  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.466914  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:09.460901  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:09.605129  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 144394us
I20260709 13:17:09.605520  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.605831  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:09.416392  9208 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 5. Current term is 6.
W20260709 13:17:09.481849  5444 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.004s
I20260709 13:17:09.607105  5444 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:09.608162  5519 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 6: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:09.491725  5522 raft_consensus.cc:606] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:09.608927  5522 raft_consensus.cc:614] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:09.609330  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.584132  8775 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.498966  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.499419  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.501700  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2041) took 1350 ms. Trace:
I20260709 13:17:09.465689  9009 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:09.511085  5370 raft_consensus.cc:2889] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:09.548446  9272 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:17:09.555954  9161 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:09.558758  8945 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.003s
I20260709 13:17:09.512235  9197 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:09.569895  8981 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.574494  5271 catalog_manager.cc:5697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 5 to 10, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 10 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.585727  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:09.588655  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 133269us
W20260709 13:17:09.592175  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 431492us
I20260709 13:17:09.627593  5374 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:09.628052  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:09.628226  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:09.393273  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 86306.8us
I20260709 13:17:09.629484  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:09.629788  5521 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:09.630093  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:09.535382  9135 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:09.597412  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:09.598049  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:09.591274  9238 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.002s
I20260709 13:17:09.413075  9191 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.612833  5522 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:17:09.598762  9211 consensus_meta.cc:287] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.001s
I20260709 13:17:09.615346  5441 rpcz_store.cc:276] 0709 13:17:08.150966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.574508 (+423542us) service_pool.cc:224] Handling call
0709 13:17:08.574796 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.575104 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.575129 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.575600 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:17:08.653948 (+ 78348us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:08.653992 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.654065 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.501316 (+847251us) raft_consensus.cc:1685] finished
0709 13:17:09.501348 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.501598 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":413,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":87,"thread_start_us":77968,"threads_started":1,"wal-append.queue_time_us":211538}
W20260709 13:17:09.619973  5446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.057s	sys 0.071s
I20260709 13:17:09.622279  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:09.601096  8957 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:09.652257  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:09.599659  9110 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:09.655401  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:09.778818  9110 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.778465  9214 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.780783  9206 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:09.666895  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69536.9us
I20260709 13:17:09.631456  9027 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:09.782485  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 130331us
I20260709 13:17:09.783051  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:09.673583  5446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.057s	sys 0.071s
W20260709 13:17:09.674332  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52154.8us
I20260709 13:17:09.786234  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:09.591893  8955 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.615749  9226 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:09.633000  9147 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.949s	user 0.016s	sys 0.001s
I20260709 13:17:09.670506  9135 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.845703  5447 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:09.674500  9237 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.616809  9199 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.676319  9247 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:09.781443  9206 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:17:09.855165  9118 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:09.856508  9118 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:09.654547  9120 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:09.660753  9161 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.661094  9208 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:09.603111  9204 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.660840  9197 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.676038  8957 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.748126  9211 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:09.850356  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60939.4us
I20260709 13:17:09.675506  9238 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.624577  8775 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:09.900462  8957 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.861644  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:09.861923  5520 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:09.631546  8945 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.857987  9120 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:09.861450  9161 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.923338  5271 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:09.865130  9021 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.924777  9021 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:09.851140  9014 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:09.925622  9014 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.926043  9014 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.926097  9238 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.867143  9208 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:09.867750  9009 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.927100  9208 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.929160  9133 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.791237  9027 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.803318  9110 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:09.840212  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:09.819159  9226 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:09.846242  9231 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.849669  9207 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:09.856822  9206 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:09.675125  8675 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.177s
I20260709 13:17:09.672462  8852 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.851553  9147 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.899044  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:17:09.940065  9223 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.000s
I20260709 13:17:09.857225  9118 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:09.952046  9226 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.952965  5369 raft_consensus.cc:2410] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:09.953275  9226 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.953128  9118 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.954524  9118 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:09.958041  9281 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:09.915710  9237 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:09.958969  8675 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:09.959371  8675 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:09.960199  8675 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.925855  5271 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 2 to 8, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 8 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:09.961410  9135 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.929831  9027 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.925199  9021 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:09.963934  9021 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.966763  9204 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.968148  9284 ts_tablet_manager.cc:933] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.969784  8675 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.944587  9278 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:09.971101  9278 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:09.938535  5371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.015s	sys 0.031s
W20260709 13:17:09.974032  5371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.015s	sys 0.032s
W20260709 13:17:09.942263  9236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.028s
W20260709 13:17:09.939674  9274 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:17:09.951687  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:09.980082  5447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1590) took 3006 ms (client timeout 2028 ms). Trace:
I20260709 13:17:09.980755  5516 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:09.938932  5523 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.017s
I20260709 13:17:09.958724  9237 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.924163  9161 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.963907  9135 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.978466  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 309) took 1107 ms. Trace:
I20260709 13:17:10.010668  5375 rpcz_store.cc:276] 0709 13:17:08.870717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.936061 (+1065344us) service_pool.cc:224] Handling call
0709 13:17:09.977780 (+ 41719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.978011 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.978051 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.978109 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:09.978153 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.978221 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.978402 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.925643  9120 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:09.982352  5523 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.005s	sys 0.017s
I20260709 13:17:09.858795  9199 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:09.976507  9236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.008s	sys 0.029s
W20260709 13:17:09.980573  5447 rpcz_store.cc:269] 0709 13:17:06.968733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.970213 (+  1480us) service_pool.cc:224] Handling call
0709 13:17:09.974714 (+3004501us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b540029dbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:09.974835 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6546968320}
I20260709 13:17:09.935971  9065 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:09.950186  9110 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.023047  9110 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.023506  9110 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.024322  8949 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:10.024761  8949 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:09.986295  5373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.023s	sys 0.030s
I20260709 13:17:10.025698  8949 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.026502  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1633) took 1178 ms. Trace:
I20260709 13:17:10.027046  8949 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.949671  9207 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.027874  9207 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.031450  9237 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.033553  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:10.035447  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:10.038416  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2062) took 1194 ms. Trace:
I20260709 13:17:10.038879  5450 rpcz_store.cc:276] 0709 13:17:08.844079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.856719 (+ 12640us) service_pool.cc:224] Handling call
0709 13:17:08.857181 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.912428 (+ 55247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.912480 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.919464 (+  6984us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.288702 (+369238us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:09.288752 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.288844 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.038213 (+749369us) raft_consensus.cc:1685] finished
0709 13:17:10.038234 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.038360 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48019,"raft.queue_time_us":48252,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9430,"thread_start_us":331111,"threads_started":1,"wal-append.queue_time_us":672939}
I20260709 13:17:10.026877  5373 rpcz_store.cc:276] 0709 13:17:08.848126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.134528 (+286402us) service_pool.cc:224] Handling call
0709 13:17:09.135003 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.135262 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:09.485654 (+350392us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.026074 (+540420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.026136 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:10.026192 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.026289 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.026429 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30305,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1195,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":861343,"threads_started":2}
I20260709 13:17:10.043839  5271 catalog_manager.cc:5697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 10, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 10 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.046537  5271 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 6 to 7, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 7 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:10.047698  5520 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:10.049118  5271 catalog_manager.cc:5697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:17:10.021165  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.022017  9199 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.054227  9035 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:10.054361  9197 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.054775  9035 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:10.054965  8945 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:09.973356  9278 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:10.050693  9211 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:10.022572  9065 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:09.982671  9044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.000s	sys 0.023s
I20260709 13:17:10.062136  8775 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:10.063467  9035 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:09.974663  9231 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.087885  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1621) took 1132 ms. Trace:
I20260709 13:17:10.065100  5375 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:10.090663  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 310) took 1219 ms. Trace:
I20260709 13:17:10.091131  5375 rpcz_store.cc:276] 0709 13:17:08.870989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.012176 (+1141187us) service_pool.cc:224] Handling call
0709 13:17:10.064875 (+ 52699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.090111 (+ 25236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.090578 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.019214  9279 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:10.066502  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1635) took 1198 ms. Trace:
I20260709 13:17:10.094977  5368 rpcz_store.cc:276] 0709 13:17:08.868209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.484625 (+616416us) service_pool.cc:224] Handling call
0709 13:17:09.485173 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.627512 (+142339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.627556 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.627602 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:09.627633 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.066252 (+438619us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54000c6a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:10.066296 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.066444 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326722816}
I20260709 13:17:10.023396  9120 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:10.097816  9027 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.098848  5374 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:10.088447  5449 rpcz_store.cc:276] 0709 13:17:08.955891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.579529 (+623638us) service_pool.cc:224] Handling call
0709 13:17:09.597228 (+ 17699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.912055 (+314827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.912101 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.912158 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:09.912200 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.087538 (+175338us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540023a354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:10.087608 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.087806 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723454208}
I20260709 13:17:10.098254  9120 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.100216  9027 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.102459  9120 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:10.103255  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:10.094276  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1616) took 1253 ms. Trace:
I20260709 13:17:10.105069  5369 rpcz_store.cc:276] 0709 13:17:08.841177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.866140 (+ 24963us) service_pool.cc:224] Handling call
0709 13:17:10.094085 (+1227945us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001c02d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:10.094224 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495326464}
I20260709 13:17:10.111382  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:10.112414  5520 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:17:10.078711  9044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.000s	sys 0.024s
I20260709 13:17:10.117162  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:10.121206  5367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.014s	sys 0.041s
W20260709 13:17:10.121618  5367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.014s	sys 0.041s
W20260709 13:17:10.130342  5340 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.007s	sys 0.015s
W20260709 13:17:10.130918  5340 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.007s	sys 0.015s
W20260709 13:17:10.131366  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 631479us
I20260709 13:17:10.133033  5340 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:10.135221  5518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.008s	sys 0.016s
W20260709 13:17:10.135816  5518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.008s	sys 0.016s
I20260709 13:17:10.138655  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:10.140043  5516 raft_consensus.cc:2410] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:10.084234  8945 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:10.120806  9236 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.071275  9021 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.155735  9035 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:10.170419  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53481.1us
I20260709 13:17:10.154393  9267 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:17:10.187017  5515 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.020s	sys 0.022s
I20260709 13:17:10.143520  9236 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:10.185788  5372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.012s	sys 0.015s
W20260709 13:17:10.177104  9156 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.016s	sys 0.012s
W20260709 13:17:10.206424  5515 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.020s	sys 0.022s
I20260709 13:17:10.206508  9236 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.206537  9275 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:10.129827  9278 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:17:10.155639  9191 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:10.206844  9156 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.016s	sys 0.013s
I20260709 13:17:10.207350  9275 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:17:10.207537  5372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.013s	sys 0.015s
I20260709 13:17:10.115455  9279 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.169559  8955 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:10.212051  5517 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.007s
W20260709 13:17:10.216207  5517 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.013s	sys 0.007s
I20260709 13:17:10.143503  8945 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:10.219166  5443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.015s	sys 0.005s
I20260709 13:17:10.202153  9210 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:10.216499  8831 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.014s
W20260709 13:17:10.242456  5443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.015s	sys 0.010s
I20260709 13:17:10.267179  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1632) took 1419 ms. Trace:
I20260709 13:17:10.267786  5371 rpcz_store.cc:276] 0709 13:17:08.847887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.133130 (+285243us) service_pool.cc:224] Handling call
0709 13:17:09.219201 (+ 86071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.219699 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:09.312050 (+ 92351us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.981768 (+669718us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.012872 (+ 31104us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.013052 (+   180us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:10.019289 (+  6237us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.020383 (+  1094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.020501 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.062814 (+ 42313us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18002245c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:10.266837 (+204023us) raft_consensus.cc:1685] finished
0709 13:17:10.266877 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.267092 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59061,"prepare.queue_time_us":176683,"prepare.run_cpu_time_us":175,"prepare.run_wall_time_us":9224,"raft.queue_time_us":8397,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":25439,"spinlock_wait_cycles":9812608,"thread_start_us":561115,"threads_started":1,"wal-append.queue_time_us":814706}
I20260709 13:17:10.250895  9197 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.216262  9014 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.209292  9275 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:10.215795  9065 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.280881  9021 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:10.265681  8831 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.007s	sys 0.015s
W20260709 13:17:10.274163  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 141218us
I20260709 13:17:10.249859  9210 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:10.286784  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.022s	sys 0.039s
I20260709 13:17:10.287418  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:10.288553  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.023s	sys 0.039s
W20260709 13:17:10.291376  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 661943us
W20260709 13:17:10.284094  9176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.011s	sys 0.015s
I20260709 13:17:10.273864  9278 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:10.290096  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:10.259765  9110 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:10.289598  9122 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.000s
W20260709 13:17:10.296814  5446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.017s	sys 0.016s
W20260709 13:17:10.297972  9286 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:17:10.304385  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.304874  5446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.017s	sys 0.017s
I20260709 13:17:10.286267  9210 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:10.293203  9176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.011s	sys 0.015s
I20260709 13:17:10.307281  9247 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:10.298161  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:10.291549  8775 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.295349  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:10.318169  5522 raft_consensus.cc:606] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:10.318970  5522 raft_consensus.cc:614] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:10.322948  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:10.325512  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:10.285347  9197 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.337675  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:10.331892  5489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.012s	sys 0.005s
W20260709 13:17:10.318554  8981 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.001s
I20260709 13:17:10.315791  9275 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:10.361546  9120 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.362011  9120 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:10.362383  9120 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.362754  9110 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:10.363565  9110 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.365310  8945 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.365844  9197 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.369032  9231 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.371150  9161 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.336702  8955 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:10.373900  9290 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:17:10.375793  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:10.376624  5516 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:17:10.378226  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:10.342180  5489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.012s	sys 0.006s
W20260709 13:17:10.381699  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 726353us
I20260709 13:17:10.382784  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:10.383699  9110 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:10.384387  9110 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:10.385316  9110 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:10.392352  5366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.010s	sys 0.025s
I20260709 13:17:10.343310  5490 leader_election.cc:400] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
W20260709 13:17:10.359289  9289 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:17:10.393630  5490 leader_election.cc:403] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:10.331514  9211 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:10.394865  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51664.9us
W20260709 13:17:10.396250  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.007s	sys 0.014s
W20260709 13:17:10.396829  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.007s	sys 0.014s
W20260709 13:17:10.397800  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 611563us
I20260709 13:17:10.308332  9122 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.403072  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:10.411044  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:10.409183  5271 catalog_manager.cc:5697] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 1 to 2, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:10.373930  8955 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:10.420728  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.387996  9223 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:10.410032  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:10.408273  9161 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:10.440030  5519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.002s	sys 0.011s
W20260709 13:17:10.450933  5519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.003s	sys 0.011s
W20260709 13:17:10.423888  5488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.013s
I20260709 13:17:10.434883  9197 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:10.420377  8957 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.007s
W20260709 13:17:10.443385  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.428211  9208 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
W20260709 13:17:10.392928  5366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.010s	sys 0.025s
W20260709 13:17:10.452718  5488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.014s
W20260709 13:17:10.444231  5414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.009s	sys 0.013s
I20260709 13:17:10.465850  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:10.425257  8955 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:10.470639  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68005.3us
W20260709 13:17:10.465173  5414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.013s
W20260709 13:17:10.481112  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 697569us
I20260709 13:17:10.481308  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:10.442695  9207 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.444562  8775 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.454967  8981 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.493949  9161 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:17:10.579766  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.581709  9284 tablet_copy_client.cc:323] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.131:36363
I20260709 13:17:10.453879  9197 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.526469  9321 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.589051  9197 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.529922  9231 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:10.526151  9295 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 13:17:10.528853  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1630) took 1681 ms. Trace:
W20260709 13:17:10.560948  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.471428  9278 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:10.479194  8957 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:10.575312  9199 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.007s
I20260709 13:17:10.607316  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:10.557684  9237 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.589337  9321 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.450407  9247 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.488410  9210 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.528820  9120 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.485453  9279 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.602494  5372 rpcz_store.cc:276] 0709 13:17:08.847377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.128769 (+281392us) service_pool.cc:224] Handling call
0709 13:17:09.129219 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:09.485645 (+356426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.485672 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:09.500241 (+ 14569us) log.cc:844] Serialized 52 byte log entry
0709 13:17:10.210405 (+710164us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:10.210523 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.210609 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.528498 (+317889us) raft_consensus.cc:1685] finished
0709 13:17:10.528520 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.528782 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31302,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":979932,"threads_started":2,"wal-append.queue_time_us":918848}
I20260709 13:17:10.439783  9223 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.553812  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:10.617945  5374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.002s	sys 0.019s
I20260709 13:17:10.478333  9208 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.597716  9109 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:10.597182  8949 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.598953  9231 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:10.658434  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1854) took 1194 ms. Trace:
I20260709 13:17:10.708701  5516 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:17:10.660877  5375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.020s	sys 0.033s
W20260709 13:17:10.709815  5375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.020s	sys 0.034s
I20260709 13:17:10.671391  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:10.710744  5522 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:10.711277  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2112) took 1424 ms. Trace:
I20260709 13:17:10.629586  9305 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.562687  8775 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:10.588809  8981 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:10.683298  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 129563us
I20260709 13:17:10.607530  9199 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.608889  9303 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.707446  5515 rpcz_store.cc:276] 0709 13:17:09.463662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.624838 (+161176us) service_pool.cc:224] Handling call
0709 13:17:09.625192 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.625380 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:10.207026 (+581646us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.657713 (+450687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.657799 (+    86us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:10.658018 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.658139 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.658344 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62565,"prepare.queue_time_us":664237,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2367,"thread_start_us":965938,"threads_started":2}
I20260709 13:17:10.745028  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:10.675608  5374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.002s	sys 0.020s
I20260709 13:17:10.714646  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1847) took 1294 ms. Trace:
I20260709 13:17:10.746608  5518 rpcz_store.cc:276] 0709 13:17:09.419846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.420018 (+   172us) service_pool.cc:224] Handling call
0709 13:17:09.420444 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.541482 (+121038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.541535 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.542290 (+   755us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.136396 (+594106us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:10.136456 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.409359 (+272903us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x7b5400278dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:10.409406 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.704341 (+294935us) raft_consensus.cc:1685] finished
0709 13:17:10.704372 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.714491 (+ 10119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21628,"raft.queue_time_us":28896,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":126,"spinlock_wait_cycles":213193088,"thread_start_us":553588,"threads_started":1,"wal-append.queue_time_us":828800}
I20260709 13:17:10.711855  5375 rpcz_store.cc:276] 0709 13:17:09.286554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.092072 (+805518us) service_pool.cc:224] Handling call
0709 13:17:10.132596 (+ 40524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.132859 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:10.154766 (+ 21907us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.710671 (+555905us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.710853 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.710904 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:10.710957 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.711056 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.711208 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86168,"prepare.run_cpu_time_us":5230,"prepare.run_wall_time_us":11595,"thread_start_us":555121,"threads_started":1}
I20260709 13:17:10.749334  9208 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:10.750101  9208 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.750566  9208 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:10.750720  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 311) took 1201 ms. Trace:
I20260709 13:17:10.751470  9208 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.751333  5375 rpcz_store.cc:276] 0709 13:17:09.549245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.749378 (+1200133us) service_pool.cc:224] Handling call
0709 13:17:10.750058 (+   680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.750302 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.750344 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.750407 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:10.750455 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.750531 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.750661 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.749372  8981 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.754112  8981 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:10.754716  9120 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:10.754601  8981 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.755577  9120 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.756075  9120 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.756770  8981 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.716864  9231 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:10.758160  9293 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:17:10.759845  9291 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:17:10.761137  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1642) took 1890 ms. Trace:
I20260709 13:17:10.636039  9237 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.761582  5367 rpcz_store.cc:276] 0709 13:17:08.870455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.589473 (+719018us) service_pool.cc:224] Handling call
0709 13:17:09.589763 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.590101 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.590126 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.590590 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.122013 (+531423us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:10.122053 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.122228 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.760878 (+638650us) raft_consensus.cc:1685] finished
0709 13:17:10.760901 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.761066 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3311,"raft.queue_time_us":2870,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6443,"thread_start_us":531109,"threads_started":1,"wal-append.queue_time_us":871645}
I20260709 13:17:10.763667  9237 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.702926  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:10.769810  9304 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:10.770562  9304 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:10.771667  9304 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.777210  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:10.715732  8949 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.778560  9176 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:10.778952  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:10.779062  9176 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:10.779807  9176 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:10.780048  8949 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.781484  9226 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.782076  9226 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:10.782914  8775 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:10.783041  9226 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.606340  9236 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.672649  9211 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:10.818761  5517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.013s	sys 0.016s
W20260709 13:17:10.833550  5517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.014s	sys 0.016s
I20260709 13:17:10.697077  9161 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:10.711465  9306 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:10.842725  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.835994  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1856) took 1371 ms. Trace:
I20260709 13:17:10.853048  5517 rpcz_store.cc:276] 0709 13:17:09.464286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.625114 (+160828us) service_pool.cc:224] Handling call
0709 13:17:09.625352 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.625561 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:10.218680 (+593119us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.835498 (+616818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.835574 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:10.835630 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.835724 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.835914 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":644777,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"thread_start_us":1169664,"threads_started":2}
I20260709 13:17:10.714462  9232 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:10.836521  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57654.2us
W20260709 13:17:10.881587  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.886137  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 476219us
W20260709 13:17:10.872653  9118 consensus_meta.cc:287] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.918s	user 0.018s	sys 0.001s
W20260709 13:17:10.893791  5446 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.011s	sys 0.051s
I20260709 13:17:10.868803  9122 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:10.896515  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 499475us
I20260709 13:17:10.898906  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:10.898018  5446 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.012s	sys 0.051s
W20260709 13:17:10.893913  9065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.035s	sys 0.073s
I20260709 13:17:10.917620  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:10.845779  9211 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:10.889513  9161 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:10.912938  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 257) took 1501 ms. Trace:
I20260709 13:17:10.914458  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2065) took 2067 ms. Trace:
I20260709 13:17:10.912029  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1862) took 1010 ms. Trace:
W20260709 13:17:10.920301  9065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.035s	sys 0.073s
I20260709 13:17:10.936919  5519 rpcz_store.cc:276] 0709 13:17:09.902055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.903242 (+  1187us) service_pool.cc:224] Handling call
0709 13:17:09.903629 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.903888 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:10.451488 (+547600us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.911524 (+460036us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.911684 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.911727 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:10.911765 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.911833 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.911964 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":395734,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"thread_start_us":981066,"threads_started":2}
W20260709 13:17:10.999668  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.929281  5523 rpcz_store.cc:276] 0709 13:17:09.411742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.411930 (+   188us) service_pool.cc:224] Handling call
0709 13:17:09.435821 (+ 23891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.436066 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:10.017033 (+580967us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.912605 (+895572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.912658 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:10.912702 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.912771 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.912883 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":776224,"prepare.run_cpu_time_us":4105,"prepare.run_wall_time_us":14866,"raft.queue_time_us":315691,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":80,"thread_start_us":1475485,"threads_started":3,"wal-append.queue_time_us":798129}
I20260709 13:17:10.910845  9303 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:10.915256  8675 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:10.920900  9207 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:10.976635  9066 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:11.026512  5488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.025s
W20260709 13:17:11.015519  9276 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:17:11.032788  5488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.025s
I20260709 13:17:11.012127  9021 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:10.900278  9298 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:17:10.643940  9321 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:11.022133  8957 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:11.029363  9207 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.025902  9066 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:11.037856  9120 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:11.021530  9176 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.049305  9223 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.042060  9210 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.051154  9021 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.024537  8675 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:11.054296  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.203004  6041 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.066s	sys 0.134s
W20260709 13:17:11.269680  6041 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.067s	sys 0.134s
W20260709 13:17:11.270133  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 802570us
W20260709 13:17:11.156703  5368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.033s	sys 0.037s
W20260709 13:17:11.272210  5368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.033s	sys 0.037s
W20260709 13:17:11.128831  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.276319  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 788942us
I20260709 13:17:11.165874  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2125) took 1773 ms. Trace:
I20260709 13:17:11.279628  5374 rpcz_store.cc:276] 0709 13:17:09.392335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.099653 (+707318us) service_pool.cc:224] Handling call
0709 13:17:10.099905 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.100105 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:10.772012 (+671907us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.165320 (+393308us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.165399 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:11.165490 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.165591 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.165786 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86885,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":282,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":10344,"thread_start_us":1064099,"threads_started":2}
W20260709 13:17:11.115433  9310 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 13:17:11.117901  9276 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:17:11.118541  9323 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:17:11.137486  9197 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.004s
W20260709 13:17:11.323901  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 436177us
W20260709 13:17:11.311946  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.249544  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.004s	sys 0.012s
W20260709 13:17:11.119735  9320 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:17:11.127252  9318 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
W20260709 13:17:11.146039  9301 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:17:11.056694  9298 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:11.122579  9317 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:17:11.141075  9176 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:11.234875  9315 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:17:11.056447  9014 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.115026  9199 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.127004  9206 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:11.119048  8945 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:11.322541  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:11.165488  8957 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:11.150739  9305 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:11.326439  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.004s	sys 0.013s
I20260709 13:17:11.134756  9211 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.367244  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:11.155805  9231 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.161092  9210 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.211704  9278 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.378139  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:11.378798  9278 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.379102  5523 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:11.380561  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:11.380945  9278 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.162201  9236 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.355796  9328 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.358558  8957 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:11.381699  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:11.382373  6070 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:17:11.381903  9328 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.382591  8957 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.383908  8957 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.384099  9311 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.384481  9311 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:11.384997  9328 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:11.055322  9312 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:17:11.334177  5521 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:11.403220  9334 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:17:11.404132  9316 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.427s	user 0.000s	sys 0.004s
I20260709 13:17:11.404372  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2110) took 2118 ms. Trace:
I20260709 13:17:11.404472  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1860) took 1867 ms. Trace:
I20260709 13:17:11.404958  5521 rpcz_store.cc:276] 0709 13:17:09.537135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.659613 (+122478us) service_pool.cc:224] Handling call
0709 13:17:09.660169 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.403597 (+1743428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.404244 (+   647us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54002dbc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:11.404409 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3849295232}
I20260709 13:17:11.404909  5373 rpcz_store.cc:276] 0709 13:17:09.285803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.043238 (+757435us) service_pool.cc:224] Handling call
0709 13:17:10.056291 (+ 13053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.056638 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.056662 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.058253 (+  1591us) log.cc:844] Serialized 499 byte log entry
0709 13:17:10.461589 (+403336us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:10.461631 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.461727 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.404124 (+942397us) raft_consensus.cc:1685] finished
0709 13:17:11.404145 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.404311 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":402868,"threads_started":1,"wal-append.queue_time_us":813572}
I20260709 13:17:11.407063  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2115) took 2119 ms. Trace:
W20260709 13:17:11.407307  9335 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:11.407552  5370 rpcz_store.cc:276] 0709 13:17:09.287652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.095518 (+807866us) service_pool.cc:224] Handling call
0709 13:17:10.095862 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.134850 (+ 38988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.134880 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.144695 (+  9815us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.620207 (+475512us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:10.620286 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.620401 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.403557 (+783156us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:11.406672 (+  3115us) raft_consensus.cc:1685] finished
0709 13:17:11.406699 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.406990 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74018,"raft.queue_time_us":24837,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7975,"spinlock_wait_cycles":61698432,"thread_start_us":428053,"threads_started":1,"wal-append.queue_time_us":726282}
I20260709 13:17:11.066953  9161 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.407109  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 295) took 2225 ms. Trace:
I20260709 13:17:11.407229  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:11.409893  5521 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.409619  5443 rpcz_store.cc:276] 0709 13:17:09.181967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.591600 (+409633us) service_pool.cc:224] Handling call
0709 13:17:09.592023 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.592424 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.592455 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.592960 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.265934 (+672974us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:10.266002 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.266112 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.406869 (+1140757us) raft_consensus.cc:1685] finished
0709 13:17:11.406900 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.407054 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7019,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":12233,"thread_start_us":636169,"threads_started":1,"wal-append.queue_time_us":1063520}
W20260709 13:17:11.411196  9299 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.524s	user 0.000s	sys 0.002s
I20260709 13:17:11.412006  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:11.412464  9321 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:11.413262  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:11.413450  9021 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.414345  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:11.414398  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1631) took 2566 ms. Trace:
W20260709 13:17:11.416277  8955 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.917s	user 0.002s	sys 0.011s
I20260709 13:17:11.414897  5366 rpcz_store.cc:276] 0709 13:17:08.847633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.130790 (+283157us) service_pool.cc:224] Handling call
0709 13:17:09.131198 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.596142 (+464944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.596173 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.601154 (+  4981us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.465716 (+864562us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:10.484665 (+ 18949us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.594376 (+109711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.594866 (+   490us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.410604 (+815738us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:11.413826 (+  3222us) raft_consensus.cc:1685] finished
0709 13:17:11.413920 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.414338 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1337,"prepare.queue_time_us":16748,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":64991,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":5067,"spinlock_wait_cycles":5863168,"thread_start_us":1257640,"threads_started":2,"wal-append.queue_time_us":1081237}
I20260709 13:17:11.328380  9197 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:11.417783  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.419332  9197 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.142010  9066 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.376101  5448 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.421053  5271 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 6 to 8, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 8 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.423309  5371 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:11.425087  5271 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 11 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.427273  5271 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 2 to 6, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 6 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:11.431504  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:11.308442  9304 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:17:11.313704  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 396143us
I20260709 13:17:11.060739  9207 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:11.352559  5489 connection.cc:256] RPC call timeout handler was delayed by -1.082421358999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:17:11.444597  6072 consensus_meta.cc:287] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.000s
I20260709 13:17:11.444716  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:11.416733  8955 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.322088  9330 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:11.325539  9065 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:11.361008  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.363152  5445 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:11.365264  5444 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:11.365689  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:11.464901  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:11.465999  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:11.466101  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:11.466883  5374 raft_consensus.cc:2410] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:11.467535  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:11.468159  5444 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:11.366652  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.368105  5522 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:11.368728  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:11.135951  9303 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:11.369797  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:11.471300  5524 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.473912  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:11.358227  9206 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:11.374958  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:11.474754  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d219441478644a3e8915df9d2083022c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:11.475641  5522 raft_consensus.cc:606] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:11.476075  5522 raft_consensus.cc:614] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:11.375166  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:11.477608  5518 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:11.375540  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53140.9us
I20260709 13:17:11.376055  9199 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:11.376811  9226 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.377182  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:11.377772  5441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:17:11.485110  5516 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.245627  9326 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:11.385269  9311 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.361580  8945 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:11.386497  9329 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:17:11.386694  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:11.387071  9322 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:17:11.387812  9176 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.388532  9035 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.172s	user 0.011s	sys 0.005s
I20260709 13:17:11.390861  9231 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.390962  8675 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:11.392684  9325 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:17:11.393499  9333 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:17:11.224767  9327 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:11.400966  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2128) took 1964 ms. Trace:
I20260709 13:17:11.401482  5523 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:11.375974  5447 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:11.420313  9066 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:11.341827  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 451301us
I20260709 13:17:11.420325  5521 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:11.434046  5517 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:11.439936  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:11.521271  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:11.521754  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 81959.2us
I20260709 13:17:11.370997  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:11.469210  5444 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:11.567900  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:11.489004  9247 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:17:11.568624  5444 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:11.569077  9305 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:11.569244  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:11.569548  9305 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:11.569862  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.570463  9207 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.569967  9305 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.571416  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:11.467480  9330 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.573755  9278 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.574354  9278 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.574754  9278 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.575533  9330 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:11.464169  9304 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:11.577947  9247 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:11.481331  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:11.481635  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:11.480840  9328 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.578941  5449 raft_consensus.cc:2410] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:17:11.579082  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 97548.1us
I20260709 13:17:11.579210  9328 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.580372  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:11.485253  5441 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:11.581297  5441 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.929678  5446 rpcz_store.cc:276] 0709 13:17:08.846828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.874596 (+ 27768us) service_pool.cc:224] Handling call
0709 13:17:08.908554 (+ 33958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.908777 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:08.909046 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.037644 (+128598us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b1800327a60. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:17:10.901786 (+1864142us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.908336 (+  6550us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.913779 (+  5443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.913835 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:10.913880 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.913954 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.914391 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9927,"prepare.queue_time_us":219924,"prepare.run_cpu_time_us":393,"prepare.run_wall_time_us":16538,"raft.queue_time_us":138039,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":26001,"spinlock_wait_cycles":6137216,"thread_start_us":1863383,"threads_started":3,"wal-append.queue_time_us":1099653}
I20260709 13:17:11.445359  6072 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:17:11.490434  5524 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:11.493701  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:11.592756  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:11.476415  9009 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.477713  9303 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.502049  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1647) took 1953 ms. Trace:
I20260709 13:17:11.475381  9120 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.517617  5369 rpcz_store.cc:276] 0709 13:17:09.436307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.109300 (+672993us) service_pool.cc:224] Handling call
0709 13:17:10.109700 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.203825 (+ 94125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.203876 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.218431 (+ 14555us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.302378 (+ 83947us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:10.703227 (+400849us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:10.703297 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.703387 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.400629 (+697242us) raft_consensus.cc:1685] finished
0709 13:17:11.400649 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.400896 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93555,"raft.queue_time_us":100588,"raft.run_cpu_time_us":2552,"raft.run_wall_time_us":89676,"spinlock_wait_cycles":6864768,"thread_start_us":420897,"threads_started":1,"wal-append.queue_time_us":738314}
I20260709 13:17:11.596807  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:11.597102  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.597537  5446 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:11.489722  9021 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:17:11.598261  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:11.598625  5446 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:11.489369  9199 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.431308  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:11.514186  5534 tablet_copy_service.cc:140] P 544c82a50cc4477886bb6f7d58f455ca: Received BeginTabletCopySession request for tablet 9d883e5d309d4113a821624777a85d05 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:34858)
I20260709 13:17:11.522810  5442 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:11.522902  9035 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.523805  8955 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:11.525300  8945 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:11.529605  9311 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.517843  9208 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.629846  9208 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.529930  9349 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:11.531541  9206 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:11.631731  5534 tablet_copy_service.cc:161] P 544c82a50cc4477886bb6f7d58f455ca: Beginning new tablet copy session on tablet 9d883e5d309d4113a821624777a85d05 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:34858: session id = 53eb858bdf82438d83f1be6a01da2e0e-9d883e5d309d4113a821624777a85d05
I20260709 13:17:11.632118  9206 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.633916  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:11.486194  9344 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:17:11.638276  9344 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.638685  9344 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:11.513592  9176 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.639559  9199 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.641068  9176 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.534843  9231 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:11.493376  9306 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:11.511130  9298 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:17:11.516760  9327 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:11.467792  9065 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:11.544361  9226 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:11.544756  5516 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:17:11.546464  5270 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 155) took 24291 ms (client timeout 15000 ms). Trace:
I20260709 13:17:11.548393  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:11.549252  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:11.549894  8675 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:11.558158  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.559489  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:11.561008  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:11.566200  9340 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:11.577888  9304 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:11.377998  9210 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.580215  5449 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:11.653671  9195 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.588827  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:11.595319  5371 rpcz_store.cc:276] 0709 13:17:09.548407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.597512 (+1049105us) service_pool.cc:224] Handling call
0709 13:17:10.632211 (+ 34699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.423753 (+791542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.501705 (+ 77952us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54001e9454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:11.501966 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815200000}
I20260709 13:17:11.603718  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.606631  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:11.610540  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:11.618775  6043 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.494484  9326 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:11.619733  9009 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.642858  5443 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.643231  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2119) took 2354 ms. Trace:
I20260709 13:17:11.590157  9232 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.734088  9232 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.733693  5368 rpcz_store.cc:276] 0709 13:17:09.289266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.096636 (+807370us) service_pool.cc:224] Handling call
0709 13:17:10.097000 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.097270 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:10.596095 (+498825us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.273032 (+676937us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.542106 (+269074us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b18003d02a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:11.555894 (+ 13788us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b18003d02a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:11.560501 (+  4607us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b18003d02a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:17:11.591718 (+ 31217us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.642876 (+ 51158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:11.642937 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:11.642979 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.643053 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.643172 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142974,"prepare.queue_time_us":27448,"prepare.run_cpu_time_us":172,"prepare.run_wall_time_us":6357,"raft.queue_time_us":309797,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":12109,"spinlock_wait_cycles":118284032,"thread_start_us":1171768,"threads_started":2,"wal-append.queue_time_us":669585}
I20260709 13:17:11.736888  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:11.618208  5441 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.590149  9350 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.593442  9223 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:11.738850  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:11.664902  9343 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:17:11.631758  9349 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:11.677269  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.594206  9110 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:17:11.642527  9336 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:11.587263  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.662149  9306 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.654894  9197 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:11.681880  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75325.6us
I20260709 13:17:11.682349  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:11.765322  5367 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.738574  8957 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.668388  9226 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.744014  5441 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.595131  9109 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:11.744441  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:11.788192  5371 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.599985  9303 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.747671  5375 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:11.747819  6070 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:11.749481  9210 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:11.670110  5270 rpcz_store.cc:269] 0709 13:16:47.242612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.262903 (+ 20291us) service_pool.cc:224] Handling call
0709 13:17:11.521251 (+24258348us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:02.752254 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:02.760106 (+  7852us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:02.760159 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:17:02.760190 (+    31us) tablet.cc:662] Decoding operations
0709 13:17:02.761709 (+  1519us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:02.761799 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:02.761826 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:17:02.763087 (+  1261us) tablet.cc:701] Row locks acquired
0709 13:17:02.763138 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:17:02.763346 (+   208us) write_op.cc:270] Start()
0709 13:17:02.763504 (+   158us) write_op.cc:276] Timestamp: P: 1783603022763266 usec, L: 0
0709 13:17:02.763540 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:17:02.764366 (+   826us) log.cc:844] Serialized 5923 byte log entry
0709 13:17:02.878526 (+114160us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d0c820ac 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b
0709 13:17:03.483416 (+604890us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b180033fd00. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:03.818478 (+335062us) op_driver.cc:464] REPLICATION: finished
0709 13:17:04.068450 (+249972us) write_op.cc:301] APPLY: starting
0709 13:17:04.075884 (+  7434us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:04.140249 (+ 64365us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:04.145927 (+  5678us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:04.248447 (+102520us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:04.248925 (+   478us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:17:04.249012 (+    87us) write_op.cc:312] APPLY: finished
0709 13:17:04.303056 (+ 54044us) log.cc:844] Serialized 106 byte log entry
0709 13:17:04.304181 (+  1125us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:04.304442 (+   261us) write_op.cc:454] Released schema lock
0709 13:17:04.304540 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:04.415718 (+111178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:04.424198 (+  8480us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2243540,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":200509,"apply.run_cpu_time_us":6707,"apply.run_wall_time_us":363035,"num_ops":15,"prepare.queue_time_us":258076,"prepare.run_cpu_time_us":20162,"prepare.run_wall_time_us":247978,"raft.queue_time_us":274020,"raft.run_cpu_time_us":40781,"raft.run_wall_time_us":116760,"replication_time_us":1054688,"spinlock_wait_cycles":48382464,"thread_start_us":632365,"threads_started":4,"wal-append.queue_time_us":238690,"wal-append.run_cpu_time_us":26154,"wal-append.run_wall_time_us":1853381}]]}
I20260709 13:17:11.738840  5368 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.681644  8675 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.751237  5443 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:11.758796  5366 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 5: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:11.764909  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.683861  5369 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.727144  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.770680  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1648) took 2222 ms. Trace:
W20260709 13:17:11.790760  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 210458us
I20260709 13:17:11.738801  9305 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:11.824909  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.825106  5374 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:11.758286  9349 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:11.826771  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.764437  9306 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.726763  9195 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.834252  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.837900  5374 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:11.827229  5372 rpcz_store.cc:276] 0709 13:17:09.548712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.668348 (+1119636us) service_pool.cc:224] Handling call
0709 13:17:10.668772 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.718490 (+ 49718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.718544 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.746689 (+ 28145us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.243908 (+497219us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:11.243966 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.400582 (+156616us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b54001c61d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:11.400634 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.770371 (+369737us) raft_consensus.cc:1685] finished
0709 13:17:11.770393 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.770619 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113432448,"thread_start_us":403564,"threads_started":1,"wal-append.queue_time_us":538461}
I20260709 13:17:11.832602  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:11.839917  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.746826  9009 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.765630  9328 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:11.843628  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 200082us
I20260709 13:17:11.859685  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:11.858911  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 289728us
I20260709 13:17:11.863397  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:11.770624  5534 tablet_copy_source_session.cc:215] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:11.758749  9223 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.865967  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.773543  8957 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:11.789561  9226 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.869547  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:11.900699  5375 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.839542  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:11.842422  9330 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:11.768254  9336 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.890563  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:11.770865  9197 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.830402  9065 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:11.856082  5368 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:11.904191  5374 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:11.924469  5371 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:11.771083  9247 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:17:11.899101  5369 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:11.794162  9109 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.939797  9109 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.940728  9109 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.941116  9109 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.917591  5372 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:11.794353  9120 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:17:11.943955  9120 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:11.944319  9120 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:11.879676  5490 leader_election.cc:400] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13.
I20260709 13:17:11.945775  5490 leader_election.cc:403] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:11.835708  9110 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:17:11.889235  9210 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.930788  9223 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.931627  9014 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:11.900089  8957 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.891198  9044 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:11.886802  9328 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.949126  5375 raft_consensus.cc:2410] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:11.956969  5367 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:11.919219  9336 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:11.905942  9330 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:11.973773  5373 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
W20260709 13:17:11.978933  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 211783us
I20260709 13:17:11.946300  9109 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:11.994349  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 114891us
I20260709 13:17:11.995210  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:11.965368  9210 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.000135  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:11.967284  9021 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:11.972150  9223 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.973523  9065 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:11.971011  9247 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:12.054141  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 411927us
I20260709 13:17:11.945164  9120 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:11.995527  9347 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.999221  9210 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.969179  9349 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.067898  9306 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.068890  9330 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
W20260709 13:17:12.070562  9353 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:17:12.071059  9195 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.072743  9035 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:12.075464  9278 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 13:17:12.077862  8675 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.079618  9232 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.080479  9298 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:11.974668  9014 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.006013  9328 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.093222  9120 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.093536  9197 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.094393  9305 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:12.125542  9208 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:12.095979  9206 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.126827  9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d883e5d309d4113a821624777a85d05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:12.127074  9330 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:12.042084  9247 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:12.043726  9065 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.097595  9362 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.099175  9267 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:12.135988  9351 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.278s	user 0.003s	sys 0.000s
I20260709 13:17:12.057652  9223 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.032872  9021 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:12.139520  9344 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.140206  9065 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:12.140528  9344 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.141008  9362 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.141396  9021 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:12.143349  9362 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.100456  9349 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.137265  9247 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.147125  9226 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.150254  9345 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:12.150738  9345 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:12.151615  9345 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.152007  9303 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.139604  9223 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.152951  9345 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.127626  9366 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.154423  9303 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:12.102428  9347 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:12.157743  9247 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.056885  9044 consensus_queue.cc:1243] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:12.159716  9066 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:12.160182  9066 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:12.004271  9356 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13.
I20260709 13:17:12.101182  9326 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:12.108474  9035 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:12.161103  9066 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.115245  9298 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:12.162133  8957 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.162389  9035 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.162984  9298 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.163671  9035 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.115325  9278 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:12.164177  9298 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:12.123381  9014 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.165294  8957 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:12.131402  9199 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:12.165616  9278 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:12.165969  9199 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:12.166821  9199 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.168195  9199 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:12.135710  9267 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:12.058667  9327 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:12.115229  9161 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.171063  9306 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:12.171136  9161 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.098940  9110 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:12.097141  9109 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.174957  9109 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.161654  9210 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.157748  9347 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:12.181057  9066 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.150254  9226 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.184747  9161 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.185442  9267 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.192685  9210 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:12.186700  9311 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.006s
W20260709 13:17:12.230356  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 339546us
I20260709 13:17:12.088580  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:12.234617  5366 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:12.235924  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 147254us
I20260709 13:17:12.243711  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:12.089802  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.258291  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 253604us
I20260709 13:17:12.259956  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:12.262720  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.263648  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.264072  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.264457  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.268096  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 267933us
W20260709 13:17:12.270314  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.270159  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.279393  5449 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 13. Ops: []
I20260709 13:17:12.282724  5450 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:12.284664  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.284890  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.285909  5445 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:17:12.290484  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:12.293264  5518 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.296377  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:12.180064  9009 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:12.293148  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:12.265254  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.300266  5447 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:12.324841  9223 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:12.295722  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:12.294512  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:12.316092  9109 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:12.336256  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.316882  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:12.303985  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.295353  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:12.325620  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.339119  9223 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.343302  5446 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:12.352512  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:12.346062  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.354383  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.348608  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.357074  5444 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:12.311149  9345 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.360054  9345 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:12.360582  9223 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.355202  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.355902  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.356207  5450 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:12.356886  6076 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 7.
I20260709 13:17:12.345803  9109 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.333817  9210 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:12.362308  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.334993  5448 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:12.370316  5445 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:12.378010  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.378562  5449 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:12.383723  9109 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:12.385478  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.386610  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.394047  9223 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:12.396579  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 153180us
I20260709 13:17:12.397938  9210 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.398847  9210 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:12.401975  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.403966  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.405755  5449 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:12.405656  9044 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:12.406481  9044 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:12.407014  9044 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.409062  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.409598  5446 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:12.411300  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.412132  5446 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:12.367269  9345 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.414443  5449 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.414311  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.415942  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.416113  9211 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:12.416895  9211 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:12.417694  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 110345us
I20260709 13:17:12.418675  9211 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.421847  9376 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:12.421880  9197 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.423259  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.423780  9197 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:12.423906  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.400612  9210 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.424423  5446 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:12.424867  5519 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:12.431859  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.439695  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.440968  5450 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:12.452994  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.454062  5517 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:12.455144  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.425797  9376 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:12.469080  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.475276  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.473569  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.473371  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.465021  9376 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:12.488582  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 251198us
I20260709 13:17:12.495213  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.425248  9197 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.500806  5519 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.494616  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.511333  5449 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:12.494336  9362 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:12.514753  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.522430  5517 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:12.532274  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.540040  5449 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:12.540237  9278 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.540732  5515 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:12.541144  9278 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.542279  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.544057  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.544927  5521 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:12.544981  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:12.545717  9226 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.547376  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.547853  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.549177  5515 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:12.549659  9226 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.550379  9267 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.544071  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.556593  5415 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:12.557780  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.556303  9376 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.566331  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.567153  5441 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:12.568544  9362 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:12.570569  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.582083  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.582818  5449 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:12.583205  5521 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:12.583496  9362 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.570835  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.571590  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.571733  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.584925  5447 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:12.572557  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.586076  5448 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:12.572849  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.588428  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.574534  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.575551  9226 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.591118  5515 raft_consensus.cc:2368] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:12.591501  5516 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:12.592207  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:12.593156  6076 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.591039  5443 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.609182  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.617296  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.639587  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:12.645305  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.614553  5340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.168s (SENT) [suppressed 28 similar messages]
I20260709 13:17:12.655777  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.664980  9372 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:12.665838  9372 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.611471  9362 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:12.670535  9362 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.673023  9362 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.674314  5519 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:12.655056  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.658506  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:12.683647  5515 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:12.687645  5441 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:12.695348  6076 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:17:12.637174  9278 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.700899  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.701610  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.711246  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.712218  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.717849  5517 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:12.708788  9376 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:12.723277  5521 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:12.728729  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.700348  9044 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.728008  5516 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:12.737118  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.738734  5515 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:12.727576  9347 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.738941  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.742699  5517 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.745589  9197 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:12.746667  9197 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.745395  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.733952  9278 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.749922  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.757225  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:12.763794  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:12.764443  9384 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:17:12.764606  5441 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:12.741940  9347 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:12.775486  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.774071  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.775159  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.786564  9278 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.765974  9347 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:12.799479  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 116177us
I20260709 13:17:12.802798  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:12.804874  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 190346us
I20260709 13:17:12.774467  9372 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.806824  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:12.807039  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62825.7us
W20260709 13:17:12.808408  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.809778  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:12.818697  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.816155  5450 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:17:12.828794  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.836628  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.837930  5516 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:12.843755  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.857138  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.837603  9210 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.861840  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.852291  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.870349  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.865461  9210 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.872121  9232 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:12.872931  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:12.873733  9014 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:12.879312  5366 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:12.875171  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.859400  9372 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.877969  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.879748  5442 raft_consensus.cc:2368] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:12.875106  9044 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:12.885354  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.879074  9210 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.888252  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:12.890686  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.893445  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.893834  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.894387  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.879024  9232 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:12.894258  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:12.896473  9232 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.894232  5372 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:12.895320  5442 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:12.896617  9378 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:12.896483  9223 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:12.896696  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:12.903649  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.889978  9014 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:12.911489  5517 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:12.910518  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.902338  9378 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.895120  9278 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:12.916659  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44978.6us
I20260709 13:17:12.913319  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:12.915455  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.922598  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:12.924274  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.924976  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.923843  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:12.905200  9223 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:12.930841  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:12.931821  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.923609  9395 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:17:12.938217  9014 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:12.945639  5524 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:17:12.946188  9397 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:17:12.929373  9392 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:17:12.948776  9378 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:12.914433  9372 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:12.947011  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.958552  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.958755  5521 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:12.959169  5523 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:12.961155  5443 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:12.961604  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:12.931944  9044 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:12.989353  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.990134  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:12.970223  9378 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:12.991374  5517 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:12.994129  5524 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:13.000626  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:13.001765  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:13.002408  5448 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.002776  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:12.989717  9278 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:12.989202  9044 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.006462  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.006690  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.007761  5442 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:13.007894  5441 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:13.007939  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.010766  5521 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:13.010980  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.010159  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:13.012634  5520 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.015806  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.016731  5519 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:13.009073  9278 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.018100  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.018625  9278 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.019049  9284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59508 (request call id 119) took 3965 ms. Trace:
I20260709 13:17:13.019649  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.020567  5519 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 5: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:13.019532  9284 rpcz_store.cc:276] 0709 13:17:09.053871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.056266 (+  2395us) service_pool.cc:224] Handling call
0709 13:17:09.968485 (+912219us) ts_tablet_manager.cc:934] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
0709 13:17:11.968549 (+2000064us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:17:12.580918 (+612369us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:12.581156 (+   238us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:17:13.017846 (+436690us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:17:13.018307 (+   461us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:13.018698 (+   391us) ts_tablet_manager.cc:989] Replica registered.
0709 13:17:13.018833 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":115692,"tablet-copy.queue_time_us":811143,"thread_start_us":841137,"threads_started":2}
I20260709 13:17:13.024849  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.026751  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.027369  5521 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:13.028192  9393 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:17:13.027992  9378 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.009681  9044 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.033298  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.035898  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.035228  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.037175  5367 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.038177  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.007261  9223 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:13.031077  9197 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.044847  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:13.045687  9390 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.329s	user 0.000s	sys 0.006s
I20260709 13:17:13.046449  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.047130  5373 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.048256  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.048493  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.049554  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.050287  5372 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.053809  5339 leader_election.cc:400] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:13.054301  5339 leader_election.cc:403] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:13.049554  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.059304  5524 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:13.060971  5518 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:13.061604  5522 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:13.064167  9197 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.064700  5446 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:13.064214  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.067540  9378 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:13.068763  9399 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:17:13.072770  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.079101  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.079730  5521 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:13.030048  9284 tablet_copy_client.cc:806] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:13.082002  5448 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:13.082983  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.084349  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.086170  5522 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:13.090342  5519 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:13.091480  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.091367  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.092577  5448 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:13.086095  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.088001  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.115566  5519 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:17:13.115568  5368 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:13.116650  5515 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:13.117934  5520 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:13.119612  5524 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:13.120970  9226 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:13.121546  9109 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:13.122112  9226 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:13.122388  9109 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:13.124115  9109 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.126667  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.122521  9226 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:13.127756  5370 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:13.119144  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48968.6us
I20260709 13:17:13.130332  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.133160  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.139205  5446 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:13.147388  5521 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.144893  9364 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:17:13.128230  9226 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.152532  5522 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:13.145563  9362 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:13.157114  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.157639  9362 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.158084  9362 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.137136  9284 tablet_copy_client.cc:670] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:13.158154  5371 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:17:13.164778  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.168816  5373 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:13.172133  5522 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.176460  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.177145  5374 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.169714  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.178143  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.173516  5446 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5.
I20260709 13:17:13.175294  5520 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.183585  5370 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:13.182286  5521 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:13.184515  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.187019  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.186488  5446 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:13.188364  9226 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.193629  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.194586  5441 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:13.196070  9372 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.196594  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:13.196740  9372 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:13.200722  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:13.200996  9372 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:13.208473  5371 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:13.209004  5522 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.212453  5372 raft_consensus.cc:2410] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:17:13.202201  9372 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.209007  5371 pending_rounds.cc:85] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 5
I20260709 13:17:13.222764  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.217815  5371 pending_rounds.cc:107] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:13.226038  5371 raft_consensus.cc:2889] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.226154  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.219983  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:13.224900  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 68558.2us
I20260709 13:17:13.234709  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.235677  5518 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:13.242399  9197 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:13.245697  5375 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:13.245867  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.247192  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.248956  5366 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:13.249963  9014 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:13.250469  9378 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.250464  9014 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:13.251703  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.252055  9014 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.252547  5369 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:13.257596  5372 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.258363  9364 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:13.258852  9364 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:13.259261  9364 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.259858  5374 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:13.262161  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.270080  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.270944  9197 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:13.271351  9197 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:13.272342  9197 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.266772  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:13.273645  9223 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.274145  9223 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.267211  9376 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:13.274528  9223 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.275092  9376 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:13.275473  9376 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:13.276446  9376 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.277915  9275 raft_consensus.cc:2764] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:13.279548  9376 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.282138  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.287674  9211 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:13.289126  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.290017  5518 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:13.281126  9197 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:13.292791  5340 leader_election.cc:336] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.028s (SENT)
I20260709 13:17:13.294030  9014 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:13.203200  9232 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.297919  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.268193  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.298708  5372 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:13.299577  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.301265  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.304325  5367 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:13.307626  5520 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:13.311565  5373 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:13.312346  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.312435  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:13.312683  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 125600us
I20260709 13:17:13.317899  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.319208  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.320710  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.322398  5368 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.285063  9347 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:13.324357  5367 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:13.325335  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:13.325814  5369 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:13.326701  5372 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.326923  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.334290  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.348284  5374 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:13.349049  5373 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:13.340739  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 194520us
W20260709 13:17:13.350618  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82511.3us
I20260709 13:17:13.355326  5366 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:13.359274  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.364192  5517 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:13.366183  5367 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:13.310503  9044 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.362820  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.370147  5445 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:13.371500  5374 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.373543  9377 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.374639  9377 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.375106  9377 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:13.375473  9377 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.377754  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:13.378582  6076 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:13.380524  9347 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:13.322943  9278 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.383198  9197 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.384323  9210 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.385154  9278 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.386677  9014 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.388700  5374 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:13.388747  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.389962  9362 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.391274  9044 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.391206  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.391971  5368 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:13.392082  9362 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.393177  5375 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:13.396327  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:13.345144  9211 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:13.400055  9347 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.400520  9211 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.402787  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:13.404695  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:13.406347  9232 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.410365  5375 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.412093  5368 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.404196  9223 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:13.417485  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.425922  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.424115  9347 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:13.428978  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.430079  5372 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:13.430025  5366 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
W20260709 13:17:13.446317  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.451352  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.454814  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 111774us
I20260709 13:17:13.455209  5370 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:13.456454  5371 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:13.457816  5516 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:13.462184  9223 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:13.472491  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 120742us
I20260709 13:17:13.447829  9347 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:13.473834  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.476701  9210 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.476775  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:13.448175  9376 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:13.454777  9364 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:13.495643  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.498395  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.500808  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.501807  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.502621  9405 raft_consensus.cc:2764] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:17:13.502704  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.503364  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.504160  5515 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.503376  5517 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.506727  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.507076  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.507886  5519 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.508199  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.508771  5520 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.514742  5523 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:13.526364  9410 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.527108  9410 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:13.531138  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.532470  9284 tablet_copy_client.cc:538] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:13.536294  9347 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.504554  9378 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:13.540855  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57175.5us
I20260709 13:17:13.552742  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:13.558938  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.563110  5518 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:17:13.570463  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 96688.6us
W20260709 13:17:13.575119  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 258742us
I20260709 13:17:13.577035  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.578181  5523 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.562577  9405 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.588812  9410 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:13.593753  5272 catalog_manager.cc:5697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:13.598644  5272 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 8 to 10, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 10 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:13.568148  9109 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:13.589228  9364 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.625560  9109 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:13.630546  9109 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.632217  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:13.633193  9378 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:13.633610  9378 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:13.634052  9378 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.633584  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:13.636229  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:13.637332  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 158756us
I20260709 13:17:13.638769  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:13.642045  5272 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 8 to 10, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 10 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:13.615281  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.624866  5271 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 152) took 19806 ms (client timeout 15000 ms). Trace:
I20260709 13:17:13.657383  5519 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:13.658455  5515 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:13.658901  5517 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:13.660128  5523 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:13.658784  5272 catalog_manager.cc:5697] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:13.665613  5272 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:13.669555  9412 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:17:13.670673  9412 consensus_queue.cc:1243] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:13.671197  9412 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:13.671772  9412 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:13.656991  9362 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:17:13.674697  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.678720  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.672778  9412 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.662523  9364 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.684283  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:13.686635  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.668013  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.663849  9405 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.686234  5272 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:13.691272  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:13.693197  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.693148  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:13.655505  5271 rpcz_store.cc:269] 0709 13:16:53.818598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.821608 (+  3010us) service_pool.cc:224] Handling call
0709 13:17:13.624636 (+19803028us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:11.965980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:12.081474 (+115494us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:12.081508 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:17:12.081527 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:12.082571 (+  1044us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:12.082652 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:12.082676 (+    24us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:17:12.083701 (+  1025us) tablet.cc:701] Row locks acquired
0709 13:17:12.083723 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:17:12.103599 (+ 19876us) write_op.cc:270] Start()
0709 13:17:12.109748 (+  6149us) write_op.cc:276] Timestamp: P: 1783603032103488 usec, L: 0
0709 13:17:12.113778 (+  4030us) op_driver.cc:348] REPLICATION: starting
0709 13:17:12.158096 (+ 44318us) log.cc:844] Serialized 4764 byte log entry
0709 13:17:12.204851 (+ 46755us) op_driver.cc:464] REPLICATION: finished
0709 13:17:12.380112 (+175261us) write_op.cc:301] APPLY: starting
0709 13:17:12.380347 (+   235us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:12.380860 (+   513us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:12.381054 (+   194us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:12.551579 (+170525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:12.551972 (+   393us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:17:12.552034 (+    62us) write_op.cc:312] APPLY: finished
0709 13:17:12.552575 (+   541us) log.cc:844] Serialized 88 byte log entry
0709 13:17:12.552862 (+   287us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:12.553176 (+   314us) write_op.cc:454] Released schema lock
0709 13:17:12.553264 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:12.553972 (+   708us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:12.554010 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3106061,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":1172,"apply.run_cpu_time_us":7179,"apply.run_wall_time_us":216220,"num_ops":12,"prepare.queue_time_us":392515,"prepare.run_cpu_time_us":24712,"prepare.run_wall_time_us":292109,"raft.queue_time_us":1167,"raft.run_cpu_time_us":1998,"raft.run_wall_time_us":137106,"replication_time_us":90885,"thread_start_us":449337,"threads_started":4,"wal-append.queue_time_us":42868,"wal-append.run_cpu_time_us":4834,"wal-append.run_wall_time_us":1353184}]]}
I20260709 13:17:13.699338  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.700201  9408 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.689218  9362 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:17:13.711930  5520 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:13.712385  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.693835  9211 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:13.716054  5272 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:13.703146  9412 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.710466  9376 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.723155  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.679664  9377 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.722597  5340 leader_election.cc:400] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:13.718925  9223 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:13.710422  9411 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:13.734740  5520 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:13.727424  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:13.715848  9408 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:13.742172  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52616.8us
I20260709 13:17:13.743604  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:13.747877  5516 raft_consensus.cc:2368] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
W20260709 13:17:13.769604  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 104857us
I20260709 13:17:13.739598  9211 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:13.749747  9223 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:13.794231  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 71840.1us
I20260709 13:17:13.886305  5272 catalog_manager.cc:5697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 9 to 10, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:13.891809  5515 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:13.880759  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:13.750082  9405 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:13.729839  9347 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.742477  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:13.896246  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 153885us
W20260709 13:17:13.881997  9416 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.132s	user 0.001s	sys 0.005s
I20260709 13:17:13.882802  5523 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:13.724856  9044 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:13.885633  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 67089.2us
I20260709 13:17:13.888355  5519 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.750370  9197 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:13.905071  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.903606  9418 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.909385  9418 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.910198  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:13.905673  5272 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 5 to 8, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 8 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:13.919000  5516 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:13.921715  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.889242  9411 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:13.942960  9411 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.924608  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:13.903640  9014 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:13.931704  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.929168  9412 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.921154  9364 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:17:13.932427  9044 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:13.946072  9412 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.946532  9362 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:13.947292  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.947432  9362 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:13.904027  9223 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.933902  9407 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:13.932876  9197 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:13.948884  9362 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.926718  5517 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:13.937582  9415 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.153s	user 0.003s	sys 0.009s
I20260709 13:17:13.944995  9014 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:13.946887  9044 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.954991  9014 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.934298  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.950224  9197 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.890581  9211 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:13.949343  5490 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.904158  9109 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.981333  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:13.982024  5445 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:17:13.983018  9109 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:13.983280  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:13.904729  9405 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.971727  9407 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.984405  9405 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.970173  9412 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.985260  9412 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.986778  9378 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:13.987738  9412 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:13.990455  9347 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:13.990808  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:13.991068  9347 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:13.979190  9377 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:13.981040  9226 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:13.994828  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 60654.2us
I20260709 13:17:13.995955  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.004128  5524 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:14.004522  5517 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:13.966629  9418 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:14.011516  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 130857us
I20260709 13:17:13.996829  9347 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.989295  9378 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:14.000131  9376 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:14.014394  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:14.001720  9412 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.026595  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.035485  9426 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:14.036712  9426 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.012423  9408 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:14.046844  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 136755us
I20260709 13:17:14.038424  9426 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.023933  9376 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.054476  5272 catalog_manager.cc:5697] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:14.060406  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.044664  9364 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:14.019369  9407 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:17:14.046707  9412 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:14.079178  9434 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:14.078986  9364 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:14.079623  9434 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:14.081583  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54442.4us
I20260709 13:17:14.061771  9376 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.087863  5272 catalog_manager.cc:5697] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 5 to 8, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 8 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.070848  9372 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.077852  9424 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.101282  5272 catalog_manager.cc:5697] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:14.063326  9109 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:17:14.115109  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 134529us
I20260709 13:17:14.120314  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:14.125146  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:14.130159  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.100955  9421 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.121784  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:14.102818  9408 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:14.138556  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:14.133800  9412 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.106664  9424 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:14.080771  9434 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:14.137810  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54732.5us
I20260709 13:17:14.105532  9197 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:17:14.147301  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.154604  9432 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:14.161935  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:14.163153  5441 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.140110  9420 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:14.146591  9411 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:14.183590  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 192854us
I20260709 13:17:14.187817  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.181223  5272 catalog_manager.cc:5697] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 6 to 9, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 9 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.191422  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:14.192114  5448 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
W20260709 13:17:14.199404  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49044.5us
I20260709 13:17:14.178752  9420 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:14.200415  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 80386.8us
I20260709 13:17:14.201879  5272 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:14.187023  9434 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:14.204070  9428 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:17:14.206739  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:14.223595  9443 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:14.224282  9443 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:14.224638  9413 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.225462  9443 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.227360  9443 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:14.229979  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 208577us
I20260709 13:17:14.231082  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.236927  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.237136  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:14.241225  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.206084  9420 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.205082  9372 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:14.233981  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:14.232756  9435 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:17:14.259649  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 71938.3us
W20260709 13:17:14.260066  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.262753  9444 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:14.273006  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.278707  9436 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.249315  9197 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:14.285912  9197 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.288843  9197 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:14.290282  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:14.291306  5519 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:14.294417  9284 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:17:14.299575  5524 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:14.257973  9372 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:14.310168  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.270906  9210 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:14.315934  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:14.307309  9418 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:14.329747  9223 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:14.339844  9440 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:14.340575  9440 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:14.341940  9440 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.345570  9438 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:14.346340  9438 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.346863  9438 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.329957  9444 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:14.359293  9372 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:14.360643  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 123775us
I20260709 13:17:14.361670  9372 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.232012  9424 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.359289  5441 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:14.351759  9226 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:14.382634  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:14.386984  9436 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:14.387533  9436 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:14.388016  9436 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:14.394013  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 160148us
I20260709 13:17:14.358351  9223 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:14.396086  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 92740.8us
I20260709 13:17:14.367053  9444 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:14.365217  9426 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:14.385403  9226 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:14.419899  9454 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:14.423166  9434 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:14.424957  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.425019  9443 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:14.429500  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 192424us
I20260709 13:17:14.430042  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.402194  9444 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.452414  9424 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.403687  9405 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.449658  9418 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.468602  6073 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:14.466104  9347 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.480326  6072 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:14.465804  9429 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:14.450724  9449 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.164s
I20260709 13:17:14.491379  9453 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:14.491134  9014 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:14.491746  9453 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:14.492486  9364 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:14.493876  9405 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:14.492583  9453 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:14.497752  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 96942.3us
I20260709 13:17:14.488729  9434 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:14.505759  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.495078  9407 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:14.515256  9438 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.519568  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.504878  9411 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.521021  9452 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.521664  9418 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:14.533507  9434 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:14.522135  9450 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:17:14.522475  9453 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.539449  9434 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.533818  9452 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:14.523720  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.476289  9223 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.545670  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:14.546010  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.547089  9413 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.548051  9413 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:14.541249  9226 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.550252  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.475172  9426 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.542708  9452 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.525739  9429 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:14.526026  9444 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.550577  9405 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:14.572680  9444 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:14.567468  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:14.579744  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:14.580588  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.580680  5441 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.599416  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.565460  9412 raft_consensus.cc:2764] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:14.576963  9438 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:14.537523  9440 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:17:14.607954  9456 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:14.610150  9420 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.584326  9418 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.567050  9376 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.579653  9421 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:14.549273  9413 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.684695  5441 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:14.705741  5520 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:14.716110  9457 raft_consensus.cc:2764] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:17:14.605010  9452 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.716861  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:14.710556  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 111104us
I20260709 13:17:14.719132  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.692844  9440 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:14.737365  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:14.739395  5441 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.719316  9421 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:14.743271  9421 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.744958  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:14.747494  5441 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 6.
I20260709 13:17:14.584753  9436 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.751039  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:14.705551  9109 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:14.711798  9429 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:17:14.758778  9376 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:14.757529  9424 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.718475  9412 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.761634  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:14.737102  9420 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:14.740456  9378 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.760232  9440 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:14.759785  9436 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:14.764035  9418 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:14.780066  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43560.9us
I20260709 13:17:14.781296  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.769140  9424 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:14.788504  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43755.9us
I20260709 13:17:14.789633  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:14.764367  9109 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.791846  9424 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:14.796500  9418 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:14.801849  9424 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.802922  9418 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.794484  9420 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.805732  9420 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.780000  9378 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:14.765126  9412 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.812587  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.816290  9378 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.817538  5441 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:14.817634  9420 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:14.814846  9426 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:14.818734  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:14.819361  9426 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:14.819851  9426 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:14.821492  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 396641us
I20260709 13:17:14.821342  9420 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:14.822359  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.824620  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.825256  9440 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.826135  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.827754  5414 leader_election.cc:400] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:17:14.828123  5414 leader_election.cc:403] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:14.825659  9411 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.830103  9405 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.827529  9364 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.830338  9457 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:14.834138  9441 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.835054  9467 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.835060  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:14.836097  9443 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:14.837699  9449 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.838328  9429 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:14.841660  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:14.843856  9347 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:14.845002  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:14.862438  5370 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:17:14.847795  5340 consensus_peers.cc:597] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:14.817047  9376 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.853324  9226 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.861887  5523 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:14.862574  5520 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:14.845969  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:14.863097  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 53357.1us
I20260709 13:17:14.867491  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:14.867602  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:14.868286  5340 leader_election.cc:336] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.503s (SENT)
I20260709 13:17:14.868511  5366 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:14.868731  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.870216  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:14.870580  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:14.870877  5371 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 5.
I20260709 13:17:14.872215  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:14.872727  5369 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.847647  9453 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.871745  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:14.876632  5375 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.874758  9411 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:14.889205  5518 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
W20260709 13:17:14.895217  9464 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 13:17:14.878134  9362 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:14.902626  5367 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:14.904191  9454 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:14.907265  9454 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:14.908424  9454 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.904321  9364 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:14.910059  9364 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:14.910907  9364 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.912251  9364 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.877700  9453 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.889918  9411 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:14.929262  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61000.8us
I20260709 13:17:14.904065  9405 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:14.936830  5340 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.516s (SENT)
I20260709 13:17:14.937516  9405 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:14.938217  5340 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.518s (SENT)
W20260709 13:17:14.939785  5340 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.524s (SENT)
I20260709 13:17:14.940418  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.941649  9044 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.905506  9434 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:14.927870  9454 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.963172  9471 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:14.963908  9461 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.003s
I20260709 13:17:14.969866  9109 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:14.982066  9412 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:14.982331  9411 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:14.983471  5340 leader_election.cc:336] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.548s (SENT)
I20260709 13:17:15.052392  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:14.923722  9424 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:14.991981  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:14.999368  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:15.054697  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 219698us
I20260709 13:17:15.045281  5369 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
W20260709 13:17:15.048839  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.044544  5375 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:15.056851  5448 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:17:15.060976  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.061578  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.018620  9440 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:15.102711  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 119281us
W20260709 13:17:15.103500  5340 leader_election.cc:336] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.568s (SENT)
I20260709 13:17:15.103876  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:15.113559  5340 leader_election.cc:336] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.581s (SENT)
I20260709 13:17:15.118239  9486 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:15.122330  9487 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.123003  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:15.123198  9487 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.124811  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:15.126704  9478 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.127502  9478 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:15.128959  9478 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:15.132294  9486 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:15.132712  9486 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:15.133621  9486 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.134898  9486 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.135466  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:15.136301  9449 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.136686  9449 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:15.136736  9443 consensus_queue.cc:1175] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 10 index: 7 } }
I20260709 13:17:15.137216  9449 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.137818  9490 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:15.107636  9223 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:15.139894  9478 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:15.140867  5368 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:15.140964  9478 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.143150  9441 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:15.143477  9372 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.143790  9441 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:15.144188  9471 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.146375  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.147250  5370 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:15.148613  9411 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.150605  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.151597  9494 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.152097  9494 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.152752  9418 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.153256  9418 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.155033  9492 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.155375  5517 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:15.155458  9418 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.155516  9492 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.156246  9418 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.156507  5518 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:15.116585  9429 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.157774  9485 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:15.158378  9347 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:15.158761  9347 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:15.159185  9420 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:15.159749  9347 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.160776  9420 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:15.159710  9492 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.161909  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:15.117242  9440 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.164593  9440 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.145198  9471 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.059096  9421 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.156858  9418 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.177870  5370 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:17:15.178053  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 64553.8us
W20260709 13:17:15.179432  5340 leader_election.cc:336] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.670s (SENT)
I20260709 13:17:15.170192  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:15.174387  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:15.197227  5517 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:15.182647  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:15.203624  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.205948  5490 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.208673  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.161278  9347 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.212600  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.215826  5373 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:15.159206  9424 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.219697  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:15.182314  9421 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.222712  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.181761  9109 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.235325  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.242820  5442 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:15.205035  9438 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.146448  9449 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.203998  9377 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:15.251344  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 81287.6us
I20260709 13:17:15.194363  9364 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:17:15.258641  5516 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:15.275301  5524 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:15.276126  5443 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:15.277608  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:15.284425  5518 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:15.182121  9429 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.217109  9044 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 13:17:15.283103  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 74573.6us
I20260709 13:17:15.284008  5450 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:15.278591  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70162.1us
I20260709 13:17:15.247820  9457 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:15.227489  9444 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:15.237973  9210 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.251386  9278 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.287823  5519 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:15.252671  9109 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.291217  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:15.291731  5340 leader_election.cc:336] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.785s (SENT)
I20260709 13:17:15.245412  9432 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:17:15.234736  9420 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:17:15.280390  9211 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.248466  9485 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:15.308934  5445 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:15.309506  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.314602  5518 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:15.145188  9441 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.282778  9223 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:15.293290  9495 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:15.288671  9413 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:15.315289  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.398152  5448 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:15.398387  5444 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
W20260709 13:17:15.356853  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.376269  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.376917  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 61471.6us
I20260709 13:17:15.276937  9494 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.287531  9453 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:15.379160  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 87445.3us
I20260709 13:17:15.257984  9438 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.306111  9226 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:15.381629  5442 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:15.279886  9377 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:15.307708  9440 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:15.320852  9412 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.313373  9457 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:15.398730  9477 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:17:15.382215  9376 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:15.439325  5340 leader_election.cc:336] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.786s (SENT)
I20260709 13:17:15.294272  9426 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.413517  9413 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.447937  5444 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:15.310389  9444 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:15.307410  9210 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.313887  9278 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:15.462285  9463 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:15.467113  5520 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:15.470412  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:15.493083  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73773.5us
W20260709 13:17:15.493724  5340 leader_election.cc:336] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.791s (SENT)
I20260709 13:17:15.494145  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.398074  9485 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:15.496068  9485 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.476054  5524 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:15.394311  9492 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:17:15.501613  9432 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.504441  5441 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:15.506377  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:15.450155  9376 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.451128  9226 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:15.391240  9211 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.471560  9441 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.471063  9413 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:15.398880  9223 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.451920  9494 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:17:15.462867  9457 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.502177  9492 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.447683  9412 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.502151  9432 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.528888  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.514484  9376 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.527611  5517 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:15.451974  9440 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.520112  9418 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.522718  9453 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:15.522971  9044 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.533859  5445 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:15.530409  9488 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:15.542977  9421 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.557540  9449 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:15.573596  9467 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.719s	user 0.013s	sys 0.001s
I20260709 13:17:15.532811  9492 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.565302  9488 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:15.602056  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.602268  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.611552  9109 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.612993  9109 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:15.604240  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.615073  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.615770  5448 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:15.616837  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.617626  5448 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:15.618618  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.619843  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.591324  9429 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.620635  5448 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:15.611440  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.605664  5450 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:15.623145  9372 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.623713  9372 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.627276  9492 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.583324  9226 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.602742  9467 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:17:15.631103  9488 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.632632  9488 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.603426  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.629230  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:15.590669  9482 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.424s	user 0.003s	sys 0.000s
I20260709 13:17:15.635813  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:15.637352  5373 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:15.586827  9364 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.566495  9453 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.644284  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.648984  5373 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:15.638461  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.645385  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:15.651701  5371 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.645454  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.653399  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:15.653632  5367 raft_consensus.cc:1217] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Deduplicated request from leader. Original: 8.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 13:17:15.654095  5367 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:15.654227  5375 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:15.654935  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.656216  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.650472  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:15.656813  5447 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:15.657727  5374 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:15.658907  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:15.657609  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 256896us
I20260709 13:17:15.660326  5372 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:15.661298  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.663743  5448 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:15.666288  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:15.610567  9426 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.667028  5519 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:15.636246  9044 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.672314  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:15.673640  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.678153  5443 raft_consensus.cc:2376] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 5. Re-sending same reply.
I20260709 13:17:15.674412  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.679337  5442 raft_consensus.cc:2376] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11. Re-sending same reply.
I20260709 13:17:15.667268  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.675432  5373 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:15.683080  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.684957  5447 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 8: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:15.685137  5444 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:15.697055  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:15.697227  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.698343  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:15.702783  9278 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.703979  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.704738  5366 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:15.705088  9223 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.705766  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.706449  5366 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:15.707428  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.676404  9377 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.710489  9372 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.711444  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.713692  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:15.714331  9440 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.714411  5521 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:15.715612  9412 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.663509  9364 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.716979  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:15.717517  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.718339  5447 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:15.718897  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:15.719485  5448 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.719758  5371 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:15.719175  5366 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:15.713047  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.745743  5366 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:15.675215  9452 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.740106  9364 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.707561  9453 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.772987  9452 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.778604  9452 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.759249  9501 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:17:15.780652  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61825.9us
W20260709 13:17:15.777664  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 283845us
I20260709 13:17:15.781637  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:15.781813  5519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041443b19a6248948edd8e88378fd175"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:15.782780  5519 raft_consensus.cc:606] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.696648  9438 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.784502  9438 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.785012  9438 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.785460  9438 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.739993  9432 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.790103  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:15.718235  9502 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.677662  9494 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 13:17:15.797307  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.802765  5448 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
W20260709 13:17:15.758963  9284 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:15.752795  9412 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.808807  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:15.804839  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 233489us
I20260709 13:17:15.809556  5519 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:15.805619  5340 leader_election.cc:336] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.860s (SENT)
I20260709 13:17:15.805841  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:15.713223  9376 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.814282  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.814921  5444 raft_consensus.cc:2376] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12. Re-sending same reply.
I20260709 13:17:15.806743  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.772164  9426 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.808612  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:15.804179  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 212824us
I20260709 13:17:15.812551  5521 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:15.794332  9440 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.796574  9377 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:15.753294  9492 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:17:15.831900  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:15.814865  9444 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:15.809176  9412 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.817353  9210 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.849196  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.852342  9420 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.853112  9420 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.854010  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.854877  9501 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:15.855270  9501 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:15.855628  9501 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:15.855826  9420 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.856949  9444 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:15.840883  9377 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.802094  9510 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:15.859747  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.865957  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c2527a380a499db649c9aa30957175"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:15.867331  5522 raft_consensus.cc:606] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.867667  5522 raft_consensus.cc:614] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:15.809947  9502 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.870826  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:15.872216  5444 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
W20260709 13:17:15.882556  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 89109.5us
W20260709 13:17:15.884562  5340 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.168s (SENT)
I20260709 13:17:15.844166  9440 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.850817  9412 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.865341  9377 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.891989  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:15.892675  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.868398  9494 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:15.848780  9492 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.857595  9444 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.841199  9426 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.899039  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.915253  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:15.915967  5522 raft_consensus.cc:606] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.916421  5522 raft_consensus.cc:614] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:15.920580  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:15.927559  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 95769.3us
I20260709 13:17:15.900211  9518 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:15.939330  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.941465  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:15.941241  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56697.5us
I20260709 13:17:15.942239  5444 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:15.892071  9421 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:17:15.936919  9493 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.551s	user 0.005s	sys 0.000s
I20260709 13:17:15.920699  9514 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.906991  9492 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.955771  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.956789  5444 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:15.957931  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.958631  5367 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:15.964515  9426 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.964689  9444 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.967278  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:15.949487  9372 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:17:15.968158  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:15.970611  9492 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.972950  9487 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:15.973608  9487 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:15.973937  9511 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:17:15.967972  5519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:15.974105  9487 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.975438  9509 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:15.975865  9509 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:15.976415  9487 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:15.977802  9515 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:17:15.940866  9518 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.979465  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.980398  5450 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:17:15.980872  9518 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:15.974665  5519 raft_consensus.cc:606] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:15.983247  5519 raft_consensus.cc:614] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:15.968063  5522 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:15.947289  9223 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:17:16.018829  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:15.995478  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.020637  5444 raft_consensus.cc:2410] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:16.020035  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:16.021766  9436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.008s	sys 0.012s
W20260709 13:17:15.991626  9347 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.004s
I20260709 13:17:16.025719  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:15.982925  9376 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.028610  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:16.032734  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.038618  9502 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.041157  5441 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:16.041658  5448 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:17:16.042145  5448 pending_rounds.cc:85] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 4
I20260709 13:17:16.042402  5448 pending_rounds.cc:107] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:17:16.042658  5448 raft_consensus.cc:2889] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.042832  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.043788  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.044559  5448 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:16.027287  9454 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.032s	user 0.014s	sys 0.000s
I20260709 13:17:15.976830  9509 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:15.961154  9278 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:17:16.024829  9518 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:17:16.045567  9508 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:17:16.045703  9522 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:17:16.046839  5442 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:16.078677  5442 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:16.047758  5443 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:17:16.081756  5443 pending_rounds.cc:85] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 7
I20260709 13:17:16.081967  5443 pending_rounds.cc:107] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:16.082214  5443 raft_consensus.cc:2889] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.083561  5443 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:16.051561  9471 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.052412  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.086092  5374 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:16.087163  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.087955  9438 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.088442  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.053710  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:16.090408  9413 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 13:17:16.090880  9413 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.093803  5516 raft_consensus.cc:2368] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14.
I20260709 13:17:16.062121  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.081238  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:16.095579  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75667.5us
I20260709 13:17:16.066021  5519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1289dc7debf403aa87416568de586e6"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:16.096735  5519 raft_consensus.cc:606] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:16.097102  5519 raft_consensus.cc:614] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:16.071885  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:16.045394  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.098527  5369 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.099264  5448 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:16.101328  5373 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:16.070080  5450 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:16.102536  5442 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:16.048600  5441 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:16.045910  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.062176  9418 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.067605  9509 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.108273  9418 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:16.109158  9418 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.110471  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.111307  5524 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:16.112185  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:16.112875  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.113039  9376 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.113561  5375 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:16.113646  9376 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.114198  9424 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:16.114667  9424 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.115168  9424 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.117129  9378 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.114194  9376 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.117885  9378 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.120814  9378 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.124709  5515 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:17:16.054297  9486 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.919s	user 0.014s	sys 0.000s
I20260709 13:17:16.055896  9440 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:16.027820  9436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.008s	sys 0.012s
I20260709 13:17:16.130098  5447 raft_consensus.cc:2410] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:16.134990  5369 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
W20260709 13:17:16.140110  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 190218us
I20260709 13:17:16.113652  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:16.075052  9441 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
I20260709 13:17:16.156616  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:16.163218  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:16.163939  5367 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.168882  9444 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:16.169097  9506 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:16.169919  9347 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:16.170321  9487 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.170439  9347 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.171124  9487 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:16.171277  9347 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.172093  9487 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.170336  9506 consensus_queue.cc:1243] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:16.175382  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.176646  9426 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.177340  9426 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.180219  9426 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:16.186507  9278 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:16.093327  9413 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.203796  9506 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:16.209651  9486 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.210278  5516 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:16.211249  9438 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.100916  9210 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.211272  9377 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.212466  9210 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.214356  9377 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.215150  9210 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:16.067665  9211 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:16.216842  9488 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.005s
I20260709 13:17:16.074640  9044 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.177063  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.219797  5448 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
W20260709 13:17:16.220139  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.220909  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.219017  5370 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:16.224110  9501 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.106717  9223 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.230764  5449 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:16.244715  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.237105  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:16.242383  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.243652  5367 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:16.244108  5445 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:17:16.234280  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 134410us
I20260709 13:17:16.250005  5339 leader_election.cc:400] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14.
I20260709 13:17:16.250466  5339 leader_election.cc:403] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:16.248121  5520 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:16.249090  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:16.266934  5523 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 13:17:16.266599  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.270057  5524 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:16.267256  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:16.257085  5340 leader_election.cc:336] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.537s (SENT)
I20260709 13:17:16.271968  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:16.272114  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:16.239190  9485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.013s	sys 0.032s
I20260709 13:17:16.274238  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.278297  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.236054  9044 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.282126  5448 raft_consensus.cc:2368] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6.
I20260709 13:17:16.283471  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:16.286186  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.306049  5443 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:16.326772  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.327539  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.328183  5450 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:16.328763  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.329408  5367 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:16.337095  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:16.282567  9485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.016s	sys 0.032s
I20260709 13:17:16.338433  5445 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:16.341456  5521 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:16.321033  5373 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:16.277073  9441 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:16.248961  9486 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:17:16.291504  9506 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.348079  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.348079  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.362023  5518 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:16.373667  5443 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:16.348423  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.375172  5448 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:16.375264  5441 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:16.371237  5375 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:16.377965  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.283792  9210 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14.
I20260709 13:17:16.376844  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.380278  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.368248  5373 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:16.380992  5444 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:16.378692  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:16.322440  5340 leader_election.cc:336] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.909s (SENT)
I20260709 13:17:16.378847  5450 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:16.377617  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.384091  5447 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.383749  5443 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:17:16.385895  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 137014us
I20260709 13:17:16.382598  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:16.388341  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.359899  9432 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.359894  9226 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.347422  9525 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:16.441709  5442 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:16.381343  5373 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.389024  5521 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:16.443066  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.379103  9457 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.367508  9441 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.450119  5449 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:16.446523  9413 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.453439  9413 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.453904  9413 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.447687  9226 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.460273  9284 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:17:16.461462  9284 tablet_bootstrap.cc:492] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:17:16.462209  9284 ts_tablet_manager.cc:1403] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 2.168s	user 0.054s	sys 0.028s
I20260709 13:17:16.448772  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:16.348609  9426 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:17:16.419587  5490 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:16.470693  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51240.1us
I20260709 13:17:16.420157  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:16.417510  9518 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.443823  5444 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:16.291383  9044 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.326473  9488 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:17:16.447228  5450 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:16.474882  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.482754  5521 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:16.465307  5448 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:17:16.486527  5448 pending_rounds.cc:85] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 3
I20260709 13:17:16.466094  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.467495  5373 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:16.433733  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111306us
I20260709 13:17:16.464272  9441 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.418766  5445 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:16.463510  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:16.471696  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:16.494510  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.477735  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.468562  9226 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:16.480997  5444 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:16.486797  5448 pending_rounds.cc:107] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 8.4
W20260709 13:17:16.489809  5340 leader_election.cc:336] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.952s (SENT)
I20260709 13:17:16.468748  5441 raft_consensus.cc:2410] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:16.487304  5443 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:16.472683  9210 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.517629  5375 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:16.495021  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:16.520678  5445 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:17:16.531507  5445 pending_rounds.cc:85] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 5
I20260709 13:17:16.531738  5445 pending_rounds.cc:107] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:16.531961  5445 raft_consensus.cc:2889] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.522372  5448 raft_consensus.cc:2889] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.532734  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:16.533808  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.534379  9492 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:16.523835  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.475720  9494 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:16.529803  5366 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:16.538457  5450 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:16.522647  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:16.535151  5448 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:16.450562  9432 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.560801  5373 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:16.561668  5444 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:16.470490  9457 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.530663  9210 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.519829  9440 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.519719  9532 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.557355  9436 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.472009  9525 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.559042  9421 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.595583  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.481776  9518 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.535180  9485 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:16.574622  9210 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.558599  9278 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 13:17:16.604763  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.574958  9440 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:16.591743  9540 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:17:16.583608  9532 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.620774  9492 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:16.621831  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 101291us
I20260709 13:17:16.591709  9501 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.626296  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.595599  9421 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.651522  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.584699  9502 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:17:16.618825  9410 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:16.654743  5444 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:16.623291  9440 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:16.650349  9528 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:17:16.623673  9512 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.653795  9223 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:16.664345  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.650820  9532 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.661499  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:16.604890  9347 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.664052  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.599500  9436 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.658814  9421 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:16.682469  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 148395us
W20260709 13:17:16.685195  9533 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:17:16.685950  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.687372  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:16.689760  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:16.680568  9509 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:17:16.667285  9410 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:16.700094  9410 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:16.707049  9347 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:16.708057  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.708777  5444 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:16.710940  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:16.716325  9471 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:16.716823  9471 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:16.711004  9284 raft_consensus.cc:359] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.717756  9471 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.719045  9284 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:17:16.720153  9284 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:16.723101  9284 ts_tablet_manager.cc:1434] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.261s	user 0.011s	sys 0.000s
I20260709 13:17:16.724457  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.683044  9278 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:16.734297  9523 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.514s	user 0.006s	sys 0.001s
W20260709 13:17:16.734767  9376 consensus_meta.cc:287] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 13:17:16.719197  9471 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.742537  9525 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.743458  9457 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:16.745285  9436 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:16.745929  9492 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.746133  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.754688  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.788013  5444 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.759413  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.736711  5447 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:16.673693  9223 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:16.774449  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.770651  9278 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.779707  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.793469  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:16.793816  5450 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:16.786545  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.766781  9424 consensus_meta.cc:287] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.001s
I20260709 13:17:16.793944  5515 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:16.794867  9044 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:16.795717  9278 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.795619  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:16.797350  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2136) took 1615 ms. Trace:
W20260709 13:17:16.798663  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.801806  9412 consensus_meta.cc:287] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.893s	user 0.004s	sys 0.008s
I20260709 13:17:16.784224  9426 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.802727  9518 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:16.804379  9421 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.808490  9487 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:16.809636  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.810429  9223 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:16.874686  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49034.9us
I20260709 13:17:16.812906  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:16.865523  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:16.875710  5447 raft_consensus.cc:2376] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11. Re-sending same reply.
I20260709 13:17:16.876099  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:16.815431  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:16.816774  5444 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:16.745318  9210 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.839555  5372 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.881582  5449 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:17:16.882038  5449 pending_rounds.cc:85] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 7
I20260709 13:17:16.882496  5449 pending_rounds.cc:107] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:16.882889  5449 raft_consensus.cc:2889] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.789569  9525 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.856990  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 367213us
I20260709 13:17:16.776450  9376 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.818322  9275 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.826015  9509 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:16.836916  5446 rpcz_store.cc:276] 0709 13:17:15.182017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.182156 (+   139us) service_pool.cc:224] Handling call
0709 13:17:15.182565 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.196130 (+ 13565us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:15.647843 (+451713us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b18004521a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:17:15.828915 (+181072us) log.cc:844] Serialized 14 byte log entry
0709 13:17:15.942704 (+113789us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:15.943264 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:17:15.943411 (+   147us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:15.943458 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.943561 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.728858 (+785297us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:16.797097 (+ 68239us) raft_consensus.cc:1685] finished
0709 13:17:16.797121 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.797255 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4566,"prepare.queue_time_us":280932,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":11138,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":21648,"spinlock_wait_cycles":75167488,"thread_start_us":258439,"threads_started":2,"wal-append.queue_time_us":295541}
I20260709 13:17:16.881958  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:16.905021  5340 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.014s (SENT)
I20260709 13:17:16.911387  5450 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 5.
I20260709 13:17:16.840129  9478 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:16.915189  5373 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:16.814543  9413 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.837011  9510 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:17:16.941890  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65880.3us
I20260709 13:17:16.886591  9527 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:16.882766  9226 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:16.875181  9488 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.840255  9424 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:16.960487  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.863942  9412 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.972847  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:16.874523  9426 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.917855  9223 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:17.152598  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.100032  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 234653us
W20260709 13:17:17.160575  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.009644  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.163035  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:17.016494  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111521us
I20260709 13:17:17.164362  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.967849  5372 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
W20260709 13:17:16.954993  9362 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:17:17.050460  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.901990  9525 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.013566  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.193815  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.173593  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2190) took 1288 ms. Trace:
W20260709 13:17:17.164412  5340 leader_election.cc:336] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.044s (SENT)
I20260709 13:17:16.958765  9347 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:17.060712  9519 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:17:17.050408  9454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.043s	sys 0.056s
I20260709 13:17:17.196938  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:16.959892  9527 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.195007  5366 rpcz_store.cc:276] 0709 13:17:15.885236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.283068 (+397832us) service_pool.cc:224] Handling call
0709 13:17:16.344241 (+ 61173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.551214 (+206973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.173256 (+622042us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54001c66d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:17.173513 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427450496}
W20260709 13:17:17.172694  9553 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:17:17.225623  5371 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:17.151398  9376 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.198269  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.198836  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:16.981354  5534 tablet_copy_service.cc:342] P 544c82a50cc4477886bb6f7d58f455ca: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-9d883e5d309d4113a821624777a85d05 received from {username='slave'} at 127.0.0.1:34858
I20260709 13:17:17.226795  5370 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:17.016223  9421 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.089020  9377 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:17.065699  9544 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:16.918702  9509 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.203995  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.223742  5445 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:17:17.227837  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63481.1us
I20260709 13:17:16.973899  9226 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:16.981629  9488 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.185891  9550 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:17.240952  5340 leader_election.cc:336] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.072s (SENT)
I20260709 13:17:17.241457  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.232740  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:16.953033  9478 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:17.201678  9562 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:17.226846  9454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.046s	sys 0.077s
I20260709 13:17:17.225965  9527 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:17.273787  9554 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:17:17.236498  9377 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.331267  9377 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.221205  9347 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:17:17.332695  9347 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:17.333109  9347 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:17.334177  9347 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.335651  9347 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.241061  9544 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:17.243824  9210 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:17.339447  9512 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.000s
I20260709 13:17:17.339744  5374 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.339883  9512 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.340555  5375 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.341472  9424 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.341806  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.343010  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:17.298801  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57869.5us
I20260709 13:17:17.301514  9478 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:17.302769  9426 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.243072  9522 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.306299  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1979) took 1059 ms. Trace:
I20260709 13:17:17.308374  9525 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.310287  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.354297  9424 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.369203  9424 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.372478  9424 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.313848  9413 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.233587  5534 tablet_copy_service.cc:434] P 544c82a50cc4477886bb6f7d58f455ca: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-9d883e5d309d4113a821624777a85d05 on tablet 9d883e5d309d4113a821624777a85d05 with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:17.315348  5372 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:17.379248  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.381003  9362 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.317158  9509 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:17.317752  9560 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:17:17.381683  9362 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.319710  9226 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:17.320389  9471 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.005s
I20260709 13:17:17.202126  9563 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:17.383831  9362 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:17.384603  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.383504  9563 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:17.185286  9440 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.325029  9487 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.325677  5448 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
W20260709 13:17:17.344246  5340 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.098s (SENT)
I20260709 13:17:17.353209  5375 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:17.393386  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.392807  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:17.395704  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.345670  9562 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.357007  5374 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:17.317736  9532 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.010s
I20260709 13:17:17.357990  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:17.400290  9486 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:17.400499  9562 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:17.343904  9441 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.005s
I20260709 13:17:17.334893  9412 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.353958  9454 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.368054  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.311349  9570 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.354538  5520 rpcz_store.cc:276] 0709 13:17:16.247083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.254308 (+  7225us) service_pool.cc:224] Handling call
0709 13:17:16.254689 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.255115 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.255147 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.255666 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.898094 (+642428us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b18003c1ea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:17:17.093267 (+195173us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:17.093315 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.093393 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.305953 (+212560us) raft_consensus.cc:1685] finished
0709 13:17:17.305983 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.306210 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30449,"raft.queue_time_us":19160,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":47413,"spinlock_wait_cycles":8997632,"thread_start_us":194915,"threads_started":1,"wal-append.queue_time_us":960622}
I20260709 13:17:17.388795  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.324373  9550 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:17.358347  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.400646  9532 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.394577  9544 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:17.414157  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:17.418357  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 185685us
I20260709 13:17:17.418521  5374 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:17.420125  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76021.8us
W20260709 13:17:17.420871  5340 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.115s (SENT)
I20260709 13:17:17.421275  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.407279  9362 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.404237  9486 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:17.426580  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.427287  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.427698  5446 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:17.428937  9432 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.430038  9544 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:17.430815  5370 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:17.431201  9418 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.432264  9432 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.434113  9563 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:17.434585  9544 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:17.435297  9544 consensus_queue.cc:1243] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:17.435407  9488 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.436003  9488 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:17.436323  9432 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:17.436334  9488 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:17.437223  9532 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.438269  9488 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.440167  9440 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.440713  9488 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.406733  9441 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.442715  9441 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:17.442943  5340 leader_election.cc:336] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.128s (SENT)
I20260709 13:17:17.448731  9109 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:17.450913  9109 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:17.451611  9211 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:17.451840  9561 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:17.452390  9109 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:17.453564  9109 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:17.453953  9109 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:17.454519  9486 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.454794  9109 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.454794  9044 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:17.455791  9486 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.456096  9109 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.456745  9555 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:17.454566  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:17.460759  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.461097  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.461644  5372 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.466266  5368 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:17.467751  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.470396  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.473110  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.473796  5445 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.473529  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:17.474622  5446 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:17.487465  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.490244  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 1985) took 1106 ms. Trace:
I20260709 13:17:17.492556  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.492549  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.493170  5445 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:17.493665  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:17.494414  5517 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:17.494949  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:17.498303  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.499343  5515 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:17.500566  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.500696  9441 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.501400  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:17.502095  9436 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:17.478274  9544 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.502700  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.503558  9436 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:17.503933  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.504999  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.505869  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.506191  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:17.506552  5442 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.508113  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:17.508733  5448 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:17.509048  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.509541  5441 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:17.509610  9555 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:17.510167  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:17.510452  9223 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.510834  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.519912  5374 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:17.511300  9471 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.511788  5518 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.511925  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:17.541450  5524 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:17.541273  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:17.514060  9550 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.542315  5523 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:17.521404  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.533357  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.534235  5447 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:17.533430  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46084.3us
I20260709 13:17:17.546584  5515 raft_consensus.cc:2410] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:17.547003  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.412724  9454 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.534809  5444 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:17.528714  5517 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:17.548797  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.501405  9210 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:17:17.482151  9522 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.490789  5522 rpcz_store.cc:276] 0709 13:17:16.383455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.462547 (+ 79092us) service_pool.cc:224] Handling call
0709 13:17:16.462850 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.463046 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:17.457286 (+994240us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b18002e2d60. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf
0709 13:17:17.457470 (+   184us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.489735 (+ 32265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.489937 (+   202us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:17.489985 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.490055 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.490188 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155874,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":124,"spinlock_wait_cycles":12130688,"thread_start_us":176597,"threads_started":2}
I20260709 13:17:17.559533  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:17.554714  5521 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:17:17.502763  9559 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.343s	user 0.004s	sys 0.000s
I20260709 13:17:17.557763  5372 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:17.460595  9570 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:17:17.559789  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.563906  5523 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:17.518196  9278 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.001s
I20260709 13:17:17.558645  9210 consensus_queue.cc:1243] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:17.562567  9572 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.576889  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.510882  9512 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:17:17.548575  9441 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:17.588006  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.578416  5442 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:17.533922  9223 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:17.483099  9561 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:17:17.586416  5518 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:17.586686  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:17.586674  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.596524  5523 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.543834  9436 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:17.572257  9278 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.589445  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.592105  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.564332  9522 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:17.563122  9347 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.587582  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2158) took 1342 ms. Trace:
I20260709 13:17:17.598500  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.582324  9487 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:17.606184  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.606300  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.555536  9471 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.611822  9527 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.603161  9440 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:17.614027  9420 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.595896  9570 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.606638  9522 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.603701  5443 rpcz_store.cc:276] 0709 13:17:16.245173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.523384 (+278211us) service_pool.cc:224] Handling call
0709 13:17:16.559313 (+ 35929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.565303 (+  5990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.565348 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.565938 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.812605 (+246667us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b1800328300. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:17:16.938746 (+126141us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:16.938793 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.938872 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.502445 (+563573us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b24002bf958. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0b259c4 00007fc1d0b23acb 00007fc1d0cdedc9 00007fc1d0cdea55 00007fc1d0cde09d 00007fc1d391010e 00007fc1d392788c 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221
0709 13:17:17.587364 (+ 84919us) raft_consensus.cc:1685] finished
0709 13:17:17.587385 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.587524 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":535,"raft.queue_time_us":24824,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4531,"spinlock_wait_cycles":34694784,"thread_start_us":125952,"threads_started":1,"wal-append.queue_time_us":492450}
I20260709 13:17:17.626870  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.594920  9223 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.582041  9544 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:17.638589  9454 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.616705  9441 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.681860  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.627527  9550 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.625854  9487 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.628249  9562 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.646454  5516 raft_consensus.cc:2410] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:17.684948  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:17.685652  5518 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:17.646458  9471 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:17.648674  9527 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.649070  9278 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:17.649318  5369 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:17.649627  5367 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:17.688297  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.636978  9362 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.663388  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.692288  5375 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:17.693267  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.694837  5375 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:17.665879  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:17.696903  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1731) took 1468 ms. Trace:
I20260709 13:17:17.697463  5449 rpcz_store.cc:276] 0709 13:17:16.228014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.468115 (+240101us) service_pool.cc:224] Handling call
0709 13:17:16.881169 (+413054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.896819 (+ 15650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.696627 (+799808us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540019cb50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:17.696827 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922843520}
I20260709 13:17:17.688683  9487 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.618106  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:17.700115  5516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 1969) took 1460 ms (client timeout 1640 ms). Trace:
W20260709 13:17:17.700547  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82528us
I20260709 13:17:17.483304  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:17.677161  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50381.9us
I20260709 13:17:17.702395  9562 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:17.704497  9347 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:17.678045  5523 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:17.681216  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.706132  9562 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:17:17.706568  5372 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:17.681413  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.707630  5370 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.708068  9563 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:17.708397  9563 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:17.643234  9440 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:17.699337  5367 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:17.681413  9575 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:17:17.704627  6042 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.679644  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.713059  5371 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:17.700523  5516 rpcz_store.cc:269] 0709 13:17:16.239404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.241574 (+  2170us) service_pool.cc:224] Handling call
0709 13:17:17.699773 (+1458199us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002dbc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:17.700024 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3162442112}
I20260709 13:17:17.676592  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:17.714457  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.713470  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.678563  9572 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:17.709770  9440 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:17.716444  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 181527us
I20260709 13:17:17.711359  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:17.717362  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.717840  5515 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.719096  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.720969  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:17.722069  5370 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:17.722932  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.726603  9211 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:17.726852  9561 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.726536  9412 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:17.723095  9471 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:17:17.728649  5372 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:17.709734  9502 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:17.730010  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56978.4us
I20260709 13:17:17.718143  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:17.733755  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.726954  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.730322  5369 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:17.736531  5449 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:17.709005  9563 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.710860  9347 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:17.739979  5441 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:17.740171  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:17.743511  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.745774  5523 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:17.744390  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:17.748158  5515 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:17.726429  9210 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:17.731657  9494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.157s	user 0.008s	sys 0.015s
I20260709 13:17:17.749218  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.749349  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:17.749696  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.756407  5447 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:17.756204  5442 raft_consensus.cc:2376] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13. Re-sending same reply.
I20260709 13:17:17.722160  9532 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.732126  9418 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:17.750924  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:17.750962  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:17.747916  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:17.741291  9577 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:17.767114  9577 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:17.767532  9577 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:17.767621  9501 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:17.768244  9501 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:17.769165  9501 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.770726  9413 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:17.772902  9545 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:17.773687  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:17.773797  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.774557  9210 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:17.776317  9210 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.766187  9525 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:17:17.756001  9494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.008s	sys 0.016s
I20260709 13:17:17.777793  9494 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:17.778669  9494 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.752972  9492 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:17.779714  9492 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:17.780622  9492 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.782081  5515 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.777199  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.783541  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.749807  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.784490  5443 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:17.760212  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.750799  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:17.756549  5373 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:17.785583  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.786561  5371 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:17.787920  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.788704  5515 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:17.793826  5367 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:17.745297  9347 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:17.795845  9377 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:17.797153  9550 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.746829  9438 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.773345  9545 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:17.790196  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:17.755641  9563 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.754150  9420 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:17.793533  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.839540  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.839651  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.840265  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.805282  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.840991  5373 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:17.762183  9211 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:17.817934  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.820848  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.818410  9418 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:17.834067  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.834682  6076 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 LEARNER]: Advancing to term 14
I20260709 13:17:17.806464  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.842160  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:17.834411  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.857108  5443 raft_consensus.cc:2368] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6.
I20260709 13:17:17.858091  9420 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:17.859205  9420 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.861784  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.862061  9577 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:17.862617  5442 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:17.863018  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:17.863816  5448 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.800371  9580 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.868052  5446 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:17.839306  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.835724  9545 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.819806  9377 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:17.834106  9412 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.840143  9436 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:17.800848  9413 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:17:17.902115  5366 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:17.817852  9471 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:17:17.916947  5340 leader_election.cc:400] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6.
I20260709 13:17:17.917333  5340 leader_election.cc:403] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:17:17.917646  5371 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:17.870321  9580 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:17.910279  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:17.923133  9454 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:17.924639  9432 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:17.925117  9432 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:17.926275  9432 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.928097  9432 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:17.929668  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 90451.1us
I20260709 13:17:17.932291  9550 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:17.932651  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.932960  9550 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:17.934188  9550 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.938495  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:17.947049  5448 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
W20260709 13:17:17.991227  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.893222  9436 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:17.991554  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 198108us
I20260709 13:17:17.956113  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.892727  9525 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.890182  9572 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:18.019593  9572 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:17.992720  9432 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:18.023643  9432 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.026150  9432 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.028923  5489 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:17.893767  9377 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:18.032718  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 76664.4us
I20260709 13:17:17.950691  9278 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:18.040066  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:17.945227  9421 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:18.046607  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:17.945914  9580 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.031242  9436 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.914561  9527 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:17.989564  9510 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:17.898459  9412 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.059808  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:18.064582  5372 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:18.064941  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:18.055112  5447 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:18.037071  9426 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.065008  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:18.036839  9572 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.095970  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:17.997301  9441 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:17:18.102487  5447 pending_rounds.cc:85] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 6
I20260709 13:17:18.102909  5447 pending_rounds.cc:107] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:18.103156  5447 raft_consensus.cc:2889] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.059049  9211 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:18.060829  9471 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.036456  9525 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.041402  9562 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:17:18.060045  9587 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:18.143256  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 226440us
W20260709 13:17:18.150550  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.950282  9347 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.021821  9418 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.105372  9109 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:18.167017  9421 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:18.101307  9488 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.185261  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 79249.9us
I20260709 13:17:18.109122  9278 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6.
W20260709 13:17:18.209765  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.123016  9572 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:18.094488  9544 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:17:18.163120  9587 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.092485  9527 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:18.214988  9576 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:17:18.084784  9510 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:18.255561  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.196909  9509 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:18.205195  9109 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:18.219818  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.266229  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.252295  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 192584us
W20260709 13:17:18.215586  9574 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:17:18.239128  9522 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:17:18.197181  9492 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:18.220726  9347 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.272784  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:18.294731  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:18.252910  9587 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.269630  9426 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:18.218863  9488 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:18.293373  9487 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.007s
I20260709 13:17:18.014317  9555 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:17:18.297549  9544 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:18.254769  9572 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.289395  9522 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.329607  9426 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:18.359793  9440 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.004s
W20260709 13:17:18.390033  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 122533us
I20260709 13:17:18.391759  9509 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:18.219189  9486 consensus_queue.cc:1175] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "86b410d62f4040c39d33dc0698998562" responder_term: 14 status { last_received { term: 11 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: [13.7-13.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:18.357924  9544 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:18.404064  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:18.446689  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.357750  9487 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:18.545786  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.558890  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.331847  9211 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.609102  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:18.593381  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 189448us
I20260709 13:17:18.341864  9421 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.489526  9615 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.609982  5372 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:18.610194  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:18.622485  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:18.623003  5369 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:18.623116  5372 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:18.611660  5368 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:18.615456  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:18.618759  5444 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:18.495844  9494 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:18.641182  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:18.655964  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.399812  9440 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:18.584486  9510 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:18.667871  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43764.4us
I20260709 13:17:18.581594  9492 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:18.489884  9377 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:18.657176  9584 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
W20260709 13:17:18.643002  9581 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.501s	user 0.000s	sys 0.001s
I20260709 13:17:18.626820  9441 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.660601  9589 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.499s	user 0.000s	sys 0.002s
I20260709 13:17:18.659353  9512 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:18.725291  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.673349  9525 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:18.739916  9583 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:17:18.750717  9602 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.491s	user 0.001s	sys 0.000s
I20260709 13:17:18.715134  9596 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:18.710391  9593 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:18.751891  6042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.018s	sys 0.026s
I20260709 13:17:18.719456  9510 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.783146  6042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.019s	sys 0.027s
I20260709 13:17:18.753612  9562 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.786201  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 872336us
W20260709 13:17:18.799276  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.029s	sys 0.071s
W20260709 13:17:18.800094  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.030s	sys 0.071s
W20260709 13:17:18.800608  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 869111us
I20260709 13:17:18.647130  9615 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.802563  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2220) took 1408 ms. Trace:
I20260709 13:17:18.762900  9109 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.814587  9635 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:18.665387  9544 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.815117  9635 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:18.815618  9635 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.817835  9492 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.819344  9623 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.819902  9623 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:18.820674  9588 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.498s	user 0.002s	sys 0.000s
I20260709 13:17:18.821992  9413 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:18.822407  9610 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:17:18.822600  9413 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:18.822894  9639 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:18.823252  9413 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.823622  6076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59510 (request call id 148) took 1021 ms. Trace:
W20260709 13:17:18.822405  9622 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:18.824043  6076 rpcz_store.cc:276] 0709 13:17:17.802715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.817390 (+ 14675us) service_pool.cc:224] Handling call
0709 13:17:17.834292 (+ 16902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.105573 (+271281us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:18.105605 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.106159 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.344357 (+238198us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:18.344413 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.345161 (+   748us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.823400 (+478239us) raft_consensus.cc:1685] finished
0709 13:17:18.823423 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.823563 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":232173,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":17036,"thread_start_us":263603,"threads_started":2,"wal-append.queue_time_us":394504}
I20260709 13:17:18.795892  9510 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.826875  9623 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.828290  9615 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.764053  9512 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.715762  9441 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.812763  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:18.781529  9550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.004s	sys 0.004s
I20260709 13:17:18.809271  5374 rpcz_store.cc:276] 0709 13:17:17.382234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.535911 (+153677us) service_pool.cc:224] Handling call
0709 13:17:17.568514 (+ 32603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.722317 (+153803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.722346 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.735985 (+ 13639us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.887115 (+151130us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:17.887158 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.887236 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.790028 (+902792us) raft_consensus.cc:1685] finished
0709 13:17:18.790049 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.790270 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143078,"raft.queue_time_us":147889,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":55,"thread_start_us":132822,"threads_started":1,"wal-append.queue_time_us":310383}
I20260709 13:17:18.847199  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1766) took 1032 ms. Trace:
W20260709 13:17:18.874157  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.687179  9509 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:18.852149  9563 consensus_meta.cc:287] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.999s	user 0.012s	sys 0.000s
W20260709 13:17:18.844218  9578 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.122s	user 0.003s	sys 0.010s
W20260709 13:17:18.851116  9590 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.498s	user 0.001s	sys 0.000s
I20260709 13:17:18.795171  9527 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:18.915319  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 289843us
I20260709 13:17:18.829334  9615 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.916061  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.884469  5441 rpcz_store.cc:276] 0709 13:17:17.814681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.053330 (+238649us) service_pool.cc:224] Handling call
0709 13:17:18.054134 (+   804us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.062393 (+  8259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.062429 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.098970 (+ 36541us) log.cc:844] Serialized 525 byte log entry
0709 13:17:18.394876 (+295906us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:18.395143 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.395421 (+   278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.846973 (+451552us) raft_consensus.cc:1685] finished
0709 13:17:18.846995 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.847140 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5506,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9342,"thread_start_us":210153,"threads_started":1,"wal-append.queue_time_us":717868}
I20260709 13:17:18.830165  9488 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.831089  9487 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.838752  9440 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:18.828312  9510 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:18.922008  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:18.906430  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.030s
I20260709 13:17:18.854202  9596 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:18.876531  9223 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.187s	user 0.015s	sys 0.007s
I20260709 13:17:18.846196  9612 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.926971  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:18.930572  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 118132us
I20260709 13:17:18.962177  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:18.962239  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:18.907457  9550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.004s	sys 0.004s
W20260709 13:17:18.916538  9532 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.134s	user 0.012s	sys 0.001s
I20260709 13:17:18.943217  5368 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:18.805351  9562 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:18.950448  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 309375us
I20260709 13:17:18.995553  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:18.952596  5374 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:17:18.934698  9589 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:17:18.792920  9593 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.923475  9572 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.922307  9522 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:18.906459  9630 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:18.965929  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:18.975020  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.942440  9563 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:18.999161  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:18.952260  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.007s	sys 0.030s
W20260709 13:17:19.002046  9600 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.541s	user 0.002s	sys 0.000s
W20260709 13:17:19.002467  9601 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:17:19.003170  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.617s (SENT) [suppressed 34 similar messages]
I20260709 13:17:19.003540  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1760) took 1196 ms. Trace:
I20260709 13:17:19.001407  9488 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.000579  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:19.010474  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:19.026162  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:19.049299  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48785.8us
I20260709 13:17:19.039633  5445 rpcz_store.cc:276] 0709 13:17:17.807106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.807246 (+   140us) service_pool.cc:224] Handling call
0709 13:17:17.807579 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.807941 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.807969 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.817324 (+  9355us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.063715 (+246391us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:18.107977 (+ 44262us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.111387 (+  3410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.111467 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.003294 (+891827us) raft_consensus.cc:1685] finished
0709 13:17:19.003318 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.003478 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3137,"prepare.queue_time_us":44210,"prepare.run_wall_time_us":60,"raft.queue_time_us":54942,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":39796,"spinlock_wait_cycles":61587456,"thread_start_us":178128,"threads_started":1,"wal-append.queue_time_us":417099}
I20260709 13:17:18.943281  9615 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:18.997743  9532 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:19.035599  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 740885us
W20260709 13:17:19.006428  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44231.6us
I20260709 13:17:19.005179  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1782) took 1512 ms. Trace:
I20260709 13:17:19.046494  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1761) took 1239 ms. Trace:
I20260709 13:17:18.961720  9223 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.055640  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:19.054924  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:19.055912  5442 rpcz_store.cc:276] 0709 13:17:17.807499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.863166 (+ 55667us) service_pool.cc:224] Handling call
0709 13:17:17.863529 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.863887 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.863928 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.864366 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.922821 (+ 58455us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:17.930324 (+  7503us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.930894 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.931060 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.046160 (+1115100us) raft_consensus.cc:1685] finished
0709 13:17:19.046194 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.046416 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2533,"prepare.queue_time_us":102099,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3816,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":5133,"thread_start_us":64949,"threads_started":2,"wal-append.queue_time_us":201399}
I20260709 13:17:19.055154  5519 rpcz_store.cc:276] 0709 13:17:17.492720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.493535 (+   815us) service_pool.cc:224] Handling call
0709 13:17:17.493833 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.512816 (+ 18983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.512849 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.513361 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.675334 (+161973us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:17.675378 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.675473 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.843332 (+1167859us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:18.993455 (+150123us) raft_consensus.cc:1685] finished
0709 13:17:18.993489 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.005115 (+ 11626us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":369,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":18637568,"thread_start_us":160931,"threads_started":1,"wal-append.queue_time_us":161556}
I20260709 13:17:19.046543  9563 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.068856  9594 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.069571  9640 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.070468  9643 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.070184  9640 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:19.071437  5372 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:19.038635  9522 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.048413  9527 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.053352  9572 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.053342  9377 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:19.087595  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 84453.9us
W20260709 13:17:19.099299  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49138.1us
I20260709 13:17:19.088218  5370 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:19.067188  9623 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:19.143867  9545 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.247s	user 0.010s	sys 0.002s
I20260709 13:17:19.135949  9440 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:19.144443  9648 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:19.092177  9522 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.107761  9418 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:19.061024  9596 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.132474  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:19.232275  9650 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:19.201632  9512 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.140515  9638 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.141402  9609 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260709 13:17:19.146652  9562 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.038019  9630 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:19.199713  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 144188us
I20260709 13:17:19.210937  9648 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.054287  9488 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.110287  9572 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:19.165074  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.267490  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.240761  5369 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:19.200889  9550 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.075956  9643 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:19.165074  9347 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.861s	user 0.011s	sys 0.002s
I20260709 13:17:19.253376  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:19.254550  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:19.255966  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:19.279759  5518 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:19.210474  9545 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.259028  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:19.287452  5369 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:19.249380  9441 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:19.266392  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 267312us
I20260709 13:17:19.271229  5516 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:19.274149  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:19.239347  9487 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:19.257629  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:19.250166  9512 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:19.211308  9440 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.209259  9623 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.261600  9648 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.234789  9418 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:19.269531  9562 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:19.311004  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.312006  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:19.304118  9440 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.265758  9638 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.305189  9640 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.303274  9377 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.339231  9659 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.404695  9659 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:19.405648  9471 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.208s	user 0.008s	sys 0.012s
W20260709 13:17:19.405790  9651 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:17:19.344383  9636 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.308202  9487 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:19.410943  9555 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.004s
I20260709 13:17:19.411859  9487 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:19.330915  9223 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.412506  9658 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.413244  9658 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.281148  9550 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.415992  9658 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.418112  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:19.350307  9655 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.201s
I20260709 13:17:19.378793  9572 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.330329  9607 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:19.423439  9603 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:19.423813  9607 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.424467  9607 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.425405  9418 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:19.425810  9638 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.387079  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1764) took 1573 ms. Trace:
I20260709 13:17:19.299817  9649 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:19.408152  9652 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:17:19.408803  9488 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.325568  9512 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:19.423259  9636 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.403733  9522 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.382916  9278 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.390496  9436 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.296s	user 0.018s	sys 0.000s
I20260709 13:17:19.376850  9438 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.442588  9643 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.426704  5449 rpcz_store.cc:276] 0709 13:17:17.814027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.048362 (+234335us) service_pool.cc:224] Handling call
0709 13:17:18.085619 (+ 37257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.166351 (+ 80732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.166383 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.166929 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.312707 (+145778us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:18.588824 (+276117us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.659777 (+ 70953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.659896 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.386752 (+726856us) raft_consensus.cc:1685] finished
0709 13:17:19.386786 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.386982 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30510,"raft.queue_time_us":143965,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":70928,"thread_start_us":495565,"threads_started":4,"wal-append.queue_time_us":624018}
I20260709 13:17:19.326666  9562 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.417098  9550 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:19.462898  9626 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:19.462728  9512 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:19.463503  9635 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.006s
I20260709 13:17:19.452896  9347 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.453223  9638 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.462756  9613 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:19.421864  9471 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:19.431648  9655 consensus_queue.cc:1243] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:19.471735  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.495215  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.480247  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:19.459589  9454 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.467406  9572 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.461503  9487 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:19.464646  9278 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.420383  9377 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.491618  9659 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:19.496620  5449 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:17:19.502004  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.506733  9454 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.494277  9545 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.507299  9623 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.469596  9438 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.509773  9278 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.509923  9616 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.464931  9436 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.518556  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:19.534451  9454 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.534752  9438 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:19.494433  9638 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.534046  9616 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.488140  9347 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.451201  9649 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.485460  9635 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.574523  5375 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:19.566609  9454 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.529955  9545 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.511492  9572 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.585095  9488 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.592481  9647 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:17:19.592543  9488 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.597003  9636 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:19.616546  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.599188  9545 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.572285  9630 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:19.652355  9436 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.485814  9626 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.654186  9649 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:19.784180  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.654738  9413 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.831s	user 0.017s	sys 0.009s
I20260709 13:17:19.656136  9638 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.659363  9347 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.572533  9643 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.662940  9562 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.664098  5522 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:19.652388  9488 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.666755  9572 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:19.668766  9580 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.584s	user 0.016s	sys 0.004s
I20260709 13:17:19.803689  9580 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.806110  9580 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:19.590548  9454 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:19.672075  9612 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.000s
I20260709 13:17:19.807049  9612 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:19.677228  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1762) took 1869 ms. Trace:
I20260709 13:17:19.808349  9454 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.807770  5446 rpcz_store.cc:276] 0709 13:17:17.807740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.892536 (+ 84796us) service_pool.cc:224] Handling call
0709 13:17:17.892917 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.910121 (+ 17204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.910153 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:17.947398 (+ 37245us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.253582 (+306184us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.320595 (+ 67013us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.320975 (+   380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.321478 (+   503us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.676907 (+1355429us) raft_consensus.cc:1685] finished
0709 13:17:19.676938 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.677145 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16815,"prepare.queue_time_us":212757,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":190776,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":166740,"spinlock_wait_cycles":35778816,"thread_start_us":243473,"threads_started":2,"wal-append.queue_time_us":1287790}
I20260709 13:17:19.811457  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:19.812615  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:19.813577  5446 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:19.514621  9487 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.790172  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:19.676496  9650 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:19.797699  9413 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.800582  9643 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:19.780792  9441 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.830591  9593 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:19.833997  9545 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:19.843798  9633 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.816s	user 0.002s	sys 0.006s
I20260709 13:17:19.845958  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2237) took 1788 ms. Trace:
I20260709 13:17:19.846410  5367 rpcz_store.cc:276] 0709 13:17:18.057354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.061105 (+  3751us) service_pool.cc:224] Handling call
0709 13:17:18.061465 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.295553 (+234088us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:18.372643 (+ 77090us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.676002 (+303359us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.697949 (+ 21947us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.708672 (+ 10723us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:18.708730 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.708834 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.834111 (+1125277us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:19.845616 (+ 11505us) raft_consensus.cc:1685] finished
0709 13:17:19.845726 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.845881 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5257,"prepare.queue_time_us":75625,"raft.queue_time_us":445371,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":4624,"spinlock_wait_cycles":31298560,"thread_start_us":397274,"threads_started":2,"wal-append.queue_time_us":551038}
I20260709 13:17:19.799086  9638 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.838518  9587 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.496s	user 0.002s	sys 0.021s
W20260709 13:17:19.873226  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.872944  5489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.016s	sys 0.030s
W20260709 13:17:19.875555  5489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.016s	sys 0.030s
W20260709 13:17:19.880390  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 582958us
W20260709 13:17:19.908879  5519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.018s	sys 0.073s
I20260709 13:17:19.859787  9635 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:19.910820  5519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.019s	sys 0.073s
W20260709 13:17:19.912551  5442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.012s	sys 0.060s
W20260709 13:17:19.915903  5442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.012s	sys 0.060s
I20260709 13:17:19.850047  9441 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:19.907687  9509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.015s
W20260709 13:17:19.923859  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.009s	sys 0.037s
W20260709 13:17:19.938751  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.009s	sys 0.037s
W20260709 13:17:19.939436  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 703322us
I20260709 13:17:19.940068  9664 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:19.942345  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:19.940788  9664 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.869335  9587 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.954001  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:19.958928  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:19.963047  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:19.963889  5367 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:19.840615  9650 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.971236  5367 raft_consensus.cc:1217] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-13.8]   Dedup: 9.6->[11.7-13.8]
I20260709 13:17:19.972422  5450 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:19.943195  9211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.017s	sys 0.025s
W20260709 13:17:19.933022  9509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.015s
I20260709 13:17:19.975999  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:19.971936  5367 pending_rounds.cc:85] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 6
I20260709 13:17:19.977500  5367 pending_rounds.cc:107] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:19.977854  5367 raft_consensus.cc:2889] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.941300  9626 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:19.866477  9638 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:19.980147  5523 raft_consensus.cc:2368] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12.
I20260709 13:17:19.945668  9377 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:19.978135  9211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.017s	sys 0.026s
I20260709 13:17:19.986131  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:19.971446  9421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.025s	sys 0.013s
I20260709 13:17:19.992945  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:19.997140  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:20.000339  5374 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:19.988914  9421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.026s	sys 0.014s
I20260709 13:17:20.003747  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:20.004694  5368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.000s	sys 0.040s
I20260709 13:17:20.007803  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:20.007329  5368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.000s	sys 0.040s
W20260709 13:17:20.009356  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.011934  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.012477  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:20.014071  6043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.006s	sys 0.035s
W20260709 13:17:20.014447  6043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.007s	sys 0.036s
W20260709 13:17:20.014734  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 716692us
I20260709 13:17:20.016712  5521 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:20.004546  9440 consensus_meta.cc:287] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.007s
I20260709 13:17:20.017086  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:20.019649  9650 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:20.023365  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.067035  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.068246  5520 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:20.069180  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:20.071434  5449 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.001s
I20260709 13:17:20.071413  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.072368  5449 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:20.073575  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:20.075203  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:20.075836  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.069886  5520 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
W20260709 13:17:20.081764  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.075902  5449 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:20.022023  9669 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:20.023073  9616 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:20.075964  9492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.019s	sys 0.051s
I20260709 13:17:20.061587  9413 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:20.064993  9487 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:20.095053  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.018s	sys 0.052s
W20260709 13:17:20.114847  5444 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1751) took 2376 ms (client timeout 2798 ms). Trace:
W20260709 13:17:20.122502  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.019s	sys 0.052s
I20260709 13:17:20.115237  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.092478  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:20.122705  5444 rpcz_store.cc:269] 0709 13:17:17.731454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.731600 (+   146us) service_pool.cc:224] Handling call
0709 13:17:20.107852 (+2376252us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400238f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:20.108032 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1916339584}
I20260709 13:17:20.108363  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:20.094925  9620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.013s	sys 0.009s
W20260709 13:17:20.140275  9596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.038s
W20260709 13:17:20.155712  9596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.000s	sys 0.038s
I20260709 13:17:20.156739  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:20.158722  6040 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.030s	sys 0.069s
W20260709 13:17:20.159121  6040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.030s	sys 0.069s
I20260709 13:17:20.023277  9440 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:20.165041  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.151476  9616 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.097604  9614 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.098s	user 0.004s	sys 0.000s
W20260709 13:17:20.163445  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 55162.6us
W20260709 13:17:20.121961  9492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.019s	sys 0.052s
W20260709 13:17:20.121088  9418 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.020s	sys 0.028s
I20260709 13:17:20.097133  9502 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:17:20.223104  5449 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:20.220719  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:20.224427  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:20.224957  5441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.041s	sys 0.065s
W20260709 13:17:20.225340  5441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.041s	sys 0.065s
W20260709 13:17:20.155020  9620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.013s	sys 0.009s
I20260709 13:17:20.226218  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:20.161748  9666 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:17:20.230479  5449 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:20.231426  5521 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:20.220893  9607 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.000s
W20260709 13:17:20.216553  9594 consensus_meta.cc:287] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.144s	user 0.012s	sys 0.003s
I20260709 13:17:20.151757  9211 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.223469  9418 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.021s	sys 0.028s
I20260709 13:17:20.174685  9664 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:20.240267  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:20.175585  9655 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:20.221359  9441 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:20.097402  9665 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 13:17:20.245035  5449 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:20.156790  9577 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:20.238592  9509 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:20.243120  9594 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.252578  9563 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:20.252149  9667 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:17:20.272773  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2015) took 1022 ms. Trace:
I20260709 13:17:20.273391  5519 rpcz_store.cc:276] 0709 13:17:19.250350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.258336 (+  7986us) service_pool.cc:224] Handling call
0709 13:17:19.258563 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.258726 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:19.915232 (+656506us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.272269 (+357037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:20.272342 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:20.272417 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.272519 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.272690 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6220,"prepare.queue_time_us":756015,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":5725,"thread_start_us":990417,"threads_started":2}
I20260709 13:17:20.275745  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1769) took 2438 ms. Trace:
I20260709 13:17:20.276430  5442 rpcz_store.cc:276] 0709 13:17:17.837106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.107405 (+1270299us) service_pool.cc:224] Handling call
0709 13:17:19.137927 (+ 30522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.138325 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.138462 (+   137us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.151207 (+ 12745us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.917869 (+766662us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:19.917936 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.919474 (+  1538us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.275290 (+355816us) raft_consensus.cc:1685] finished
0709 13:17:20.275333 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.275633 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9891,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":17431,"thread_start_us":684190,"threads_started":1,"wal-append.queue_time_us":794608}
I20260709 13:17:20.276883  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.280529  5519 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:20.247207  9655 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:20.255484  9440 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:20.284024  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.251014  9638 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:20.285876  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.287736  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:20.153317  9669 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:20.230482  9616 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:20.289455  5519 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:20.290823  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:20.266538  9413 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.292323  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.244154  9211 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:20.241382  9607 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:20.293987  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:20.299710  5442 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:20.289773  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:20.293867  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:20.286255  9655 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.285832  9649 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:20.307735  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.290367  9630 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:20.300778  9596 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.316286  9596 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:20.317327  9616 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:20.318774  9596 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:20.321595  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1765) took 2507 ms. Trace:
I20260709 13:17:20.321890  5449 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:20.322229  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.315261  5515 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:20.326599  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.328593  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 82079.7us
I20260709 13:17:20.325220  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:20.302348  9620 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.313980  9638 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:20.338006  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1763) took 2530 ms. Trace:
I20260709 13:17:20.303476  9509 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:20.338716  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:20.349144  5442 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:20.323033  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:20.310386  9440 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.350445  5449 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:20.298147  9413 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:20.356271  9648 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.034s	user 0.011s	sys 0.003s
I20260709 13:17:20.328328  9630 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:20.375506  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2238) took 2169 ms. Trace:
I20260709 13:17:20.376030  5373 rpcz_store.cc:276] 0709 13:17:18.206039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.206326 (+   287us) service_pool.cc:224] Handling call
0709 13:17:18.206743 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.419918 (+1213175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.419950 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.419996 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:19.420028 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.375143 (+955115us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000fafd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:20.375224 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.375402 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2789467008}
I20260709 13:17:20.346779  5448 rpcz_store.cc:276] 0709 13:17:17.807974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.018392 (+210418us) service_pool.cc:224] Handling call
0709 13:17:18.019009 (+   617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.037399 (+ 18390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.037488 (+    89us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.045020 (+  7532us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.293993 (+248973us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.534892 (+240899us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.535178 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.535287 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.599056 (+1063769us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:20.327789 (+728733us) raft_consensus.cc:1685] finished
0709 13:17:20.337742 (+  9953us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.337929 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28197,"prepare.queue_time_us":2025417,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":149764,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":29393,"spinlock_wait_cycles":12761344,"thread_start_us":389946,"threads_started":2,"wal-append.queue_time_us":726325}
I20260709 13:17:20.380739  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:20.324430  9649 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:20.387046  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:20.388976  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:20.356324  9440 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:20.392051  5521 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:20.389353  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:20.363180  9665 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:20.393581  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1772) took 2555 ms. Trace:
I20260709 13:17:20.392784  5448 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:20.392711  9675 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.384399  9648 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:20.367071  9509 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:20.364464  9638 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:20.395493  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:20.395859  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:20.398499  5517 raft_consensus.cc:2368] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12.
I20260709 13:17:20.415747  5448 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:20.430299  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:20.431344  5448 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:20.394096  5446 rpcz_store.cc:276] 0709 13:17:17.838068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.839200 (+2001132us) service_pool.cc:224] Handling call
0709 13:17:19.839699 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.852789 (+ 13090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.852839 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.860664 (+  7825us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.110054 (+249390us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:20.371336 (+261282us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.393230 (+ 21894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.393309 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.393357 (+    48us) raft_consensus.cc:1685] finished
0709 13:17:20.393370 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.393526 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":300035,"prepare.queue_time_us":261312,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":36009,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":4883,"thread_start_us":194669,"threads_started":1,"wal-append.queue_time_us":353460}
I20260709 13:17:20.964533  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.014858  5448 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:20.969223  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.016649  5442 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:17:20.968725  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 483190us
W20260709 13:17:20.963552  5340 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.009s	sys 0.005s
W20260709 13:17:21.020601  5340 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.010s	sys 0.006s
W20260709 13:17:21.021248  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 588047us
I20260709 13:17:20.427241  5449 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
W20260709 13:17:20.641145  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.969298  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.322070  5443 rpcz_store.cc:276] 0709 13:17:17.814295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.049417 (+235122us) service_pool.cc:224] Handling call
0709 13:17:18.093709 (+ 44292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.185769 (+ 92060us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:18.266648 (+ 80879us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.403539 (+136891us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.583946 (+180407us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.584107 (+   161us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:19.404752 (+820645us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b18003a8a00. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:19.594458 (+189706us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18003a8a00. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:20.319463 (+725005us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18003a8a00. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d7c6058f 00007fc1d0c9f571 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd
0709 13:17:20.320935 (+  1472us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.321199 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.321281 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.321330 (+    49us) raft_consensus.cc:1685] finished
0709 13:17:20.321343 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.321514 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1839403,"prepare.queue_time_us":1947237,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":91,"raft.queue_time_us":166461,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":86885,"spinlock_wait_cycles":114334592,"thread_start_us":192009,"threads_started":3,"wal-append.queue_time_us":266811}
W20260709 13:17:21.024595  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.467300  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56493.6us
W20260709 13:17:20.973191  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 577538us
I20260709 13:17:21.025674  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:21.026355  5443 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.032222  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.033165  5446 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:20.485530  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1767) took 2649 ms. Trace:
W20260709 13:17:21.034421  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.037532  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.044787  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:21.064955  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:21.067071  5448 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.034794  5447 rpcz_store.cc:276] 0709 13:17:17.836470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.072367 (+235897us) service_pool.cc:224] Handling call
0709 13:17:18.102268 (+ 29901us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.156636 (+ 54368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.156683 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.198427 (+ 41744us) log.cc:844] Serialized 52 byte log entry
0709 13:17:18.468007 (+269580us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:18.657496 (+189489us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.323429 (+1665933us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.485018 (+161589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.485123 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.485168 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:20.485183 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.485463 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1469570,"prepare.queue_time_us":3297525,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":245504,"raft.run_cpu_time_us":495,"raft.run_wall_time_us":66089,"thread_start_us":665063,"threads_started":4,"wal-append.queue_time_us":375166,"wal-append.run_cpu_time_us":3349,"wal-append.run_wall_time_us":1181887}
W20260709 13:17:20.455382  9555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.014s	sys 0.010s
I20260709 13:17:21.100443  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.102706  5446 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:21.103250  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2202) took 1034 ms. Trace:
I20260709 13:17:21.103307  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.103638  5446 rpcz_store.cc:276] 0709 13:17:20.069009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.100145 (+1031136us) service_pool.cc:224] Handling call
0709 13:17:21.103181 (+  3036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.103967  5447 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:21.104790  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:21.105247  5447 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:20.828373  9688 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 13:17:20.393009  9440 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.117962  9649 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:21.099444  9441 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:17:21.120154  9441 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:20.454465  9685 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:17:20.994362  9607 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:20.393298  9665 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.462752  9454 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:21.110641  9672 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.040s	user 0.002s	sys 0.000s
I20260709 13:17:20.790840  9596 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.494555  9486 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.839287  9669 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:20.494315  9675 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:21.123939  5443 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:21.144683  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.145279  5443 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:17:20.397050  9674 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:17:20.616312  9044 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.130213  9665 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:20.485392  9347 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:21.126819  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:20.534446  9680 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:21.102365  9555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.690s	user 0.016s	sys 0.016s
W20260709 13:17:21.124785  9655 consensus_meta.cc:287] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.801s	user 0.012s	sys 0.000s
I20260709 13:17:21.149637  5446 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:21.150797  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2204) took 1034 ms. Trace:
I20260709 13:17:20.825616  9630 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:21.140436  5447 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:21.126194  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.151295  5446 rpcz_store.cc:276] 0709 13:17:20.115948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.124593 (+1008645us) service_pool.cc:224] Handling call
0709 13:17:21.150730 (+ 26137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.157401  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.136066  9648 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.132702  9454 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.141165  9486 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.159670  5446 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:21.137460  9596 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.139982  5448 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:21.140997  9638 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:21.143965  9675 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:21.156137  5442 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:21.194247  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1791) took 1025 ms. Trace:
I20260709 13:17:21.194654  5442 rpcz_store.cc:276] 0709 13:17:20.169012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.064529 (+895517us) service_pool.cc:224] Handling call
0709 13:17:21.194181 (+129652us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.168622  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.160225  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:21.195802  5447 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:21.196205  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1789) took 1027 ms. Trace:
W20260709 13:17:21.140597  9636 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.018s	sys 0.021s
I20260709 13:17:21.174904  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.161809  9413 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.198915  5448 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:21.199453  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2186) took 1183 ms. Trace:
I20260709 13:17:21.199744  5448 rpcz_store.cc:276] 0709 13:17:20.015711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.174513 (+1158802us) service_pool.cc:224] Handling call
0709 13:17:21.199396 (+ 24883us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.196537  5443 rpcz_store.cc:276] 0709 13:17:20.168450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.145750 (+977300us) service_pool.cc:224] Handling call
0709 13:17:21.196149 (+ 50399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.200862  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.203518  9486 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.150246  9044 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.164801  9211 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.196673  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.154501  9347 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.190231  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1792) took 1021 ms. Trace:
I20260709 13:17:21.208283  5447 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:21.198683  9636 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.019s	sys 0.021s
I20260709 13:17:21.154019  9655 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.216667  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.217615  5442 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:21.218263  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1784) took 1051 ms. Trace:
I20260709 13:17:21.218653  5442 rpcz_store.cc:276] 0709 13:17:20.166933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.195382 (+1028449us) service_pool.cc:224] Handling call
0709 13:17:21.218196 (+ 22814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.206421  5448 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:21.214848  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1768) took 3378 ms. Trace:
I20260709 13:17:21.214710  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:21.219656  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1788) took 1051 ms. Trace:
I20260709 13:17:21.211563  5446 rpcz_store.cc:276] 0709 13:17:20.169287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.157097 (+987810us) service_pool.cc:224] Handling call
0709 13:17:21.190134 (+ 33037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.197499  9675 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.220054  5443 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.156924  9680 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:21.227800  5446 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: [12.6-13.7]
I20260709 13:17:21.227893  5449 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.212911  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:21.236393  5447 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.220073  5448 rpcz_store.cc:276] 0709 13:17:20.168150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.200538 (+1032388us) service_pool.cc:224] Handling call
0709 13:17:21.219600 (+ 19062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.267285  9454 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.269322  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1774) took 3430 ms. Trace:
I20260709 13:17:21.269589  9044 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.270023  5446 rpcz_store.cc:276] 0709 13:17:17.838567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.225468 (+3386901us) service_pool.cc:224] Handling call
0709 13:17:21.225988 (+   520us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:21.268899 (+ 42911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.269247 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.271898  9655 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.272431  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 310) took 2332 ms. Trace:
I20260709 13:17:21.273025  5446 rpcz_store.cc:276] 0709 13:17:18.940253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.271241 (+2330988us) service_pool.cc:224] Handling call
0709 13:17:21.271707 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.271968 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.272011 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.272073 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:21.272121 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.272198 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.272350 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.277611  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 312) took 2223 ms. Trace:
I20260709 13:17:21.278134  5446 rpcz_store.cc:276] 0709 13:17:19.054233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.276432 (+2222199us) service_pool.cc:224] Handling call
0709 13:17:21.276892 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.277134 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.277173 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.277235 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:21.277279 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.277349 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.277532 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.280853  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1776) took 2198 ms. Trace:
I20260709 13:17:21.219687  5441 rpcz_store.cc:276] 0709 13:17:17.836737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.945866 (+1109129us) service_pool.cc:224] Handling call
0709 13:17:18.946363 (+   497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.957700 (+ 11337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.957734 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.966343 (+  8609us) log.cc:844] Serialized 52 byte log entry
0709 13:17:20.225831 (+1259488us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:20.372023 (+146192us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.463391 (+ 91368us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.527221 (+ 63830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.527338 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.214622 (+687284us) raft_consensus.cc:1685] finished
0709 13:17:21.214643 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.214792 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261887,"prepare.queue_time_us":146348,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":156909,"raft.run_cpu_time_us":526,"raft.run_wall_time_us":61852,"thread_start_us":1198487,"threads_started":1,"wal-append.queue_time_us":1289048}
I20260709 13:17:21.281358  5446 rpcz_store.cc:276] 0709 13:17:19.082221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.279758 (+2197537us) service_pool.cc:224] Handling call
0709 13:17:21.280169 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.280392 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.280428 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.280487 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:21.280530 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.280604 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.280776 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.287940  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1778) took 2190 ms. Trace:
I20260709 13:17:21.212965  9211 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:21.294349  5441 rpcz_store.cc:276] 0709 13:17:19.097390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.286740 (+2189350us) service_pool.cc:224] Handling call
0709 13:17:21.287240 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.287492 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.287529 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.287588 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:21.287633 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.287704 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.287865 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.193782  9426 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.297884  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 313) took 1975 ms. Trace:
I20260709 13:17:21.298369  5441 rpcz_store.cc:276] 0709 13:17:19.322642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.296704 (+1974062us) service_pool.cc:224] Handling call
0709 13:17:21.297180 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.297449 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.297488 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.297548 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:21.297593 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.297666 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.297826 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:21.301065  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 288296us
I20260709 13:17:21.301612  5446 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:17:21.303269  5446 pending_rounds.cc:85] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 9
I20260709 13:17:21.305826  5446 pending_rounds.cc:107] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:17:21.306190  5446 raft_consensus.cc:2889] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.311954  5449 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:21.313019  5443 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:21.326146  9692 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:17:21.326306  9696 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.312902  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 249169us
I20260709 13:17:21.329401  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2185) took 1314 ms. Trace:
I20260709 13:17:21.335238  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:21.365803  5446 rpcz_store.cc:276] 0709 13:17:20.015415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.300320 (+1284905us) service_pool.cc:224] Handling call
0709 13:17:21.300644 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.306904 (+  6260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.329298 (+ 22394us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:21.347177  9691 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:17:21.298767  9211 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.369468  9211 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.359103  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.325268  5447 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:21.370828  5518 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:21.360002  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:21.363554  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:21.346243  9596 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.371830  5373 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.372483  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.374513  5447 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:21.371878  5366 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.371321  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1821) took 1304 ms. Trace:
I20260709 13:17:21.391162  5518 rpcz_store.cc:276] 0709 13:17:20.066626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.358260 (+1291634us) service_pool.cc:224] Handling call
0709 13:17:21.371266 (+ 13006us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.393179  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.397135  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1834) took 1161 ms. Trace:
I20260709 13:17:21.398363  5373 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:21.398132  5518 rpcz_store.cc:276] 0709 13:17:20.235740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.392662 (+1156922us) service_pool.cc:224] Handling call
0709 13:17:21.396930 (+  4268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.401700  5446 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:17:21.409116  9697 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:21.406106  5366 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
W20260709 13:17:21.417569  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50927.7us
I20260709 13:17:21.365269  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:21.413025  5450 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1777) took 2268 ms (client timeout 1978 ms). Trace:
I20260709 13:17:21.351210  9044 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:21.428555  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2190) took 1365 ms. Trace:
I20260709 13:17:21.402773  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:21.427418  5450 rpcz_store.cc:269] 0709 13:17:19.096963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.789793 (+692830us) service_pool.cc:224] Handling call
0709 13:17:21.365169 (+1575376us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540033c2d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:21.365312 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336615680}
I20260709 13:17:21.454471  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1823) took 1336 ms. Trace:
I20260709 13:17:21.455174  5518 rpcz_store.cc:276] 0709 13:17:20.117644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.401572 (+1283928us) service_pool.cc:224] Handling call
0709 13:17:21.454407 (+ 52835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.451977  5446 rpcz_store.cc:276] 0709 13:17:20.062860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.401021 (+1338161us) service_pool.cc:224] Handling call
0709 13:17:21.401457 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.428172 (+ 26715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.428478 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.452639  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:21.459100  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 93949.4us
I20260709 13:17:21.460268  5450 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:21.456938  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.418578  9211 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:21.464787  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:21.425396  9596 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:21.463394  5520 raft_consensus.cc:2410] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:21.463353  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:21.474351  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:21.469066  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:21.425683  9654 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:21.483178  5450 raft_consensus.cc:2368] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12.
I20260709 13:17:21.484542  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.485412  5450 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:17:21.467741  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:21.474918  5446 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:21.488153  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.489459  5446 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:17:21.494977  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1825) took 1376 ms (client timeout 1832 ms). Trace:
W20260709 13:17:21.496567  5518 rpcz_store.cc:269] 0709 13:17:20.118748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.467352 (+1348604us) service_pool.cc:224] Handling call
0709 13:17:21.494680 (+ 27328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.498438  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:21.499349  5518 raft_consensus.cc:2376] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10. Re-sending same reply.
I20260709 13:17:21.408197  9665 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.503645  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.500859  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:21.468160  9454 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:21.417506  9696 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.507658  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.494161  9638 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.514454  5450 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:21.494098  9413 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:21.458051  9044 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.508037  9648 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:21.517463  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2236) took 3469 ms. Trace:
I20260709 13:17:21.520620  5370 rpcz_store.cc:276] 0709 13:17:18.056310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.060095 (+  3785us) service_pool.cc:224] Handling call
0709 13:17:18.060455 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.199486 (+1139031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.517193 (+2317707us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400330754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:21.517384 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2363145088}
I20260709 13:17:21.506546  5446 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:21.436311  9697 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.509214  9700 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:21.475582  9211 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.502174  9596 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.522392  9413 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.530088  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1773) took 3691 ms. Trace:
I20260709 13:17:21.547451  5442 rpcz_store.cc:276] 0709 13:17:17.838311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.226212 (+3387901us) service_pool.cc:224] Handling call
0709 13:17:21.268233 (+ 42021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.289643 (+ 21410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.289695 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.293510 (+  3815us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.367910 (+ 74400us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:21.369015 (+  1105us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.369584 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.369683 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.529824 (+160141us) raft_consensus.cc:1685] finished
0709 13:17:21.529850 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.530022 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20744,"prepare.queue_time_us":109504,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":21867,"raft.run_cpu_time_us":457,"raft.run_wall_time_us":4043,"thread_start_us":67461,"threads_started":2,"wal-append.queue_time_us":172211}
I20260709 13:17:21.531417  9696 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.501545  9654 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.516918  9702 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.554236  9702 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.556914  9702 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.526599  9701 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:21.558012  9701 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.558530  9675 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.559578  9665 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.560784  9701 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.560990  9675 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.538591  9440 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:21.539963  9412 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.542937  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2017) took 2290 ms. Trace:
I20260709 13:17:21.564239  5515 rpcz_store.cc:276] 0709 13:17:19.251010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.251135 (+   125us) service_pool.cc:224] Handling call
0709 13:17:19.251427 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.327294 (+1075867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.540916 (+1213622us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002b9654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:21.541318 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446083328}
I20260709 13:17:21.565634  9440 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:21.566632  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.566795  9697 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.526510  9648 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:21.567574  5442 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:21.553032  9044 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.551373  9700 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:21.577137  9700 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.578491  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1741) took 3837 ms. Trace:
I20260709 13:17:21.578953  5375 rpcz_store.cc:276] 0709 13:17:17.741056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.840465 (+ 99409us) service_pool.cc:224] Handling call
0709 13:17:17.841541 (+  1076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.583937 (+1742396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.578036 (+1994099us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54001c70d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:21.578420 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3984675712}
I20260709 13:17:21.568171  9648 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:21.582720  9644 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 2.576s	user 0.005s	sys 0.029s
I20260709 13:17:21.553388  9654 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.567005  9211 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.593379  9596 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:21.596695  5521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1820) took 1576 ms (client timeout 1820 ms). Trace:
W20260709 13:17:21.597289  5521 rpcz_store.cc:269] 0709 13:17:20.020582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.321970 (+301388us) service_pool.cc:224] Handling call
0709 13:17:21.596422 (+1274452us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b54002b98d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:21.596610 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148303616}
I20260709 13:17:21.598910  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.598915  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:21.600418  5521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1824) took 1482 ms (client timeout 1862 ms). Trace:
I20260709 13:17:21.565693  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.508329  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1827) took 1332 ms. Trace:
I20260709 13:17:21.568051  9615 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.587308  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2187) took 1571 ms. Trace:
I20260709 13:17:21.602877  5515 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
W20260709 13:17:21.603447  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34858 (request call id 306) took 1334 ms (client timeout 1709 ms). Trace:
I20260709 13:17:21.545843  5450 pending_rounds.cc:85] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 3
W20260709 13:17:21.603952  5515 rpcz_store.cc:269] 0709 13:17:20.269599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.565371 (+1295772us) service_pool.cc:224] Handling call
0709 13:17:21.603388 (+ 38017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.603144  5441 rpcz_store.cc:276] 0709 13:17:20.015993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.301057 (+1285064us) service_pool.cc:224] Handling call
0709 13:17:21.302736 (+  1679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.317700 (+ 14964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.317733 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.363870 (+ 46137us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.515383 (+151513us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:21.515439 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.515531 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.587053 (+ 71522us) raft_consensus.cc:1685] finished
0709 13:17:21.587081 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.587238 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14541,"raft.queue_time_us":17858,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":29108,"thread_start_us":104540,"threads_started":1,"wal-append.queue_time_us":166457}
I20260709 13:17:21.604401  5450 pending_rounds.cc:107] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:21.604779  5450 raft_consensus.cc:2889] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.605036  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.601989  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.600922  9544 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.606230  9675 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.600729  9680 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:21.601892  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.604919  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.607646  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2188) took 1585 ms. Trace:
I20260709 13:17:21.602758  5518 rpcz_store.cc:276] 0709 13:17:20.174364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.498054 (+1323690us) service_pool.cc:224] Handling call
0709 13:17:21.506856 (+  8802us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.615890  5515 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:21.570633  5446 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:17:21.609705  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 103190us
I20260709 13:17:21.606266  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:21.616997  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2192) took 1553 ms. Trace:
W20260709 13:17:21.614449  9642 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 2.797s	user 0.017s	sys 0.031s
I20260709 13:17:21.617760  9675 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:21.618235  5446 rpcz_store.cc:276] 0709 13:17:20.063379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.523507 (+1460128us) service_pool.cc:224] Handling call
0709 13:17:21.570241 (+ 46734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.616749 (+ 46508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.616944 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.616357  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:21.619405  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2233) took 3577 ms. Trace:
I20260709 13:17:21.620219  9675 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.606271  5445 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:17:21.619836  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1826) took 1446 ms (client timeout 1837 ms). Trace:
W20260709 13:17:21.621397  5518 rpcz_store.cc:269] 0709 13:17:20.173853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.616095 (+1442242us) service_pool.cc:224] Handling call
0709 13:17:21.619778 (+  3683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.619817  5371 rpcz_store.cc:276] 0709 13:17:18.042208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.043273 (+  1065us) service_pool.cc:224] Handling call
0709 13:17:18.043711 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.515912 (+472201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.515969 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.516912 (+   943us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.733166 (+216254us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:18.733203 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.733315 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.613823 (+2880508us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:21.619083 (+  5260us) raft_consensus.cc:1685] finished
0709 13:17:21.619106 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.619343 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":253951,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":24928,"spinlock_wait_cycles":13364096,"thread_start_us":541054,"threads_started":2,"wal-append.queue_time_us":185037}
W20260709 13:17:21.605315  5521 rpcz_store.cc:269] 0709 13:17:20.118042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.598635 (+1480593us) service_pool.cc:224] Handling call
0709 13:17:21.600361 (+  1726us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:21.616400  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1828) took 1441 ms (client timeout 1812 ms). Trace:
W20260709 13:17:21.625247  5515 rpcz_store.cc:269] 0709 13:17:20.174867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.604626 (+1429759us) service_pool.cc:224] Handling call
0709 13:17:21.616344 (+ 11718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.615777  5443 rpcz_store.cc:276] 0709 13:17:20.022072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.407085 (+1385013us) service_pool.cc:224] Handling call
0709 13:17:21.407460 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.407811 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.407855 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.408322 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.547890 (+139568us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:21.547936 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.548011 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.607436 (+ 59425us) raft_consensus.cc:1685] finished
0709 13:17:21.607457 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.607591 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22493,"raft.queue_time_us":1190,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8061,"thread_start_us":40999,"threads_started":1,"wal-append.queue_time_us":126771}
I20260709 13:17:21.626485  5445 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:21.626629  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.627256  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2196) took 1559 ms. Trace:
I20260709 13:17:21.627851  5515 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:21.631407  5446 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.632870  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2193) took 1569 ms. Trace:
I20260709 13:17:21.628727  5445 rpcz_store.cc:276] 0709 13:17:20.067381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.621308 (+1553927us) service_pool.cc:224] Handling call
0709 13:17:21.621635 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.626961 (+  5326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.627168 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.635540  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1829) took 1418 ms. Trace:
I20260709 13:17:21.637079  5445 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:21.636847  5515 rpcz_store.cc:276] 0709 13:17:20.216966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.626282 (+1409316us) service_pool.cc:224] Handling call
0709 13:17:21.635459 (+  9177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.617215  5441 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:21.641000  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:21.641000  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2201) took 1572 ms. Trace:
I20260709 13:17:21.622879  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.643321  5445 rpcz_store.cc:276] 0709 13:17:20.068728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.636310 (+1567582us) service_pool.cc:224] Handling call
0709 13:17:21.636637 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.640728 (+  4091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.640941 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:21.644182  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1833) took 1409 ms (client timeout 1779 ms). Trace:
W20260709 13:17:21.644706  5518 rpcz_store.cc:269] 0709 13:17:20.235360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.622598 (+1387238us) service_pool.cc:224] Handling call
0709 13:17:21.644101 (+ 21503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.633980  5446 rpcz_store.cc:276] 0709 13:17:20.063629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.620008 (+1556379us) service_pool.cc:224] Handling call
0709 13:17:21.631171 (+ 11163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.632321 (+  1150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.632783 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.648335  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:21.648475  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:21.649236  5521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1807) took 1637 ms (client timeout 2017 ms). Trace:
W20260709 13:17:21.649884  5521 rpcz_store.cc:269] 0709 13:17:20.013185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.648078 (+1634893us) service_pool.cc:224] Handling call
0709 13:17:21.649178 (+  1100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.649192  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:21.650697  5441 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:21.651335  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1783) took 1484 ms. Trace:
I20260709 13:17:21.649467  5515 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:21.651803  5441 rpcz_store.cc:276] 0709 13:17:20.166615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.641784 (+1475169us) service_pool.cc:224] Handling call
0709 13:17:21.642074 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.651103 (+  9029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.651283 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:21.652133  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1813) took 1633 ms (client timeout 2142 ms). Trace:
I20260709 13:17:21.651204  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:21.652536  5515 rpcz_store.cc:269] 0709 13:17:20.018722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.648083 (+1629361us) service_pool.cc:224] Handling call
0709 13:17:21.652077 (+  3994us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7936}
I20260709 13:17:21.653964  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.655092  5515 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:21.658157  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.659512  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:21.660334  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1830) took 1443 ms. Trace:
I20260709 13:17:21.660334  5367 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.661204  5515 rpcz_store.cc:276] 0709 13:17:20.217339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.653627 (+1436288us) service_pool.cc:224] Handling call
0709 13:17:21.660247 (+  6620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.662271  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1831) took 1444 ms. Trace:
I20260709 13:17:21.662736  5521 rpcz_store.cc:276] 0709 13:17:20.217708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.657791 (+1440083us) service_pool.cc:224] Handling call
0709 13:17:21.662202 (+  4411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.653687  5518 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:21.664049  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:21.664574  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1809) took 1650 ms (client timeout 2178 ms). Trace:
W20260709 13:17:21.665047  5518 rpcz_store.cc:269] 0709 13:17:20.013892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.650527 (+1636635us) service_pool.cc:224] Handling call
0709 13:17:21.664501 (+ 13974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.666064  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.697476  5370 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:21.699652  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:21.702126  5366 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:21.669414  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1838) took 1412 ms. Trace:
I20260709 13:17:21.737329  5521 rpcz_store.cc:276] 0709 13:17:20.257064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.663743 (+1406679us) service_pool.cc:224] Handling call
0709 13:17:21.669356 (+  5613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.669087  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1837) took 1428 ms. Trace:
I20260709 13:17:21.740126  5515 rpcz_store.cc:276] 0709 13:17:20.240855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.665803 (+1424948us) service_pool.cc:224] Handling call
0709 13:17:21.669032 (+  3229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:21.742267  5372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2245) took 2815 ms (client timeout 1863 ms). Trace:
W20260709 13:17:21.714046  9719 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:21.747615  5367 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:21.742741  5372 rpcz_store.cc:269] 0709 13:17:18.921497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.921674 (+   177us) service_pool.cc:224] Handling call
0709 13:17:21.736346 (+2814672us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000d1454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:21.736536 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273723648}
I20260709 13:17:21.771685  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:21.772693  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:21.773461  5367 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:21.717909  9643 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:21.777604  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:21.778532  5373 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:21.780223  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:21.781019  9679 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.623s	user 0.007s	sys 0.010s
I20260709 13:17:21.782056  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:21.782871  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.782804  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.783667  5521 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:21.722368  9587 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:21.784926  5518 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:21.784691  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:21.785717  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1818) took 1765 ms. Trace:
I20260709 13:17:21.785982  5372 raft_consensus.cc:2410] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:17:21.786429  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1832) took 1553 ms. Trace:
I20260709 13:17:21.786194  5518 rpcz_store.cc:276] 0709 13:17:20.020022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.665864 (+1645842us) service_pool.cc:224] Handling call
0709 13:17:21.785627 (+119763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.786816  5521 rpcz_store.cc:276] 0709 13:17:20.233570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.739539 (+1505969us) service_pool.cc:224] Handling call
0709 13:17:21.784387 (+ 44848us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569536}
I20260709 13:17:21.787663  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.788005  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.788668  5518 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
I20260709 13:17:21.791146  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:21.792181  9503 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:21.795961  5367 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:21.794598  5372 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 13:17:21.796581  5372 pending_rounds.cc:85] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 4
I20260709 13:17:21.796897  5372 pending_rounds.cc:107] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:17:21.797132  5372 raft_consensus.cc:2889] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.669339  9697 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:17:21.797554  5372 pending_rounds.cc:107] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:17:21.800989  5372 raft_consensus.cc:2889] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.800844  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1839) took 1513 ms. Trace:
I20260709 13:17:21.802831  5521 rpcz_store.cc:276] 0709 13:17:20.287054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.787780 (+1500726us) service_pool.cc:224] Handling call
0709 13:17:21.800761 (+ 12981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.818991  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 305) took 1555 ms. Trace:
I20260709 13:17:21.819609  5521 rpcz_store.cc:276] 0709 13:17:20.264080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.803584 (+1539504us) service_pool.cc:224] Handling call
0709 13:17:21.803934 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.804146 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.804189 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.818541 (+ 14352us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:21.818608 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.818706 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.818909 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.799839  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.826664  5518 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:21.827396  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1814) took 1808 ms. Trace:
I20260709 13:17:21.827791  5518 rpcz_store.cc:276] 0709 13:17:20.018962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.799453 (+1780491us) service_pool.cc:224] Handling call
0709 13:17:21.827319 (+ 27866us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.832333  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 307) took 1545 ms. Trace:
I20260709 13:17:21.832908  5521 rpcz_store.cc:276] 0709 13:17:20.286740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.821275 (+1534535us) service_pool.cc:224] Handling call
0709 13:17:21.831299 (+ 10024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.831541 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.831578 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.831637 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:21.831682 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.832084 (+   402us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.832249 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.880039  5518 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.880827  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 308) took 1588 ms. Trace:
I20260709 13:17:21.881175  5518 rpcz_store.cc:276] 0709 13:17:20.291994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.828626 (+1536632us) service_pool.cc:224] Handling call
0709 13:17:21.829040 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.880551 (+ 51511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.880770 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.797286  9503 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:21.890666  5366 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:21.894170  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:21.902009  5524 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:21.902768  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1836) took 1662 ms. Trace:
I20260709 13:17:21.903168  5524 rpcz_store.cc:276] 0709 13:17:20.240192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.803021 (+1562829us) service_pool.cc:224] Handling call
0709 13:17:21.902686 (+ 99665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.890220  9503 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:21.993574  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44421.7us
W20260709 13:17:21.998019  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 61562.6us
I20260709 13:17:22.039784  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2016) took 2789 ms. Trace:
I20260709 13:17:22.040472  5522 rpcz_store.cc:276] 0709 13:17:19.250700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.253453 (+  2753us) service_pool.cc:224] Handling call
0709 13:17:19.253920 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.801711 (+547791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.039250 (+2237539us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54003a3754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:22.039691 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942745856}
I20260709 13:17:22.004978  9660 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:22.047708  9503 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:22.048674  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:22.048902  9697 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:22.050570  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.052548  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.053305  5518 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:22.054251  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.055298  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.055797  5518 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
W20260709 13:17:22.052688  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53066us
I20260709 13:17:22.057964  5521 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:22.058048  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:22.057365  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:22.059770  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:22.060089  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 220009us
I20260709 13:17:22.060369  5521 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.061585  5524 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:22.065609  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.082577  5518 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:22.070537  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:22.082541  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.085119  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.087719  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.087884  5444 raft_consensus.cc:2410] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:22.065610  9592 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.093523  5521 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:22.092715  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:22.095278  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.095470  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:22.064654  9660 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:22.099330  9669 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:22.099896  9669 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:22.100122  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.100852  9669 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.097561  9592 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.105100  9700 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.105822  9700 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.090874  9478 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.090226  9697 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:22.106913  9592 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:22.126942  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:22.112140  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 637844us
I20260709 13:17:22.128051  9426 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.128161  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1810) took 2110 ms. Trace:
I20260709 13:17:22.128332  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:22.110015  9718 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:17:22.129738  9544 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:22.130286  9544 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.130573  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.130767  9544 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.132014  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:22.114766  9638 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:22.134091  9638 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:22.134444  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.135895  5515 raft_consensus.cc:2410] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:22.136709  9638 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:22.108675  9700 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:22.117900  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 518803us
I20260709 13:17:22.133313  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.141600  9726 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:22.142683  9638 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.143016  9726 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:22.143430  9726 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:22.144410  9726 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:22.091223  9418 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:17:22.143117  9638 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.146274  9638 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.118129  9615 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:22.148372  9615 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:22.148717  9615 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:22.112751  9454 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:22.149554  9615 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.150187  9454 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.150753  9454 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.120702  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2191) took 2057 ms. Trace:
I20260709 13:17:22.121383  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2199) took 2053 ms. Trace:
I20260709 13:17:22.154469  5443 rpcz_store.cc:276] 0709 13:17:20.068179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.627061 (+1558882us) service_pool.cc:224] Handling call
0709 13:17:21.627344 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.627541 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:21.627902 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.120987 (+493085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.121052 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:22.121098 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.121176 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.121315 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":363359,"prepare.queue_time_us":7285,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":57,"raft.queue_time_us":323611,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":170930,"threads_started":1,"wal-append.queue_time_us":443672}
I20260709 13:17:22.116478  9509 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:22.128856  5516 rpcz_store.cc:276] 0709 13:17:20.017860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.720341 (+1702481us) service_pool.cc:224] Handling call
0709 13:17:22.126719 (+406378us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:17:22.128081 (+  1362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4849536}
W20260709 13:17:22.123837  5523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2026) took 2866 ms (client timeout 1645 ms). Trace:
I20260709 13:17:22.156715  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:22.158792  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:22.160065  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.161695  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:22.157676  5523 rpcz_store.cc:269] 0709 13:17:19.257175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.257314 (+   139us) service_pool.cc:224] Handling call
0709 13:17:22.123529 (+2866215us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54002774d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:22.123682 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559798016}
I20260709 13:17:22.166152  5374 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:22.168248  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.169929  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.170732  5374 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:22.136746  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1805) took 2125 ms. Trace:
I20260709 13:17:22.174803  5515 rpcz_store.cc:276] 0709 13:17:20.011037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.771005 (+1759968us) service_pool.cc:224] Handling call
0709 13:17:22.134194 (+363189us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:17:22.136611 (+  2417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3601664}
W20260709 13:17:22.114411  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.120199  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1790) took 1951 ms. Trace:
I20260709 13:17:22.119639  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1775) took 4266 ms. Trace:
W20260709 13:17:22.176846  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.176651  5445 rpcz_store.cc:276] 0709 13:17:20.168742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.646961 (+1478219us) service_pool.cc:224] Handling call
0709 13:17:21.653705 (+  6744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.119846 (+466141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.119884 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.119932 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:22.119960 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.120019 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.120137 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":465652,"raft.queue_time_us":468404,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54}
I20260709 13:17:22.179457  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:22.188758  5445 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:22.194046  9660 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:22.133504  9441 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.195079  9660 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.195724  9441 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:22.196223  9441 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.157457  9617 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:22.151633  5339 connection.cc:256] RPC call timeout handler was delayed by -1.4061586319999151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 13:17:22.182631  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2189) took 2130 ms. Trace:
W20260709 13:17:22.203121  5339 connection.cc:256] RPC call timeout handler was delayed by -1.3161586319999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:17:22.183229  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.203028  5374 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:22.153596  5450 rpcz_store.cc:276] 0709 13:17:20.063120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.521856 (+1458736us) service_pool.cc:224] Handling call
0709 13:17:21.545594 (+ 23738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.605384 (+ 59790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.605416 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.605885 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.659788 (+ 53903us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:21.697126 (+ 37338us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.120396 (+423270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.120475 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.120521 (+    46us) raft_consensus.cc:1685] finished
0709 13:17:22.120534 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.120645 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":423007,"prepare.queue_time_us":71195,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":65,"raft.queue_time_us":425388,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":54,"thread_start_us":51448,"threads_started":1,"wal-append.queue_time_us":60965}
I20260709 13:17:22.183548  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.176780  5448 rpcz_store.cc:276] 0709 13:17:17.853605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.245590 (+3391985us) service_pool.cc:224] Handling call
0709 13:17:21.248809 (+  3219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.302848 (+ 54039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.302992 (+   144us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.304138 (+  1146us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.424345 (+120207us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:21.653082 (+228737us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.119294 (+466212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.119381 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.119426 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:22.119438 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.119577 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519392,"prepare.queue_time_us":88467,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1860,"raft.queue_time_us":523901,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":3279,"thread_start_us":245680,"threads_started":2,"wal-append.queue_time_us":209030}
I20260709 13:17:22.203228  5447 rpcz_store.cc:276] 0709 13:17:20.051940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.376140 (+1324200us) service_pool.cc:224] Handling call
0709 13:17:21.377233 (+  1093us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:21.377901 (+   668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.377929 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:21.378950 (+  1021us) log.cc:844] Serialized 52 byte log entry
0709 13:17:21.381024 (+  2074us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.422441 (+ 41417us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.426113 (+  3672us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.449975 (+ 23862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.450078 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.594412 (+144334us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b180046cba0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:22.088691 (+494279us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b180046cba0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c6d2a6 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1
0709 13:17:22.111866 (+ 23175us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b180046cba0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d7c6058f 00007fc1d0c9f571 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd
0709 13:17:22.143538 (+ 31672us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b180046cba0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:22.182394 (+ 38856us) raft_consensus.cc:1685] finished
0709 13:17:22.182424 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.182564 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":549287,"prepare.queue_time_us":219129,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":64341,"raft.run_cpu_time_us":515,"raft.run_wall_time_us":29534,"spinlock_wait_cycles":132303488,"thread_start_us":13503,"threads_started":2,"wal-append.queue_time_us":91724}
I20260709 13:17:22.205605  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:22.206538  5448 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:22.185680  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.120311  9478 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.187290  9503 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:22.123253  6042 connection.cc:256] RPC call timeout handler was delayed by -1.3368463769998016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 13:17:22.187487  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.214569  5370 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
W20260709 13:17:22.185339  9717 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:17:22.202636  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:22.203553  5339 connection.cc:256] RPC call timeout handler was delayed by -1.0731586319998314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 13:17:22.227413  5339 connection.cc:256] RPC call timeout handler was delayed by -1.0164586319999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:17:22.204180  5367 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:22.229107  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.142026  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:22.210759  5449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2207) took 2093 ms (client timeout 2034 ms). Trace:
W20260709 13:17:22.232786  5449 rpcz_store.cc:269] 0709 13:17:20.117008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.044390 (+927382us) service_pool.cc:224] Handling call
0709 13:17:22.210548 (+1166158us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540033d6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:22.210679 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418854656}
I20260709 13:17:22.150822  9615 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.169332  9697 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:22.212617  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.186118  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.133314  9680 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.280727  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:17:22.281873  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 140056us
I20260709 13:17:22.220417  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:22.211004  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.250540  5375 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:22.250896  5449 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:22.283200  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2216) took 1896 ms. Trace:
I20260709 13:17:22.264385  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:22.192739  9454 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.249185  9486 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:22.285219  5371 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:22.271457  5374 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:22.283600  5449 rpcz_store.cc:276] 0709 13:17:20.386371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.249803 (+1863432us) service_pool.cc:224] Handling call
0709 13:17:22.250398 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.282923 (+ 32525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.283141 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.287565  5449 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:22.288120  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2219) took 1246 ms. Trace:
I20260709 13:17:22.288920  5449 rpcz_store.cc:276] 0709 13:17:21.041342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.286916 (+1245574us) service_pool.cc:224] Handling call
0709 13:17:22.287233 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.287902 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.288063 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.290015  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.291850  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1797) took 1189 ms. Trace:
I20260709 13:17:22.283227  5445 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:22.292280  5449 rpcz_store.cc:276] 0709 13:17:21.102223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.290740 (+1188517us) service_pool.cc:224] Handling call
0709 13:17:22.291145 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.291401 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.291441 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.291502 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:22.291549 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.291625 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.291781 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.284931  6073 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:22.294474  5445 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:17:22.295117  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.299217  5449 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:22.295171  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2215) took 1910 ms. Trace:
I20260709 13:17:22.299692  5450 rpcz_store.cc:276] 0709 13:17:20.385143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.250141 (+1864998us) service_pool.cc:224] Handling call
0709 13:17:22.294578 (+ 44437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.294753 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.294785 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.294842 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:22.294884 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.294955 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.295097 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.297217  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.301561  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.301620  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.201939  9617 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:22.283515  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:22.270936  9712 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:17:22.302320  5374 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:22.302985  5515 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:22.274145  9726 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.302989  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:22.239765  9503 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.304793  5445 pending_rounds.cc:85] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 6
I20260709 13:17:22.295953  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:22.316919  6073 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:22.312901  6076 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEARNER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
W20260709 13:17:22.288929  5414 connection.cc:256] RPC call timeout handler was delayed by -1.6304924739999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:17:22.310648  5443 raft_consensus.cc:2368] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:22.272943  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:22.322077  5448 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:22.311913  5523 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:22.324070  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:22.322867  5414 connection.cc:256] RPC call timeout handler was delayed by -1.2511905609999303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:17:22.325991  5414 connection.cc:256] RPC call timeout handler was delayed by -1.1170363510000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:17:22.316001  5445 pending_rounds.cc:107] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:17:22.309906  9702 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.326803  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:22.324807  9625 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:22.319171  9632 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:17:22.269411  9638 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.339192  9454 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:22.339793  9638 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:22.331961  9702 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:22.340934  9702 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.331856  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:22.342096  6072 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 6: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:22.343683  6069 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:22.346192  9625 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:22.346696  9625 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:22.347570  9625 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.349617  9625 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.333743  5415 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:22.351545  9721 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 13:17:22.350432  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.353681  9632 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:22.354156  9632 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:22.354548  9441 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:22.355240  5446 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:22.355770  5446 pending_rounds.cc:85] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 6
W20260709 13:17:22.353715  5444 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2183) took 2341 ms (client timeout 1587 ms). Trace:
I20260709 13:17:22.356123  5446 pending_rounds.cc:107] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:22.356516  5446 raft_consensus.cc:2889] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:22.356299  5444 rpcz_store.cc:269] 0709 13:17:20.012804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.156408 (+143604us) service_pool.cc:224] Handling call
0709 13:17:22.353500 (+2197092us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400238a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:22.353646 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4438834560}
I20260709 13:17:22.357103  9441 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:22.358189  9638 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.358961  9638 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:22.359467  9638 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.330982  5445 raft_consensus.cc:2889] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:22.326475  5414 connection.cc:256] RPC call timeout handler was delayed by -1.0809276249999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:17:22.363303  5414 connection.cc:256] RPC call timeout handler was delayed by -1.0243852989999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
I20260709 13:17:22.365839  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.369786  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.371800  5515 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:22.372532  5414 connection.cc:256] RPC call timeout handler was delayed by -1.0051013110000895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 13:17:22.373631  6073 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:22.375301  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.376267  9617 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:22.377249  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.377908  5523 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:22.378891  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.381251  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.382552  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.383605  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.373797  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.386047  5523 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:22.270694  9697 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.392891  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.394934  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.371923  9655 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:22.383302  9509 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.383515  9630 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:22.383937  9377 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:22.402300  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.332501  9555 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:17:22.355155  9632 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:22.404297  5519 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:22.395211  9510 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:22.402566  9612 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.412015  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:22.391847  9607 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.419569  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.419323  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:22.405926  9418 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.428393  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.430372  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:22.438875  5272 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 156) took 28621 ms (client timeout 15000 ms). Trace:
I20260709 13:17:22.442090  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:22.442870  5523 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:22.439949  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.445500  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:22.446023  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:22.444584  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 136726us
I20260709 13:17:22.446717  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:22.454907  5414 leader_election.cc:336] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.680s (SENT)
I20260709 13:17:22.455574  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.455690  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:22.456189  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:22.456405  5443 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:22.458202  5443 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:22.459172  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:22.460265  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:22.427284  9635 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.470443  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.392884  9544 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.417284  9377 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:22.467521  9486 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:22.410943  9655 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.462659  9555 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:22.424647  9612 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:22.426522  9607 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:22.490047  9607 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.494807  9648 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:22.495605  9648 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:22.462963  9680 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:22.468266  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:22.477069  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:22.440708  9421 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:22.436692  9418 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:22.443320  9454 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:22.438490  9510 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:22.413254  9509 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.417043  9630 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:22.510077  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 121373us
I20260709 13:17:22.499521  5444 raft_consensus.cc:2376] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11. Re-sending same reply.
I20260709 13:17:22.511778  6042 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:22.464161  9632 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.498157  5445 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:17:22.439757  5272 rpcz_store.cc:269] 0709 13:16:53.817990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.818335 (+   345us) service_pool.cc:224] Handling call
0709 13:17:22.438798 (+28620463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:14.765123 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:14.830867 (+ 65744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:14.830954 (+    87us) write_op.cc:435] Acquired schema lock
0709 13:17:14.830985 (+    31us) tablet.cc:662] Decoding operations
0709 13:17:14.832830 (+  1845us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:14.832973 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:14.833015 (+    42us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:17:14.852306 (+ 19291us) tablet.cc:701] Row locks acquired
0709 13:17:14.852360 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:17:14.852643 (+   283us) write_op.cc:270] Start()
0709 13:17:14.852859 (+   216us) write_op.cc:276] Timestamp: P: 1783603034852552 usec, L: 0
0709 13:17:14.852883 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:14.912028 (+ 59145us) log.cc:844] Serialized 5533 byte log entry
0709 13:17:15.981383 (+1069355us) op_driver.cc:464] REPLICATION: finished
0709 13:17:16.276005 (+294622us) write_op.cc:301] APPLY: starting
0709 13:17:16.282546 (+  6541us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:16.427197 (+144651us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:16.427335 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:16.668896 (+241561us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:16.686868 (+ 17972us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:17:16.686945 (+    77us) write_op.cc:312] APPLY: finished
0709 13:17:16.687330 (+   385us) log.cc:844] Serialized 100 byte log entry
0709 13:17:16.687810 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:16.688024 (+   214us) write_op.cc:454] Released schema lock
0709 13:17:16.688099 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:16.688612 (+   513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:16.688644 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":432611,"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":255028,"apply.run_cpu_time_us":6865,"apply.run_wall_time_us":439535,"num_ops":14,"prepare.queue_time_us":289141,"prepare.run_cpu_time_us":14539,"prepare.run_wall_time_us":207663,"raft.queue_time_us":135951,"raft.run_cpu_time_us":80329,"raft.run_wall_time_us":154278,"replication_time_us":1128315,"thread_start_us":367686,"threads_started":4,"wal-append.queue_time_us":141745,"wal-append.run_cpu_time_us":50919,"wal-append.run_wall_time_us":2635037}]]}
I20260709 13:17:22.509130  5442 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:22.509330  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:22.453644  9440 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:22.501362  9731 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:22.618111  9421 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:22.484543  9580 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:22.517221  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.488770  9555 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.470681  9635 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:22.498701  9592 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:22.498677  9612 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.621414  9441 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.660468  5262 maintenance_manager.cc:419] P 76d1a118b8e24e8fbc379c88999cb11f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033394
W20260709 13:17:22.732810  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 244325us
W20260709 13:17:22.764374  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 244092us
I20260709 13:17:22.860374  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:22.865062  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:22.712455  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2271) took 1079 ms. Trace:
I20260709 13:17:22.872431  5368 rpcz_store.cc:276] 0709 13:17:21.632889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.633074 (+   185us) service_pool.cc:224] Handling call
0709 13:17:21.663567 (+ 30493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.670355 (+  6788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.670411 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.671209 (+   798us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.132658 (+461449us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b180042a060. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:17:22.414845 (+282187us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:22.414893 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.414970 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.712080 (+297110us) raft_consensus.cc:1685] finished
0709 13:17:22.712104 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.712367 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12670,"raft.queue_time_us":7526,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4467,"spinlock_wait_cycles":19827968,"thread_start_us":281977,"threads_started":1,"wal-append.queue_time_us":787042}
I20260709 13:17:22.875837  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:22.667922  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.682618  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 224663us
I20260709 13:17:22.878619  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:22.882566  5414 leader_election.cc:336] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.781s (SENT)
I20260709 13:17:22.883559  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.893901  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:22.779110  5442 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 1812) took 1209 ms (client timeout 1522 ms). Trace:
W20260709 13:17:22.911325  5442 rpcz_store.cc:269] 0709 13:17:21.569228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.601613 (+ 32385us) service_pool.cc:224] Handling call
0709 13:17:22.777370 (+1175757us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b540033d1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:22.779013 (+  1643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054412544}
I20260709 13:17:22.726002  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2212) took 2462 ms. Trace:
I20260709 13:17:22.915191  5446 rpcz_store.cc:276] 0709 13:17:20.263652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.650135 (+1386483us) service_pool.cc:224] Handling call
0709 13:17:22.354893 (+704758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.357308 (+  2415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.724779 (+367471us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b5400238a50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:22.725923 (+  1144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615915392}
W20260709 13:17:22.908601  5414 leader_election.cc:336] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.812s (SENT)
W20260709 13:17:22.751719  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 241720us
I20260709 13:17:22.922298  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:22.918002  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:22.733357  5517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2024) took 3455 ms (client timeout 1978 ms). Trace:
W20260709 13:17:22.926084  5517 rpcz_store.cc:269] 0709 13:17:19.253028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.253137 (+   109us) service_pool.cc:224] Handling call
0709 13:17:22.707799 (+3454662us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002db254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:22.708004 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2573303552}
W20260709 13:17:22.704560  5520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1817) took 2684 ms (client timeout 1680 ms). Trace:
W20260709 13:17:22.933913  5520 rpcz_store.cc:269] 0709 13:17:20.019746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.092195 (+ 72449us) service_pool.cc:224] Handling call
0709 13:17:22.704278 (+2612083us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001e6c54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:22.704481 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036632448}
W20260709 13:17:22.677474  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 127470us
I20260709 13:17:22.683148  9278 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:17:22.659644  9223 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:22.717734  9347 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:22.746162  9377 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:22.498278  9413 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:22.508311  9418 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.949693  9532 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.949782  9278 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:22.950719  9278 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.951203  9278 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.951009  9532 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:22.770380  9421 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.519752  9440 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:22.953176  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 55900.9us
I20260709 13:17:22.953733  9440 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.955181  9591 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:22.956570  9591 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:22.739751  9441 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.957886  9109 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:22.958530  9109 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:22.959074  9109 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.508569  9454 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.962035  9454 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.962739  9697 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:22.808920  9478 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:22.510671  9492 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.178s
I20260709 13:17:22.814666  9506 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:22.730193  9509 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:22.983320  9506 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:22.722436  9510 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.986171  9615 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.482124  9545 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:22.734433  9544 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:22.675122  9580 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:22.990839  9580 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.992053  9492 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:22.515056  9586 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.173s
I20260709 13:17:22.993827  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.735680  9587 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:22.994918  9587 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:22.686547  9592 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:22.997944  9592 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.998435  9698 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:22.999066  9698 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:22.508916  9598 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.002025  9598 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.002599  9598 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.756021  9603 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:23.006179  9603 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.720434  9612 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.015386  9441 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:23.016065  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51677.1us
I20260709 13:17:23.017443  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.018114  9612 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:22.809265  9607 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.019047  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:23.020483  9632 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:22.510380  9617 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:23.021047  9632 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:23.022079  9632 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.697803  9634 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:22.688016  9635 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.026626  5445 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.815497  9638 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:23.028169  9506 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.496737  9648 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.751025  9655 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:22.801280  9669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.007s	sys 0.011s
W20260709 13:17:23.089279  9669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.007s	sys 0.011s
I20260709 13:17:23.089075  9410 consensus_queue.cc:1059] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:17:22.788944  9702 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:23.091392  9410 raft_consensus.cc:3055] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:23.091929  9410 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:22.675484  9728 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:17:22.819832  9738 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.111s	user 0.002s	sys 0.001s
I20260709 13:17:22.946431  9426 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.098994  9426 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.099611  9426 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:22.963927  5414 leader_election.cc:336] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.820s (SENT)
I20260709 13:17:22.973515  9746 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.974517  9700 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:23.102306  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:22.976305  9486 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.103091  5270 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 11 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:17:23.104216  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 165022us
I20260709 13:17:22.986054  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.102348  9746 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:23.105603  5446 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:23.105566  9746 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.683501  9555 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:23.109488  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.986141  9680 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.000798  9698 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.118382  9698 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.013621  9522 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:23.022156  9617 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:23.119618  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.119683  9522 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:23.120873  9617 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.121971  9522 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:22.732148  9630 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:23.123962  9522 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.023327  9742 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:23.021225  9607 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:23.008847  9603 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:22.996570  9587 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:23.131824  5414 leader_election.cc:336] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.829s (SENT)
W20260709 13:17:23.075927  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 154059us
I20260709 13:17:23.093631  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.093400  9702 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:23.104404  9486 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.982386  5441 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:23.136510  5441 pending_rounds.cc:85] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 5
W20260709 13:17:23.134902  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 141461us
I20260709 13:17:23.140650  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:23.142584  5375 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.143013  9587 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.129552  9742 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:23.144009  9638 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:23.144722  9742 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.140223  5441 pending_rounds.cc:107] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:23.142997  5270 catalog_manager.cc:5697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.146314  5441 raft_consensus.cc:2889] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:23.149078  9607 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:17:23.146524  9742 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.152999  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2214) took 2839 ms. Trace:
I20260709 13:17:23.158581  5441 rpcz_store.cc:276] 0709 13:17:20.313120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.652633 (+1339513us) service_pool.cc:224] Handling call
0709 13:17:22.777629 (+1124996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.149076 (+371447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.151869 (+  2793us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540033d1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:23.152723 (+   854us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540033d1d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:23.152904 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014986368}
I20260709 13:17:23.153085  9607 consensus_queue.cc:1243] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:17:23.167196  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 91955.5us
I20260709 13:17:23.168438  5340 leader_election.cc:400] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12.
I20260709 13:17:23.168787  5340 leader_election.cc:403] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:23.169631  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.169922  9486 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.170456  5368 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:23.171684  5375 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:23.163908  9506 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.177281  9418 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.190268  9509 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:23.191519  9635 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.192414  9418 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:23.174165  5367 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:23.192929  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:23.171737  9702 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12.
I20260709 13:17:23.093382  9410 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:23.193902  9728 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.194069  9635 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:23.183351  9278 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.184459  9486 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:23.201710  9492 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:23.201728  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96363.5us
I20260709 13:17:23.201975  9486 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:23.203051  5414 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.832s (SENT)
I20260709 13:17:23.203500  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:23.204818  9486 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:23.210083  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.192169  9555 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.194758  9410 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.194646  9603 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:23.175366  5340 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.195353  5270 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.185672  9755 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:23.205101  5414 leader_election.cc:336] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.837s (SENT)
I20260709 13:17:23.205039  9638 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.169808  9632 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.160530  9454 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.225629  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:23.197762  9509 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:23.224141  5270 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.208475  9655 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.217289  9755 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:23.202075  9607 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:23.232962  5368 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:23.197389  9592 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:23.234766  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59544.1us
I20260709 13:17:23.224686  9617 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:23.239914  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 100886us
I20260709 13:17:23.235245  9755 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.246101  5371 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:23.243682  9486 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.241508  9617 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:23.254984  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:23.253778  9655 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.255400  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.256249  5441 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:23.254053  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.250293  5270 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:17:23.259387  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54350.4us
I20260709 13:17:23.259753  5270 catalog_manager.cc:5697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 6 to 13, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 13 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.262470  5367 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:23.263098  9702 raft_consensus.cc:2764] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:23.262673  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:23.266855  9454 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:23.268304  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.268627  9278 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.268867  9702 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:23.273463  9509 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:23.275315  9757 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:23.276738  9607 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.277413  9607 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:23.284578  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.271896  9655 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:23.280416  9758 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:17:23.287808  5519 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.290539  5515 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:23.284611  5517 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:23.292680  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.268409  9746 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:23.241140  9580 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:23.280174  9607 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:23.267077  5270 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:23.271076  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:23.277285  5414 leader_election.cc:336] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.929s (SENT)
I20260709 13:17:23.256963  9617 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.391007  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:23.391242  5367 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:23.391870  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.392201  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:23.391841  9555 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.406472  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.405758  6076 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:23.420717  5520 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:23.421061  9454 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.421061  9278 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.422221  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:23.423395  5445 raft_consensus.cc:2368] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14.
W20260709 13:17:23.423542  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 152605us
I20260709 13:17:23.424621  5441 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.425082  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:23.409490  9728 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:23.405016  9746 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:23.426203  5270 catalog_manager.cc:5697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 11 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } }
I20260709 13:17:23.450351  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.407418  9440 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.405961  9109 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.450631  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.453136  5270 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:17:23.476065  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 200127us
I20260709 13:17:23.487999  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:23.488194  5441 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:23.468017  9742 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.473809  9454 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:23.497887  9454 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.447639  9726 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:17:23.503062  5519 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.510535  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:23.482546  9592 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.507493  5270 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.519033  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.519528  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:23.532155  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.520102  5371 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:23.525473  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:23.508174  9454 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.548295  5270 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:23.537102  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 112185us
I20260709 13:17:23.536118  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:23.539475  9598 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.536s	user 0.000s	sys 0.022s
W20260709 13:17:23.539831  5414 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.042s (SENT)
I20260709 13:17:23.543166  9426 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.557472  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.536422  5446 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.562983  5441 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.565074  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:23.565846  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.566938  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:23.574867  9760 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:17:23.576498  9426 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.576790  9454 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.577824  5524 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.579047  5519 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:23.581889  9764 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:17:23.582942  5448 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:23.584529  9746 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:23.581660  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:23.589599  9763 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:23.595781  5445 raft_consensus.cc:2368] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14.
I20260709 13:17:23.592864  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.600971  5270 catalog_manager.cc:5697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 9 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 11 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.608994  5516 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.610952  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.593734  9580 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:23.564880  9598 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.568449  9755 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.618568  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.616534  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.623413  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.618270  9555 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:23.629917  9702 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:23.630467  9702 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:23.620167  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.629684  9223 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.627647  5270 catalog_manager.cc:5697] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 9 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 11 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.609675  9746 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:17:23.604967  9617 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:23.638963  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 102416us
I20260709 13:17:23.634353  9223 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:23.640780  5369 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.641053  9223 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.636140  5444 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:23.646617  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.631767  9702 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.640226  5270 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.633415  9440 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:23.636691  9109 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:23.654388  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.654896  9702 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.655835  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.653734  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.657482  5443 raft_consensus.cc:2410] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:17:23.660861  6076 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:23.667991  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.665803  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:23.671691  9632 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.671831  5270 catalog_manager.cc:5697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 6 to 13, now has a pending config: VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129), VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130), VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131), NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 13 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:17:23.675186  5270 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:23.677058  5270 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 9 to 11, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 11 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:23.678437  9598 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.678987  5270 catalog_manager.cc:5697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.682013  5270 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.651446  9591 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:23.686640  9591 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:23.687088  9591 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:23.688113  9591 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:23.689759  5414 leader_election.cc:336] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.150s (SENT)
I20260709 13:17:23.690346  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:23.683658  5270 catalog_manager.cc:5697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 10, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 10 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:17:23.697541  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.698005  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.691273  9638 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:23.664494  9522 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:23.707183  9746 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.708062  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.712247  5367 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:23.715303  5441 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:23.717376  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.719800  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.722023  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.722368  9742 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.722851  5515 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.730018  5523 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:23.731297  9728 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:23.730062  5270 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 5 to 9, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 9 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.732191  9728 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:23.703962  9617 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.746555  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.752533  9755 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.754475  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.760128  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.760671  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.761250  5369 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.763234  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.764545  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.765858  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.766351  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.767238  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.767693  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.768666  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.769273  5374 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:23.769804  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.700742  9598 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:17:23.770447  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.770982  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.771195  9598 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:23.771567  9598 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:23.772426  9598 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.772478  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.710188  9522 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:23.742156  5367 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:23.735874  9591 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.742461  9742 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:23.770454  5371 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:23.780586  5524 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:23.740532  5270 catalog_manager.cc:5697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 1 to 12. New cstate: current_term: 12 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.774906  5374 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:23.778730  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 127178us
I20260709 13:17:23.765380  5366 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
W20260709 13:17:23.785853  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.786808  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.787770  5446 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:23.788127  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:23.791364  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.791504  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:23.795439  9771 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:17:23.795995  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.800832  5369 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:23.787155  9598 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.803722  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.802958  5441 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:23.804961  5516 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:23.805811  5366 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:23.810194  9278 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:23.817921  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.821316  5446 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:23.800894  9617 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:23.801249  9109 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.828660  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:23.827760  5270 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 11 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.813674  9638 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:23.821584  9278 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:23.826728  9109 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:23.821396  9486 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.832422  9592 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:23.798981  9728 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:23.840803  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.840330  9109 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.844002  5366 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:23.845018  9278 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.851801  5515 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:23.853653  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:23.843307  5270 catalog_manager.cc:5697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 3 to 10, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.853495  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.858060  5374 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:23.858577  5270 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 10, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 10 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.860275  9486 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.869763  5270 catalog_manager.cc:5697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 5 to 8, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 8 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.871382  5270 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 9, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 9 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.874047  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.874266  9617 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:23.866843  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:23.863791  9592 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:23.857380  9638 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.864495  9728 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.881230  5270 catalog_manager.cc:5697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 12, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 12 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.891337  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.891535  6076 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEARNER]: Advancing to term 15
I20260709 13:17:23.861387  9223 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.861097  9522 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.903057  9522 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.905757  5372 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:23.909557  9769 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.133s	user 0.003s	sys 0.002s
I20260709 13:17:23.911017  6076 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 LEARNER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:23.919384  9486 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.921521  9638 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:23.922847  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 64382us
I20260709 13:17:23.922652  9592 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:23.924214  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.900890  5270 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:23.928969  9454 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.929360  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.929605  9454 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:23.883358  9617 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:23.936327  9773 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:23.939507  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.940487  5372 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:23.900149  9742 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.942468  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.932808  9506 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.946969  5447 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:23.948033  5446 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:17:23.949783  5441 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:23.950984  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:23.953776  9755 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:23.956254  9755 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:23.956763  9755 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.958654  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.959596  5369 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.961827  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.963320  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.964051  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.965135  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.965538  5374 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:23.967268  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.967893  5368 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:23.969635  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.972704  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.975988  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:23.980399  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:23.953302  9506 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:23.981091  9506 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.981786  9454 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:23.984481  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:23.985703  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:23.985965  9746 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:23.986521  5441 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:23.986979  5367 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:23.996373  5372 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:23.997375  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44314.4us
I20260709 13:17:23.998534  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:24.005306  5369 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:24.005368  5441 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:24.015496  9726 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:24.017693  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:24.018203  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:24.017647  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.978470  9223 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.027087  5374 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:24.028450  5369 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:24.029506  5375 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:24.033492  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:24.033888  9454 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.034543  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:24.034821  9486 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:24.035213  9486 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:24.035295  5441 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:24.035658  9486 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.033529  5370 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:24.036876  5373 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.035467  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:24.039213  9648 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:24.039667  9648 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.040165  9648 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:24.040593  9440 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:24.041823  9509 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:24.042033  9580 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:24.042402  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.043826  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:24.045320  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.047072  9410 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:24.053135  5372 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:24.053857  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:24.054579  5368 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:24.055176  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:24.057222  9592 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:24.045604  9454 raft_consensus.cc:2764] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:24.058048  9592 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:24.060065  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.060549  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:24.060681  5445 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.061246  5446 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:24.045146  9638 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.057279  5340 leader_election.cc:400] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:24.066434  5340 leader_election.cc:403] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:24.053871  9410 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:24.072288  9454 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:24.081530  9774 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:17:24.081725  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:24.082536  9638 raft_consensus.cc:2764] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:24.083587  9726 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.084193  9726 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:24.069464  5489 connection.cc:256] RPC call timeout handler was delayed by -1.953188511999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:17:24.086913  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.087138  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.087690  5515 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:24.087746  5523 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:24.089028  5519 raft_consensus.cc:1217] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:17:24.089615  5519 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:24.089923  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.090529  5447 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.090670  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.091989  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.093763  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.094173  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.094696  5518 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.094969  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.095619  5523 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:24.095803  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.096196  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.096240  9755 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.096534  5517 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:24.098062  9109 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.095708  5448 pending_rounds.cc:85] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 6
I20260709 13:17:24.099749  5448 pending_rounds.cc:107] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:24.100363  5448 raft_consensus.cc:2889] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.100292  9486 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.070214  9591 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
W20260709 13:17:24.070959  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.556s (SENT) [suppressed 49 similar messages]
W20260709 13:17:24.112366  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45139.6us
I20260709 13:17:24.112282  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.119082  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.120134  5445 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:24.121518  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.121866  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.124807  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:24.125949  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:24.123458  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52524.2us
I20260709 13:17:24.112028  9109 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.112028  9726 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.122416  9702 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.124043  9426 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.134940  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:24.137955  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:24.142309  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 85196.9us
I20260709 13:17:24.144904  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:24.145085  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:24.069216  9617 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.146168  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:24.151098  5414 leader_election.cc:336] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.635s (SENT)
I20260709 13:17:24.151608  9440 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.151772  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.152058  9440 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.152463  9440 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.155040  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.158452  5516 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:24.160616  5445 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.142364  9638 raft_consensus.cc:2764] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:24.164322  5447 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:24.145921  9598 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:24.172158  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.175688  9755 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.166493  9410 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:24.179077  9410 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.179522  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.180577  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.180877  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.181305  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.181490  5515 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:24.135582  9418 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:24.132798  9509 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:24.182646  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.183622  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.169036  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.186955  5518 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:24.166914  9426 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.171782  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.189749  5449 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:24.174803  9109 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:17:24.191217  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.195931  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.154475  9702 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.199716  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.200655  5521 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:24.185976  9638 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.202185  9702 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.196233  9486 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.198515  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.199142  9726 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.205808  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:24.207145  9778 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:24.172294  9598 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:24.209558  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:24.222067  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:24.212072  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86233us
I20260709 13:17:24.227101  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:24.228250  9794 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:24.228377  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:24.242806  9784 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:24.244397  9486 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.245000  9486 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.245482  9486 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.246059  5449 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:24.247498  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.248311  5524 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
W20260709 13:17:24.250491  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 60137.1us
I20260709 13:17:24.251616  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:24.252632  9109 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.254258  9506 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.255801  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:24.257493  9702 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:24.258096  9702 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:24.258231  9591 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.260037  9702 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.269551  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.224267  9598 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.270253  5523 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.263361  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:24.249255  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.229053  9794 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:24.275876  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:24.278879  5519 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:24.283563  9698 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:24.284655  9698 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:24.285737  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.277892  9794 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.286701  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.287128  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.287895  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.288266  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.288718  5517 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:24.285617  9418 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:24.289489  9509 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:24.289912  9509 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:24.290714  9789 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:24.291231  9789 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:24.290791  9509 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.292575  9509 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.292712  9789 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.294178  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.285640  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:24.298698  5515 raft_consensus.cc:606] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:24.309634  5515 raft_consensus.cc:614] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:24.298799  9648 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.311286  5520 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 16. Ops: []
I20260709 13:17:24.313017  9648 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:24.294521  9789 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:24.300040  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 156588us
W20260709 13:17:24.314489  5414 leader_election.cc:336] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.697s (SENT)
I20260709 13:17:24.314922  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.300431  9506 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.294198  9755 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:24.318804  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:24.318872  9755 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:24.319465  5520 raft_consensus.cc:606] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.319836  5520 raft_consensus.cc:614] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:24.320363  9426 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:24.283610  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:24.301365  9109 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.321593  9109 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:24.321996  9109 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.302141  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.302428  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:24.302847  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.280179  9454 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:24.306293  9418 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:24.306555  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68259.1us
I20260709 13:17:24.299542  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.329957  5523 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:24.333797  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:24.336849  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d883e5d309d4113a821624777a85d05"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:24.337519  5523 raft_consensus.cc:606] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:24.340667  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.338416  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54881.9us
I20260709 13:17:24.345595  5518 raft_consensus.cc:2410] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:24.351016  6076 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:24.350414  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.336751  9418 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:24.280580  9440 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:24.358206  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.357860  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:24.347502  9509 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:24.363101  9426 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:24.363677  9426 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:24.364581  9426 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.367257  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:24.368254  5523 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:24.368512  9598 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.368846  9787 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:24.370016  9787 consensus_queue.cc:1243] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:24.319936  9755 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.370711  9638 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:24.350407  9635 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:17:24.371119  9638 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:24.371627  9454 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:24.355165  9580 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:17:24.373106  9648 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.352573  9698 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:17:24.372684  9638 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:24.370724  5521 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:24.376991  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.377697  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.336150  9486 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.393253  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:24.398700  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:24.399871  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.349239  9794 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.404210  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:24.405998  5442 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.402930  9223 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:17:24.379087  9698 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:24.403733  9635 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:17:24.410029  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 64500.4us
I20260709 13:17:24.400974  9788 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.420039  5446 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.389894  9702 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:17:24.414119  9454 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:24.421737  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:24.431751  9755 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.431980  9486 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.433795  5442 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:24.413440  9698 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:24.435992  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 85645.4us
I20260709 13:17:24.414911  9635 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:24.448740  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:24.443701  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.455683  5446 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.416285  9418 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.457811  9486 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.458585  9486 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.458870  9418 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.486547  9591 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:24.448041  9698 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.434875  9522 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:17:24.488910  9788 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:24.489486  9788 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.488984  9698 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.490801  9440 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:24.442091  9509 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:24.497571  5373 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:24.427379  9454 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:24.499187  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
W20260709 13:17:24.499786  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 51130.3us
I20260709 13:17:24.448096  9638 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.503410  9800 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:24.501833  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.505756  5448 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:24.504379  9440 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:24.511783  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 67338.9us
I20260709 13:17:24.516667  9635 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.517863  9635 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:24.522729  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.526273  9800 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:24.526769  9532 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:24.537560  9532 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:24.537916  9509 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.538687  9532 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:24.540042  9532 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.524610  9592 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:24.529058  9800 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:24.533778  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.527120  9454 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.534765  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.542830  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.547142  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:17:24.522919  9580 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.551405  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.523132  9555 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:24.554224  5446 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:24.543803  9592 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:24.558867  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 46113.8us
I20260709 13:17:24.560232  9555 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:24.562791  9555 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:24.560415  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.565207  5449 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:24.565730  9801 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:24.568009  9592 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:24.569964  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.570753  5442 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.572438  9648 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.573392  5522 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.574553  5448 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:17:24.574975  5448 pending_rounds.cc:85] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 8
I20260709 13:17:24.575204  5448 pending_rounds.cc:107] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:17:24.575434  5448 raft_consensus.cc:2889] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.547576  9486 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.553020  9580 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:17:24.584331  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 137147us
I20260709 13:17:24.593667  5489 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.547026  9109 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.595638  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.603693  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:24.604388  5371 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.605052  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.605811  5441 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.606544  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:24.607093  5367 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:24.585846  9592 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:24.610960  5370 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:24.586948  9580 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.599280  9454 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.628160  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:24.626989  5414 leader_election.cc:336] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.708s (SENT)
I20260709 13:17:24.628872  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.635860  5449 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.631597  9803 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.623427  9794 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.648363  5372 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:24.657037  9795 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:17:24.657502  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.660816  5443 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:24.633693  9810 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:17:24.673496  6076 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:24.673872  9804 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:17:24.643366  9806 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:24.682564  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.685566  5441 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:24.675470  9109 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.692684  5371 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:24.694707  5367 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:24.696568  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.693269  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.701977  5443 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.646571  9801 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:24.715427  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:24.716324  5444 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:24.728240  5442 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:24.732685  9598 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:24.742372  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.721312  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 127989us
I20260709 13:17:24.760160  5449 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:17:24.759279  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.763507  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.760671  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.765758  5444 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:24.754455  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.769017  5518 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:24.776669  9702 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:24.780586  9808 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:24.787015  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:24.715315  9755 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:24.789897  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:24.790788  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:24.796590  5447 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:24.794337  5441 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:24.806684  5449 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:24.794335  9755 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:24.756734  9788 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.813329  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:24.823796  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.820421  9755 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:24.826908  9755 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:24.828821  9755 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.831305  5450 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.831656  9788 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:24.833056  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.835294  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.836900  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.839546  5447 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:24.844681  6076 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:24.851158  5450 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.853009  5450 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:24.856490  5450 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:24.854457  5449 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:24.891729  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.893304  5446 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:24.893481  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:24.893757  5449 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:24.894238  5450 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:24.891692  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:24.895466  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.848232  9806 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:24.931533  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.931660  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.932335  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:24.932618  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.937788  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.945345  5367 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:24.946790  5367 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:24.946648  9815 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:24.947417  9617 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.947609  9815 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:24.948004  9815 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:24.949105  5371 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:24.954833  9648 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.955713  9648 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.948109  5367 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.942354  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:24.962335  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:24.964620  5372 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:24.968350  9813 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:17:24.947959  9617 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:24.970947  9648 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:24.971117  9814 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:24.838364  9801 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:24.979133  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.979789  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 88277.3us
I20260709 13:17:24.982736  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.990279  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:24.949129  9794 raft_consensus.cc:2764] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:25.003755  9648 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.007757  5522 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:25.019857  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:24.992833  9810 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:24.994064  9789 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:25.026566  5450 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:25.010010  9410 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.016386  9803 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:17:25.016177  9787 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:25.039829  9817 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:17:25.040395  9812 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 13:17:25.040261  9819 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:25.040724  9440 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:25.041491  5521 raft_consensus.cc:606] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:25.042227  5441 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:25.038878  9806 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:25.050071  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:25.040940  9800 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:17:25.052361  5450 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:24.949144  9815 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.047415  5444 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:17:25.061041  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78251.1us
I20260709 13:17:25.062258  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:25.067754  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48594us
I20260709 13:17:25.068763  5489 leader_election.cc:400] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14.
I20260709 13:17:25.068646  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:25.077203  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.048884  9810 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:25.059799  9789 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:25.076756  9698 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.000s
I20260709 13:17:25.106986  5444 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:25.131841  5443 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:25.133509  5447 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:25.134087  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65287.5us
I20260709 13:17:25.070034  9418 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:25.138945  5441 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:25.050544  9410 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:25.093818  9806 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.059943  9509 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 13:17:25.149080  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 143554us
W20260709 13:17:25.142211  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45584.3us
I20260709 13:17:25.141957  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:25.142732  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 80105.3us
I20260709 13:17:25.132669  9815 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.107712  9109 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.150337  5448 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:25.152989  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:25.154299  5444 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:25.154444  5371 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:25.155719  5443 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:25.155928  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:25.156562  5368 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.139501  9418 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:25.167054  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:25.173741  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:25.174677  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:25.148830  9638 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:25.192922  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.209040  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:25.209661  5372 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:25.211673  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67599us
I20260709 13:17:25.215502  5375 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:25.220259  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:25.226042  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75306.1us
I20260709 13:17:25.187683  9806 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:25.245169  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:25.146986  9810 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.224757  9454 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:25.249300  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 64599.9us
I20260709 13:17:25.169260  9109 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.252696  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:25.246115  9702 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:25.251564  9827 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:17:25.282804  5340 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:25.250612  9806 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:25.280438  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:25.279320  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 98533.8us
I20260709 13:17:25.307060  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.285327  9592 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:25.287871  9811 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:25.328259  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:25.329932  5521 raft_consensus.cc:606] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:25.330495  5521 raft_consensus.cc:614] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:25.290316  9648 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:25.290728  9828 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:17:25.290987  9598 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:25.340965  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.293779  9824 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:17:25.298844  9410 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:25.256699  9746 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.321120  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:25.339628  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:25.237172  9789 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.349938  5447 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:17:25.352690  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:25.282352  9788 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:25.353962  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47046.3us
I20260709 13:17:25.356966  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.358773  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.352996  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:25.336764  9702 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.361176  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:17:25.362915  9822 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.236s	user 0.000s	sys 0.003s
I20260709 13:17:25.366182  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:25.371135  9819 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:25.371798  9819 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:25.373072  9819 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.375185  9819 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.378388  9807 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:25.379184  9807 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:25.328729  9811 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:25.343204  9555 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.348451  9580 consensus_meta.cc:287] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.004s
I20260709 13:17:25.331827  9831 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.363169  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:25.332089  9648 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:25.390916  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:25.391959  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 123646us
I20260709 13:17:25.343987  9426 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.275930  9418 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.352118  9794 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.407446  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:25.414258  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:25.416167  5489 leader_election.cc:400] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14.
I20260709 13:17:25.421481  5489 leader_election.cc:403] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:25.365079  9598 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:25.388597  9278 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.385522  9486 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.415693  9532 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.426120  5373 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:25.380752  9807 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.430761  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:25.446136  5371 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:25.431749  9794 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.437013  5375 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:25.397161  9591 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:25.420472  9803 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:25.405862  9746 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:25.408330  9580 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:25.445628  9223 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.409725  9555 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.450301  9598 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:25.450878  9617 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.455582  9418 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.479259  9807 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.454972  9591 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:25.420887  9426 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.501019  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.470067  9830 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.296s	user 0.000s	sys 0.002s
I20260709 13:17:25.457507  9532 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:25.462698  9803 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:25.461205  9509 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14.
I20260709 13:17:25.266116  9698 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:17:25.466156  9486 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.509371  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.440049  9831 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:25.519122  5368 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:25.529059  5367 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:25.519692  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 112701us
I20260709 13:17:25.530079  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:25.530345  5375 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:25.523144  9845 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:25.531148  9845 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.535460  9845 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.537474  9592 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.538096  9592 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.540813  9592 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:25.543252  9818 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.400s	user 0.002s	sys 0.001s
W20260709 13:17:25.548815  9825 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.326s	user 0.000s	sys 0.002s
I20260709 13:17:25.512461  9591 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.504412  9223 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:25.554468  9800 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.558257  9532 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.525964  9803 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.462335  9811 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.563330  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 204631us
I20260709 13:17:25.508390  9648 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.564913  9841 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:25.565568  9486 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:25.566221  5373 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:25.566673  9823 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:17:25.496640  9794 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:25.570845  9410 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.512838  9843 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:25.576452  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.550881  9109 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:25.623646  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 188714us
I20260709 13:17:25.576310  9454 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.462141  9806 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.626948  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 222723us
W20260709 13:17:25.629683  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51898.2us
I20260709 13:17:25.624306  9794 consensus_queue.cc:1243] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:25.630728  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.632174  9638 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.638697  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:25.642760  9820 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.617s	user 0.001s	sys 0.003s
W20260709 13:17:25.643025  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 113152us
I20260709 13:17:25.644227  9486 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:25.645587  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.624396  9843 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.647053  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:25.644369  9826 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.496s	user 0.000s	sys 0.003s
I20260709 13:17:25.652181  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2342) took 1048 ms. Trace:
I20260709 13:17:25.653978  5374 rpcz_store.cc:276] 0709 13:17:24.596520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.596631 (+   111us) service_pool.cc:224] Handling call
0709 13:17:24.596959 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.600841 (+  3882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.600870 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.626258 (+ 25388us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.644284 (+ 18026us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:24.809260 (+164976us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:24.809326 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.809444 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.423572 (+614128us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:25.645037 (+221465us) raft_consensus.cc:1685] finished
0709 13:17:25.645061 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.645199 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4103,"raft.run_cpu_time_us":4168,"raft.run_wall_time_us":42531,"spinlock_wait_cycles":19620352,"thread_start_us":155863,"threads_started":1,"wal-append.queue_time_us":301584}
I20260709 13:17:25.655313  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.656075  9440 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:25.627703  9410 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:25.657505  9842 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:17:25.657790  9835 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:25.658268  9835 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:25.658694  9835 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.659374  9410 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.660495  9555 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.661471  9580 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:25.647491  9617 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.630245  9598 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.662838  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:25.663455  5515 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:17:25.658293  9836 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:17:25.657526  9440 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:25.665608  9746 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:25.672907  9811 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:25.676051  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.677068  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.637812  9794 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:25.687021  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:25.696194  6076 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:25.685534  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.700258  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:25.653455  9486 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.705447  5445 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:17:25.699565  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:25.702941  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.699991  9555 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.651122  9843 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.708860  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:25.707345  9454 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.709801  9426 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.711186  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:25.712215  9454 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.712659  9454 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.713104  9454 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:25.718192  9848 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:25.720484  9580 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.721009  9580 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:25.721364  9580 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.686530  9836 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:25.703480  9794 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.686189  9223 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.722229  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:25.723780  9794 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.723919  9109 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:17:25.733981  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57002.6us
I20260709 13:17:25.737469  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:25.748812  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.724706  9109 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:17:25.726483  9555 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:25.758878  6076 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:25.763314  6042 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:25.764858  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:25.765552  5443 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:25.765916  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:25.766947  5447 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:25.770589  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:25.771476  5447 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:25.772689  9853 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:25.773700  9834 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 13:17:25.774402  9844 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:17:25.777124  9410 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:25.779422  9410 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.779788  9410 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.742396  9849 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:25.734552  9454 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:25.758167  9598 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.754122  9702 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:17:25.799226  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 99702.6us
I20260709 13:17:25.806396  9454 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:25.793638  9849 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:25.792044  9598 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.811756  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:25.784412  9591 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.803241  9755 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.968s	user 0.014s	sys 0.003s
I20260709 13:17:25.813706  9109 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:25.813830  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:25.816685  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:25.818153  9109 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.804203  9746 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.818688  9109 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.820304  5366 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:17:25.814617  9850 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:17:25.820780  9223 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:25.825518  9223 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.825902  9223 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.821399  9746 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.815488  9598 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.819535  9278 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.837617  9278 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.838078  9278 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.834360  9648 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:25.840591  9854 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.119s	user 0.000s	sys 0.003s
I20260709 13:17:25.814961  9849 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.842936  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:25.844086  6073 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:25.835585  9851 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
I20260709 13:17:25.847059  9835 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.830799  9815 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.001s
I20260709 13:17:25.863027  9835 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:25.874127  9109 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.877323  9109 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.810026  9555 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.881357  9861 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:25.885095  9278 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.887444  9278 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.869038  9746 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.870962  9580 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.899998  9746 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.900856  9580 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:25.900895  9746 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.889101  9803 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.885145  9591 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.911270  6073 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:25.922086  9746 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.924250  9803 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:25.941099  9598 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.956539  5414 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.556s (SENT)
I20260709 13:17:25.957116  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:25.963867  9806 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.904945  9410 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:25.965674  9598 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:25.904945  9223 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:25.974028  9868 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:17:25.979611  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:25.980252  5447 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:25.982719  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:25.983049  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:25.984985  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:25.985111  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:25.985704  5449 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.985788  5444 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.987362  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:25.987998  5446 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.990814  9836 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:25.991308  9836 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:25.992318  9836 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.995069  9837 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.995692  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.995596  9837 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.996843  9635 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:25.998256  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.999464  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 254373us
I20260709 13:17:26.000119  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:26.001283  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:26.002767  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:26.003849  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:26.004045  9789 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.004488  9789 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:26.004870  9789 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.005115  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.005859  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.005802  5519 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:26.006610  9801 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:26.006904  9648 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:26.007107  9801 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:26.007457  9648 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:26.008159  9801 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.008401  9648 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:25.996980  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:26.006081  9580 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:26.010156  9580 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:26.010557  9580 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.010588  9838 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:26.011122  9838 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.011490  9838 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.011682  5518 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:26.005743  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34856 (request call id 7) took 20047 ms. Trace:
I20260709 13:17:26.014503  9418 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:26.014962  9800 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:26.016130  9418 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:26.016211  9698 rpcz_store.cc:276] 0709 13:17:05.958106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.961148 (+  3042us) service_pool.cc:224] Handling call
0709 13:17:05.975867 (+ 14719us) log.cc:844] Serialized 499 byte log entry
0709 13:17:26.005617 (+20029750us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":467,"raft.run_cpu_time_us":1817,"raft.run_wall_time_us":1816}
I20260709 13:17:26.021073  9831 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:26.026633  9486 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.977964  9454 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.027706  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:26.028206  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.029753  5517 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.033154  5444 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:26.044441  5447 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:26.045337  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.043670  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60683.4us
W20260709 13:17:26.033704  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55399.5us
I20260709 13:17:26.035454  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.036686  5374 pending_rounds.cc:85] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 7
I20260709 13:17:26.049219  5374 pending_rounds.cc:107] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:26.049625  5374 raft_consensus.cc:2889] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.039575  5367 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:26.052596  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.053220  5444 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.053539  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:26.039474  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:26.028954  5414 leader_election.cc:336] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.676s (SENT)
W20260709 13:17:26.056128  5414 leader_election.cc:336] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.514s (SENT)
I20260709 13:17:26.056527  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:26.056648  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:25.997279  9836 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.047624  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:26.062598  9870 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:17:26.070411  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.070508  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.071473  5373 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:26.071352  5444 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:17:26.072121  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.074667  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:26.069203  9532 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.977959  9806 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:26.077368  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.090771  5521 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:26.090794  5369 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:17:26.091398  5524 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:26.077376  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.086512  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81124.8us
I20260709 13:17:26.043489  9815 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:26.091259  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:26.093626  5449 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:26.044831  9223 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:26.098897  9109 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:26.099413  9109 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:26.065126  9853 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:26.100054  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:26.104475  5414 leader_election.cc:336] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.749s (SENT)
I20260709 13:17:26.103008  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:26.073014  9794 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:26.104954  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:26.103574  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.106375  5446 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:26.064924  9278 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:17:26.107777  5447 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:26.107987  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:26.084326  9837 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:26.087529  9532 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.117664  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:26.114118  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:26.097893  9842 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.119257  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.115658  9109 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.117136  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:26.097975  9815 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:26.073745  9454 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.101800  9638 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:26.123204  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:26.075644  9486 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:26.101082  9806 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:26.133510  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.140362  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:26.122010  9223 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.156515  5443 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 6.
I20260709 13:17:26.119977  9532 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.119846  9857 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.159373  9635 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.160702  9486 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:26.157487  9849 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:26.167956  9410 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:26.124861  9598 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:26.169556  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:26.205401  6073 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
W20260709 13:17:26.170343  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.119916  9702 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:26.170471  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:26.123960  9803 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:26.173684  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.208503  5447 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.180652  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.160709  9806 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:26.228039  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44595.8us
I20260709 13:17:26.229619  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:26.187125  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 88072.8us
I20260709 13:17:26.187783  9486 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.234287  5447 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10.
I20260709 13:17:26.190245  5368 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:26.235690  6042 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:26.149633  9638 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:26.236011  5414 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.618s (SENT)
I20260709 13:17:26.236135  9789 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.236565  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:26.194788  9838 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.196393  9815 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.237879  9638 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:26.238114  9815 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.238831  9838 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:26.183291  9857 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.206802  5517 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:26.241004  9857 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:26.206869  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:26.236649  9831 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:26.148962  9555 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:26.204242  9849 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:26.207911  9800 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.177579  9223 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.323889  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.325641  5521 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:26.227443  9698 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.326373  5446 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:26.327685  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 120930us
I20260709 13:17:26.246052  9598 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:26.343461  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 100119us
W20260709 13:17:26.345556  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 109565us
I20260709 13:17:26.244012  9794 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:26.349496  6042 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:26.332582  9811 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.000s
I20260709 13:17:26.242326  9852 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:17:26.360353  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:26.361255  5366 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.369732  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.325543  9702 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:26.283314  9857 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:17:26.328302  9831 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:26.382915  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.383695  5517 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:26.384756  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.390625  6076 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:26.394316  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.394374  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.398285  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.398561  5516 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:26.399945  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.400740  5517 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.382694  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.403359  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.404819  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.408274  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.408699  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.409678  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.412159  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.350154  9638 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.412026  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.351431  9806 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:26.420322  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.419376  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.418324  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.431783  5368 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:17:26.425355  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.426302  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.367437  9742 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.328136  9800 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.335254  9698 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.437974  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.395711  9591 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.448273  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.463516  5517 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10.
W20260709 13:17:26.435295  9818 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:26.349735  9838 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:17:26.466877  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:26.446919  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.497087  5516 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:26.372731  9837 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:17:26.494300  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:26.477671  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.372363  9810 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:17:26.485692  5524 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:26.467502  9830 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:17:26.524271  9810 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.525029  9810 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:26.527859  9810 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:26.528612  9887 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.509443  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.529458  9887 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:26.507498  5522 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:26.518577  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:26.534572  9837 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:26.538538  9810 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:26.541585  9810 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:26.541925  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:26.538192  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.544948  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.513592  9794 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:26.467933  9509 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.545845  5368 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:26.578842  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:26.550848  5373 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:26.555558  9109 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.580765  9109 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:26.542785  9810 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.589694  9887 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:26.589959  9810 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.590114  9109 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:26.590582  9887 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:26.591130  9887 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.594290  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:26.596163  5446 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:26.597713  5443 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.599627  5448 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:26.601233  5447 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:26.603211  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.603933  5443 raft_consensus.cc:2368] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:26.447680  9742 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.444584  9806 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:26.578945  9843 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.858s	user 0.006s	sys 0.004s
I20260709 13:17:26.619400  5447 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:26.516863  9555 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:26.625123  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:26.413733  9702 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.467679  9591 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.550479  9426 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.549975  9889 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.242491  9819 consensus_queue.cc:1175] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b781c7e31b7145aea647a7ff649e6ac7" responder_term: 12 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:26.555102  9789 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:26.550078  9879 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:26.626987  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 192630us
I20260709 13:17:26.636965  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.638078  5449 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:26.442046  9849 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.641566  9897 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.665246  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet e3f62ebef8b04990ab6f34443d897c80: Illegal state: Replica 544c82a50cc4477886bb6f7d58f455ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:26.666363  9897 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.667601  9833 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:26.668062  9833 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.668432  9833 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:26.668692  9897 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:26.671778  9223 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:26.672988  9884 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:26.673779  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.642689  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.611092  9454 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:26.675691  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.677577  5446 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.545797  9837 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:26.469355  9598 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:26.671905  9880 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:17:26.685741  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:26.622411  5448 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:17:26.596630  9509 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.596930  9811 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:17:26.625160  9876 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:26.690519  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:26.691170  5449 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:26.612624  9887 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:26.602922  9831 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:26.706301  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:26.673215  9698 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:26.711351  5520 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:17:26.713763  5371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.016s	sys 0.031s
W20260709 13:17:26.715134  5371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.016s	sys 0.031s
I20260709 13:17:26.723884  5446 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:26.631907  9843 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:26.690891  9876 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.730849  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:26.739835  5445 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:26.729259  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:26.742702  5446 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:26.748533  5489 leader_election.cc:400] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:26.749027  5489 leader_election.cc:403] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:26.752054  9838 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:26.752310  9892 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:26.753845  9838 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10.
I20260709 13:17:26.755159  9109 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:26.771385  5446 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:26.776934  5445 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:26.789292  5446 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:26.661989  9889 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.727516  9894 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:26.766503  9801 raft_consensus.cc:1064] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:17:26.797561  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.747300  9887 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.804139  5414 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.619s (SENT)
W20260709 13:17:26.937774  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 133691us
W20260709 13:17:26.881886  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 90234.1us
I20260709 13:17:26.685864  9879 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.883414  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:26.940244  5523 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:26.730419  9876 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:26.908818  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:26.941568  6073 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:26.731281  9898 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.714978  9789 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:17:26.747077  9698 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 13:17:26.794641  9863 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:26.910804  6043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.024s	sys 0.093s
W20260709 13:17:26.943347  6043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.026s	sys 0.100s
W20260709 13:17:26.943733  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 589397us
W20260709 13:17:26.800465  9853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.012s	sys 0.009s
I20260709 13:17:26.781369  9892 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 13:17:26.811661  9894 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:26.935316  9880 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:17:26.726219  9555 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:26.948742  9853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.013s	sys 0.009s
I20260709 13:17:26.947491  9863 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:27.000104  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 273089us
I20260709 13:17:26.955418  9800 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:26.989250  9853 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:26.990986  9897 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.990298  9895 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.010018  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 259326us
I20260709 13:17:27.015216  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:26.953341  9887 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:26.984184  9806 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:26.980904  9901 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:27.026407  5366 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.000s
I20260709 13:17:27.027647  5447 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:27.035532  5366 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:27.023597  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:26.999614  9899 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.039943  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:27.040232  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:27.043479  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:27.045339  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:27.006197  9742 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.050860  5368 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:27.018823  9897 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.053776  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:27.059945  5368 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:27.007920  9698 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:27.060060  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:27.026932  9800 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:26.961678  9837 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:27.035151  9591 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:27.085033  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 142630us
I20260709 13:17:27.061852  9509 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:27.103567  9900 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.381s	user 0.003s	sys 0.000s
I20260709 13:17:27.102680  9801 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:27.062135  9698 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:27.107378  9914 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.065447  9852 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:27.047315  9901 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.022431  9895 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.108108  9914 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:27.114071  9887 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.116120  9914 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.116189  9895 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.108335  9852 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.117822  9852 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:27.118263  9893 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:17:27.120710  9811 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:27.108920  9807 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.587s	user 0.011s	sys 0.002s
I20260709 13:17:27.123374  9907 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.123963  9907 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:27.124480  9635 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.923s	user 0.009s	sys 0.000s
I20260709 13:17:27.124900  9635 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.056272  9899 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:27.125576  9853 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.127909  9899 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:27.107755  9698 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.091259  9863 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.130079  9698 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.131027  9897 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:27.131942  9580 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.121s	user 0.006s	sys 0.007s
I20260709 13:17:27.132432  9580 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.062561  9806 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.134413  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 195330us
I20260709 13:17:27.135145  6073 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:27.135303  5519 raft_consensus.cc:2410] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:17:27.135949  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92558.7us
I20260709 13:17:27.136785  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:27.135475  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:27.144451  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48217.5us
I20260709 13:17:27.146195  5521 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:27.146087  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:27.146601  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:27.147125  5523 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
W20260709 13:17:27.129297  9532 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.946s	user 0.008s	sys 0.001s
I20260709 13:17:27.085644  9906 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:27.099130  9843 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:27.151885  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:27.161166  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:27.162499  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:27.138378  9742 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:17:27.137975  9850 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:17:27.166115  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 222070us
I20260709 13:17:27.168076  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:27.152486  9794 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:27.165163  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:27.167126  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:27.198473  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:27.142091  9897 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:27.159868  9901 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.144273  9806 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.152498  9532 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.207522  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
W20260709 13:17:27.201597  9903 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:17:27.152249  9895 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:17:27.178524  9857 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.178766  9889 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.202740  9509 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:27.203536  9789 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:27.223173  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 63450.6us
W20260709 13:17:27.221832  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53852.9us
W20260709 13:17:27.230731  5369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.009s	sys 0.020s
I20260709 13:17:27.231853  5367 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 13:17:27.229405  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56871.3us
I20260709 13:17:27.234942  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:27.234064  5369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.010s	sys 0.021s
I20260709 13:17:27.213673  9454 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:27.226958  9902 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:17:27.231045  9835 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:27.166007  9906 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.252691  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:27.255118  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:27.255540  5366 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:27.232580  9810 consensus_meta.cc:287] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.000s
I20260709 13:17:27.231506  9914 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:27.232371  9889 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:27.263979  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.253374  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:27.232147  9789 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.232703  9922 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.310777  6076 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:27.282656  5374 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:17:27.316823  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:27.277755  9835 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.322160  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:27.256613  9907 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.328600  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:27.278877  9794 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.391825  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:27.277325  9914 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.393090  5515 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:27.392056  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:27.395364  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:27.413230  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 214614us
I20260709 13:17:27.281289  9509 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:27.310940  9789 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.442502  5366 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10.
I20260709 13:17:27.442790  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1876) took 1463 ms. Trace:
W20260709 13:17:27.438480  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 183455us
W20260709 13:17:27.405750  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 238715us
W20260709 13:17:27.250342  9648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.008s	sys 0.009s
I20260709 13:17:27.250725  9801 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 13:17:27.250818  9899 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 13:17:27.322119  9897 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.444880  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:27.443202  5441 rpcz_store.cc:276] 0709 13:17:25.979508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.979641 (+   133us) service_pool.cc:224] Handling call
0709 13:17:25.979952 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.019889 (+ 39937us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:26.027619 (+  7730us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.152152 (+124533us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b2c0003b228. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:17:26.158042 (+  5890us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.704075 (+546033us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:26.704135 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.704229 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.437549 (+733320us) raft_consensus.cc:1685] finished
0709 13:17:27.437576 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.442725 (+  5149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4341,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":4296064,"thread_start_us":486781,"threads_started":1,"wal-append.queue_time_us":546006}
W20260709 13:17:27.448554  9648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.008s	sys 0.017s
I20260709 13:17:27.393832  9835 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.393622  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:27.393512  9905 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.285027  9901 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.154s
I20260709 13:17:27.397414  9454 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:27.376436  9879 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.439993  9914 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:27.451193  9833 consensus_meta.cc:287] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.005s
I20260709 13:17:27.452806  9850 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.509367  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:27.509145  9815 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.270s	user 0.019s	sys 0.000s
I20260709 13:17:27.314432  9920 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.183s
I20260709 13:17:27.458065  9887 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.576114  5372 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:27.576694  5441 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:27.396440  9889 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.113s
W20260709 13:17:27.610709  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.509193  9897 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:27.616407  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.614387  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:27.622774  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:27.624560  5441 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:27.376654  9922 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.636185  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:27.636958  5441 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:17:27.449512  9876 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:27.572077  9879 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:27.508558  9811 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.108s
W20260709 13:17:27.630357  9852 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.512s	user 0.016s	sys 0.001s
I20260709 13:17:27.615723  9898 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.543058  9454 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:17:27.675336  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 230529us
I20260709 13:17:27.676612  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:27.680687  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:27.682379  5441 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:27.637480  9532 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.680359  9837 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:27.591437  9850 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.687834  9837 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.657902  9806 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.580623  9833 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:27.671016  9944 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:27.705806  9807 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.638188  9897 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.715691  6076 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 LEARNER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:17:27.691855  9836 consensus_meta.cc:287] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.622s	user 0.015s	sys 0.001s
I20260709 13:17:27.720996  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1897) took 1328 ms. Trace:
I20260709 13:17:27.720302  9807 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.727943  9833 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:27.703907  9648 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.630841  9509 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.721524  5522 rpcz_store.cc:276] 0709 13:17:26.387761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.411582 (+ 23821us) service_pool.cc:224] Handling call
0709 13:17:27.715923 (+1304341us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b540025d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:27.716089 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113532800}
I20260709 13:17:27.708890  9592 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.736508  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:27.739970  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:27.740592  5366 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:27.743397  9918 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:17:27.744215  9897 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.744937  9592 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:27.745635  9930 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:17:27.747375  9919 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:17:27.747638  9592 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.748397  9911 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:27.748554  9592 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:27.749125  9592 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.749511  9580 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:27.749773  9592 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:27.750039  9923 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:17:27.674239  9852 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.752743  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34856 (request call id 9) took 1047 ms. Trace:
I20260709 13:17:27.754264  9852 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:27.755976  9921 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:17:27.757752  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2294) took 1085 ms. Trace:
I20260709 13:17:27.759367  9850 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.758177  5445 rpcz_store.cc:276] 0709 13:17:26.672051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.795864 (+123813us) service_pool.cc:224] Handling call
0709 13:17:26.796384 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.881226 (+ 84842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.881275 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.882227 (+   952us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.167765 (+285538us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.208248 (+ 40483us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.457609 (+249361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.457697 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.757502 (+299805us) raft_consensus.cc:1685] finished
0709 13:17:27.757527 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.757684 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14379,"prepare.queue_time_us":85826,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":71725,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":50915,"thread_start_us":452051,"threads_started":2,"wal-append.queue_time_us":346833}
I20260709 13:17:27.759966  9850 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:27.760370  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:27.761161  5445 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.761732  9922 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:27.760457  9698 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.001s
W20260709 13:17:27.762866  9904 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.044s	user 0.009s	sys 0.000s
I20260709 13:17:27.764658  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1870) took 1787 ms. Trace:
I20260709 13:17:27.765750  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2278) took 1165 ms. Trace:
I20260709 13:17:27.711772  9899 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:27.765033  5442 rpcz_store.cc:276] 0709 13:17:25.977703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.980231 (+  2528us) service_pool.cc:224] Handling call
0709 13:17:25.995167 (+ 14936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.995511 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.995537 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.203483 (+207946us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b2c0003b228. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:17:26.227864 (+ 24381us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.710329 (+482465us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:26.768661 (+ 58332us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.768971 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.769066 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.762067 (+993001us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:27.764430 (+  2363us) raft_consensus.cc:1685] finished
0709 13:17:27.764451 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.764600 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63980,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":8967,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":12182,"spinlock_wait_cycles":102359040,"thread_start_us":376079,"threads_started":1,"wal-append.queue_time_us":434272}
I20260709 13:17:27.767997  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2295) took 1095 ms. Trace:
W20260709 13:17:27.773758  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 159436us
I20260709 13:17:27.774034  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2296) took 1101 ms. Trace:
W20260709 13:17:27.738360  9831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.004s	sys 0.015s
I20260709 13:17:27.798578  9454 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
W20260709 13:17:27.798933  9831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.004s	sys 0.015s
I20260709 13:17:27.760541  9850 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:27.709842  9811 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:27.801770  9811 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.802042  9835 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.802879  9850 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:27.804061  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2378) took 1599 ms. Trace:
I20260709 13:17:27.753163  5516 rpcz_store.cc:276] 0709 13:17:26.705296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.705847 (+   551us) service_pool.cc:224] Handling call
0709 13:17:27.752476 (+1046629us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54002dad54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d92735 00007fc1d8d52d29 00007fc1d22d11d4 00007fc1d22d1162 00007fc1d22d1091 00007fc1d22d100c 00007fc1d22d02c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:27.752658 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983099264}
I20260709 13:17:27.766198  5448 rpcz_store.cc:276] 0709 13:17:26.600650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.603505 (+  2855us) service_pool.cc:224] Handling call
0709 13:17:26.603803 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.622247 (+ 18444us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:27.084461 (+462214us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.460871 (+376410us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.466203 (+  5332us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.508417 (+ 42214us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.508626 (+   209us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:27.508915 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.509877 (+   962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.509998 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.756045 (+246047us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b1800158c20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:27.765518 (+  9473us) raft_consensus.cc:1685] finished
0709 13:17:27.765543 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.765692 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24404,"prepare.queue_time_us":611679,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":327763,"raft.run_cpu_time_us":542,"raft.run_wall_time_us":66263,"spinlock_wait_cycles":17536128,"thread_start_us":263730,"threads_started":1,"wal-append.queue_time_us":589502}
I20260709 13:17:27.784893  5445 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:27.785209  9807 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:27.807004  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70597.4us
I20260709 13:17:27.808566  5445 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:27.804639  5369 rpcz_store.cc:276] 0709 13:17:26.205193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.205330 (+   137us) service_pool.cc:224] Handling call
0709 13:17:26.229631 (+ 24301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.321329 (+ 91698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.321377 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.325116 (+  3739us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.535307 (+210191us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:27.236107 (+700800us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.236179 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.238570 (+  2391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.766587 (+528017us) raft_consensus.cc:1685] finished
0709 13:17:27.766610 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.803963 (+ 37353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142037,"raft.queue_time_us":92074,"raft.run_cpu_time_us":6554,"raft.run_wall_time_us":212113,"spinlock_wait_cycles":6997888,"thread_start_us":867939,"threads_started":1,"wal-append.queue_time_us":1099361}
I20260709 13:17:27.809278  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2298) took 1136 ms. Trace:
I20260709 13:17:27.809693  5445 rpcz_store.cc:276] 0709 13:17:26.673207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.808014 (+1134807us) service_pool.cc:224] Handling call
0709 13:17:27.808394 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.809026 (+   632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.809222 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.790518  9876 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:27.770500  9648 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.733217  9935 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:27.730082  9815 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.795737  9837 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:27.770325  9889 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:27.758507  9592 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:27.830396  5518 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
W20260709 13:17:27.748420  9925 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:17:27.814023  5366 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 7.
I20260709 13:17:27.824602  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1887) took 1035 ms. Trace:
I20260709 13:17:27.768580  5446 rpcz_store.cc:276] 0709 13:17:26.672306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.797042 (+124736us) service_pool.cc:224] Handling call
0709 13:17:26.801953 (+  4911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.802413 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.802442 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.910020 (+107578us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.168969 (+258949us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.440921 (+271952us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.442905 (+  1984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.442987 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.754491 (+311504us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b18003d1f20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:27.767653 (+ 13162us) raft_consensus.cc:1685] finished
0709 13:17:27.767754 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.767911 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49164,"prepare.queue_time_us":224851,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":46,"raft.queue_time_us":62205,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":104865,"spinlock_wait_cycles":92839680,"thread_start_us":329406,"threads_started":2,"wal-append.queue_time_us":433003}
I20260709 13:17:27.774791  5450 rpcz_store.cc:276] 0709 13:17:26.672653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.912028 (+239375us) service_pool.cc:224] Handling call
0709 13:17:26.936385 (+ 24357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.951730 (+ 15345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.951780 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.966280 (+ 14500us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.169579 (+203299us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:27.516079 (+346500us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.610423 (+ 94344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.610556 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.769613 (+159057us) raft_consensus.cc:1685] finished
0709 13:17:27.773673 (+  4060us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.773934 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124241,"prepare.queue_time_us":585096,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":58598,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":22815,"thread_start_us":425864,"threads_started":2,"wal-append.queue_time_us":451321}
I20260709 13:17:27.859807  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1889) took 1057 ms. Trace:
I20260709 13:17:27.858283  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:27.860302  5450 rpcz_store.cc:276] 0709 13:17:26.802448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.858845 (+1056397us) service_pool.cc:224] Handling call
0709 13:17:27.859187 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.859407 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.859442 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.859497 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.859539 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.859604 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.859740 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.826215  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:27.812964  5448 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: [12.6-14.8]
I20260709 13:17:27.739835  9906 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:27.811745  9921 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:17:27.869747  9949 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.870398  9949 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.811964  9811 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:27.861778  5442 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.847777  9698 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.858314  5446 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:27.911935  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1888) took 1121 ms. Trace:
I20260709 13:17:27.912314  5446 rpcz_store.cc:276] 0709 13:17:26.790821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.857505 (+1066684us) service_pool.cc:224] Handling call
0709 13:17:27.857891 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.911608 (+ 53717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.911871 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.864661  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1890) took 1060 ms. Trace:
I20260709 13:17:27.913969  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1891) took 1108 ms. Trace:
W20260709 13:17:27.850483  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet 28ae73f1403d44db9d77ab1da61496ea: Illegal state: Replica 544c82a50cc4477886bb6f7d58f455ca is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:27.871315  9810 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:27.918252  9810 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.865768  5445 rpcz_store.cc:276] 0709 13:17:26.789228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.823264 (+1034036us) service_pool.cc:224] Handling call
0709 13:17:27.823747 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.824000 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.824038 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.824095 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.824138 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.824211 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.824511 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.717413  9944 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.819584  9835 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:27.861368  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 416317us
I20260709 13:17:27.872692  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:27.894657  9592 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:27.749117  9911 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.897186  9950 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:27.827622  9532 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:27.862035  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2297) took 1189 ms. Trace:
I20260709 13:17:27.849535  9922 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.849817  9852 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.981911  9852 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.859319  9807 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.913707  5450 rpcz_store.cc:276] 0709 13:17:26.803867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.863585 (+1059718us) service_pool.cc:224] Handling call
0709 13:17:27.863971 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.864206 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.864244 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.864301 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.864358 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.864431 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.864590 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.984563  9807 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.985716  5450 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:27.986534  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1893) took 1179 ms. Trace:
I20260709 13:17:27.922889  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1892) took 1116 ms. Trace:
I20260709 13:17:27.978801  5448 rpcz_store.cc:276] 0709 13:17:26.672933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.812110 (+1139177us) service_pool.cc:224] Handling call
0709 13:17:27.812598 (+   488us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:27.861730 (+ 49132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.861987 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.987263  9922 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.987628  5445 rpcz_store.cc:276] 0709 13:17:26.806473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.922039 (+1115566us) service_pool.cc:224] Handling call
0709 13:17:27.922376 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.922555 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.922594 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.922642 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:27.922673 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.922727 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.922833 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.989037  5445 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:27.989661  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1896) took 1043 ms. Trace:
I20260709 13:17:27.989586  9532 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.990209  5445 rpcz_store.cc:276] 0709 13:17:26.946220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.988584 (+1042364us) service_pool.cc:224] Handling call
0709 13:17:27.988872 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.989406 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.989608 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.914379  5446 rpcz_store.cc:276] 0709 13:17:26.805165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.913108 (+1107943us) service_pool.cc:224] Handling call
0709 13:17:27.913388 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.913648 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.913672 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.913718 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.913750 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.913805 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.913919 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.811321  9899 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.952399  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:27.995397  5374 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
W20260709 13:17:27.996061  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.018s	sys 0.041s
I20260709 13:17:27.834650  9815 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:27.967481  5369 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:27.968631  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.974668  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:27.979646  9955 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.992450  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1894) took 1183 ms. Trace:
W20260709 13:17:27.992964  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45546.9us
I20260709 13:17:27.970268  5442 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 10.
I20260709 13:17:28.007807  5374 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:27.986902  5450 rpcz_store.cc:276] 0709 13:17:26.807643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.984818 (+1177175us) service_pool.cc:224] Handling call
0709 13:17:27.985274 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.986209 (+   935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.986469 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:27.868376  9837 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:27.996935  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.018s	sys 0.042s
I20260709 13:17:28.002163  5445 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:28.012677  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1897) took 1066 ms. Trace:
I20260709 13:17:28.013034  5445 rpcz_store.cc:276] 0709 13:17:26.946551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.990984 (+1044433us) service_pool.cc:224] Handling call
0709 13:17:27.993283 (+  2299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.012378 (+ 19095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.012611 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.014444  5445 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:28.016037  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 339708us
I20260709 13:17:28.003744  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2381) took 1672 ms. Trace:
I20260709 13:17:27.841286  9935 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:28.010073  9789 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.002s
I20260709 13:17:27.978411  9950 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.987282  9810 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:27.852236  9889 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.021824  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:28.044052  5374 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.008637  5448 rpcz_store.cc:276] 0709 13:17:26.808743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.988056 (+1179313us) service_pool.cc:224] Handling call
0709 13:17:27.991791 (+  3735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.992110 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.992133 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.992188 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.992215 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.992269 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.992383 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.024613  5516 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:27.940718  9698 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.016685  5373 rpcz_store.cc:276] 0709 13:17:26.331553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.331818 (+   265us) service_pool.cc:224] Handling call
0709 13:17:26.332177 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.580648 (+248471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.003528 (+1422880us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54000f9bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:28.003692 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502268672}
I20260709 13:17:28.047904  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:27.996701  9648 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.016196  9955 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.087817  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.122227  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.155170  5369 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:28.155359  5523 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:28.048365  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.160609  9935 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:28.162037  9944 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:28.021502  9806 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:28.113020  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:28.103327  9957 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:28.163159  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50235.5us
I20260709 13:17:28.166824  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.166908  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.167910  5448 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:28.168771  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:28.087162  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 70079.6us
I20260709 13:17:28.175230  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:28.174719  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:28.178647  5448 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:28.179926  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.032208  9950 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.184636  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.187947  5450 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:28.139344  9698 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.121721  9532 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:28.165802  9849 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:28.188498  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.164356  9922 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.113458  9486 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:28.163268  9912 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:28.163228  9949 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.032147  9789 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.192201  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.211077  5448 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:28.211911  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.212420  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:28.115577  9934 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:17:28.180994  9810 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:28.194339  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:28.020054  9837 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:17:28.198611  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 189815us
I20260709 13:17:28.201924  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.202795  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.203240  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:28.205389  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:28.190615  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:28.185154  9899 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.038656  9855 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:17:28.181592  9440 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:28.116219  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:28.198694  9223 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:17:28.163117  9957 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.117257  9894 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:28.618518  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2301) took 1366 ms. Trace:
I20260709 13:17:28.350205  9638 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.620018  5442 rpcz_store.cc:276] 0709 13:17:27.251939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.011283 (+759344us) service_pool.cc:224] Handling call
0709 13:17:28.011667 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.054075 (+ 42408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.054122 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.093455 (+ 39333us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.200937 (+107482us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.200984 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.201059 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.618250 (+417191us) raft_consensus.cc:1685] finished
0709 13:17:28.618279 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.618448 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41858,"raft.queue_time_us":42614,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":27897,"thread_start_us":79720,"threads_started":1,"wal-append.queue_time_us":90406}
I20260709 13:17:28.622680  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.624411  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:28.289790  9951 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.311s	user 0.000s	sys 0.002s
I20260709 13:17:28.626223  9746 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:28.626669  9746 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:28.627880  9857 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.628458  9857 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:28.627923  9746 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.628873  9857 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.629231  9746 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.624668  5442 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:28.634857  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.349968  9426 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:28.284549  5261 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.294s	user 0.010s	sys 0.019s
I20260709 13:17:28.292171  9889 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:28.298357  9955 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.643867  9888 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:28.645004  9888 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.646220  9888 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.624492  9789 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.339927  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2283) took 1712 ms. Trace:
I20260709 13:17:28.656020  6070 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:28.208123  9486 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:28.660440  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 466074us
W20260709 13:17:28.662698  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 472087us
I20260709 13:17:28.274355  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.636583  5442 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:28.622274  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:28.711412  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.702809  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.251820  5522 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:28.684700  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 481372us
I20260709 13:17:28.313755  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2370) took 2256 ms. Trace:
I20260709 13:17:28.693446  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.213265  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.195046  9958 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:28.740314  5441 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:28.704866  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:28.289953  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:28.387627  5374 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:28.206616  9698 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.420s
I20260709 13:17:28.744629  9855 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.752743  9855 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:28.744413  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.742063  9440 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:28.743098  5448 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:28.756052  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:28.336942  9909 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.234s	user 0.002s	sys 0.001s
I20260709 13:17:28.763046  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:28.672319  9789 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.762429  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.742034  5367 rpcz_store.cc:276] 0709 13:17:26.045996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.076829 (+ 30833us) service_pool.cc:224] Handling call
0709 13:17:26.077138 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.236291 (+1159153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.302447 (+1066156us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000d1454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:28.302747 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2654980480}
W20260709 13:17:28.719555  9950 consensus_meta.cc:287] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.001s
I20260709 13:17:28.206099  9912 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:28.285224  9914 consensus_meta.cc:287] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.004s
I20260709 13:17:28.764503  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.767227  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.654481  5447 rpcz_store.cc:276] 0709 13:17:26.627603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.628009 (+   406us) service_pool.cc:224] Handling call
0709 13:17:26.636025 (+  8016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.035684 (+399659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.339521 (+1303837us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54003bc254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:28.339820 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900092160}
I20260709 13:17:28.671591  5373 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:28.349611  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.207932  9849 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.770431  9842 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.770970  9935 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.770586  9440 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:28.297652  9961 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:17:28.693826  9898 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.785364  9944 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:28.822607  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:28.785683  9912 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.203768  9901 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:28.773857  5450 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.637367  9426 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.772486  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.606794  9806 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.779284  5374 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:28.780560  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:28.318835  9917 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:28.684357  9955 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.840818  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.823545  9935 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.810505  5517 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:28.811705  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.814875  5448 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:28.815133  9837 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.840196  9806 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.871294  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.871768  9806 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:28.872594  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:28.841261  9901 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.874168  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.874948  5369 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:28.875445  9957 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:28.876055  9909 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:28.876266  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.815764  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.782135  9889 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:28.878433  5366 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 8: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:28.878347  9889 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.816669  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:28.879500  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2306) took 1619 ms. Trace:
I20260709 13:17:28.880002  5447 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.880563  9889 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:28.782920  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78147.4us
W20260709 13:17:28.882483  9960 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.768s	user 0.011s	sys 0.000s
I20260709 13:17:28.883133  9888 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.777052  9958 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.884563  9958 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.829981  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:28.877221  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2280) took 2272 ms. Trace:
I20260709 13:17:28.781970  9894 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.896469  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:28.899333  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:28.774030  5414 leader_election.cc:336] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.000s (SENT)
I20260709 13:17:28.834652  5367 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:28.900646  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:28.900708  5366 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:28.806196  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.824033  9910 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:28.928678  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:28.928992  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47575.4us
I20260709 13:17:28.930928  9887 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:28.930856  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 156867us
I20260709 13:17:28.844352  9418 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.868263  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.869678  9837 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:28.218092  9948 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.577s
I20260709 13:17:28.874250  5374 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:28.879931  5445 rpcz_store.cc:276] 0709 13:17:27.260427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.015205 (+754778us) service_pool.cc:224] Handling call
0709 13:17:28.015539 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.016185 (+   646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.016214 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.029148 (+ 12934us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.208206 (+179058us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:28.208244 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.208320 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.879293 (+670973us) raft_consensus.cc:1685] finished
0709 13:17:28.879312 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.879444 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61427,"raft.queue_time_us":3370,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":17988,"thread_start_us":104693,"threads_started":1,"wal-append.queue_time_us":754824}
I20260709 13:17:28.941355  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.818949  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.831280  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.943290  5449 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:17:28.774953  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:28.944729  5442 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:28.620260  9638 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.885761  5371 raft_consensus.cc:2376] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11. Re-sending same reply.
I20260709 13:17:28.946545  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.947324  5371 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:28.948491  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:28.886130  5521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1887) took 2499 ms (client timeout 2000 ms). Trace:
I20260709 13:17:28.887432  9935 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.890162  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.891746  9911 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.953073  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:28.894413  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2300) took 1652 ms. Trace:
W20260709 13:17:28.895079  9908 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.840s	user 0.009s	sys 0.005s
I20260709 13:17:28.896445  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.886662  6072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 157) took 1574 ms. Trace:
I20260709 13:17:28.877313  5369 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:28.905524  5447 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:28.906131  5441 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:28.899566  5524 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.907585  5450 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:28.783766  9789 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.885885  5443 rpcz_store.cc:276] 0709 13:17:26.604893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.605723 (+   830us) service_pool.cc:224] Handling call
0709 13:17:26.606047 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.621282 (+ 15235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.621323 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.652924 (+ 31601us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.970319 (+317395us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:27.009442 (+ 39123us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.009657 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.009758 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.335086 (+1325328us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:28.876882 (+541796us) raft_consensus.cc:1685] finished
0709 13:17:28.876994 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.877140 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33875,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":52,"raft.queue_time_us":67381,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":8778,"spinlock_wait_cycles":90611584,"thread_start_us":267824,"threads_started":1,"wal-append.queue_time_us":412969}
I20260709 13:17:28.967455  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2308) took 1702 ms. Trace:
I20260709 13:17:28.967866  5447 rpcz_store.cc:276] 0709 13:17:27.264722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.966624 (+1701902us) service_pool.cc:224] Handling call
0709 13:17:28.966951 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.967123 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.967147 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.967193 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:28.967236 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.967287 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.967398 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.908497  5375 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.827909  9898 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:28.814786  9914 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:28.830771  9944 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.936023  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.836287  9917 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:28.936888  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.950851  5371 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:28.823110  9842 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:28.951442  9957 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:28.784133  9950 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.887403  9955 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:28.949616  5521 rpcz_store.cc:269] 0709 13:17:26.386293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.411791 (+ 25498us) service_pool.cc:224] Handling call
0709 13:17:28.885856 (+2474065us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54001e7154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:28.886035 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679363840}
I20260709 13:17:28.954790  5446 rpcz_store.cc:276] 0709 13:17:27.241742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.012974 (+771232us) service_pool.cc:224] Handling call
0709 13:17:28.017808 (+  4834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.120982 (+103174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.121033 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.121619 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.211059 (+ 89440us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.211100 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.211177 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.894170 (+682993us) raft_consensus.cc:1685] finished
0709 13:17:28.894193 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.894337 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102664,"raft.queue_time_us":104091,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":89037,"threads_started":1,"wal-append.queue_time_us":704915}
I20260709 13:17:28.932576  9887 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:28.958760  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:28.885399  9888 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:28.983426  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.983812  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.951483  9806 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.968453  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2307) took 1706 ms. Trace:
I20260709 13:17:28.970520  5447 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:28.985819  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.971467  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.986438  5371 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:28.972738  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:28.928520  9910 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:28.955389  5444 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:28.980293  5441 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:28.981673  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.984473  5516 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:17:28.988233  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:28.989902  9917 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:28.990777  9957 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.028221  5374 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:28.991158  9914 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:28.991925  6069 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 14: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:28.991847  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:28.994493  9842 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:28.976748  9944 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.974048  9898 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.995759  9888 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:28.996042  9789 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.997793  9950 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:28.998238  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2151) took 2394 ms. Trace:
I20260709 13:17:29.083007  5520 rpcz_store.cc:276] 0709 13:17:26.604295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.604671 (+   376us) service_pool.cc:224] Handling call
0709 13:17:26.628172 (+ 23501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.711963 (+ 83791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.997923 (+2285960us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b54001653d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:28.998145 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190327168}
I20260709 13:17:28.999258  9934 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.001220  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2376) took 2851 ms. Trace:
I20260709 13:17:28.960188  6072 rpcz_store.cc:276] 0709 13:17:27.311914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.474661 (+162747us) service_pool.cc:224] Handling call
0709 13:17:27.630713 (+156052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.687681 (+ 56968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.687726 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.688316 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.021945 (+333629us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:28.029281 (+  7336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.083752 (+ 54471us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.881874 (+798122us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:28.886193 (+  4319us) raft_consensus.cc:1685] finished
0709 13:17:28.886226 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.886467 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8628,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":13219,"spinlock_wait_cycles":8527104,"thread_start_us":315840,"threads_started":1,"wal-append.queue_time_us":425770}
I20260709 13:17:28.965932  9948 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:29.004240  9486 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.004453  5522 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:29.005306  9882 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 2.422s	user 0.004s	sys 0.015s
I20260709 13:17:29.006278  5524 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:29.015549  9806 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.007253  9857 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.009235  9849 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.010203  9852 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:29.010075  9912 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.010617  9855 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.011421  9958 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.011583  5371 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:29.013217  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.020289  5367 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:29.037873  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.048012  5445 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:29.066197  5366 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:29.014345  9887 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:29.077410  6041 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.823s (SENT) [suppressed 13 similar messages]
I20260709 13:17:29.077858  9955 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:29.086436  5372 rpcz_store.cc:276] 0709 13:17:26.150342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.150696 (+   354us) service_pool.cc:224] Handling call
0709 13:17:26.161135 (+ 10439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.616280 (+1455145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.000935 (+1384655us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54000fa0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:29.001156 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3253393792}
I20260709 13:17:29.049321  9914 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:28.985347  5449 rpcz_store.cc:276] 0709 13:17:27.262566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.962280 (+1699714us) service_pool.cc:224] Handling call
0709 13:17:28.967809 (+  5529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.968042 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.968079 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.968137 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:28.968181 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.968252 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.968379 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:29.110086  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2159) took 1083 ms. Trace:
I20260709 13:17:29.126210  5522 rpcz_store.cc:276] 0709 13:17:28.026423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.003964 (+977541us) service_pool.cc:224] Handling call
0709 13:17:29.004277 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.100201 (+ 95924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.110005 (+  9804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:29.128134  5522 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:29.075661  9917 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.109365  9486 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:29.112236  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 70833.7us
I20260709 13:17:29.115108  5520 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:29.121273  5448 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:29.123471  5521 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:29.099776  9948 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:29.135691  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.141633  9807 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:29.134884  5522 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:29.143507  5522 pending_rounds.cc:85] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 6
I20260709 13:17:29.143796  5522 pending_rounds.cc:107] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:29.144085  5522 raft_consensus.cc:2889] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.146389  5522 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:17:29.101250  9934 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.149353  5520 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.150697  5521 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:17:29.151252  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 861460us
I20260709 13:17:29.152496  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:29.152454  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 396495us
I20260709 13:17:29.156749  6043 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:29.160527  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.164340  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.165091  5523 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:29.166316  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.144174  9927 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:29.166965  5523 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
I20260709 13:17:29.134785  9914 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:29.163762  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.145712  9916 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:29.165138  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.170877  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:29.175168  5521 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:29.141690  9957 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:29.173992  5519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1884) took 2788 ms (client timeout 1618 ms). Trace:
W20260709 13:17:29.176913  5519 rpcz_store.cc:269] 0709 13:17:26.385500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.385610 (+   110us) service_pool.cc:224] Handling call
0709 13:17:29.170165 (+2784555us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54002dad54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:29.173909 (+  3744us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612232448}
I20260709 13:17:29.175150  5447 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:17:29.178699  5522 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:29.179987  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:29.182968  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 344486us
W20260709 13:17:29.187230  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.188758  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.190420  5523 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:29.190752  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.188172  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.191431  5519 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:29.192341  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.193120  5519 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:29.169520  9892 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.191454  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.146124  9486 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.197847  5520 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:29.199847  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.201028  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.169792  9410 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:29.169320  9968 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:29.195413  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:29.207693  5523 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:29.173612  9927 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:29.192342  9934 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.216728  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.180423  9916 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:29.112684  9910 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.218832  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:29.220350  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.221580  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.255239  5372 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:29.190637  9849 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:29.226743  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:29.235929  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 294922us
I20260709 13:17:29.241456  9927 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.244163  9486 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.143052  5261 maintenance_manager.cc:643] P 76d1a118b8e24e8fbc379c88999cb11f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.257s	user 0.212s	sys 0.094s Metrics: {"bytes_written":30443,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":41832,"dirs.run_cpu_time_us":363,"dirs.run_wall_time_us":4942,"drs_written":1,"lbm_read_time_us":436,"lbm_reads_lt_1ms":4,"lbm_write_time_us":67856,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":3,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":202940,"threads_started":2,"update_count":29,"wal-append.queue_time_us":215864}
I20260709 13:17:29.217509  9440 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:29.224613  9638 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.224462  9899 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:29.235059  9968 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:29.262794  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.280673  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.281587  9806 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.281132  9916 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.216883  9892 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.281466  9935 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:29.190140  9948 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.341504  5368 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:29.282285  9849 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:29.251698  9852 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.320580  9440 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:29.347218  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 166304us
W20260709 13:17:29.327371  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67262.2us
I20260709 13:17:29.253000  9958 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:29.329137  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.333177  9927 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.336426  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.283905  9810 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:29.342464  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1911) took 1160 ms. Trace:
I20260709 13:17:29.358657  5446 rpcz_store.cc:276] 0709 13:17:28.182393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.981903 (+799510us) service_pool.cc:224] Handling call
0709 13:17:29.027870 (+ 45967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.339089 (+311219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.341670 (+  2581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.341945 (+   275us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:29.342014 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.342106 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.342388 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12593,"raft.queue_time_us":95707,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5131,"thread_start_us":302746,"threads_started":1}
W20260709 13:17:29.342806  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 143044us
W20260709 13:17:29.319839  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 242431us
W20260709 13:17:29.345611  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 82896.1us
W20260709 13:17:29.323969  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 123035us
I20260709 13:17:29.327649  9912 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:29.324034  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.350235  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:29.334123  9910 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.241437  9914 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:29.334966  9410 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:29.352030  9978 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.361624  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.335371  9957 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.366958  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.369755  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.370915  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:29.395195  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45048.1us
I20260709 13:17:29.396562  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.350596  9440 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.371093  9698 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:29.354699  9958 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.422353  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.367554  9916 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.364773  9810 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.394408  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:29.486357  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 114056us
I20260709 13:17:29.440171  9980 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:29.352223  9852 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.474900  9957 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.372213  9887 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.374755  9978 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.394845  9598 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.350961  9944 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.396739  9968 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:29.457095  9935 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.374532  9889 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:17:29.516767  9957 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.518795  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:29.519039  9852 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:29.495309  9991 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:29.520077  9991 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.520195  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:29.521979  5367 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:29.522778  9887 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:29.480031  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1913) took 1246 ms. Trace:
I20260709 13:17:29.481997  5519 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:29.449163  9958 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:29.474766  5262 maintenance_manager.cc:419] P 76d1a118b8e24e8fbc379c88999cb11f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7221 bytes on disk
I20260709 13:17:29.442715  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:29.492902  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 122084us
W20260709 13:17:29.462126  9981 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:29.610186  9901 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.475044  9702 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:29.489661  9980 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.501010  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:29.636314  5515 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:29.503954  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 107464us
I20260709 13:17:29.506309  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2164) took 1368 ms. Trace:
I20260709 13:17:29.637060  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.638319  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.636883  5517 rpcz_store.cc:276] 0709 13:17:28.140240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.028632 (+888392us) service_pool.cc:224] Handling call
0709 13:17:29.029007 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.029300 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:29.234736 (+205436us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.505963 (+271227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.506018 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:29.506062 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.506128 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.506254 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13608,"prepare.queue_time_us":151928,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":32288,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":57842,"thread_start_us":441258,"threads_started":2,"wal-append.queue_time_us":373972}
I20260709 13:17:29.489787  9810 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.508555 10001 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.500692  9806 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:29.500890  9978 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.513793  9912 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:29.520529  9991 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:29.478127  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1889) took 3091 ms (client timeout 1632 ms). Trace:
I20260709 13:17:29.524809  5447 rpcz_store.cc:276] 0709 13:17:28.234076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.986421 (+752345us) service_pool.cc:224] Handling call
0709 13:17:29.010194 (+ 23773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.178213 (+168019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.479793 (+301580us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003cbc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:29.479973 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378311424}
I20260709 13:17:29.571797  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.572898  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:29.575007  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83565us
W20260709 13:17:29.576313  9986 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:17:29.576913  9968 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.501160  9638 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:29.648993  9935 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:29.649230  9806 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:29.577239 10000 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.649540  9638 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.650282  9901 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.650388 10000 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:29.650841  9901 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.651854  9638 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.652460  9968 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.652933  9901 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.653092 10000 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:29.654752  9968 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.641881  9755 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:29.657938  9755 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.642189  9895 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:29.658510  9895 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.634476  9702 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.659281  9895 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.580751  9849 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:29.474951  9410 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:29.659953  9486 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.660459  9486 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:29.586553  9988 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:29.662585  9486 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.664264  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2162) took 1637 ms. Trace:
I20260709 13:17:29.664676  5516 rpcz_store.cc:276] 0709 13:17:28.027169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.019208 (+992039us) service_pool.cc:224] Handling call
0709 13:17:29.046031 (+ 26823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.046518 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.046558 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:29.067421 (+ 20863us) log.cc:844] Serialized 26 byte log entry
0709 13:17:29.324375 (+256954us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:29.338782 (+ 14407us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.345792 (+  7010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.345876 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.511603 (+165727us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b180014f860. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:29.663943 (+152340us) raft_consensus.cc:1685] finished
0709 13:17:29.664046 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.664200 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12032,"prepare.queue_time_us":17311,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":11190,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":16354,"spinlock_wait_cycles":11528448,"thread_start_us":206208,"threads_started":1,"wal-append.queue_time_us":293141}
I20260709 13:17:29.666283  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2390) took 2621 ms. Trace:
I20260709 13:17:29.666597 10001 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.666702  5375 rpcz_store.cc:276] 0709 13:17:27.044544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.054192 (+  9648us) service_pool.cc:224] Handling call
0709 13:17:27.054698 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.968973 (+1914275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.666035 (+697062us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54001202d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:29.666222 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4262750592}
I20260709 13:17:29.668654  9819 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:29.669083  9819 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:29.670186  9819 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.671188  9912 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:29.671661  9912 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:29.578111  9984 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:29.588356  9815 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:29.497520  9698 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:29.591368  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2396) took 1740 ms. Trace:
I20260709 13:17:29.506980  9598 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.669150 10001 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.640799  9980 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:29.594168  5524 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:29.609045  9998 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.586684  9894 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.678s	user 0.004s	sys 0.008s
I20260709 13:17:29.671231  9819 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.690341  5523 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:17:29.690824  5523 pending_rounds.cc:85] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:17:29.691071  5523 pending_rounds.cc:107] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:17:29.691339  5523 raft_consensus.cc:2889] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.490592  9989 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:29.374357  9975 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:17:29.506767  9223 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.693413  9223 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.693617  9998 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:29.695991  9998 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:29.676200  9917 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
W20260709 13:17:29.644259  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 72610.5us
W20260709 13:17:29.644513  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 71731.7us
I20260709 13:17:29.699147  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:29.642853  5518 rpcz_store.cc:269] 0709 13:17:26.386594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.404534 (+ 17940us) service_pool.cc:224] Handling call
0709 13:17:29.477958 (+3073424us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003787d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:29.478063 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2780107136}
I20260709 13:17:29.618953  9892 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:29.649852  9806 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:29.658478  9755 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.659343  9702 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.587659  5261 maintenance_manager.cc:643] P 76d1a118b8e24e8fbc379c88999cb11f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.058s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":412,"lbm_reads_lt_1ms":4}
I20260709 13:17:29.580124  9944 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.647883  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:29.686650  5368 rpcz_store.cc:276] 0709 13:17:27.850912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.852060 (+  1148us) service_pool.cc:224] Handling call
0709 13:17:27.852395 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.344107 (+1491712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.591107 (+247000us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54001e9454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:29.591302 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420409728}
W20260709 13:17:29.593093  9898 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.001s
I20260709 13:17:29.688251  5524 pending_rounds.cc:85] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 7
I20260709 13:17:29.639612  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.716951  5524 pending_rounds.cc:107] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 14.8
W20260709 13:17:29.717211  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77659.3us
I20260709 13:17:29.717262  5524 raft_consensus.cc:2889] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.717965  5340 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.696519  9223 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.724509  5444 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:29.724781  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:29.707058  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.709888  5371 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:29.704366  9989 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.724993  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.726135  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2311) took 1560 ms. Trace:
I20260709 13:17:29.714679  5369 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 12 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:29.721776  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.675271  9899 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:29.697299  9842 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.732743  9899 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:29.732817  9842 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:29.733856  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.724087  9746 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:29.734575  5441 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:29.734144  9899 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.712548  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.706461  9990 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.736496  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.736788  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:29.726248  5449 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:17:29.727563  5448 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:29.744270  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.739132  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.741396  6076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59508 (request call id 139) took 2301 ms. Trace:
W20260709 13:17:29.722857  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75042.4us
I20260709 13:17:29.729573  9917 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:29.732089  9989 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.734892  9746 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.724375  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.737236  5444 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:29.726918  5443 rpcz_store.cc:276] 0709 13:17:28.166115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.967587 (+801472us) service_pool.cc:224] Handling call
0709 13:17:28.967873 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.968203 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.968231 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.973890 (+  5659us) log.cc:844] Serialized 26 byte log entry
0709 13:17:29.229081 (+255191us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:29.229143 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.229244 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.725832 (+496588us) raft_consensus.cc:1685] finished
0709 13:17:29.725865 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.726060 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30770,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":246491,"threads_started":1,"wal-append.queue_time_us":347985}
I20260709 13:17:29.761876  5447 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:29.762611  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:29.763206  5443 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.763339  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:29.764714  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:29.742992 10005 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:29.770381  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.752254  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.773339  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.754806  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.774482  5372 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:29.775657  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.757256  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:29.746714  6076 rpcz_store.cc:276] 0709 13:17:27.439995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.450979 (+ 10984us) service_pool.cc:224] Handling call
0709 13:17:27.715312 (+264333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.716240 (+   928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.740809 (+2024569us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400a4c4d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:29.741142 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489973120}
I20260709 13:17:29.758479  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.778427  5442 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:29.779829  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:29.759781  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.766039  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.782094  5444 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:29.766824  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54379.9us
I20260709 13:17:29.750936  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:29.768241  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 93357.4us
I20260709 13:17:29.768600  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.781324  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.783521  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.784183  5442 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:29.785493  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.787524  5442 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:29.775756  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.776468  5372 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 6.
I20260709 13:17:29.788458  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:29.790856  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:29.791431  5444 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.791713  5366 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:29.789609  5373 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:29.789659  5447 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:29.795207  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.797480  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.802848  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.803606  5447 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:29.804611  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.755290  9917 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.770617 10005 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.810022 10005 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.788172 10006 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:29.814206 10006 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:29.738313  6069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59508 (request call id 138) took 2456 ms (client timeout 2935 ms). Trace:
I20260709 13:17:29.767371  9746 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.760349  9944 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:29.819298  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.820087  5443 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:29.826623  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.793782  9957 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.795015  9598 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.834323  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.847288  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.847678  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:29.847985  5443 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
W20260709 13:17:29.822963  6069 rpcz_store.cc:269] 0709 13:17:27.281607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.283970 (+  2363us) service_pool.cc:224] Handling call
0709 13:17:29.738067 (+2454097us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54005f23d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:29.738222 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3417989888}
I20260709 13:17:29.738164  9898 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.847721  6072 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.840623  9638 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.849773  9638 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.766732  9223 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:17:29.815102  9916 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:29.817309  9917 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.820843  9486 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:29.794440  9968 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:29.794767  9971 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:29.872591  9968 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.872807  9971 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.875368  9971 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.875990  9971 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:29.876353  9971 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:29.876750  9971 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.851334  5449 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.833081  9944 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.877864  9944 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.849041  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.881498  5443 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:29.805289  9975 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:17:29.882670  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.884199  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.884929  5443 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:29.855844  5444 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 14.
W20260709 13:17:29.885331  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 661358us
I20260709 13:17:29.886237  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2416) took 1110 ms. Trace:
I20260709 13:17:29.872856  9223 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:29.886937  9223 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:29.886662  5374 rpcz_store.cc:276] 0709 13:17:28.775488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.029373 (+253885us) service_pool.cc:224] Handling call
0709 13:17:29.477560 (+448187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.477732 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.477757 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.477803 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:29.477834 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.477889 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.886084 (+408195us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54000c6050. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:29.886183 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990434560}
I20260709 13:17:29.826484  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.888406  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:29.820999  9989 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:29.868777  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:29.890710  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.742177  9806 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.831502  9901 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.814739 10006 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.871654  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.891511  5443 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 6.
I20260709 13:17:29.891570  6073 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59510 (request call id 159) took 2110 ms. Trace:
I20260709 13:17:29.830610  9982 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:29.892915  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66514.2us
I20260709 13:17:29.824111  9895 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.893791  9223 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.895121  5449 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:29.895316  9927 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:29.896327  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69776.4us
I20260709 13:17:29.850118  9638 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.898190  9815 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:17:29.821033 10001 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:17:29.901129  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.957120  5443 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 7.
I20260709 13:17:29.901013  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:29.957959  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57036.9us
I20260709 13:17:29.900512  6073 rpcz_store.cc:276] 0709 13:17:27.780893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.786009 (+  5116us) service_pool.cc:224] Handling call
0709 13:17:27.786450 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.060072 (+273622us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:28.139715 (+ 79643us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.344319 (+204604us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.344409 (+    90us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:28.344467 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.891338 (+1546871us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540049d9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:29.891384 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.891516 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62473,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":164,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":117,"spinlock_wait_cycles":628583680,"thread_start_us":203998,"threads_started":1,"wal-append.queue_time_us":696016}
I20260709 13:17:29.949824  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:29.949069  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60720.9us
I20260709 13:17:29.947845  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.870106  9916 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.871194  9486 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.964331  9486 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.970217  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:29.834323  9440 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.891065  9989 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.973446  9989 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.974726  9440 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:29.975246 10005 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.958642  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.978591  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:29.889366  9978 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.963423  9916 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.963832  9957 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.971611  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.977532  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:29.822626  9698 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.840467  9894 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:17:29.979934  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:29.899510  9901 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:29.908500  9892 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:29.931228  9755 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:29.890486  9702 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.020515  5443 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.020774  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:29.952271  9927 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:30.024602  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46202.7us
W20260709 13:17:30.024979  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45126.3us
I20260709 13:17:29.951449  9806 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.037990 10005 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.027508  9418 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.029594  9977 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.021800  9440 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:17:30.041524  9895 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:29.904765  9991 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.049721  5443 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:29.982808  9957 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.016117  9223 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.054770  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:29.931734  9982 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.051893 10000 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.022032  9815 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:29.979281  9922 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:30.026710  9901 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.092552  5448 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:30.075579 10011 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:30.031394  9898 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.035439  9810 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.078974  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:30.043823  9927 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.045154 10015 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:30.018652  9789 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.079514  9957 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.088948  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:30.030284  9819 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:30.095958  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.113353  5442 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:30.098039 10000 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.118436  9702 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.112499 10015 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:30.125870 10015 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.126284  9978 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.126857  9857 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.095890  9899 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:30.128194  9899 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.128607  9899 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.130398  9755 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.131184  9971 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:30.032382 10006 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.065448  9418 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.087057  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:30.141052  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 54086.6us
I20260709 13:17:30.142519  9857 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.144731  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:30.145501  5446 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:17:30.146452  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.093585  9922 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:30.069728  9974 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:17:30.154278  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:30.081895  9912 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.162358  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:30.162786  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:30.094372  9815 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.164270  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.115727  9819 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:30.133906  9968 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.167825  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.173676  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.169788  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.166311  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:30.170897  5446 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:30.178747  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:30.179036  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.179953  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.180449  5517 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.154771  9922 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.133369  9971 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:17:30.186484  5515 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:30.189788  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:30.192904  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 127290us
I20260709 13:17:30.187458  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:30.165257  9857 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.134752  9980 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.170719  9815 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.172616  9819 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.181346  9789 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:30.205755  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.218079  5517 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:30.218111  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.218971  5515 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:30.208175  9418 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.208938  9852 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:30.210829 10000 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.227522  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2170) took 2064 ms. Trace:
I20260709 13:17:30.213982  9789 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.197535  9978 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:17:30.232795  5524 rpcz_store.cc:276] 0709 13:17:28.158054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.105693 (+947639us) service_pool.cc:224] Handling call
0709 13:17:29.107698 (+  2005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.718042 (+610344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.222227 (+504185us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54003a3754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:30.222378 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117360512}
I20260709 13:17:30.219451  9894 raft_consensus.cc:2764] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:17:30.229894  9958 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.654s	user 0.017s	sys 0.000s
I20260709 13:17:30.213549  9892 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:17:30.229576  9852 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.241565  9991 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:30.260058  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.241917 10018 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:17:30.240566  9789 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.246688  9978 consensus_queue.cc:1243] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:30.248780  9810 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.245954 10021 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.268203  9852 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:30.314205  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.381124  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.381091  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.383131  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.383512  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.387959  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.389030  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.400882  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1834) took 1165 ms. Trace:
I20260709 13:17:30.259545  9958 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.405009  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.405942  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:30.401484  5371 rpcz_store.cc:276] 0709 13:17:29.220248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.221237 (+   989us) service_pool.cc:224] Handling call
0709 13:17:30.334559 (+1113322us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400393ad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:30.385224 (+ 50665us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045324032}
W20260709 13:17:30.395996 10020 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.124s	user 0.000s	sys 0.004s
W20260709 13:17:30.402419  9917 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:17:30.435122  9980 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:30.410307  9746 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.567s	user 0.021s	sys 0.019s
I20260709 13:17:30.433024  9810 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:30.312008 10021 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.477310  5448 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:30.444357 10006 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:30.435774  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50231.1us
I20260709 13:17:30.428246  9982 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.479363  9426 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.415064  9974 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:17:30.418259  9989 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.444958  9912 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.453073  9857 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:30.512346  5448 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:30.517640  5445 raft_consensus.cc:2410] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:30.517657  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1918) took 1328 ms. Trace:
I20260709 13:17:30.511889  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:30.537648  5519 rpcz_store.cc:276] 0709 13:17:29.189141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.194134 (+  4993us) service_pool.cc:224] Handling call
0709 13:17:29.481730 (+287596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.528691 (+ 46961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.513016 (+984325us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54003787d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:30.517590 (+  4574us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587375488}
W20260709 13:17:30.519866  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.434059  9917 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:30.533535  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.494417 10021 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.541090  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.550884  5519 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:30.495849  9746 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:17:30.546073  9888 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:30.547430 10023 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:30.549191  9989 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.536698  9950 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:30.534385  9842 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:30.552279  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:30.561878  5519 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:17:30.566900  5519 pending_rounds.cc:85] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 8
I20260709 13:17:30.567269  5519 pending_rounds.cc:107] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:17:30.567600  5519 raft_consensus.cc:2889] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:30.567813  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:17:30.555866  9486 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.004s
W20260709 13:17:30.583372  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 164047us
I20260709 13:17:30.564455  9746 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.587577  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:30.571800 10000 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:30.555191  9755 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:30.565289  9950 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:30.603397  9917 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.574913  9842 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:30.582683  9855 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:30.609088 10022 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:30.575081  9891 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:17:30.615736 10014 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:17:30.585198  9702 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:30.584017  9486 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.612879  9842 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:30.631951  9819 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:17:30.632190  9638 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.003s
I20260709 13:17:30.623476  9746 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:30.627218  9958 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.646322  5442 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
I20260709 13:17:30.609122  9980 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:17:30.649235  9899 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.520s	user 0.013s	sys 0.000s
I20260709 13:17:30.663488  9899 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.664084  5442 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:30.636842  9944 consensus_meta.cc:287] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.758s	user 0.007s	sys 0.005s
I20260709 13:17:30.665771  9944 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.667271  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:30.668278  9944 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.628969  9855 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:30.669668  9855 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:30.656278  9819 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:30.662516  9223 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 13:17:30.662742  5516 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:30.676781  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.651850  9638 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.679695  9638 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.679936  9899 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:30.690155 10030 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:17:30.690634  5414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.029s	sys 0.037s
I20260709 13:17:30.690064  9842 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:30.691041  5414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.029s	sys 0.037s
I20260709 13:17:30.691629  9842 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:30.691776  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 720183us
I20260709 13:17:30.648518  9950 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.694155  9950 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.698740  9486 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.700122  5442 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:30.688850  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1836) took 1466 ms. Trace:
I20260709 13:17:30.700919  5367 rpcz_store.cc:276] 0709 13:17:29.222798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.336161 (+113363us) service_pool.cc:224] Handling call
0709 13:17:30.688637 (+1352476us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54003949d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:30.688778 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386402048}
W20260709 13:17:30.702615  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.704666  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 127817us
I20260709 13:17:30.708417  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 1920) took 1518 ms. Trace:
I20260709 13:17:30.688789  9789 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.709028  5523 rpcz_store.cc:276] 0709 13:17:29.189977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.225948 (+ 35971us) service_pool.cc:224] Handling call
0709 13:17:29.226355 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.691822 (+465467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.708141 (+1016319us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b540018ef54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:30.708344 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065965568}
I20260709 13:17:30.650558  9746 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:30.710429  9901 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
W20260709 13:17:30.706303  9957 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 13:17:30.653256  9974 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:30.734850  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.735860  5519 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:30.740171  9927 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.002s
I20260709 13:17:30.740504  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.740630  9927 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.743036  9957 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:30.743774  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.786670  5519 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:30.748623  9916 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.002s
I20260709 13:17:30.749004  9974 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.750200  9746 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:30.750984  9922 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 13:17:30.722575  9638 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:17:30.753947  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.717564  9742 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:17:30.757330  9958 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:17:30.759336  9815 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.007s
I20260709 13:17:30.762535  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.763270  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.764292  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:30.823277  5448 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:17:30.770210  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.771287  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:30.773474  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.752816  9852 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.808193  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:30.803675  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:30.874213  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66116us
I20260709 13:17:30.874729  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.875051  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:30.876583  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.818322  9591 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:30.877154  5520 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:30.877672  9638 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.821622  5446 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:30.879739  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:30.881083  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:30.822662  5517 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:30.825157  5523 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:30.881682  5446 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:30.882406  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.883011  9958 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.883657  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.884728  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.885375  5519 raft_consensus.cc:2368] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:30.886224  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.886962  5519 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:30.887229  9948 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.887732  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.888288  5519 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.888417  9638 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.786448  9426 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.826926  9746 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.889765  9426 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.892673  9426 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.821348  9922 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.836061  9957 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:30.850450  9815 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.895145  9922 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.769524  9901 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.896862  9815 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.897789  5518 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:30.898304  9901 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:30.899498  5447 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:30.901755  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.817770 10006 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:30.854816  9789 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.853176  9927 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.810099  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:30.872100 10015 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.000s
I20260709 13:17:30.882472  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.820660  9991 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:30.928555  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.929366  5523 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:30.860980  9888 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.910719  5446 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:30.917505  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:30.931944  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.932737  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:30.933050  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:30.939559  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:30.940739  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:30.927793  9591 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:30.941923  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:30.942406  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:30.942641  5366 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:30.942976  5369 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.944692  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:30.946040  5370 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:30.947036  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:30.948220  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:30.934108  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:30.939667  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:30.920158  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 110131us
I20260709 13:17:30.920461  5517 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:30.922640  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:30.826922  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:30.918725  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:30.927074  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:30.904798  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.908435  5521 raft_consensus.cc:2368] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
W20260709 13:17:30.978531  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59904.9us
I20260709 13:17:30.973176  5369 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:30.879793  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:30.980083  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53091.7us
I20260709 13:17:30.932720  5524 raft_consensus.cc:2368] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
W20260709 13:17:30.933542  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.875272  9852 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:30.814801  9916 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.981091  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:30.950554  9223 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:31.006631  9223 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:31.007125  9223 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:30.930836  9789 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:17:30.931142 10015 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.934921  9991 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.015089  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1936) took 1192 ms. Trace:
I20260709 13:17:31.015630  9991 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.015599  5442 rpcz_store.cc:276] 0709 13:17:29.822737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.664911 (+842174us) service_pool.cc:224] Handling call
0709 13:17:30.665231 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:30.700591 (+ 35360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.014813 (+314222us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b540007e9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:31.015024 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79674752}
I20260709 13:17:31.017822  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.018792  5370 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.024060  9863 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.034518  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:30.970083  5371 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:30.974737  5367 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:17:30.965140  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:30.976404  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:30.912189 10006 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.983184  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.983650  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:31.038666  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62331.4us
I20260709 13:17:31.039433  5448 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:17:31.040902  5448 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:30.985178  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:31.042302  5521 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:30.950148  9940 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:30.941075  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.040084  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:31.046710  5373 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:30.977231  9755 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:30.987011  9935 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.052755  9952 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.052975  9935 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:31.053272  9952 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:31.053709  9952 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.054276 10006 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.054003  9935 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.046017  9901 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:30.989125  9916 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.055425  9901 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:30.989912  9440 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:30.989810  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:31.058532  5520 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:30.990592  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:30.992543  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:30.993321  5366 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:30.998936  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:31.063110  5443 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:31.046221  9940 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:31.063774  9940 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:31.064591  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2327) took 1345 ms. Trace:
I20260709 13:17:31.064992  5445 rpcz_store.cc:276] 0709 13:17:29.718800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.738836 (+ 20036us) service_pool.cc:224] Handling call
0709 13:17:31.064377 (+1325541us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540032f0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:31.064506 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764735360}
I20260709 13:17:30.972128 10037 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:30.984934  9927 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:30.978313  9888 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:30.952360  9974 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:31.018239  5442 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:31.082944  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.083606  5373 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:31.024410  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2336) took 1303 ms. Trace:
I20260709 13:17:31.084384  5447 rpcz_store.cc:276] 0709 13:17:29.721358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.821241 (+ 99883us) service_pool.cc:224] Handling call
0709 13:17:29.828063 (+  6822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.899953 (+1071890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.024138 (+124185us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540019d554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:31.024344 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2463588736}
I20260709 13:17:30.938967  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:30.969138  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.042685  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.087440  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.043761  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.043928  5448 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:31.047354  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:31.048910  5372 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:31.048337  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:31.049494  9746 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:31.102154  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 133134us
I20260709 13:17:31.103016  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.104386  5369 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:31.049618  9755 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:31.057533  9803 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:31.136415  9803 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.137650  9803 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.074923  5446 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:31.140897  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.079941 10015 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.143458  5339 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:31.148386  5519 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:31.152611  5373 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:31.154253  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.155530  9855 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:31.156136  9855 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.156499  9855 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.156665  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.155336  5373 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 9: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:31.092357  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:31.105300  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.106024  5369 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:17:31.168771  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.077322 10037 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:31.108276  9742 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:31.108744  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.080673  9952 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.112721  9916 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.113600  5368 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:31.081240  9950 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:17:31.117647  5515 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:17:31.121381  9917 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:31.081650  9888 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.077760 10006 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:31.157697 10005 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.081344  9927 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.077754  9440 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.127815  9746 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:31.128542  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81421.9us
I20260709 13:17:31.177191  9998 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.135186  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.214617  9917 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.217252  9980 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:31.221997  9746 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.225728  9863 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:31.169083  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.106535  5371 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:31.226861  5369 raft_consensus.cc:2368] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:31.175984  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.171101  5370 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:31.213052  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.162688  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.173342  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:31.229910  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56668.6us
I20260709 13:17:31.157352 10004 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:31.179396  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 87153.4us
I20260709 13:17:31.184441  9888 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.231936  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.232494  5366 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:31.180006  5515 pending_rounds.cc:85] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 4
I20260709 13:17:31.227727  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.232955  5515 pending_rounds.cc:107] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:31.233217  5369 raft_consensus.cc:2368] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:17:31.233320  5515 raft_consensus.cc:2889] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.101550  9410 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:31.182636  9789 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:31.172376 10037 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.236070  9410 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.238691  9410 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.240240  9934 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:31.240839  9934 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:31.121507  9978 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:31.241770  9978 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.242792  9978 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.243458  9591 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.244297  9912 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:31.183805  9901 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.190977  9952 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.231640  9892 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:31.191370  9940 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.245967  9892 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.246381  9892 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:31.247546  9940 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.191812  9755 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.247730  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.248678  9755 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.250224  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.170918  9842 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:17:31.251442  5369 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:31.162546 10015 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.260500 10015 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.261132  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.226245  9863 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:31.228401  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:31.228371  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52477.6us
I20260709 13:17:31.216627  9917 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:31.182782  9852 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.234076  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.264395  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.172552  9890 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:17:31.241199  9934 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:31.163049 10001 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.253914  9842 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.230820  9998 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.255306  9440 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.193876 10006 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.258505  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:31.230798  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:31.358901  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 128208us
I20260709 13:17:31.360194  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:31.205525  9927 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.273021  9950 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:17:31.367238  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:31.258502  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.264045  5370 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:31.234826  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 72200.8us
I20260709 13:17:31.248639  9837 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.268061  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.274418  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.277343  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1840) took 1528 ms. Trace:
I20260709 13:17:31.273137 10001 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.262080  9410 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.279743  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:31.288527  9591 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:31.279357  9852 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.361496  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.438611  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.439656  5371 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:31.267637  9948 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:17:31.359298 10005 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.262390  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.278565  9742 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:17:31.172442  9974 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:31.411715  5368 rpcz_store.cc:276] 0709 13:17:29.749067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.750555 (+  1488us) service_pool.cc:224] Handling call
0709 13:17:31.277096 (+1526541us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001e8554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:31.277260 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3059215616}
I20260709 13:17:31.412428  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.460048  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.373696  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2197) took 1109 ms. Trace:
I20260709 13:17:31.344439  9955 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:31.468961 10042 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:31.469138  5519 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:31.398032  9223 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.428905  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:31.372612  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:31.306357  9912 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:17:31.461640  5515 rpcz_store.cc:276] 0709 13:17:30.264132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.264435 (+   303us) service_pool.cc:224] Handling call
0709 13:17:30.380854 (+116419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.234024 (+853170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.373399 (+139375us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54001e6254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:31.373621 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693458688}
I20260709 13:17:31.478138  5517 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:31.433617  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.436561  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.357405  9922 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.357236  9901 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.443974  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.361992  9935 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:31.453125  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.453125  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.369990  9989 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:31.462517  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.433789  9591 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:31.494704  5522 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:17:31.495314  9591 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.496429  5522 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:31.496969  9591 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.497581  9989 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.486193  9901 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.498047  9989 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.463986  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.498832  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.424981 10001 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.408625  9426 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.467504  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.457791  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.505492  5371 raft_consensus.cc:2368] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
I20260709 13:17:31.371083 10037 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.504602  9935 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.517030  9935 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.500979  9638 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:31.519172  9638 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.523146  9901 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.523821  9889 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:31.524237  9889 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:31.356983  9842 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.473372  9223 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.490864  5524 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:31.422776  9991 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.491559  5375 raft_consensus.cc:2368] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:31.480528  9955 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.492594  5517 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:31.501780  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.499459  5367 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:31.480003  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.355731  9863 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:31.507139  9426 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:31.538746  9991 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:31.545785  9426 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:31.508788  9917 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:31.540424  9803 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:31.510221 10035 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:31.546757  9803 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.547062 10035 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.546782  9917 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.434561  9940 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:17:31.547627  9803 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.548836  9803 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:31.540500 10048 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:31.551395  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.534205  5369 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:17:31.554158  5521 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:31.556383  5523 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:31.537361  5371 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:31.539657  5375 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:31.542407  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.542905  5367 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:31.546422  9426 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.560002  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.438230  9410 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.543483  9863 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.546036  9991 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.560174  5369 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:31.544106  5522 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:31.563228  5367 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:31.569007  5371 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:31.584035  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:31.584523  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.539474  9974 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:31.584949  5523 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
W20260709 13:17:31.588419  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 314093us
I20260709 13:17:31.589774  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.590734  9810 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.549294  9917 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.589666  9922 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:31.526503 10004 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:17:31.598019  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 386249us
I20260709 13:17:31.525108  9889 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.603451  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:31.543715  9952 consensus_queue.cc:1175] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 13 status { last_received { term: 12 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:31.663973  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.536638  5370 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:31.587010  9935 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:17:31.643044  9223 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:31.643739  9842 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:31.667209  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75391.4us
I20260709 13:17:31.592324  9892 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.644431  9410 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.566617  9852 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.640638 10037 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:31.652966  5366 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:31.586381  9888 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.679076  9957 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:31.679610  9957 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:31.680639  9888 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:31.680410  9957 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.680950  6070 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:31.681319  5368 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:31.598527  9973 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:17:31.682622  9973 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:31.682994  9973 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:31.683570 10061 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:31.683842  9973 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.683951 10001 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.684722 10061 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:31.684530  9810 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:31.587229  9638 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.685544  9810 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:31.686005  9810 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.686524  9892 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:31.686952  9810 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.688105  5372 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:31.657168 10006 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.553679  9916 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:31.688514  9810 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:31.689093  9916 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:31.705677  9916 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:31.706599  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:31.640707  9974 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.706746  9916 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.707640  9746 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:31.708071  9916 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.707974  9974 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.708572  9746 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:31.708946  9746 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:31.570267  9940 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:17:31.710331  9940 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:31.710827  9940 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:31.711875  9940 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.659735  9889 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.714319  9746 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.715736  9746 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.666476  5375 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:31.668359  9894 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.716638  9934 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:31.718230 10052 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:17:31.607240  9912 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.720077  9934 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.720214  9912 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.723374  9894 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:31.622599 10015 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:31.704823 10049 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260709 13:17:31.723969  9894 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.705598  9223 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:31.726583  9894 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:31.723395  9912 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:31.685120 10061 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:31.731145 10061 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.732419 10061 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:31.723860  9855 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.001s
I20260709 13:17:31.734042  9855 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.671948  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:31.738035 10041 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.558s	user 0.004s	sys 0.000s
I20260709 13:17:31.751698  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1906) took 3642 ms. Trace:
I20260709 13:17:31.752115  5450 rpcz_store.cc:276] 0709 13:17:28.113780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.963279 (+849499us) service_pool.cc:224] Handling call
0709 13:17:28.963770 (+   491us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:28.964421 (+   651us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:30.531532 (+1567111us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b180043a7a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:17:30.629657 (+ 98125us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.039418 (+409761us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.039597 (+   179us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:31.101208 (+ 61611us) log.cc:844] Serialized 78 byte log entry
0709 13:17:31.101360 (+   152us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:31.101615 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.101927 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.127304 (+ 25377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.127384 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.132856 (+  5472us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:31.608976 (+476120us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b180043a7a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:31.688823 (+ 79847us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:31.751414 (+ 62591us) raft_consensus.cc:1685] finished
0709 13:17:31.751472 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.751634 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3085,"prepare.queue_time_us":1717717,"prepare.run_cpu_time_us":6953,"prepare.run_wall_time_us":29827,"raft.queue_time_us":51719,"raft.run_cpu_time_us":3145,"raft.run_wall_time_us":119254,"spinlock_wait_cycles":81378048,"thread_start_us":418818,"threads_started":2,"wal-append.queue_time_us":487668}
I20260709 13:17:31.685117  9973 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.765586  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.768698  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:31.741909  5367 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:17:31.739215  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67353.1us
I20260709 13:17:31.770530  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:31.780817  5519 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
W20260709 13:17:31.783962  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.787514  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:31.791930  9223 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.792356  9223 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.792659  9223 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.677908  9998 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.796277  9922 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:17:31.799256  9855 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.794488  9952 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.800765  9952 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.743767  9940 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.797137  5521 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:31.803524  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:31.793872  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.820400  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 447702us
W20260709 13:17:31.820899  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.822312  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 542623us
I20260709 13:17:31.781739  9957 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.742933 10001 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.742090  9789 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.830844  9223 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.833210  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:31.834193  5450 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.821609  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:31.840219  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:31.841078  5449 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.784870  9917 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:31.849495  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:31.887121  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:31.887861  5448 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:31.887437  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.892321  9223 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.900444  5450 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:31.902160  5449 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:31.832798  9934 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:31.910527  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:31.846818  5416 leader_election.cc:400] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:31.876045 10006 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:31.872638  9638 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.912922  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:31.919493  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:31.742926 10035 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:31.927492  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 86789.7us
I20260709 13:17:31.917217  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:31.891916  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:31.893684  9901 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:31.941816  5367 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: [11.5-11.5]
W20260709 13:17:31.942957  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.943461  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:31.944034  5368 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:31.943986  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:31.945642  5448 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:31.945964  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:31.938316  9223 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:31.946636  5449 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:31.844653  9889 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:17:31.958083  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:31.962682  5521 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.965471  9410 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:31.965977  9410 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:31.966912  9410 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:31.968567  9410 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.969741  9952 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:31.942662  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:31.894785 10005 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.913657  9927 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.981971  5520 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:31.952456  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:31.953958  5524 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
W20260709 13:17:31.955591 10054 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:31.892853  9810 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:17:31.876657  9803 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:17:31.937005 10060 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:31.879161  9912 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:17:31.958523  9894 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.940092  9638 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.960285  9426 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.899112  9991 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:31.992808  9950 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:32.003288  5524 pending_rounds.cc:85] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 11
I20260709 13:17:32.038861  5524 pending_rounds.cc:107] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:17:32.039254  5524 raft_consensus.cc:2889] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.992288  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:32.040949  5366 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:31.973188  5521 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:32.042411  5443 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:32.042826  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:32.006064  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.007920  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:32.045702  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:32.046478  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:32.047170  5444 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:32.047434  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:31.914795  5416 leader_election.cc:403] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:17:31.991828  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:31.958822  9837 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
W20260709 13:17:32.018985  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 106216us
I20260709 13:17:31.925083 10006 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:31.993093  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.914093  9996 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:17:32.061128  5519 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:32.049059  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:32.062175  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49186.3us
I20260709 13:17:32.063556  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:31.923014  9934 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.052011  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:32.011315  5368 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:31.915196 10036 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:17:32.064227  5444 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:32.065650  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:32.074749  5516 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:32.023432 10015 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.076993  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:31.958266  9989 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.077193  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:32.081499  5414 leader_election.cc:400] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:32.082074  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:32.083093  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:32.084069  5414 leader_election.cc:400] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:17:32.084396  5414 leader_election.cc:403] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.078747  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:32.079275  5441 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:32.062091 10006 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.062222  9837 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.162405  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:32.037904 10067 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.057044  9982 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:32.038694  9950 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.017365  9901 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:32.019534 10060 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:32.174780  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 328137us
W20260709 13:17:32.174619  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111171us
I20260709 13:17:32.270766  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:32.178670  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.094105 10005 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:32.178520  5445 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:32.083002  9746 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:32.258577  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:32.282203  5448 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:32.283495  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:32.284516  5448 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:32.221134  5516 raft_consensus.cc:2368] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:32.178264  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:32.249475  5521 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:32.080053 10015 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:32.079711 10064 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:32.272524  9223 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.296257  9223 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.275086  5416 leader_election.cc:400] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 8 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:17:32.299788  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:32.299831  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.287880  5441 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.156271  9996 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:32.161891 10068 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:32.175225  9910 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:32.644863  9910 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.646366  9910 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.648248  9901 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:32.302238  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.650218  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.610620  5519 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:32.605129  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.603582  9940 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.786s	user 0.000s	sys 0.018s
I20260709 13:17:32.255163 10067 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:32.604107  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 333412us
I20260709 13:17:32.660580  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:32.286729 10082 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:32.604918  9410 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.636s	user 0.019s	sys 0.002s
I20260709 13:17:32.265784  9982 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.663486  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:32.665450  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:32.286890 10005 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:32.610808  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.304411 10061 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:32.298837 10015 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.608537  9223 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:32.432468  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.505319  5450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.010s	sys 0.011s
I20260709 13:17:32.308171  9746 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:32.292081  9892 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:32.624051  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.625694  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:32.689853  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.690119  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64528.5us
I20260709 13:17:32.655306 10083 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:32.670900  9852 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.698776  9842 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.708802  9894 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.002s
I20260709 13:17:32.708693  9842 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:32.709321  9894 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:32.627501  9957 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.784s	user 0.005s	sys 0.015s
I20260709 13:17:32.630513 10058 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:32.725513  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.021s	sys 0.021s
I20260709 13:17:32.630396 10006 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.634912  9927 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:32.608186  9978 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:32.591075  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 291324us
I20260709 13:17:32.776588  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:32.293395  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 209426us
I20260709 13:17:32.654304  5444 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:32.778034  5414 leader_election.cc:400] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
I20260709 13:17:32.778427  5414 leader_election.cc:403] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.779881  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:32.655606  5441 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:32.668411  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:32.782758  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 114458us
I20260709 13:17:32.670284  5368 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:32.648861  9901 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 8. Current term is 9.
I20260709 13:17:32.653550 10068 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:17:32.680097  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.679826  5450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.010s	sys 0.011s
W20260709 13:17:32.626163 10073 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.543s	user 0.004s	sys 0.007s
I20260709 13:17:32.659582  9888 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:32.689095 10085 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.668282 10082 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:32.665566 10067 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.706773 10090 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:32.670524  9973 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.907s	user 0.020s	sys 0.000s
W20260709 13:17:32.753515  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.026s	sys 0.021s
I20260709 13:17:32.672169 10004 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:32.746501  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:32.671293 10005 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:32.671176 10061 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.787971  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:32.657145  9996 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:32.691758 10086 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:32.792045  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:32.753312  9852 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.824510  9803 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:17:32.847538  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:32.848063  9803 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:32.848433  9803 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.849327  9803 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.847599  9852 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.850662  9803 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.851794  9852 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:32.854001  9842 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:32.804045  5449 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:32.753010  9698 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:32.855523  9698 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.855930  9837 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:32.856323  9837 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.753099 10058 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.857254  9837 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.697556  9855 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:32.858457  9855 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.701961  9892 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.860486  9892 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.862216  9892 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.862762  9989 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:32.783245 10083 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
I20260709 13:17:32.820544  5367 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:32.820824  5370 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:32.820825  5368 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:17:32.866920  5368 pending_rounds.cc:85] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 9
I20260709 13:17:32.867280  5368 pending_rounds.cc:107] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:17:32.867576  5368 raft_consensus.cc:2889] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.797675  9927 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.827306  5519 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:32.869809  9426 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:32.871549  9934 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:32.882732  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:32.883610  9638 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:32.883764  5375 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:32.801141  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:32.809309  9888 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.829114 10066 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:32.806632  9955 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:17:32.808590 10082 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.824345  9922 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.892746  9922 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:32.898332  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 97288.6us
I20260709 13:17:32.899096 10060 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:32.900066  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:32.900868  9991 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:32.902936  9815 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.903425  9815 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:32.902544 10061 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.903805  9815 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:32.903935  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84167.7us
I20260709 13:17:32.904271 10061 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.905342  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:32.905696  9912 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:32.906790  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:32.907040  9852 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:32.908146  9912 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:32.800096  9978 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.742321  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:32.911768  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:32.926175  5372 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:32.912094  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:32.927167  5368 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:32.912985  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:32.928112  5370 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:32.806143 10085 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:32.941069  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:32.843025  5374 pending_rounds.cc:85] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 6
I20260709 13:17:32.941821  5374 pending_rounds.cc:107] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:32.941916  5443 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:32.942163  5374 raft_consensus.cc:2889] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.942553  5444 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:32.900079 10086 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:32.938872  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:32.944310  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 156443us
I20260709 13:17:32.951292  5375 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:32.951740  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:32.826756 10004 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:32.945284  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:32.953279  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:32.766122  9950 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:32.954326  6073 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:32.963569  5447 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:32.810174  9901 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:32.953495 10064 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.957481  5441 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:32.959762 10072 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:17:32.908738  9912 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.963550  5445 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:32.963474  5416 leader_election.cc:400] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
W20260709 13:17:32.960952  9948 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.012s	sys 0.040s
W20260709 13:17:33.003706  9948 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.013s	sys 0.040s
I20260709 13:17:33.005277  5416 leader_election.cc:400] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:33.005801  5416 leader_election.cc:403] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:32.988540  5447 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:32.933300 10091 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.948608 10085 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.965368  9426 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:33.010365  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:32.960743  9837 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.992393  9989 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.964238  9922 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:32.965620  9698 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:33.000247 10064 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:33.029392  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:33.004558  9912 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:33.035043  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.006361  9950 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.840076  9746 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.033815  9698 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:32.908753  9852 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.008747  9901 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:32.937800  9927 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:33.010082  9955 consensus_queue.cc:1175] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "86b410d62f4040c39d33dc0698998562" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
W20260709 13:17:33.034560 10077 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:17:33.068516 10091 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:33.009675 10065 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:17:32.954066 10083 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.018141  9426 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.016386  9855 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:33.067960  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.059569  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.071745  5445 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:33.091740  5445 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:33.092548  5449 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
I20260709 13:17:33.092722  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:33.093820  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.093634  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.074213  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:33.035594  9991 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:33.036275 10064 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:33.045328 10076 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.388s	user 0.001s	sys 0.001s
I20260709 13:17:33.069947  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2225) took 1310 ms. Trace:
I20260709 13:17:33.087816 10083 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:33.082419  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2229) took 1319 ms. Trace:
I20260709 13:17:33.041355 10060 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:33.040794  9998 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.087196  6073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 167) took 1396 ms (client timeout 1789 ms). Trace:
W20260709 13:17:33.144066  6073 rpcz_store.cc:269] 0709 13:17:31.679609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.706326 (+ 26717us) service_pool.cc:224] Handling call
0709 13:17:33.076176 (+1369850us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54005c1cd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:33.076339 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576508672}
I20260709 13:17:33.081579  9927 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:33.121592  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.146886  5441 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:33.106588  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.127200  5523 rpcz_store.cc:276] 0709 13:17:31.759732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.763584 (+  3852us) service_pool.cc:224] Handling call
0709 13:17:31.763957 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.764289 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.764317 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.764742 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.173996 (+409254us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:32.174040 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.174116 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.069675 (+895559us) raft_consensus.cc:1685] finished
0709 13:17:33.069723 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.069885 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24580,"raft.queue_time_us":16352,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9785,"thread_start_us":403468,"threads_started":1,"wal-append.queue_time_us":907155}
I20260709 13:17:33.069775 10088 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:33.129333  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.071678  9888 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.078507  9982 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.087816  9426 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.158053  9888 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.158670  9888 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.138700  5518 rpcz_store.cc:276] 0709 13:17:31.763177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.763316 (+   139us) service_pool.cc:224] Handling call
0709 13:17:31.763740 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.764181 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.764222 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.764739 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.999226 (+234487us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:31.999284 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.999368 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.082178 (+1082810us) raft_consensus.cc:1685] finished
0709 13:17:33.082199 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.082355 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10251,"raft.queue_time_us":15960,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9276,"thread_start_us":234014,"threads_started":1,"wal-append.queue_time_us":895596}
I20260709 13:17:33.106588  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:33.035422 10004 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.148020  5449 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:33.169243  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2376) took 1220 ms. Trace:
I20260709 13:17:33.169776  5450 rpcz_store.cc:276] 0709 13:17:31.949115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.949247 (+   132us) service_pool.cc:224] Handling call
0709 13:17:31.949562 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.949782 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:31.950102 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.162013 (+1211911us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.162241 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.168929 (+  6688us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:33.168986 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.169055 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.169184 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":603,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":2482,"spinlock_wait_cycles":22818688,"thread_start_us":1211353,"threads_started":2,"wal-append.queue_time_us":847846}
W20260709 13:17:33.172989  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.174835  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.042092  9978 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.130755  9991 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:33.166527  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.188832  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.142375 10006 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.141831 10060 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:33.198328  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2469) took 1258 ms. Trace:
I20260709 13:17:33.193105  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.201385  5445 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:33.191697  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.005s	sys 0.015s
I20260709 13:17:33.197118  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.200577  5373 rpcz_store.cc:276] 0709 13:17:31.940136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.944940 (+  4804us) service_pool.cc:224] Handling call
0709 13:17:31.945272 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.945630 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.945658 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.946095 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.168125 (+222030us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:32.168171 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.168252 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.198016 (+1029764us) raft_consensus.cc:1685] finished
0709 13:17:33.198048 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.198249 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1017,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"thread_start_us":185549,"threads_started":1,"wal-append.queue_time_us":304823}
I20260709 13:17:33.202484  5447 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.207954  9426 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.212577  5447 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:17:33.213016  9426 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:33.213213  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.006s	sys 0.015s
I20260709 13:17:33.162416 10088 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:33.216804  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:33.226330  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.226657  5449 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 9: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:33.168174  9982 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.223254  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.070541 10086 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.218648  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.230406  5445 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:33.237996  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.239140  5447 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:33.243960  5523 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:33.244022  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:33.198238  9974 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.243718  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:33.246031  9922 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:33.246644  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:33.246804  9922 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:33.247375  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:33.249159  9922 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:33.217813 10065 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.249545 10096 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.249825  5447 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: [13.5-14.6]
I20260709 13:17:33.249897 10065 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:33.253885  9922 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.255128  9922 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:33.255412  9223 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.256088  9223 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.257145  9922 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:33.253111 10065 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:33.213613  9888 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:33.258867  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.258049  9223 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.259572 10065 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:33.260010 10065 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.260419 10065 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.261827  9855 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.214269 10060 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.161305  9998 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.263909  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:33.671001  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.670676  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 406616us
W20260709 13:17:33.667943  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.673247  5374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.010s	sys 0.014s
W20260709 13:17:33.673852  5374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.011s	sys 0.014s
W20260709 13:17:33.674058  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.674346  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.677954  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:33.679838  5374 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:33.682498  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.297830  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 505824us
I20260709 13:17:33.687522  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:33.690663  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:33.693477  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:33.696231  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:33.705780  5442 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.002s	sys 0.010s
W20260709 13:17:33.705847  5443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.012s	sys 0.019s
W20260709 13:17:33.706790  5442 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.011s
W20260709 13:17:33.706972  5443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.013s	sys 0.019s
I20260709 13:17:33.269774  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:33.298117  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 348321us
I20260709 13:17:33.710949  5450 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:33.332819  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.264089  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:33.715471  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 451241us
W20260709 13:17:33.310103  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.717264  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:33.719708  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.272730  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:33.721134  5443 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:33.502084  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.727051  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:33.727777  5447 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:33.728200  5521 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:17:33.729200  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:33.730950  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.731778  5443 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.717151  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:17:33.580554  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.333170  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 334863us
W20260709 13:17:33.740716  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.519537  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59510 (request call id 169) took 1481 ms. Trace:
I20260709 13:17:33.723475  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:33.719710  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:33.283233  9952 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:33.749342  9901 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:33.749599  9952 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:33.749800  9989 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.750713  9901 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:33.495054 10035 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:33.751844  9952 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.498127 10058 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.754323 10058 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:33.755255  9952 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:33.369777 10075 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.429s	user 0.003s	sys 0.000s
I20260709 13:17:33.759708  9789 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:33.263509  9922 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:33.422120 10083 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:33.771440  5450 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:33.605064 10065 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.255278 10095 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.246592  9974 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.773723 10095 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.774981  9922 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.776437 10095 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.292223 10090 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.777058  9910 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:33.562803  9892 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.005s
I20260709 13:17:33.778133  9910 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:33.778677  9892 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:33.525066 10005 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.001s
I20260709 13:17:33.779212  9892 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:33.779333  9223 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:33.243312  9742 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.534693  9837 consensus_meta.cc:287] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 13:17:33.266283  9982 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.514585  9894 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:33.781013  9742 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.781949  9894 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:33.783989  9982 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.783674  9894 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:33.784313  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67591us
I20260709 13:17:33.785070  5447 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:17:33.582149 10085 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.009s
I20260709 13:17:33.785955  9955 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.786095 10096 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.786334 10085 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.786770  9955 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.191586 10004 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.531070  9912 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.778065 10090 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:33.515878 10084 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.551s	user 0.002s	sys 0.000s
I20260709 13:17:33.779835  9892 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.513756 10068 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:33.504613 10067 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 13:17:33.243114  9940 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.477852 10015 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.000s
I20260709 13:17:33.779961  9223 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:33.508453 10061 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.603s	user 0.013s	sys 0.000s
I20260709 13:17:33.342497  9991 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.347553 10088 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.325976  9927 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.358672  9815 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.522545  9852 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:33.779887 10005 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.544572 10064 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.773041  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:33.512380 10082 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
I20260709 13:17:33.784744  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.789829  5515 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:33.825521  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:33.288889  9803 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.539s
I20260709 13:17:33.794088  9950 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:33.797845 10015 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.806931  5519 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:33.789135  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:33.839771  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 112451us
W20260709 13:17:33.827967  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.813769  5450 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:33.741848  6070 rpcz_store.cc:276] 0709 13:17:32.038190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.064975 (+ 26785us) service_pool.cc:224] Handling call
0709 13:17:32.257294 (+192319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.636129 (+378835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.636184 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.636835 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.852929 (+216094us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b18003dd860. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:17:32.893302 (+ 40373us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b18003dd860. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:33.218774 (+325472us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:33.218816 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.218907 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.519213 (+300306us) raft_consensus.cc:1685] finished
0709 13:17:33.519247 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.519449 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68539,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9615,"spinlock_wait_cycles":19182208,"thread_start_us":365654,"threads_started":1,"wal-append.queue_time_us":822882}
I20260709 13:17:33.780383  5516 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:33.802659  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:33.828730  9950 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:17:33.829545  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 110226us
I20260709 13:17:33.798125  9223 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:33.874383  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.878278  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 135475us
I20260709 13:17:33.825599  9742 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.792637  9912 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:33.802135 10088 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.810604  9888 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.789184 10085 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:33.809835  9855 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.795826 10068 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.811309 10005 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.776501  9974 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:33.776861  9922 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.789212  9955 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:33.789623 10089 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.789404 10096 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.797330  9426 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:33.219466  9410 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:33.874153  9950 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.895995 10062 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:33.419220  9996 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.898972  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.901253  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.779850  9910 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:33.907011  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 100777us
I20260709 13:17:33.907622  9815 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:33.910283  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 107916us
I20260709 13:17:33.911695  9855 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.814566 10082 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.913194 10015 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.913643  9888 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.915820 10098 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:33.962073 10089 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:33.917356  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2240) took 1172 ms. Trace:
I20260709 13:17:33.964434  5515 rpcz_store.cc:276] 0709 13:17:32.745528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.745682 (+   154us) service_pool.cc:224] Handling call
0709 13:17:32.746009 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.829202 (+1083193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.916961 (+ 87759us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001536d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:33.917254 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399298816}
I20260709 13:17:33.918192 10065 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:33.918363  9894 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.969942  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:33.919117  9998 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.796368 10067 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:33.921411  5268 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:33.923362  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:33.894210  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:33.919064  5449 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:33.797097  9940 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:17:33.947430  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 58005.8us
I20260709 13:17:33.959276 10082 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.019650  5450 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.980472  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2400) took 1034 ms. Trace:
I20260709 13:17:34.001852  9974 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.002350  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45143us
I20260709 13:17:33.970968  5447 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.934461 10062 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.018536 10098 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:34.025874  5448 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:34.026103  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.027670  9888 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.026538  5268 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 8 to 11, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 11 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.029569 10064 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.032799  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.037595  5443 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
W20260709 13:17:34.044121  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 121401us
I20260709 13:17:34.036666  9223 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.029942  9855 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:33.949668 10090 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.067292  9991 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:34.068012  9991 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:34.068467  9991 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.020231  5444 rpcz_store.cc:276] 0709 13:17:32.946464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.946668 (+   204us) service_pool.cc:224] Handling call
0709 13:17:32.947053 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.958311 (+ 11258us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:33.708516 (+750205us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b180035cb00. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf
0709 13:17:33.724521 (+ 16005us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.894916 (+170395us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.899293 (+  4377us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.899949 (+   656us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:33.900086 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.900572 (+   486us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.924357 (+ 23785us) raft_consensus.cc:1685] finished
0709 13:17:33.933924 (+  9567us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.980244 (+ 46320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10750,"prepare.queue_time_us":315881,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":5859,"raft.queue_time_us":14787,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":56420,"spinlock_wait_cycles":12973440,"thread_start_us":523390,"threads_started":2,"wal-append.queue_time_us":191642}
I20260709 13:17:34.062150  5268 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 8 to 12, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 12 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.030169  9940 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:34.070916  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.075520  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.064414  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.033994 10062 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.080559  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:34.081842  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.082639  5374 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
I20260709 13:17:34.081871  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.091429  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:34.092641  6070 raft_consensus.cc:2410] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:34.095016  9223 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.096606  5516 raft_consensus.cc:2410] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:34.101244  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:34.104911  5443 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:34.105696  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.041787  9974 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.108731  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.115778  5450 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:34.117100  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.117952  5450 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:34.119019  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.119091  5268 catalog_manager.cc:5697] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 10 to 11, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 11 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:34.120273  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.121622  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.122545  5450 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:34.122099 10098 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:34.122102  5268 catalog_manager.cc:5697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 6 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 11 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.127377  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.127091  5268 catalog_manager.cc:5697] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 4 to 6, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 6 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.128297  5450 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:17:34.129472  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.130475  5450 raft_consensus.cc:2410] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:34.129896  5268 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 11 to 13, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 13 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.131611  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.133474  5450 raft_consensus.cc:2410] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:34.143043 10067 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.133294  5268 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 9 to 10, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 10 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:34.145967  5270 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 156) took 21243 ms (client timeout 15000 ms). Trace:
I20260709 13:17:34.146863  6073 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:34.138337  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1951) took 1021 ms. Trace:
I20260709 13:17:34.196480  5447 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:34.156958  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.173840  5442 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.173630  5373 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:34.217393  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.173791  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.165103  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1942) took 1074 ms. Trace:
I20260709 13:17:34.142037  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.174877  5370 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:34.172508  5375 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 6. (term mismatch)
I20260709 13:17:34.174278  5449 rpcz_store.cc:276] 0709 13:17:33.117309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.248309 (+131000us) service_pool.cc:224] Handling call
0709 13:17:33.248619 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.028248 (+779629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.138012 (+109764us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b540028cb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:34.138272 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475492224}
I20260709 13:17:34.220504  5448 rpcz_store.cc:276] 0709 13:17:33.091129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.094835 (+  3706us) service_pool.cc:224] Handling call
0709 13:17:33.095206 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.069469 (+974263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.164758 (+ 95289us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54003bcc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:34.165010 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993486208}
W20260709 13:17:34.149391 10123 log.cc:927] Time spent T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 13:17:34.226974  5375 pending_rounds.cc:85] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 5
I20260709 13:17:34.235523  5444 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:34.230921  5443 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 8.
I20260709 13:17:34.176304  9940 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.239359  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.292903  5447 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:34.167291  9974 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.245105  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.248942  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:34.239059  5375 pending_rounds.cc:107] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 14.6
I20260709 13:17:34.250137  5370 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:34.250054  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:34.252280  5521 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:34.294759  5375 raft_consensus.cc:2889] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:34.255800  5442 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:34.241182 10064 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.265648  9837 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.266330  9803 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.179158 10089 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:34.268404 10060 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.005s
I20260709 13:17:34.280603  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.281888  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.305842  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.283414  5373 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:34.296505  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.155740  5268 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 7 to 8, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 8 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:34.285394  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:34.286397 10004 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:34.241465  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.287451  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.287725  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.270465  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:34.274891  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.244071  5518 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:34.288468  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.283466  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.289563  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:34.277772  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 201870us
I20260709 13:17:34.290392  5441 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:34.255455  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2377) took 2305 ms. Trace:
I20260709 13:17:34.302269  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.302860  6070 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:34.284461  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:34.307675  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.307847  5442 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:34.307917  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.312834  5448 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 7: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:34.304514  9892 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.004s
I20260709 13:17:34.323470  5450 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:34.324827  5369 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:34.319821  5372 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:34.318374  5517 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:34.326884  5449 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:34.328011  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.316439  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:34.306003 10068 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.318028  5516 raft_consensus.cc:606] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:34.334290  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 391235us
W20260709 13:17:34.335188  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49897.5us
I20260709 13:17:34.335041  5447 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:17:34.103240  5340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.733s (SENT) [suppressed 12 similar messages]
W20260709 13:17:34.337709  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.325372  5444 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:34.353503  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.356467  5516 raft_consensus.cc:614] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:34.352710  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.358692  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.358526  5520 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
W20260709 13:17:34.361214  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.362061  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.355108  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.352015  5524 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:34.363055  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.363735  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:34.364784  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.362879  5372 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:34.366008  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.348925  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.316242  5446 rpcz_store.cc:276] 0709 13:17:31.949451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.949567 (+   116us) service_pool.cc:224] Handling call
0709 13:17:31.949906 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:32.018785 (+ 68879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.018815 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:32.027432 (+  8617us) log.cc:844] Serialized 52 byte log entry
0709 13:17:32.591862 (+564430us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:32.995134 (+403272us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.995448 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.995539 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.515009 (+519470us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:34.084202 (+569193us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b24002bf9e8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0b259c4 00007fc1d0b23acb 00007fc1d0cdedc9 00007fc1d0cdea55 00007fc1d0cddfb0 00007fc1d3954488 00007fc1d3954be8 00007fc1d392c398 00007fc1d392776a 00007fc1d3926bb6
0709 13:17:34.254968 (+170766us) raft_consensus.cc:1685] finished
0709 13:17:34.254995 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.255254 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68466,"prepare.queue_time_us":555292,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":58,"raft.queue_time_us":71678,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":40530,"spinlock_wait_cycles":278260864,"thread_start_us":777511,"threads_started":2,"wal-append.queue_time_us":738565}
I20260709 13:17:34.366674  5370 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:34.369573  5367 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:34.370164  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.370662  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.371417  5367 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:34.371477  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:34.367084  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53018us
I20260709 13:17:34.372738  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.375872  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.376237  5448 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:34.312986 10060 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.388701  5447 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:34.376641  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.376765  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:34.379819  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77623.5us
I20260709 13:17:34.385413  5449 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:34.390488  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.387337  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.391376  5441 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:34.388208  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.316675  9803 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.327011  9892 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.377763  9998 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:34.153049  5270 rpcz_store.cc:269] 0709 13:17:12.902792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.909298 (+  6506us) service_pool.cc:224] Handling call
0709 13:17:34.145645 (+21236347us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:24.429383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:24.430108 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:24.430166 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:17:24.430199 (+    33us) tablet.cc:662] Decoding operations
0709 13:17:24.432572 (+  2373us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:24.432675 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:24.432714 (+    39us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:17:24.532700 (+ 99986us) tablet.cc:701] Row locks acquired
0709 13:17:24.532753 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:17:24.533073 (+   320us) write_op.cc:270] Start()
0709 13:17:24.533218 (+   145us) write_op.cc:276] Timestamp: P: 1783603044532973 usec, L: 0
0709 13:17:24.533255 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:17:24.654861 (+121606us) log.cc:844] Serialized 11532 byte log entry
0709 13:17:25.659431 (+1004570us) op_driver.cc:464] REPLICATION: finished
0709 13:17:25.797228 (+137797us) write_op.cc:301] APPLY: starting
0709 13:17:25.803837 (+  6609us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:25.807147 (+  3310us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:25.807291 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:25.987337 (+180046us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:25.987744 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=58
0709 13:17:25.987805 (+    61us) write_op.cc:312] APPLY: finished
0709 13:17:25.988340 (+   535us) log.cc:844] Serialized 193 byte log entry
0709 13:17:25.988634 (+   294us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:25.988863 (+   229us) write_op.cc:454] Released schema lock
0709 13:17:25.988958 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:26.018241 (+ 29283us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:26.018294 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158060,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":102610,"apply.run_cpu_time_us":12757,"apply.run_wall_time_us":202708,"num_ops":29,"prepare.queue_time_us":228579,"prepare.run_cpu_time_us":21129,"prepare.run_wall_time_us":403790,"raft.queue_time_us":219828,"raft.run_cpu_time_us":15648,"raft.run_wall_time_us":126997,"replication_time_us":1096460,"thread_start_us":471736,"threads_started":4,"wal-append.queue_time_us":379565,"wal-append.run_cpu_time_us":51215,"wal-append.run_wall_time_us":1942321}]]}
I20260709 13:17:34.422493  5375 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 7: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:34.408747 10092 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.426218 10092 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.428735 10092 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.429800  5371 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:34.431047  5442 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:34.406958  5367 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.410849 10105 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.411069  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.412693  5373 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:34.358668  9940 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.416126  5446 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:34.417790  5372 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:34.351858 10068 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:34.314651  9837 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.424809  5414 leader_election.cc:400] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:34.425366  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.409199  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1964) took 1086 ms. Trace:
I20260709 13:17:34.420792  9991 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.442670  5524 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:34.445103  5443 rpcz_store.cc:276] 0709 13:17:33.322883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.397196 (+1074313us) service_pool.cc:224] Handling call
0709 13:17:34.408462 (+ 11266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.408756 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.408789 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:34.408851 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:34.408896 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.408962 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.409113 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:34.452171  9803 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.453711  5445 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:34.455263  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.455718  9837 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.456146  5375 raft_consensus.cc:2368] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
I20260709 13:17:34.435979  5268 catalog_manager.cc:5697] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 5 to 10, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 10 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.456171  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1946) took 1363 ms. Trace:
I20260709 13:17:34.458673  5445 rpcz_store.cc:276] 0709 13:17:33.092363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.244954 (+152591us) service_pool.cc:224] Handling call
0709 13:17:33.245294 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.454260 (+1208966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.455887 (+  1627us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540019c654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:34.456113 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2708865408}
I20260709 13:17:34.460230  5445 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:34.461717  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.462760  5366 raft_consensus.cc:2368] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:34.464628  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:34.465893 10082 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:34.466341 10082 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.466698 10082 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.458238  5268 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 8 to 10, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 10 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.471505  5268 catalog_manager.cc:5697] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 6 to 8, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 8 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.474277  9892 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.475471  5441 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:34.478916  5449 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 13:17:34.479123 10060 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.481089  9989 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:34.481742  9989 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.483870  9989 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.483911  9991 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.487543  9940 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.438266 10085 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.488763 10085 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.486176 10082 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.461961  5445 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:34.432518  9855 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:34.504698  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73697.3us
I20260709 13:17:34.502388  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2405) took 1215 ms. Trace:
I20260709 13:17:34.506515  5446 rpcz_store.cc:276] 0709 13:17:33.232669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.401941 (+1169272us) service_pool.cc:224] Handling call
0709 13:17:34.415543 (+ 13602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.440429 (+ 24886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.448286 (+  7857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:34.437885 10130 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.535338  5450 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:34.435025  9815 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.516723  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 413487us
I20260709 13:17:34.538487  5447 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:34.541131  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 141930us
W20260709 13:17:34.545722  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.546190  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.547529  5369 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:34.551476  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.555397  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1961) took 1301 ms. Trace:
I20260709 13:17:34.491559 10085 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.504326 10058 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.515419 10130 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.555958  5447 rpcz_store.cc:276] 0709 13:17:33.242715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.394790 (+1152075us) service_pool.cc:224] Handling call
0709 13:17:34.501179 (+106389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.543947 (+ 42768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.544223 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:34.561753  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.560146  5366 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:34.503681  9855 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:34.572450  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.569906  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53528.6us
I20260709 13:17:34.567590  9991 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.577248  9991 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.579574  9991 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:34.580576  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.581106  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.582487 10082 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.583105 10035 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.583837 10035 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.584575  9892 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:34.587474  9950 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.565s	user 0.003s	sys 0.008s
I20260709 13:17:34.587999  9950 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:34.590690  9855 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.592757  9855 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:34.597295  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.603600  9223 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.606055  5369 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:34.573128 10058 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.537031 10105 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.619881  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.620651  5366 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:34.620846 10035 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.622401  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:34.623392 10035 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:34.623952 10035 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.624388 10035 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:34.626700 10058 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.613605 10082 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.573598 10130 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:34.632616  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.557688  9815 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.637919  9223 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.628250 10082 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.641270 10126 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:17:34.647104  9815 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.648912  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:34.651352  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.658610  5515 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:34.653641  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:34.650565 10062 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.563s	user 0.014s	sys 0.000s
I20260709 13:17:34.596290 10098 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:17:34.671522  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.672621  5369 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 10: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:34.665580  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.666247  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:34.652089  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.668952  9223 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.677841  5490 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:34.675148  5366 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:34.670146 10068 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.681867  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.683245  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.683884  5447 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:34.684526  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.684862  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.685178  5522 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:34.685667  9698 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.686474 10105 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.686671  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.687182  5447 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:34.687486  5522 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:34.686700  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.688133  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.690274  5447 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:17:34.691767  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:34.693403  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.695583  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.697448  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.705739  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.706092  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.711329  5520 raft_consensus.cc:2410] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:34.696535  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.694270  5447 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:34.637224  9803 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:17:34.718528  5446 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:34.721756  5367 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
W20260709 13:17:34.723551  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45838.4us
I20260709 13:17:34.724599  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:34.726327  9223 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:34.656702  9837 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:17:34.730417  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.731343  5447 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:34.663985 10085 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:17:34.739421  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.739701  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.676348 10062 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.656987  9910 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:17:34.738476  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.733979  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:34.738452  9223 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.728199  9892 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:34.744429  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:34.746768  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.729009  9991 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:34.750041  5366 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:34.750869  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:34.753516  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:34.754634  5447 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:34.731132 10068 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.760427  5520 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:34.750149  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:34.762738  5522 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:34.763904  9223 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:34.764386 10141 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:17:34.764554  9223 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:34.764905  9223 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.765280  9223 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:34.749203  9892 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.766963  9892 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:34.758008  9912 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:34.768500  9912 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.746232  9815 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.768908  9912 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.765128 10064 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:34.769054  9815 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:34.771044 10144 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.151s	user 0.003s	sys 0.000s
I20260709 13:17:34.764986  9998 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.772701  9998 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:34.773241  9698 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:34.740846 10105 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.777151  5446 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:34.772254  5445 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:34.786840 10035 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.789394 10035 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.789263  9746 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.789680  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.792186  9940 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.794317  9746 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:34.792892  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.793639 10064 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:34.797528  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47460.7us
W20260709 13:17:34.798488  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.807000  5366 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:34.735119  9888 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:34.815300  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.811477  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:34.816314  5370 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 7.
I20260709 13:17:34.796308 10058 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:34.759721 10088 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:34.770503  9991 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:34.799594 10135 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:34.794677  9940 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.832511  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:34.836129  5520 raft_consensus.cc:606] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:34.836615  5520 raft_consensus.cc:614] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:34.825521  9912 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:34.838871 10136 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.223s	user 0.001s	sys 0.001s
W20260709 13:17:34.835587  5340 leader_election.cc:336] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.719s (SENT)
I20260709 13:17:34.839732  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.842343  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.856880  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:34.818274  9950 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:34.821587 10058 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.800858 10068 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:34.839920  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:34.810099 10064 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.865414  5450 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:34.864259  5366 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:17:34.868562  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.870553  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.817649  9996 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:17:34.859124 10035 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:34.878919  5375 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:34.866709 10058 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:34.883353  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 54139.5us
I20260709 13:17:34.834245 10088 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.883579  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.892964  5522 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:34.885013  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:34.894116  5524 raft_consensus.cc:606] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:34.894596  5524 raft_consensus.cc:614] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:34.896905  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.889595  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.898460  6070 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:34.898752  5516 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:34.900979  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1973) took 1195 ms. Trace:
I20260709 13:17:34.876365 10004 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:34.901779  5444 rpcz_store.cc:276] 0709 13:17:33.702411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.419843 (+717432us) service_pool.cc:224] Handling call
0709 13:17:34.420196 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.420480 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:34.602037 (+181557us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.896570 (+294533us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:34.896652 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:34.896718 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.897005 (+   287us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.897253 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":260814,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":10230,"thread_start_us":454093,"threads_started":2}
I20260709 13:17:34.904405  5366 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:34.878140  9940 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:34.907307  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 173373us
I20260709 13:17:34.891789 10082 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.911782  5375 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:34.913211  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.896904 10035 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:34.912277  5339 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:34.913347  5375 pending_rounds.cc:85] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 7
I20260709 13:17:34.920441  5375 pending_rounds.cc:107] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:17:34.920711  5375 raft_consensus.cc:2889] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:34.929639  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:34.931877  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.932554  5372 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
W20260709 13:17:34.932719  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.909158  9815 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.880856  9746 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.939455  5366 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:34.924882  9940 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.954460  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.956714  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:17:34.957841  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.960264  5520 raft_consensus.cc:2368] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:34.961006  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.957473  5516 raft_consensus.cc:606] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:34.961680  9223 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:34.966677  5524 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:34.942759 10062 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:34.955413  9940 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.974597  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.960320 10004 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:34.981259  9223 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:34.983345  5369 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:34.986548  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:34.987272  5375 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:34.983036  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:34.979669  9940 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.999286  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:34.980878  9989 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.981671 10004 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.003899  5516 raft_consensus.cc:2368] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14.
I20260709 13:17:35.007999  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:35.008658  5520 raft_consensus.cc:606] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:35.009063  5520 raft_consensus.cc:614] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:35.011121  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:35.000804  9746 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:35.017270  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.024641  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:35.009491 10147 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.234s	user 0.000s	sys 0.002s
I20260709 13:17:35.029212  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:35.030026  5524 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:35.008571 10004 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.033607  6070 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:35.035120  5366 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:35.038583  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.039304  5375 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:35.046142  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.012349  9991 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:35.050065  5523 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:35.050618  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:35.056597  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:35.056958  5518 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:35.053511 10138 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.534s	user 0.004s	sys 0.000s
I20260709 13:17:35.061739  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:35.062561  9998 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.064893  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:35.066954  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:35.058295  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:35.009060  9989 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.025319 10160 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:35.071755  5519 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:35.071404  9223 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:35.078891  9223 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:35.079479  9223 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:35.049327 10149 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.147s	user 0.002s	sys 0.000s
I20260709 13:17:35.075652  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:34.995402 10035 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.035686 10064 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:35.086378  5521 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:35.059144  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:35.036361  9888 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:35.035395 10068 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.032233 10098 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:35.089493  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:35.084137  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.093067  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.093737  5372 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.076588 10060 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.096148  5366 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:35.100903  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.100955 10068 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:35.101733  5445 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
I20260709 13:17:35.102639  9989 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:35.102916  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.103271 10060 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:35.102674  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:35.105545 10139 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.604s	user 0.003s	sys 0.000s
I20260709 13:17:35.091002  9888 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.109261  9888 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:35.109771  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:35.110401  5520 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.113771  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.114499  5442 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:17:35.114753  9912 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:35.115236  9855 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.522s	user 0.014s	sys 0.000s
I20260709 13:17:35.032553 10158 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:35.098883  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.105041  5441 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
I20260709 13:17:35.122182  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:35.086624 10160 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:35.091702 10098 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:35.135708  5518 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:17:35.139264 10156 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:17:35.143354  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.144100  5444 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:17:35.145555 10135 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:35.145998 10135 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:35.147374  5524 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:35.147118 10135 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:35.148468 10135 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.154129 10088 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:35.161819  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.166455  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:35.168283  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:35.169327 10082 raft_consensus.cc:2764] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:35.170670  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:35.172243  5519 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:35.174525  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 1969) took 1473 ms. Trace:
I20260709 13:17:35.174978  5448 rpcz_store.cc:276] 0709 13:17:33.700685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.422284 (+721599us) service_pool.cc:224] Handling call
0709 13:17:34.442411 (+ 20127us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:34.492911 (+ 50500us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:34.813306 (+320395us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.961499 (+148193us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:34.978571 (+ 17072us) log.cc:844] Serialized 78 byte log entry
0709 13:17:34.978840 (+   269us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:34.980770 (+  1930us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.989737 (+  8967us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.989947 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.990032 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.155986 (+165954us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b180013b280. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:35.158048 (+  2062us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b180013b280. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:35.174292 (+ 16244us) raft_consensus.cc:1685] finished
0709 13:17:35.174315 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.174465 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15793,"prepare.queue_time_us":204265,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":99,"raft.queue_time_us":5501,"raft.run_cpu_time_us":685,"raft.run_wall_time_us":47334,"spinlock_wait_cycles":16181888,"thread_start_us":376483,"threads_started":2,"wal-append.queue_time_us":168747}
I20260709 13:17:35.185096  5520 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:35.187223  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:35.187942  5517 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:35.187809  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:35.192200  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:35.193588  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.197371  5372 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
W20260709 13:17:35.198535  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.194707  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.204234  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.121490 10060 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:35.123710  9855 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:35.214560  9837 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:35.214996  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.215909 10158 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.221673  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:35.216564  9950 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:35.205391  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:35.220142  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 95075us
I20260709 13:17:35.232710  9223 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.223122  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:35.209164  9698 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:35.203899 10159 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.237905  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.242086  5441 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:35.218901  9815 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:35.250247  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:35.259021  5442 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:35.219556  9855 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:35.224944  9837 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.251791  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.232664  9950 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.261202  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:35.261794  9223 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:35.261890  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:35.241496 10060 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:35.233794 10158 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:35.260618 10157 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:17:35.231980  9912 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:35.257869 10085 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:35.258739  9815 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:35.280597  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54046.9us
I20260709 13:17:35.282907  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.242097 10105 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:35.279459  9950 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.240170 10062 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.279644  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:35.271818  9855 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.263334  9698 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:35.274835  9837 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:35.292812  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.338356  5447 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:35.284798 10158 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.297675  9223 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:35.298818 10130 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
I20260709 13:17:35.298749  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.287113 10092 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:17:35.272598 10098 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.307557  9815 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:35.311437  5375 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:35.313709 10058 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.316008  5442 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:35.321576  5449 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.295845  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:35.325173  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.341305  5447 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:35.271456  9910 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:17:35.354476  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70495.3us
I20260709 13:17:35.342430  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.355016  5374 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:35.346603  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:35.285589 10035 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.348567  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.356024  5446 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:35.289667 10085 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:35.350186  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51500.6us
I20260709 13:17:35.352020  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.322904 10105 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.357478  5375 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:35.355522  5441 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:35.358769  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.375931  5367 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:17:35.376034  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:35.376595  5441 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.377185  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.377892  5367 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.378700  6043 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.367502  5414 leader_election.cc:400] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:35.381788  5414 leader_election.cc:403] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:35.366238  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.396222  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.396783  5368 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.457957  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:35.411125  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46235.8us
I20260709 13:17:35.459055  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.354341  9912 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.461086  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:35.468415  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.403429  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 130205us
I20260709 13:17:35.397027  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.483577  5373 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:35.471539  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:35.471696  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.462438  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:35.475495  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 108186us
I20260709 13:17:35.489187  5414 leader_election.cc:400] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14.
I20260709 13:17:35.489629  5414 leader_election.cc:403] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:35.495748  5445 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:35.374632  9746 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:35.456722 10068 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:35.484566  5442 raft_consensus.cc:2376] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13. Re-sending same reply.
I20260709 13:17:35.357932 10035 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.343255 10062 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.374881  9998 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:35.352192 10130 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:35.507685  5367 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:35.385579 10085 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.534650 10130 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.535918  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.536489  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.537180  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:35.540192  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51123.8us
I20260709 13:17:35.361822 10105 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:35.547428  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.548105  5375 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:17:35.548997  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.550063  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.552568  9888 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.553818  9910 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:35.513527 10035 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.557874  9803 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.558372  9803 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.558730  9803 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.560369  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:35.510684  9912 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.567060  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.567608  9912 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.567975  5370 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:35.569742  9892 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.005s
I20260709 13:17:35.570186  9892 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:35.571785 10058 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.512945 10068 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.572618 10068 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:35.573194  9892 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:35.574388  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.548779  9698 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.576234  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.576970  5375 raft_consensus.cc:2368] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14.
I20260709 13:17:35.578706 10062 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:35.573904  9940 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:17:35.512833 10082 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:35.579710  9940 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.582072  9940 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:35.583654  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.584892  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.585772  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:35.586956  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48605.2us
I20260709 13:17:35.588178  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:35.589100 10064 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:35.589874 10064 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.591413  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:35.592396  5445 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:35.595557  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:35.595661  5368 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:35.599123  5442 raft_consensus.cc:2376] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13. Re-sending same reply.
I20260709 13:17:35.605779  5371 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:35.606118  5373 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:35.575379  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:35.609016  5375 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:35.609643  5446 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:35.397343 10060 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.201s
W20260709 13:17:35.624228 10004 consensus_meta.cc:287] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.001s
I20260709 13:17:35.625758 10004 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:35.628736 10004 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.574446 10088 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:35.637817  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154434us
I20260709 13:17:35.632802  9888 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:35.640874  5441 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:35.644199  5447 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:17:35.647873  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 290879us
I20260709 13:17:35.675110  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:35.676247  5367 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:35.674451  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.679996  5370 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
W20260709 13:17:35.681149  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 85702.4us
W20260709 13:17:35.682188  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.682137  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:35.683249  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.685158  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.619415 10064 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:35.687554  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.681275  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.701445  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:35.706414  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.713366  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:35.714037  5519 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:35.709796  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:35.718398  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.719396  5521 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:35.723546  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 265663us
I20260709 13:17:35.694803 10062 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:35.722124  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:35.725540  5524 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.699337 10175 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:35.735960  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:35.763155  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:35.708371  9892 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.771126  5524 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:17:35.772898  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 202143us
I20260709 13:17:35.726464 10062 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:35.774006  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 302491us
W20260709 13:17:35.753615 10135 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.003s
W20260709 13:17:35.777544  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.776818  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.714954 10058 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:17:35.790113  6042 leader_election.cc:336] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.676s (SENT)
I20260709 13:17:35.791745  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:35.772862  5519 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:35.726848  9746 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:35.807320  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 260192us
I20260709 13:17:35.753743 10092 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:35.777930  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:35.773496 10064 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:35.766283  9892 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.778563  9998 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:35.824215  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:35.823474  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47487us
W20260709 13:17:35.833168  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55397.1us
I20260709 13:17:35.792482 10062 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:35.842206  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 160193us
I20260709 13:17:35.844576  9698 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:35.845165  9698 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.846421  9910 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.820205 10092 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.854781  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.822527 10189 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:35.830412 10004 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:35.833351  9892 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.251364 10159 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.841739  9996 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:35.881796  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 107242us
I20260709 13:17:35.840178 10064 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:35.878286 10092 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:35.885151  5339 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.885561 10189 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.895671 10189 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:35.895929 10098 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.896416 10004 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:35.897068 10004 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:35.898065 10004 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.899289 10190 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:35.899881 10190 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:35.887423  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:35.918211  5416 leader_election.cc:400] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
I20260709 13:17:35.918578  5416 leader_election.cc:403] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:35.919302 10193 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:35.919735 10193 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:35.920126 10193 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:35.920442  5449 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:35.920266 10064 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.921150 10088 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14.
I20260709 13:17:35.753788 10175 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.925596  9996 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:35.926445 10175 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.926642  9996 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:35.289093 10160 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:35.884490  9950 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.002s
I20260709 13:17:35.929004  9996 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:35.888298  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 158262us
I20260709 13:17:35.903110  9803 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.929605  9746 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.930128  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:35.931550  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:35.931785  9803 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.932554  5515 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 13:17:35.879987 10168 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.282s	user 0.003s	sys 0.002s
I20260709 13:17:35.902993 10194 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:35.914601 10085 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.916467 10060 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:35.847353  9910 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:17:35.928690  9950 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:35.905957 10180 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:17:35.919742  5416 leader_election.cc:400] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
W20260709 13:17:35.933897  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48871.6us
I20260709 13:17:35.890141 10172 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:35.849474 10140 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:35.847378  9698 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.945250  9223 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:35.950973  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:35.953541  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:35.904066  9998 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:35.962071  5416 leader_election.cc:403] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:17:35.900775 10190 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.986290 10062 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.988761 10062 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.957162 10082 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:35.981564 10178 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.961946 10189 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
W20260709 13:17:35.994606  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 155301us
W20260709 13:17:35.983256  9837 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:17:35.984150 10068 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:35.985146  9950 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:35.974881  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:35.986577  9855 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:17:35.975705  9998 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:35.980949  9892 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.992098  5521 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:35.951857 10060 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:35.975368 10172 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:35.983175 10176 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:17:36.019418 10068 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:36.007961  9837 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.999543 10167 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:17:36.009799  9855 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.008087 10064 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:36.023310 10167 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:36.023700 10167 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:36.023900 10085 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:35.990211  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.993301  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 285425us
I20260709 13:17:36.010000  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:35.989604 10140 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:17:36.012557  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 79795.1us
I20260709 13:17:36.013978 10060 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:35.999192  9888 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:36.022457  9837 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:36.008288  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 88664.5us
I20260709 13:17:36.030542  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:36.034569  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:36.004910 10194 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:36.036139 10172 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:36.037657  9888 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:36.038632  9888 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.039940 10085 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:36.041467 10068 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.041601 10140 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:36.042972  9698 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:36.043526  9698 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:36.044730  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:35.996447 10082 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.059329  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:36.004791 10062 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:17:36.033907 10167 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.063359 10085 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:36.073108 10189 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.069548  9837 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:36.096331  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:36.092787  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:36.086499  9698 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.099028  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:36.100696  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:36.102241 10098 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:36.103012 10098 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:36.104730  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:36.105767 10004 raft_consensus.cc:2764] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:17:36.107144  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:36.107962 10004 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:36.108340 10004 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:36.108678 10004 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.111070  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:36.113288  6070 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:36.116291  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:36.036183 10194 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:36.126495 10204 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:36.142751  5515 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:36.143074  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:36.096686  9855 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.115717 10088 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:36.140224  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.116032 10185 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:36.128221 10035 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.571s	user 0.017s	sys 0.005s
I20260709 13:17:36.088449 10172 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:36.116830 10167 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:36.124199 10158 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.003s
I20260709 13:17:36.154407  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:36.159937  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:36.127879 10178 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:36.158649  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:36.162290  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.113613 10105 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:36.162436  9815 consensus_meta.cc:287] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.003s
I20260709 13:17:36.155613 10064 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:36.158174 10196 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.155707 10185 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.152621 10159 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.176781  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:36.186414  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.189544  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:36.191838  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:36.192435  5524 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:36.192715  5515 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:36.204236  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:36.209563  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:36.210525  5448 raft_consensus.cc:2410] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:36.209290  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:36.214103  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:36.255131  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.255905  5444 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:36.184585  9888 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:36.238885  5517 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:36.186004 10064 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:36.257858  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:36.261999  5443 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:36.258760  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.263181  5449 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.163359 10035 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.197136 10185 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:36.265549  5519 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:36.178521 10098 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:36.166443 10158 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.266286  5521 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
W20260709 13:17:36.269140  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 115131us
I20260709 13:17:36.278426  9837 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:36.183485  9815 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.185317 10197 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:17:36.312708  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:36.312919  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.312036  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.312945  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.329107  5442 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.329496  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.312706  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:36.330716  5447 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
W20260709 13:17:36.281064  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.339033 10209 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:36.336589 10060 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:36.343820 10158 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.316004 10088 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:36.346247 10088 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:36.346786 10088 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.349968  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:36.351497  9815 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:36.311770 10189 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.352610 10189 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.196466 10196 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.312700 10159 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:36.365440 10160 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:36.349884 10098 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:36.365799 10159 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.366124 10160 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.367224 10098 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.368439 10160 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.369982 10213 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.370419 10105 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:36.372537 10035 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:36.281096  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:36.374513  6070 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.370357  5369 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:36.375403  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.282658  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 105964us
W20260709 13:17:36.317765  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 108327us
I20260709 13:17:36.212419 10085 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:36.322249  5446 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:36.267396 10064 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.393179  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:36.263854  9888 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:36.269697 10178 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:36.320668  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:36.370710  9746 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:36.395792  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:36.370483 10213 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.369038 10159 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.409987  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:36.410998  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.412025  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:36.414213  5517 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:36.416491  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.417106  5446 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.422348 10092 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.426097  5369 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:36.427913  5446 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:36.336527 10193 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.385846  5372 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:36.387056  5373 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:36.389487  9892 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:36.390105 10196 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:36.390861  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:36.391559  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:36.392366  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.451592  5370 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:36.451753  5367 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.452267  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.453152  5446 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.453826  5442 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:36.403847  9888 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:36.405079  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.408159  5449 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:36.313238  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:36.429172  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:36.431366  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 110754us
I20260709 13:17:36.434865  6070 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:36.427215  9855 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:36.387610 10082 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.442693 10160 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.494109  5366 raft_consensus.cc:2410] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:36.497931  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.499046  5368 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:36.458046 10062 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:36.458280 10191 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:36.450579  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:36.463423  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.400812  9746 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:36.468297  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 89963.2us
W20260709 13:17:36.438712  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 126089us
I20260709 13:17:36.509137  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.509809  5442 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.425272  9837 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.484161  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.520145  5369 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:36.528111  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.528751  5366 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.534058  5442 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:36.484524  5367 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:36.485985  5448 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:36.535778  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.443261  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:36.507256  5373 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:36.534734  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.535778  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.536747  5442 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.537042  5450 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:36.441766  9989 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:36.536288  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:36.537083  5368 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.538012  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.541764  5367 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:36.506157 10191 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.546423  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.546485  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:36.546657  5448 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:36.547206  5445 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:36.530427 10212 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:17:36.545233  5446 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:36.542888  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:36.553537  5447 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:36.496443  9855 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:36.544402  9998 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:17:36.560425  5367 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:36.538777 10062 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:36.579689  5369 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:36.554136  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:36.574810  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.551402 10191 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.525844 10167 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:17:36.588184  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 121562us
I20260709 13:17:36.602432  5367 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:36.602449  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48395.7us
I20260709 13:17:36.601157  5450 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 8.
I20260709 13:17:36.555990  9815 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:36.589305  9998 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.618026  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:36.569823  5442 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:36.610725  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:36.621482  5367 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:36.621892  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:36.622622  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.622754  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.624442  5367 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:36.626081  5368 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:36.633296  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:36.635191  5369 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:17:36.561851 10218 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:17:36.640712  5442 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:36.620234 10196 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:36.619560  9989 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.543334 10085 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.629069  9892 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:36.627128 10219 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:36.619956  9815 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:36.605979 10004 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.698766  9998 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.699049 10182 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:36.700670  5444 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:36.691151  5367 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
W20260709 13:17:36.713887  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 95996.4us
I20260709 13:17:36.714759  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:36.589707  9746 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.716054  5367 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:36.715420  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:36.724550  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.719902  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.725737  5369 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:36.690680 10189 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.700333  9815 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:36.751631  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 308393us
I20260709 13:17:36.753577  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:36.685951 10159 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:17:36.704061 10182 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:36.707947  9892 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:36.763324 10234 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:36.765481  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:36.688117 10214 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 13:17:36.771806  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84731.9us
I20260709 13:17:36.780066 10234 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:36.780603 10234 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:36.753696 10193 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.749262 10221 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:36.788843  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:36.788692  9746 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.798158 10234 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.741542  5369 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:17:36.802212  6043 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:36.804018  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:36.789323 10221 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.806407 10221 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.791095 10218 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:17:36.810075 10226 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:17:36.789376 10225 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:17:36.822657  9892 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:36.823280  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:36.824157  5373 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:36.825755 10206 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.397s	user 0.003s	sys 0.007s
W20260709 13:17:36.827822 10220 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:17:36.829371  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:36.831264  5370 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:36.832335  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:36.832720  5370 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:17:36.836923  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 121564us
I20260709 13:17:36.838027  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:36.817698 10092 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:36.861654 10092 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:36.818038  9855 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.818526 10064 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:36.820429 10222 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:17:36.821017 10223 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.869064  9996 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:36.838135  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84658.3us
I20260709 13:17:36.874874  5369 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:36.815138  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:36.840346  5366 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:36.875679  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 118955us
I20260709 13:17:36.843499  5445 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:36.833314  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:36.860914 10189 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:36.860719 10193 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:36.744076 10062 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:36.821750  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:36.878613  5450 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
W20260709 13:17:36.866681 10185 consensus_meta.cc:287] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.544s	user 0.002s	sys 0.010s
W20260709 13:17:36.881361 10208 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.610s	user 0.001s	sys 0.004s
I20260709 13:17:36.881317 10185 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.883937 10185 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.884747  5371 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:36.885589 10200 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.886463 10200 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:36.887547 10064 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:36.888578 10200 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:36.860917 10174 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.838033  9989 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:36.889261 10172 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:36.889772  9989 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:36.890232  9989 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.890529 10172 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:36.891453  9855 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:36.891860  9855 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:36.892876  9855 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:36.895030  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 57094.3us
W20260709 13:17:36.895712 10216 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.639s	user 0.000s	sys 0.004s
I20260709 13:17:36.895890  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:36.897661 10223 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:36.862583 10140 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:36.898644 10140 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:36.899791 10140 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:36.810446 10182 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:36.872222 10060 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 13:17:36.880506 10193 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:36.871666 10218 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:36.875344  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:36.901861  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 86810.8us
I20260709 13:17:36.894134  9855 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.907658  5373 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:36.901218 10213 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:36.940995  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 65723.7us
I20260709 13:17:36.949568  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:36.941319  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 108081us
I20260709 13:17:36.941445  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:36.948542  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.909140 10092 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:36.921228 10234 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.950994  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:36.908715 10196 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:36.920576 10193 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:36.930541 10219 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:36.973589  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:36.968273  9950 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.958628 10218 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:37.071187  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.097322  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 127769us
I20260709 13:17:37.112075  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:36.976621 10175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.027s	sys 0.015s
W20260709 13:17:37.127964  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154462us
I20260709 13:17:37.129024  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:37.129964  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:36.981714 10200 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:36.984151 10092 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:37.144008  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.097015 10068 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.141247 10175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.027s	sys 0.015s
I20260709 13:17:37.138696 10058 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:37.132241 10185 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.177387 10185 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.181298 10185 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.183643  9989 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.160799 10224 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:37.149410 10231 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.162736 10192 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:37.162986 10236 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:37.163057 10218 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:37.164466 10238 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:17:37.165114 10196 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.186100 10255 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:37.238566 10255 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:37.163210 10217 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:37.144193 10193 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.169610 10219 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.254129 10255 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:37.176237 10058 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.149727 10085 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:37.185612 10223 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:37.142491 10174 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:37.160657 10237 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:37.143187  9892 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:37.189324  9888 consensus_meta.cc:287] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.003s
I20260709 13:17:37.190543 10035 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:37.191037  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:37.275175 10172 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.275530  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84714.9us
I20260709 13:17:37.275700 10172 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.276425 10035 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:37.277921  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:37.200824 10191 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.001s
I20260709 13:17:37.203963 10221 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.280432 10223 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:37.281132 10223 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.282156 10221 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:37.147235 10200 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.283264 10223 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.283370 10200 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.280454 10191 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.208365 10254 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.286031 10191 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:37.189927 10088 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.843s	user 0.013s	sys 0.000s
I20260709 13:17:37.230036 10231 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.277209 10035 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.233237 10192 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:37.286746 10231 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.286695 10088 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.287671 10192 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.236596 10236 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.290360 10172 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.290225 10236 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.289117 10088 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:37.248198  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 100931us
I20260709 13:17:37.229972 10224 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:37.296213 10224 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.296463 10231 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.298861 10231 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:37.254909 10207 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.130s	user 0.005s	sys 0.008s
I20260709 13:17:37.175187 10092 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:37.304106  9815 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.001s
I20260709 13:17:37.257176  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:37.159794 10068 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:37.258414 10058 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.262435 10237 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:37.262897  9892 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.261140 10174 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.269608 10193 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:37.256966 10217 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.274315  9888 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.285706 10254 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:37.293138  9989 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.304723  9815 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.312377 10085 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:17:37.145311  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 195846us
I20260709 13:17:37.319857  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:37.315274 10174 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:37.341051  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.344561  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:37.310978 10237 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.349736  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:37.353502  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 222382us
W20260709 13:17:37.354943  5340 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.733s (SENT)
W20260709 13:17:37.356030  5340 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.750s (SENT)
I20260709 13:17:37.356472  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:37.355072  5416 leader_election.cc:400] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14.
I20260709 13:17:37.358718  9698 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:37.362351 10217 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.363287  9746 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:37.364567  5340 leader_election.cc:336] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.789s (SENT)
I20260709 13:17:37.348299  9989 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.368201 10224 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:37.373528  6042 leader_election.cc:336] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.594s (SENT)
I20260709 13:17:37.381523  6042 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:37.360873  9950 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.374610 10196 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:37.366823 10035 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.368012  9815 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:37.365477  5340 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.832s (SENT)
I20260709 13:17:37.367727  9910 raft_consensus.cc:993] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:17:37.378931  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:37.394371  5375 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
W20260709 13:17:37.377526  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68414.1us
I20260709 13:17:37.396152  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:37.360381  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:37.385298  9888 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.400715  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:37.401650  5445 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:37.355795 10255 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.355937 10088 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:37.315469  9892 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.399091  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:37.407542  5448 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:37.394013 10140 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:37.411666  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51401.2us
I20260709 13:17:37.412890  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:37.390506 10196 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.418586  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:37.438460  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:37.441272  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.443329  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:37.442318  5521 raft_consensus.cc:2376] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14. Re-sending same reply.
I20260709 13:17:37.362375 10259 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:17:37.450052  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:37.450485  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:37.446365  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:37.449028  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.405169  9996 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.453312  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.404750  9815 raft_consensus.cc:1081] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:17:37.455462  5521 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:37.456858  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.455899  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:37.414563 10085 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.470863  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.463943  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:37.473409  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.417593 10068 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.447790 10191 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.481366  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:37.492070  5519 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:37.492681  5515 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:37.481841  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:37.484191  5518 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:37.490573  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.493556  5375 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
W20260709 13:17:37.500483  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 184473us
I20260709 13:17:37.459806  9996 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.482702 10255 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:37.511722  5444 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.490468 10253 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.391177 10237 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.458911 10140 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:37.455506 10260 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:37.537122 10255 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:37.535971  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:37.552539  5375 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:37.511485  9996 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.525772 10267 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.533914 10265 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:17:37.580631 10260 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.581352 10260 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.583716 10260 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.538276 10255 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.592482 10224 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:37.597100 10268 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:17:37.600226 10258 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:37.512135 10196 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.561156 10267 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:37.604966 10264 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:37.628562 10254 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:17:37.641768 10058 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.648218 10058 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:37.607973 10237 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.673913  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2536) took 1291 ms. Trace:
W20260709 13:17:37.645231  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.556157 10140 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:37.674728  5374 rpcz_store.cc:276] 0709 13:17:36.383227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.383412 (+   185us) service_pool.cc:224] Handling call
0709 13:17:36.383877 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.464051 (+ 80174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.464079 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.482297 (+ 18218us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.588921 (+106624us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:36.588976 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.235669 (+646693us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:37.673438 (+437769us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b54000fafd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:37.673520 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.673583 (+    63us) raft_consensus.cc:1685] finished
0709 13:17:37.673604 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.673805 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11286,"raft.queue_time_us":11951,"raft.run_cpu_time_us":14916,"raft.run_wall_time_us":765367,"spinlock_wait_cycles":182909056,"thread_start_us":68016,"threads_started":1,"wal-append.queue_time_us":112681}
I20260709 13:17:37.677065 10140 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.673702 10098 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:37.629642 10085 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:37.680202 10275 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:37.683836  5444 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:37.642786  5517 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:37.605108 10267 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:37.721508  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.728924  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:37.729158  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:37.730466  5441 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.733462  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:37.717864 10194 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.738981  5449 raft_consensus.cc:2368] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 16. Current term is 17.
I20260709 13:17:37.739604 10058 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.746814 10058 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.744908  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:37.749372 10233 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:37.739050 10272 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:37.749861  5445 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 8.
I20260709 13:17:37.750383 10272 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.751333  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:37.752239  5445 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:37.753041 10272 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:37.758164 10273 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
I20260709 13:17:37.757941 10058 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:37.761845 10249 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.559s	user 0.000s	sys 0.009s
I20260709 13:17:37.749927 10233 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:37.782618  5445 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:17:37.774029 10234 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:37.789136 10234 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:37.791594 10234 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:37.792987 10233 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:37.795374 10210 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.469s	user 0.011s	sys 0.009s
I20260709 13:17:37.806947  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:37.769970  5441 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
W20260709 13:17:37.771126  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.807967  5445 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
W20260709 13:17:37.771847  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.774581 10272 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:37.812219  5449 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:17:37.811964  5450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.018s
I20260709 13:17:37.815048  5516 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:37.816287  5450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.018s
I20260709 13:17:37.818034 10272 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:37.820345 10272 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:37.831477 10182 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.773598  9996 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:37.835052  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:37.837241 10004 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:37.852892  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:37.853410  5445 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:37.855219 10196 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:37.859838 10250 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.657s	user 0.009s	sys 0.000s
I20260709 13:17:37.865690 10237 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.866397 10237 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:37.873481  6042 leader_election.cc:336] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.525s (SENT)
I20260709 13:17:37.874706  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.874699  5374 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:37.876129  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:37.878818  5517 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:37.878131  5371 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:37.886119  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:37.889755  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.890828  5375 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:37.891837  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:37.892480  5375 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.891463  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.893200  9746 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:37.894644  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:37.895061  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:37.895967  5369 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:37.896337  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:37.897730  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:37.899168  5522 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:37.899175  5370 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:37.901396  5522 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:37.897275  5517 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:37.902246  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:37.905928  5518 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:37.902792  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:37.909382  5372 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:37.868813 10237 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:37.922150  5374 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.908345  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:37.909531  5370 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:17:37.908480 10278 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:17:37.936738  5522 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:37.943879  9888 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:37.945233  5372 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:37.834297 10174 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.889636 10092 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:37.895888 10272 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.951558  5524 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:37.957080  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:37.957283  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:37.959564  5371 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:37.962373  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:37.964048  5442 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:37.966982  5450 raft_consensus.cc:2368] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:37.978055  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:37.978925  5368 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:37.982045  5375 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:37.975665  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 71944.7us
W20260709 13:17:37.984855  6042 leader_election.cc:336] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.719s (SENT)
I20260709 13:17:37.989476  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:37.968282 10277 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 13:17:37.996749  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:38.006433 10242 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.833s	user 0.004s	sys 0.012s
W20260709 13:17:37.993079 10195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.628s	user 0.014s	sys 0.039s
I20260709 13:17:38.013159  5374 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:37.972172 10231 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:38.066429  5370 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:17:38.068674  5445 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:38.075938  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.076788  5445 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:38.077981  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.078701  5445 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.068725  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.079815  5370 pending_rounds.cc:85] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 6
I20260709 13:17:38.080305  5370 pending_rounds.cc:107] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:17:38.080688  5370 raft_consensus.cc:2889] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:38.039122 10195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.685s	user 0.014s	sys 0.039s
I20260709 13:17:38.083426  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:38.087070  6073 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:38.089525  5450 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:37.978117 10272 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:37.968773 10276 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 13:17:37.991482 10092 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.104501  5445 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:38.105813  5370 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:38.105926  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.107092  5445 raft_consensus.cc:2410] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:38.107959  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:38.110903  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.113683  5368 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:38.115998  5370 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:38.120740  5450 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.092034  5442 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:17:38.123076  5442 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:38.123505  5442 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.124238  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.125852  5444 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:17:38.131184  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 238379us
I20260709 13:17:38.135540  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:38.137230  5368 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:38.137725  5441 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:38.082228 10231 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.157001  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:38.164901  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.165668  5444 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.167241  6076 raft_consensus.cc:2368] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14.
I20260709 13:17:38.170123 10195 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:38.170585 10195 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:38.171507 10195 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.174031  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.174885  5441 raft_consensus.cc:2368] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:17:38.198781  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.164196  9996 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.215220  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:38.217958 10286 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
W20260709 13:17:38.270638  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55503.3us
W20260709 13:17:38.278698  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.223764 10248 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.020s	user 0.000s	sys 0.018s
I20260709 13:17:38.264761  9950 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.284415  5489 leader_election.cc:400] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14.
I20260709 13:17:38.304307 10236 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:17:38.301203 10098 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:38.322847 10298 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:17:38.323199 10098 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.326406  5489 leader_election.cc:403] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.328563 10184 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.329986  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:38.330770  5520 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:38.335444 10252 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.133s	user 0.000s	sys 0.013s
I20260709 13:17:38.299705  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:38.342406 10300 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:38.343405 10174 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:38.344444 10302 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.344905 10092 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:38.344980 10302 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.200055  9746 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 13:17:38.347458 10302 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.319665  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:38.348507  5523 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
W20260709 13:17:38.339707  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 55372.5us
I20260709 13:17:38.284144  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:38.353104  5521 raft_consensus.cc:2368] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:17:38.355769  5441 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:38.346248  9746 consensus_queue.cc:1243] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:17:38.356221  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 78596.6us
W20260709 13:17:38.284884 10246 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:17:38.365724  5373 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:38.373598  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:38.282660 10194 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:38.363410  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:38.374884  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:38.376396  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.273386 10178 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:17:38.383029  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:38.321105  9950 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.388715  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.391422  5450 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:38.391943  5441 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:38.380728 10243 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.378165 10184 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14.
I20260709 13:17:38.402062 10243 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.403769 10272 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:38.404917 10243 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:38.405748 10192 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:38.373449 10223 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.409554 10190 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:38.409536 10223 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.410316 10190 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.433017  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:38.343040 10300 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.375954 10173 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:38.377280 10194 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:38.439020  5444 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:38.455596  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.456866  5444 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:38.454078  5442 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.444759  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.453189  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:38.462116  5372 raft_consensus.cc:2368] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:38.463341  5450 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:17:38.467578  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.468305  5441 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.473456  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.433614  6072 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:38.435227 10190 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.497599  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:38.475876  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 284018us
I20260709 13:17:38.477389  5373 raft_consensus.cc:2410] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:38.499868  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:38.438169 10173 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:38.493742  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:38.475620  5442 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.504169  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:38.478021  5450 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.458616 10194 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.458628 10098 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.518769  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:38.516549  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:38.468092 10232 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:38.524729  5375 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:38.505910 10196 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.650s	user 0.014s	sys 0.000s
I20260709 13:17:38.495381  9803 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:38.542192  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:38.553326  5370 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:38.536909  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.542105  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:38.554363  5517 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:38.542110  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:38.562631  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.563921  5444 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:38.552158  9803 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:38.574474  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:38.580519  5523 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:38.578738  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:38.590518  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.591440  5515 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:38.551647 10098 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:38.519538  9996 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:38.520675 10302 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:17:38.569077 10231 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.559803 10004 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.602923  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.618701  5444 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:17:38.605195  5372 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:38.612828  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.620239  5442 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:38.621614  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.622268  5442 raft_consensus.cc:2376] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
I20260709 13:17:38.623091  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.623692  5442 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.625156  5450 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:38.626253  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.626957  5450 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:38.627760  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.628461  5450 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:38.615005  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:38.619415  5441 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:38.630599  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.629180  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.589361 10284 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:38.594743 10182 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.008s
I20260709 13:17:38.635454  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.592456 10098 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.552263 10232 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.600219 10192 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:38.533927  9746 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:17:38.688592  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.689481  5444 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:38.600446 10309 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.659204  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2550) took 2145 ms. Trace:
I20260709 13:17:38.690864  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:38.666018  5442 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:38.694263  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.694928  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.695327  5441 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:38.695607  5444 raft_consensus.cc:2376] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14. Re-sending same reply.
I20260709 13:17:38.697793  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.637648 10231 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.637900 10284 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:38.698750  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:38.706987  5522 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:38.707409  5522 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:38.701076  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.718762  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.719509  5441 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:38.703765  5450 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.587529 10173 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:38.725013  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 146304us
I20260709 13:17:38.688683  9855 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.652168 10098 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:38.704691  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 89759.8us
I20260709 13:17:38.638406 10004 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:38.725713  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.728340  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:38.717760  5522 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.726136  5444 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:38.699226 10312 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.739200  5522 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.704952  5442 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 12: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:38.737272  5450 raft_consensus.cc:2410] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:38.654299 10140 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:17:38.733629  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 144707us
I20260709 13:17:38.716327 10284 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.750121  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:38.752234  5441 raft_consensus.cc:2368] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16.
I20260709 13:17:38.726708 10311 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.761042  5444 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:17:38.762481  5340 leader_election.cc:400] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:38.763353  5340 leader_election.cc:403] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.715982 10231 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.749791  9950 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:38.770933  5441 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:17:38.778955 10251 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.576s	user 0.014s	sys 0.009s
I20260709 13:17:38.779450 10321 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:38.779803  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.783665  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 1995) took 1342 ms. Trace:
W20260709 13:17:38.785666 10308 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:17:38.790241 10306 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:38.828346  5442 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:17:38.790912 10307 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:17:38.750654 10243 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:17:38.760422 10173 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.808882 10088 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:38.750510 10312 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.701395 10309 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.818529  5524 rpcz_store.cc:276] 0709 13:17:37.441308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.441455 (+   147us) service_pool.cc:224] Handling call
0709 13:17:38.783427 (+1341972us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400165dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:38.783556 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883129728}
W20260709 13:17:38.856071 10245 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.680s	user 0.006s	sys 0.005s
I20260709 13:17:38.856354 10309 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.859730 10004 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.797616 10300 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.822391 10320 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.823077  5441 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:38.826583 10190 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.829239  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:38.791649 10232 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.840250  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:38.817731 10182 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:38.839202  5522 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:38.801648  5444 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:38.818033 10321 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.834991 10324 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13.
I20260709 13:17:38.761513 10192 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.863943  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:38.870050  5523 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:38.873939  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:38.879989  5444 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:38.768417 10311 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:38.885138  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.888690  5445 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:38.871426 10320 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.895298 10311 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.895721 10320 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.899811  5444 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:38.877556 10232 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.877228 10321 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.883385 10189 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:38.915091 10304 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.513s	user 0.002s	sys 0.001s
I20260709 13:17:38.920785  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2485) took 1521 ms. Trace:
I20260709 13:17:38.924687 10312 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:38.927582 10233 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.932353  9803 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.921291  5443 rpcz_store.cc:276] 0709 13:17:37.398980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.399120 (+   140us) service_pool.cc:224] Handling call
0709 13:17:37.415574 (+ 16454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.792935 (+1377361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.792988 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.793051 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:38.793098 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.920494 (+127396us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540032fad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:38.920550 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.920717 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3166953216}
W20260709 13:17:38.944118  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.944705  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 209778us
I20260709 13:17:38.877351 10316 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:17:38.909359 10315 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.948276  5416 leader_election.cc:400] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:38.952912  5416 leader_election.cc:403] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.958354  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.959550  5444 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:38.961926 10316 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13.
I20260709 13:17:38.955623  9803 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.968686  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:38.969761  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 238973us
I20260709 13:17:38.971158 10173 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:38.972390 10167 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:38.972787 10167 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:38.973707 10167 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.974678 10167 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.969777  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.980089  5443 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:38.980438  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:38.983146  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:38.984513 10247 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:38.984935 10247 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.985285 10247 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.958345 10140 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:38.990381  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:38.912629 10189 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.991154  5444 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:38.927632 10284 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:38.912950 10232 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:38.994450  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:38.998572  9910 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:38.999045  5444 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:38.957617 10315 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.002578 10315 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.006112  5441 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:39.007879 10232 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:39.010138 10267 consensus_queue.cc:1175] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b781c7e31b7145aea647a7ff649e6ac7" responder_term: 16 status { last_received { term: 16 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 16 index: 11 } }
I20260709 13:17:39.012508  9950 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:39.013155  9950 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:39.014058  9950 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.017853  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:39.020236 10284 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:39.022233 10243 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.022745 10243 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:38.995227  9892 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:39.023097 10190 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.023100 10243 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.026263 10098 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:38.992198 10236 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.029088  5443 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:38.988726 10316 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:39.027482 10305 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.624s	user 0.000s	sys 0.002s
I20260709 13:17:38.990211 10213 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:39.031754  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:39.033828  5448 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:39.043382  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:39.041195  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:39.046092  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 290567us
I20260709 13:17:38.990804 10140 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:39.047746  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.035006  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.051669  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:39.054240  5372 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:39.053609  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:39.072631  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:39.073462  5369 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.075594  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:39.077121  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:39.037791 10236 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.077576  5371 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:39.081694  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:39.079108  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:39.078917  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.034531 10233 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:17:39.043466  9803 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:39.081647  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:39.083993  5373 raft_consensus.cc:2368] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
W20260709 13:17:39.081626  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.083598  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:39.085136  5370 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:39.099126  5519 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:38.691422  5367 rpcz_store.cc:276] 0709 13:17:36.514188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.743109 (+228921us) service_pool.cc:224] Handling call
0709 13:17:36.743420 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.743590 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:38.389360 (+1645770us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b180043b0a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf
0709 13:17:38.389603 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.658762 (+269159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.658836 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:38.658887 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.658987 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.659136 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45020,"prepare.queue_time_us":31008,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":10710784,"thread_start_us":241308,"threads_started":3,"wal-append.queue_time_us":300885}
I20260709 13:17:39.064611 10218 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:17:39.064684 10267 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:39.066064 10231 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.094772  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.094990  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.106899  5372 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:39.095944 10189 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.099704  5371 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:39.039276 10217 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:17:39.046053 10213 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:39.051817 10322 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.064765  9892 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:17:39.082438 10194 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.004s
I20260709 13:17:39.116117  5369 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 14.
I20260709 13:17:39.118264  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.130277  5374 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:39.130556  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:39.120728  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73157.2us
I20260709 13:17:39.135578  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.116323  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:39.096729 10172 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.131421  5370 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:39.113731 10327 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.125715  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:39.106073 10284 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.106357 10267 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.137398  5444 raft_consensus.cc:2376] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12. Re-sending same reply.
I20260709 13:17:39.140818  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.151726  5374 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:39.128121 10231 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.128991 10322 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.157836  5368 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.159052 10322 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.171707  5368 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
W20260709 13:17:39.142292  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 267083us
I20260709 13:17:39.124672  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:39.143571  5371 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.175346  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:39.175820  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51292.5us
I20260709 13:17:39.176046  5373 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:39.177899  5373 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:39.179172  5373 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:39.177265  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:39.181573  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.182494  5370 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:17:39.144579 10221 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.155002 10267 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.193265  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:39.197343  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61856.7us
I20260709 13:17:39.193272  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:39.200624  5444 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:39.200763  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:39.133734 10194 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.187922 10189 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.208108  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:39.140002 10321 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.202961  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.215808  5369 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:39.228793  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:39.229540  5444 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:39.232584 10232 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:39.233392 10232 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.238754 10232 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.234824 10315 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:39.240773 10232 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:39.243058  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.195520 10182 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:39.192549 10329 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.194245 10098 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.152395 10327 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.192602 10328 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:39.194247 10311 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.187556 10231 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.214303 10190 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:39.271186  5444 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:17:39.277637  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76929.2us
I20260709 13:17:39.284086  5340 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.199653 10221 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.291662  5371 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
W20260709 13:17:39.299216  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.341322  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 293251us
I20260709 13:17:39.364990  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:39.366189  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 315265us
W20260709 13:17:39.380199  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.392922  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.394390  5444 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 13:17:39.344029  5447 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:39.397689  5447 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:39.287681 10236 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:39.301144 10098 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:39.300384 10140 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.224207 10213 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:39.406057  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.342921 10190 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:39.295061 10330 raft_consensus.cc:2764] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:39.381879 10316 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:39.457898  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 173907us
I20260709 13:17:39.460748  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:39.466565  5340 leader_election.cc:400] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:17:39.467141  5340 leader_election.cc:403] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:17:39.400745 10088 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.001s
I20260709 13:17:39.511469 10088 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:39.514209 10231 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.405051 10217 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
W20260709 13:17:39.518826 10333 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:39.526603 10321 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.529194 10221 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:39.530920 10190 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.540220  5374 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:39.541522  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.542109  5370 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:17:39.542506  5370 pending_rounds.cc:85] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 6
I20260709 13:17:39.542711  5370 pending_rounds.cc:107] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:17:39.542749  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.543025  5370 raft_consensus.cc:2889] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:39.540225  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.544239  5373 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:39.544414  5370 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:39.296535 10311 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.548799 10311 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.550809 10194 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.551847 10194 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:39.552515 10194 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.554200  5374 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:39.554134 10316 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.405436 10233 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:17:39.278472 10329 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.560266 10329 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:39.574733 10314 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.836s	user 0.000s	sys 0.002s
I20260709 13:17:39.577145  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2037) took 1094 ms. Trace:
I20260709 13:17:39.577661  5450 rpcz_store.cc:276] 0709 13:17:38.482544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.628968 (+146424us) service_pool.cc:224] Handling call
0709 13:17:39.576904 (+947936us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b540007eed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:39.577075 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164074368}
I20260709 13:17:39.579425  5450 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:39.580152  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2050) took 1025 ms. Trace:
I20260709 13:17:39.580469  5450 rpcz_store.cc:276] 0709 13:17:38.554702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.578736 (+1024034us) service_pool.cc:224] Handling call
0709 13:17:39.579064 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.579746 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.580094 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:39.582058  5442 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:39.583738  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2509) took 1186 ms. Trace:
I20260709 13:17:39.586555  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2519) took 1186 ms. Trace:
I20260709 13:17:39.595300  5448 rpcz_store.cc:276] 0709 13:17:38.399687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.979445 (+579758us) service_pool.cc:224] Handling call
0709 13:17:38.979787 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.041633 (+ 61846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.586212 (+544579us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b54003bd654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:39.586476 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123066752}
I20260709 13:17:39.586611  5450 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:39.601087  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.588094  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:39.602376  5372 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:39.603477  5372 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:39.468425  5444 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:39.470080  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:39.471906  9950 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:39.592522 10223 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.584115  5442 rpcz_store.cc:276] 0709 13:17:38.396935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.830659 (+433724us) service_pool.cc:224] Handling call
0709 13:17:39.581875 (+751216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.582508 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.583528 (+  1020us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b540007eed0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:39.583676 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726807424}
I20260709 13:17:39.408586 10182 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:39.607117 10182 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.473023  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:39.474140  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:39.477830 10340 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:39.610805  5370 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:17:39.611001  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 376722us
W20260709 13:17:39.584504  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.611987  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:39.612506  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.612670  5372 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:39.614050 10182 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:39.616257  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2042) took 1132 ms. Trace:
I20260709 13:17:39.616842  5444 rpcz_store.cc:276] 0709 13:17:38.484058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.395659 (+911601us) service_pool.cc:224] Handling call
0709 13:17:39.468164 (+ 72505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.604117 (+135953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.616166 (+ 12049us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:39.621622  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 147555us
I20260709 13:17:39.620045  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:39.612013 10247 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.006s
I20260709 13:17:39.627938  5416 leader_election.cc:400] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:17:39.628362  5416 leader_election.cc:403] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:39.628996 10223 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:17:39.622786  5370 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
W20260709 13:17:39.638785  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.644819  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2300) took 1770 ms (client timeout 1631 ms). Trace:
I20260709 13:17:39.645947  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:39.646647  5517 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:39.645272  5515 rpcz_store.cc:269] 0709 13:17:37.874259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.874399 (+   140us) service_pool.cc:224] Handling call
0709 13:17:39.644612 (+1770213us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b540025c1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:39.644729 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590522240}
I20260709 13:17:39.653496  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:39.655098  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 188713us
I20260709 13:17:39.656623  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.660609  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.623867  9855 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 8. Current term is 9.
I20260709 13:17:39.662012 10321 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:39.663057 10321 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.663863 10342 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:39.664149 10340 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.664578  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.664454 10342 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:39.664719 10340 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.665887 10173 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:39.666821 10342 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:39.641790 10341 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.667234  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.667840 10341 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.668527 10340 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:39.668579 10173 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:39.669800  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:39.670147  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.670337  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.670928  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.671540  5372 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:39.669128  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.672544  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.672943  5373 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:39.673053 10173 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:39.671501 10340 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:17:39.674368  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:39.623500 10315 consensus_queue.cc:1243] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:39.700662  5490 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.696317 10349 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:39.718969  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:39.720098  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45804.8us
I20260709 13:17:39.727960  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.645539 10182 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:39.722361  5490 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:39.716372 10167 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.003s
I20260709 13:17:39.702816 10342 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:39.758878  5414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.078s	sys 0.074s
W20260709 13:17:39.759316  5414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.078s	sys 0.074s
W20260709 13:17:39.759603  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 528037us
I20260709 13:17:39.725557 10217 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:39.731693  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:39.633334 10247 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.670149 10341 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:39.677444 10243 consensus_meta.cc:287] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 13:17:39.771705  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 354) took 2055 ms. Trace:
I20260709 13:17:39.719439 10232 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:39.772414  5449 rpcz_store.cc:276] 0709 13:17:37.716727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.759564 (+ 42837us) service_pool.cc:224] Handling call
0709 13:17:37.808868 (+ 49304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.815903 (+  7035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.771426 (+1955523us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b54001798d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:39.771629 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112384896}
I20260709 13:17:39.731704 10233 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:17:39.738516 10231 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:39.738504 10218 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.737892  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:39.739156 10173 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:39.740726 10328 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.715234 10236 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:39.724746 10276 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:17:39.724517 10338 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:17:39.724956 10321 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:39.745291 10098 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.731376 10349 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.738408  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:39.728545 10088 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.723650  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.792665  5524 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:39.733953  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:39.799203  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 61433.7us
I20260709 13:17:39.826843  5515 raft_consensus.cc:2376] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
I20260709 13:17:39.731990 10223 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.826524  5370 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
W20260709 13:17:39.895017  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 65919.3us
I20260709 13:17:39.777276 10311 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.945060 10341 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:39.948690 10340 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:39.952087 10340 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:39.952721 10217 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:39.936563 10338 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:17:39.956065  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.956918  5366 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:39.760313  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:39.958544  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 198310us
I20260709 13:17:39.770532  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:39.773702  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2477) took 3164 ms. Trace:
I20260709 13:17:39.959426  5414 leader_election.cc:400] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:17:39.959542  5446 rpcz_store.cc:276] 0709 13:17:36.609049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.609168 (+   119us) service_pool.cc:224] Handling call
0709 13:17:36.628230 (+ 19062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.634033 (+  5803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.634066 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.692576 (+ 58510us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.820734 (+128158us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b180032bea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d7c6058f 00007fc1d0c9f571 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd
0709 13:17:38.308542 (+1487808us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b180032bea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c6d2a6 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9
0709 13:17:39.115414 (+806872us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b180032bea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:17:39.380494 (+265080us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:39.380554 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.380660 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.773386 (+392726us) raft_consensus.cc:1685] finished
0709 13:17:39.773416 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.773627 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9869,"raft.queue_time_us":11172,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":35216,"spinlock_wait_cycles":76222080,"thread_start_us":246852,"threads_started":1,"wal-append.queue_time_us":2979526}
I20260709 13:17:39.755640 10342 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.956120  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:39.960753  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:39.799124 10276 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:39.823488  9855 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:39.777963  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.985404  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.789808 10321 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:40.023469  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.970644  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 200185us
I20260709 13:17:40.049597  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:40.051049  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 90388.3us
I20260709 13:17:39.783461 10243 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.957098 10350 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.768617  5517 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:39.791163 10328 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:40.040697  9803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.086s	sys 0.155s
I20260709 13:17:39.883728 10192 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:40.039822 10342 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:40.045696  5489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.052s	sys 0.104s
I20260709 13:17:40.044332 10172 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:40.072820  5489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.052s	sys 0.105s
I20260709 13:17:40.050627 10329 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:40.076040  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 615341us
I20260709 13:17:39.882490 10223 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.058286 10321 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.061798 10276 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:39.801800 10088 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.791348 10231 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:39.799693 10098 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.074522  5518 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:39.922781 10311 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:40.068763  9803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.086s	sys 0.156s
I20260709 13:17:40.081444 10172 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:40.111043  5370 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:17:40.072422 10324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.060s	sys 0.056s
W20260709 13:17:40.114178  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.125948  5490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.729s (SENT) [suppressed 24 similar messages]
I20260709 13:17:40.069065 10350 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:40.130831  5375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.039s	sys 0.062s
W20260709 13:17:40.085595  5369 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.051s
I20260709 13:17:40.050194 10349 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:40.081630 10337 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.454s	user 0.000s	sys 0.001s
I20260709 13:17:40.079282 10192 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.104602 10311 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:40.131423  5369 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.007s	sys 0.051s
I20260709 13:17:40.058869  9855 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.110050 10329 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:40.131819  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 79639.4us
W20260709 13:17:40.135409  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.103344  9803 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:40.110906 10213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.017s	sys 0.045s
I20260709 13:17:40.047689  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:40.137501  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.178622  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.130354 10324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.060s	sys 0.057s
W20260709 13:17:40.131682  5375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.039s	sys 0.062s
W20260709 13:17:40.182575  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 133056us
I20260709 13:17:40.183457  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:40.184468  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.188391  5340 leader_election.cc:400] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16.
I20260709 13:17:40.188793  5340 leader_election.cc:403] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:17:40.190562  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.190991  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.191146  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:40.191670  5522 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.181833 10247 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:40.177886 10213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.017s	sys 0.045s
I20260709 13:17:40.141245  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:40.178184 10353 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.181951 10196 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.209703  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.211640  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.140215 10349 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:17:40.223981 10329 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:40.228623 10329 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:40.235894  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 109987us
I20260709 13:17:40.250420  5522 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:40.252888  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.267984  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:40.270462  5448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.002s	sys 0.022s
W20260709 13:17:40.272881  5448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.002s	sys 0.022s
I20260709 13:17:40.275826  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.219424 10243 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:40.211220 10353 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.262735 10364 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:40.270984 10267 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.044s	user 0.010s	sys 0.003s
I20260709 13:17:40.258594 10348 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:40.292079  5521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.017s	sys 0.031s
W20260709 13:17:40.297127  5521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.017s	sys 0.031s
I20260709 13:17:40.214588 10196 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.293783  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:40.273883 10195 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:40.275074 10349 consensus_queue.cc:1243] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:40.274789 10367 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.203418 10276 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.282653 10326 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:40.314878 10362 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.317363 10362 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.318863  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.319521  5516 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:40.326565 10350 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.326946 10192 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.216549 10172 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:40.328814 10357 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:40.330163  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2044) took 1845 ms. Trace:
W20260709 13:17:40.330520  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.331506  9855 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.332125 10088 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.334641 10098 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.297516 10223 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.335764  5517 raft_consensus.cc:2376] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12. Re-sending same reply.
I20260709 13:17:40.330547  5447 rpcz_store.cc:276] 0709 13:17:38.484610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.398881 (+914271us) service_pool.cc:224] Handling call
0709 13:17:39.399253 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.458915 (+ 59662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.458997 (+    82us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.604541 (+145544us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.090947 (+486406us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:40.091110 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.091508 (+   398us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.329927 (+238419us) raft_consensus.cc:1685] finished
0709 13:17:40.329952 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.330102 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":453,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7598,"thread_start_us":443994,"threads_started":1,"wal-append.queue_time_us":560838}
I20260709 13:17:40.302625  9892 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:40.348969 10354 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:17:40.353322  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:40.345606 10356 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:17:40.358130  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:40.365866  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:40.273128  9803 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.302785 10267 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.376413  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:40.380259  5367 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:40.379846  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:40.389294  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 105219us
I20260709 13:17:40.389524  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:40.390210  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:40.391063  5367 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:40.387866  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:40.393494 10196 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:40.393792 10189 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:40.394219 10189 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:40.395223 10189 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.305090 10348 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.396587 10189 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:40.398761  5447 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:17:40.401871  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:40.399050  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:40.300674 10364 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.414203  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.416360  5522 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:40.411163  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:40.414470  5520 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:40.415005  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2324) took 1364 ms. Trace:
I20260709 13:17:40.356954 10350 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:40.409034  5443 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39322 (request call id 362) took 1364 ms (client timeout 1564 ms). Trace:
I20260709 13:17:40.417682  5367 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
W20260709 13:17:40.417898  5443 rpcz_store.cc:269] 0709 13:17:39.044811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.380002 (+1335191us) service_pool.cc:224] Handling call
0709 13:17:40.408962 (+ 28960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:40.422737  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:40.421164  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:40.425344  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.426452  5522 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:40.429884  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:40.430591  5442 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:40.382352 10358 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:40.423595  5447 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:40.431927 10217 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:40.390477 10349 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.417299  5523 rpcz_store.cc:276] 0709 13:17:39.050280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.050395 (+   115us) service_pool.cc:224] Handling call
0709 13:17:39.078096 (+ 27701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.298012 (+219916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.298050 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.365057 (+ 67007us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.784692 (+419635us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:39.784735 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.784807 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.413697 (+628890us) raft_consensus.cc:1685] finished
0709 13:17:40.413728 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.414929 (+  1201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65902,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":519080,"threads_started":2,"wal-append.queue_time_us":710228}
I20260709 13:17:40.439563  5522 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:40.447814  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 82025.4us
I20260709 13:17:40.454044  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:40.414379 10196 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:40.403730 10340 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.460177  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:40.459052  5416 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:40.459079  5443 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:40.320619 10367 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:40.381850 10344 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:17:40.381662 10247 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:17:40.470229  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:40.416527 10373 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:40.522869  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.481854 10214 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:40.481127  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:40.548460  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66440.1us
I20260709 13:17:40.549875  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:40.461892 10196 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:40.505043  5445 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:40.504264 10368 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:17:40.519691  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 311252us
W20260709 13:17:40.538570  5368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2592) took 1460 ms (client timeout 1729 ms). Trace:
W20260709 13:17:40.509439  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49360.1us
I20260709 13:17:40.465039 10340 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:40.432590 10350 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.461692 10382 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:40.515318 10190 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.575685 10190 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.576103 10190 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.576239 10267 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:40.457492 10341 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.084s
W20260709 13:17:40.554894  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 73860.2us
I20260709 13:17:40.558866 10196 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.461694 10221 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:17:40.463392 10366 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:17:40.514626 10365 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:40.562600  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 360) took 1520 ms. Trace:
I20260709 13:17:40.595490  5448 rpcz_store.cc:276] 0709 13:17:39.042258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.596456 (+554198us) service_pool.cc:224] Handling call
0709 13:17:39.596989 (+   533us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.597464 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.597495 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.598109 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 13:17:40.273241 (+675132us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:40.273284 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.274011 (+   727us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.562350 (+288339us) raft_consensus.cc:1685] finished
0709 13:17:40.562372 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.562532 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9344,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":674698,"threads_started":1,"wal-append.queue_time_us":753234}
I20260709 13:17:40.565524  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:40.559214  5368 rpcz_store.cc:269] 0709 13:17:39.054096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.055528 (+  1432us) service_pool.cc:224] Handling call
0709 13:17:40.514293 (+1458765us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b5400051ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:40.514474 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170251648}
I20260709 13:17:40.506772 10392 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:40.465689 10349 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.568240 10340 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.557575 10088 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:17:40.575196 10192 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.556965  5445 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:40.662074 10388 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:40.662891  5445 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.663887 10390 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:40.664197  5445 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.582602  5490 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:40.665859  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83326.2us
I20260709 13:17:40.665992 10396 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.666594 10396 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.666951 10396 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.667137  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:40.563100 10214 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:40.593451  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 140460us
I20260709 13:17:40.668732 10214 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.461359 10358 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.669132 10214 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:40.670997  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2598) took 1131 ms. Trace:
I20260709 13:17:40.671551  5374 rpcz_store.cc:276] 0709 13:17:39.540044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.542537 (+  2493us) service_pool.cc:224] Handling call
0709 13:17:40.670706 (+1128169us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b540025a3d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:40.670914 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24441088}
I20260709 13:17:40.674538 10267 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:40.675237 10267 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.675738 10267 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:40.595788 10276 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:17:40.677273 10217 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.678331 10362 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.678026 10217 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:40.577828 10353 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:40.550027 10342 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.679898  5515 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:40.680178 10247 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.680629 10342 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:40.680735 10247 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.684340  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:40.626073  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60652.3us
W20260709 13:17:40.629269 10379 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:40.563422 10385 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:17:40.581437 10394 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:40.583338 10378 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:40.567190 10373 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.650398  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2320) took 1603 ms. Trace:
I20260709 13:17:40.651331 10349 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.652842 10350 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.653930 10364 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.630344 10382 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:40.631428 10365 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:40.690086  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:40.694116  5445 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:17:40.712891  5445 pending_rounds.cc:85] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 9
I20260709 13:17:40.713150  5445 pending_rounds.cc:107] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:17:40.695945  5521 rpcz_store.cc:276] 0709 13:17:39.046616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.048631 (+  2015us) service_pool.cc:224] Handling call
0709 13:17:39.049069 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.364723 (+315654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.384486 (+ 19763us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.391263 (+  6777us) log.cc:844] Serialized 52 byte log entry
0709 13:17:40.297873 (+906610us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:40.297943 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.298105 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.650109 (+352004us) raft_consensus.cc:1685] finished
0709 13:17:40.650131 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.650326 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14960,"raft.queue_time_us":77917,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":9553,"thread_start_us":918106,"threads_started":2,"wal-append.queue_time_us":1104376}
I20260709 13:17:40.713413  5445 raft_consensus.cc:2889] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.712668  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:40.714320  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2517) took 2315 ms. Trace:
I20260709 13:17:40.714672  5445 rpcz_store.cc:276] 0709 13:17:38.399144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.889792 (+490648us) service_pool.cc:224] Handling call
0709 13:17:38.890046 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.503641 (+1613595us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b540002cea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d03dc0 00007fc1d3d8e1c0 00007fc1d3d8f231 00007fc1d3d8bd8f 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c
0709 13:17:40.714002 (+210361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.714264 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159750528}
I20260709 13:17:40.715919  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:40.716506  5445 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.664574 10390 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:40.712451  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:40.718338 10311 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.004s
I20260709 13:17:40.722620  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:40.701089 10338 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:40.712311 10321 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.005s
I20260709 13:17:40.753294 10217 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:40.762125 10348 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.711412 10377 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:40.766418 10247 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:40.766865  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:40.769272  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56664.4us
W20260709 13:17:40.723030 10320 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:17:40.723415 10350 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.710708 10382 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.719913 10364 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.744393 10338 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.639113 10392 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:40.800432  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:40.734381 10311 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.803288  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:40.770362 10385 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:40.780795 10384 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:40.806120  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 83585.4us
I20260709 13:17:40.807762  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:40.811743  5445 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:40.814906  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:40.770376 10321 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:40.868674  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 65477.5us
W20260709 13:17:40.872459  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 57701.9us
I20260709 13:17:40.872694  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:40.871858  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:40.875411  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.810623 10338 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.796895 10217 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:40.877328  5521 raft_consensus.cc:2410] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:40.873562 10189 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:40.877995  5445 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:40.891716  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:40.891887  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.892928  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:40.870039  5449 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.812819 10358 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.893289  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.874732  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:40.880479  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.805061 10382 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:40.897403  5445 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:40.798215 10377 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.908064  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:40.844735 10344 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.844312 10378 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:40.896170  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.874279 10385 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:40.890827 10189 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:40.806382 10348 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:40.806713 10350 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:40.925336  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50676.8us
I20260709 13:17:40.843835 10190 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.927100  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.812357 10364 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:40.928149  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:40.886921 10380 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:40.924266 10383 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:40.957871  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73779.2us
I20260709 13:17:40.871268 10365 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:40.966773 10350 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:40.976408 10402 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:40.958874 10348 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.977962 10348 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:40.926884 10384 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:40.907995 10105 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 13:17:40.958547 10375 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.185s	user 0.003s	sys 0.000s
I20260709 13:17:40.984433 10190 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.969511 10378 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:17:40.987412 10364 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:40.988242 10390 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.988494 10321 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.989773 10311 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.990342 10392 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.991220 10340 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.991750 10316 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:40.944959  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.962563 10373 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.964558 10189 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:40.961154 10387 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:17:40.931224 10358 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:40.994606  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:40.985697  5444 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:17:40.995384  5522 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:40.962829 10232 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.992684  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:41.007205  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:40.971091 10380 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.008970  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:41.012244  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.018752 10217 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:41.019114 10214 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.994493 10349 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:41.021350 10349 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:41.023665 10349 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:41.010259 10232 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:41.025944 10403 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:17:41.026950 10400 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:17:41.027664 10232 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:40.927037 10344 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.028136 10405 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:41.028529 10405 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.028867 10405 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.006089 10385 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.012401 10380 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.035239 10194 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.036098 10105 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:41.036522 10105 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.036852 10105 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:40.968461  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 195068us
I20260709 13:17:41.006922 10358 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.053048  5449 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:41.054378 10088 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.056485  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:41.058336  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:41.059567 10404 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.060215 10404 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:41.061316 10404 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.062232  5449 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:17:41.065776  5449 pending_rounds.cc:85] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 7
I20260709 13:17:41.066584  5449 pending_rounds.cc:107] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:41.067503  5449 raft_consensus.cc:2889] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:41.077498  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.043205 10217 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:40.995024 10383 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.083905  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:41.084048  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:41.068331 10358 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.087076  6076 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
W20260709 13:17:41.088363  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.043519 10267 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:40.996982 10384 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.074282 10214 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.086088  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:41.121629  5449 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.114140 10183 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:41.115564  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.049348 10396 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:41.117605 10196 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.004s
I20260709 13:17:41.118666 10232 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:41.120630 10194 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:17:41.200837 10195 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.895s	user 0.008s	sys 0.006s
W20260709 13:17:41.205603  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92268.1us
I20260709 13:17:41.207096  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.205133 10217 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:41.209120 10408 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:41.210507 10413 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.212658  9950 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.214095  9950 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.131172 10196 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.227807  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2593) took 1689 ms. Trace:
I20260709 13:17:41.215368 10396 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.228282  5371 rpcz_store.cc:276] 0709 13:17:39.538294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.538501 (+   207us) service_pool.cc:224] Handling call
0709 13:17:39.538964 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.609703 (+ 70739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.609750 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.609808 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:39.609855 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.226086 (+1616231us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b540015c7d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:41.227592 (+  1506us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.227738 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162049408}
I20260709 13:17:41.239907 10267 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.244676  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2330) took 1785 ms. Trace:
I20260709 13:17:41.248446  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:41.249562  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.247401  5518 rpcz_store.cc:276] 0709 13:17:39.459670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.459962 (+   292us) service_pool.cc:224] Handling call
0709 13:17:39.462783 (+  2821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.102217 (+639434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.244420 (+1142203us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001e6754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:41.244611 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405979904}
I20260709 13:17:41.251190  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:41.201817 10194 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:41.217923 10340 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.262676  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:41.262367  5448 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:41.265786  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:41.266449  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:41.200024 10232 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:41.268319 10411 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:17:41.268390 10415 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:41.268790 10189 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.270298 10267 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:41.271329 10417 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:41.275369  5449 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 14.
I20260709 13:17:41.211457 10413 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.279488  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.293723  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:41.294327  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.294737  5449 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 17.
I20260709 13:17:41.279446 10412 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.279902 10190 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.279714 10349 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.297019  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.288005 10267 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.300900  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:41.289983 10383 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.302646  5521 raft_consensus.cc:2410] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:17:41.299556 10416 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:17:41.313293  5518 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:41.313815  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2541) took 1069 ms. Trace:
I20260709 13:17:41.314180  5447 rpcz_store.cc:276] 0709 13:17:40.244621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.029804 (+785183us) service_pool.cc:224] Handling call
0709 13:17:41.030186 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.030656 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.030697 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.031256 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.070014 (+ 38758us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:41.070078 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.070169 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.313605 (+243436us) raft_consensus.cc:1685] finished
0709 13:17:41.313626 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.313761 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4405,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"thread_start_us":37762,"threads_started":1,"wal-append.queue_time_us":51308}
I20260709 13:17:41.304400 10267 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.300748 10190 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.325169  5516 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:41.326997  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2539) took 1084 ms. Trace:
I20260709 13:17:41.327458  5445 rpcz_store.cc:276] 0709 13:17:40.242212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.972033 (+729821us) service_pool.cc:224] Handling call
0709 13:17:40.972394 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.053920 (+ 81526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.053952 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.054408 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.083964 (+ 29556us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:41.084007 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.084077 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.326742 (+242665us) raft_consensus.cc:1685] finished
0709 13:17:41.326764 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.326930 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14479,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":109823,"threads_started":2,"wal-append.queue_time_us":65777}
W20260709 13:17:41.325078  5524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2329) took 1865 ms (client timeout 2140 ms). Trace:
W20260709 13:17:41.330181  5524 rpcz_store.cc:269] 0709 13:17:39.459276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.461435 (+  2159us) service_pool.cc:224] Handling call
0709 13:17:41.324822 (+1863387us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001536d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:41.325008 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431495040}
I20260709 13:17:41.304652 10349 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.298144 10412 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.339787  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 380) took 2276 ms. Trace:
W20260709 13:17:41.341784  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 1.15342e+06us
I20260709 13:17:41.340351  5375 rpcz_store.cc:276] 0709 13:17:39.052655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.054417 (+  1762us) service_pool.cc:224] Handling call
0709 13:17:39.054692 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.054896 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:39.384127 (+329231us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.186191 (+802064us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.328893 (+1142702us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b18001d3c80. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:17:41.329053 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:41.329109 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:41.329153 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.329219 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.329332 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8724,"prepare.queue_time_us":593656,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":64,"raft.queue_time_us":4958,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":9535,"spinlock_wait_cycles":35253632,"thread_start_us":1085229,"threads_started":2,"wal-append.queue_time_us":874666,"wal-append.run_cpu_time_us":1808,"wal-append.run_wall_time_us":1050364}
I20260709 13:17:41.343613 10167 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.344175 10167 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:41.349291  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:41.350276  5447 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:41.351935  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:41.352895  5447 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.325011 10105 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.364933  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:41.339967 10360 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.367835  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:41.369807  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:41.372435  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:41.346586 10349 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.371850 10315 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.384651 10383 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:41.387279 10236 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.365079 10361 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16.
I20260709 13:17:41.399914  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2617) took 1344 ms. Trace:
I20260709 13:17:41.400764 10383 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.409776 10344 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.445626 10189 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.414484 10350 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.422439 10194 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:41.385088 10196 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.445019 10326 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.397552 10178 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.384017 10385 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:41.507161  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.507167  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2618) took 1451 ms. Trace:
I20260709 13:17:41.345144 10167 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.557277  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2021) took 1290 ms. Trace:
I20260709 13:17:41.358165 10348 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.555332  5366 rpcz_store.cc:276] 0709 13:17:40.055824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.766658 (+710834us) service_pool.cc:224] Handling call
0709 13:17:40.767012 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.767224 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:40.767536 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.399426 (+631890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:41.399501 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:41.399561 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.399654 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.399820 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":475695,"prepare.queue_time_us":620,"prepare.run_cpu_time_us":2354,"prepare.run_wall_time_us":15391,"raft.queue_time_us":584023,"thread_start_us":155769,"threads_started":1,"wal-append.queue_time_us":192981}
I20260709 13:17:41.410710  9892 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:41.554862 10338 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.657s	user 0.014s	sys 0.001s
W20260709 13:17:41.554278 10380 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.010s
I20260709 13:17:41.587973 10383 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.643162  5517 rpcz_store.cc:276] 0709 13:17:40.267090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.267723 (+   633us) service_pool.cc:224] Handling call
0709 13:17:41.408957 (+1141234us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b5400165dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:41.557194 (+148237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154318720}
I20260709 13:17:41.594485 10320 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.659257  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:41.659399 10320 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.660225  5366 raft_consensus.cc:2376] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16. Re-sending same reply.
W20260709 13:17:41.662557 10426 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:41.633301  5372 rpcz_store.cc:276] 0709 13:17:40.056114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.798358 (+742244us) service_pool.cc:224] Handling call
0709 13:17:40.809335 (+ 10977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.809667 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:40.846169 (+ 36502us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.506669 (+660500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:41.506742 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:41.506794 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.506888 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.507066 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":505717,"prepare.queue_time_us":61509,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":548257,"spinlock_wait_cycles":5516032,"thread_start_us":153815,"threads_started":1,"wal-append.queue_time_us":228703}
I20260709 13:17:41.591466 10321 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.594602 10413 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.670212  5447 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
W20260709 13:17:41.671377  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 328568us
I20260709 13:17:41.667488  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:41.633064 10232 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:41.651250  9892 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.643035 10178 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.631484 10326 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.679356  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:41.679872  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:41.678043  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:41.694109  5372 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:41.694481  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:41.685205  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.689286  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2526) took 1491 ms. Trace:
W20260709 13:17:41.698329 10423 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:41.698633  5446 rpcz_store.cc:276] 0709 13:17:40.198105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.198252 (+   147us) service_pool.cc:224] Handling call
0709 13:17:40.209042 (+ 10790us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:41.037814 (+828772us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b18004342c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d84bfb 00007fc1d3d8f64b
0709 13:17:41.037951 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.037981 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:41.042256 (+  4275us) log.cc:844] Serialized 52 byte log entry
0709 13:17:41.303493 (+261237us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:41.303536 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.303608 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.673564 (+369956us) raft_consensus.cc:1685] finished
0709 13:17:41.673588 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.689186 (+ 15598us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39436,"raft.queue_time_us":126665,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5181,"spinlock_wait_cycles":47332224,"thread_start_us":417485,"threads_started":2,"wal-append.queue_time_us":316627}
I20260709 13:17:41.665642 10380 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.701627 10412 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.703130 10380 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.642629 10330 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.704610 10380 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.705240 10380 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:41.705775 10432 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:41.708063  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2535) took 1474 ms. Trace:
I20260709 13:17:41.710666  5447 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:41.713775  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:41.712594  5443 rpcz_store.cc:276] 0709 13:17:40.233851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.469822 (+235971us) service_pool.cc:224] Handling call
0709 13:17:40.514055 (+ 44233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.582560 (+ 68505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.582594 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.582633 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:40.582664 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.707820 (+1125156us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b540028c654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:41.707873 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.708005 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157024512}
I20260709 13:17:41.720362  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2595) took 2181 ms. Trace:
I20260709 13:17:41.723670 10361 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:41.727330  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:41.730717  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2547) took 1484 ms. Trace:
I20260709 13:17:41.689214 10232 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.732766  5443 rpcz_store.cc:276] 0709 13:17:40.246549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.729821 (+1483272us) service_pool.cc:224] Handling call
0709 13:17:41.730191 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:41.730374 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.730406 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:41.730451 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:41.730486 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.730543 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.730663 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:41.670148 10321 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.704375 10330 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.679481 10325 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:17:41.766776 10325 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:41.768215 10358 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.643s	user 0.019s	sys 0.008s
I20260709 13:17:41.675836 10363 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:17:41.767616 10382 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.858s	user 0.010s	sys 0.020s
I20260709 13:17:41.772998 10315 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.722397 10421 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:41.774863 10421 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.768870 10358 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.721189  5369 rpcz_store.cc:276] 0709 13:17:39.539112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.545208 (+  6096us) service_pool.cc:224] Handling call
0709 13:17:39.545595 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.545859 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:40.138598 (+592739us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.719424 (+1580826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:41.719600 (+   176us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:41.719752 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.719942 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.720275 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1237695,"prepare.queue_time_us":116304,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":1100769,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2726,"thread_start_us":1097616,"threads_started":3,"wal-append.queue_time_us":341990,"wal-append.run_cpu_time_us":1319,"wal-append.run_wall_time_us":1107488}
I20260709 13:17:41.671080 10338 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:41.735781  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 1.68799e+06us
I20260709 13:17:41.711788 10190 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:41.758767 10405 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.729s	user 0.018s	sys 0.009s
I20260709 13:17:41.795333 10330 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.795781 10405 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.754926 10232 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.729936 10428 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:17:41.762722 10350 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.771478 10412 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.784418  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:41.730010 10427 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.769860  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:41.794142 10348 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.795169 10363 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.784099  5448 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.794173  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2615) took 1739 ms. Trace:
I20260709 13:17:41.816830 10363 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.817576  5368 rpcz_store.cc:276] 0709 13:17:40.055141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.628539 (+573398us) service_pool.cc:224] Handling call
0709 13:17:40.628949 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.398806 (+769857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.398838 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.444858 (+ 46020us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.674062 (+229204us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:41.674118 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.674208 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.793967 (+119759us) raft_consensus.cc:1685] finished
0709 13:17:41.793991 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.794117 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":769481,"raft.queue_time_us":876988,"spinlock_wait_cycles":9673984,"thread_start_us":228774,"threads_started":1,"wal-append.queue_time_us":346433}
I20260709 13:17:41.778954 10321 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.819342  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:41.820286 10232 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.820672  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:41.813189  5372 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:41.822486  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:41.823750  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:41.777410 10421 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.824388  5372 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:41.798956 10432 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.783733 10267 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.815969  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:41.783967  9950 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.816250 10405 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.825768  5368 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:41.839865  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:41.785957 10380 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:17:41.785671 10338 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:41.783744 10358 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:41.830652 10361 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.854902 10325 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.853163 10326 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.781665 10382 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.830665 10330 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:41.825110 10432 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:41.812422 10412 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.003489  5448 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:17:41.911654  5375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.018s
I20260709 13:17:41.891290  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2608) took 1936 ms. Trace:
W20260709 13:17:41.959203  5414 leader_election.cc:336] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.804s (SENT)
W20260709 13:17:42.051642  5375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.019s	sys 0.021s
I20260709 13:17:42.052011  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.052723  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.054214  5368 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:42.051767  5370 rpcz_store.cc:276] 0709 13:17:39.954477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.954662 (+   185us) service_pool.cc:224] Handling call
0709 13:17:39.955162 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.111480 (+156318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.890948 (+1779468us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001202d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:41.891201 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357672192}
W20260709 13:17:42.024863  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 269860us
W20260709 13:17:42.053664  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 94531.6us
I20260709 13:17:42.056254  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:41.841154 10427 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:41.841275 10360 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:42.073732  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:40.357097  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:42.146683  5372 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:42.066896  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.148020  5368 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:42.083112  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:42.149245  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.065198 10167 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.151052  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.152388  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.150686 10167 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:41.892891 10428 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.858852 10178 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.028527 10429 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.064805 10324 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:42.160861  5366 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:42.075510 10329 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:42.064514 10431 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.075281 10312 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:42.074839 10412 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.074191 10367 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:41.930258 10231 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.157403 10363 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.054234 10330 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.155247 10236 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:42.069337  9892 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.184792  5370 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:42.054301 10361 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.065904 10325 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.195590  5372 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:42.198241  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.199002  5370 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:42.199385 10330 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.199990  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:42.200626  5370 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.069376 10427 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:42.202344  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:42.164476 10327 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.157311 10383 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.207966  5368 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:42.210063  5370 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:42.206103 10312 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:42.221971  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.223356  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.160122 10428 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.226658  5369 raft_consensus.cc:2376] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16. Re-sending same reply.
I20260709 13:17:42.162245 10429 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.196754 10267 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:42.201000 10236 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:42.235682 10236 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:42.237231 10441 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:42.239066 10325 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.240032  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2620) took 2183 ms. Trace:
I20260709 13:17:42.241541 10362 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:42.241999 10362 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:42.243089 10362 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.244415 10362 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.240501  5375 rpcz_store.cc:276] 0709 13:17:40.056694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.343316 (+1286622us) service_pool.cc:224] Handling call
0709 13:17:41.343737 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.344135 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.344174 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.344755 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.052180 (+707425us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:42.052220 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.052342 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.239736 (+187394us) raft_consensus.cc:1685] finished
0709 13:17:42.239762 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.239956 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123030,"raft.queue_time_us":17778,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7720,"thread_start_us":706983,"threads_started":1,"wal-append.queue_time_us":821279}
I20260709 13:17:42.250138  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.253512 10105 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:42.253700 10312 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.260682  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.282622  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.283154  5375 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 8.
W20260709 13:17:42.284500  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 216401us
I20260709 13:17:42.180847 10431 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:42.284956  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:42.284029  5372 raft_consensus.cc:2410] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:42.286069  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.287905  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2537) took 2053 ms. Trace:
I20260709 13:17:42.288113  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:42.288328  5444 rpcz_store.cc:276] 0709 13:17:40.234418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.686331 (+451913us) service_pool.cc:224] Handling call
0709 13:17:40.708297 (+ 21966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.004220 (+295923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.287640 (+1283420us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400321ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:42.287835 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637316864}
I20260709 13:17:42.289777  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:42.287140 10231 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.291267  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:42.243114 10192 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.293309  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.294085  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.291955  5372 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.293825 10192 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.296142  5370 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 17.
I20260709 13:17:42.296525  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.296728  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:42.296902  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:42.299420  5444 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:42.300303  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.285957 10088 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:42.314885 10329 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.315745 10231 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:42.316250 10231 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.316675 10231 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.317749  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:42.318517 10167 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:42.319067 10428 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.317778 10326 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.321874 10192 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.323441  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.324174  5444 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:42.324294 10192 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.301339  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:42.326565 10192 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:42.327144 10192 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.327610 10192 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.295434 10382 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.290604 10243 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:42.328785 10243 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.331044 10243 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:42.332960  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.333971  5444 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:42.334072 10328 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.334477 10429 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.334934  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041443b19a6248948edd8e88378fd175"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:42.334834  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.335668  5518 raft_consensus.cc:606] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.306522  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:42.335876  5444 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:42.291311 10327 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:42.326666  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2026) took 1977 ms. Trace:
I20260709 13:17:42.338735  5516 rpcz_store.cc:276] 0709 13:17:40.349840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.350002 (+   162us) service_pool.cc:224] Handling call
0709 13:17:41.324970 (+974968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:41.325640 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.326469 (+1000829us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54001536d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:42.326611 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185590144}
I20260709 13:17:42.294602 10338 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.292879 10367 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:42.347158  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:42.292555 10183 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:42.342267 10432 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.341518  5372 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:42.349642  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.351540  5518 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:42.351770  5372 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:42.354050  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.335074 10405 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:42.356240  5518 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:42.344305 10327 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.351330 10218 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:42.360116  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.370803  5372 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:42.353556  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:42.360250  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d883e5d309d4113a821624777a85d05"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:42.361276  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:42.360246  9892 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:42.372659  5516 raft_consensus.cc:606] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.362334 10383 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.362457  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:42.373517  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.346956 10367 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.364814 10324 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.364903 10431 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:42.366268  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2571) took 1125 ms. Trace:
W20260709 13:17:42.369112 10437 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:42.351572 10182 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.372931  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:42.372726  5441 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.374466  5375 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:42.363554 10438 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:17:42.391041 10440 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:17:42.372795 10327 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.402100  5518 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:42.375771 10233 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:42.398366  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2543) took 2153 ms. Trace:
I20260709 13:17:42.403893  5446 rpcz_store.cc:276] 0709 13:17:40.245232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.701048 (+1455816us) service_pool.cc:224] Handling call
0709 13:17:41.704215 (+  3167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.707281 (+  3066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.707337 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.708088 (+   751us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.162120 (+454032us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:42.162183 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.162283 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.398135 (+235852us) raft_consensus.cc:1685] finished
0709 13:17:42.398159 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.398298 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2572,"raft.queue_time_us":2956,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10948,"thread_start_us":406248,"threads_started":1,"wal-append.queue_time_us":482225}
I20260709 13:17:42.406675  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.407528  5446 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:42.408707  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.356901  9950 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:42.393630  5448 rpcz_store.cc:276] 0709 13:17:41.241156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.265544 (+ 24388us) service_pool.cc:224] Handling call
0709 13:17:42.366074 (+1100530us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54003bd154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:42.366185 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190361472}
I20260709 13:17:42.414562  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.416154  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:42.374897  5372 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:42.398367  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:42.417953  5516 raft_consensus.cc:606] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.418515  5516 raft_consensus.cc:614] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:42.350296 10338 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.418255  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:42.419313  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.352113 10105 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:17:42.391898 10324 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.372997 10218 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:42.393152 10182 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.390779 10320 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.393081 10367 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.354750 10183 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:42.438551  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2531) took 2238 ms. Trace:
I20260709 13:17:42.430737  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.431509  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.440303  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2536) took 2206 ms. Trace:
I20260709 13:17:42.440745  5375 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:42.440721  5442 rpcz_store.cc:276] 0709 13:17:40.234124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.677522 (+443398us) service_pool.cc:224] Handling call
0709 13:17:40.684219 (+  6697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.723855 (+ 39636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.723904 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.723964 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:40.724011 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.440071 (+1716060us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b5400238a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:42.440124 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.440249 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90476288}
I20260709 13:17:42.442356  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:42.439023  5450 rpcz_store.cc:276] 0709 13:17:40.199968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.221189 (+ 21221us) service_pool.cc:224] Handling call
0709 13:17:40.221592 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:40.415342 (+193750us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:40.415731 (+   389us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:40.432107 (+ 16376us) log.cc:844] Serialized 26 byte log entry
0709 13:17:40.580037 (+147930us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:40.580081 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.580158 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.399296 (+1819138us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b24002bf9e8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0b259c4 00007fc1d0b23acb 00007fc1d0cdedc9 00007fc1d0cdea55 00007fc1d0cddfb0 00007fc1d3954488 00007fc1d3954be8 00007fc1d392c398 00007fc1d392776a 00007fc1d3926bb6
0709 13:17:42.426913 (+ 27617us) raft_consensus.cc:1685] finished
0709 13:17:42.426935 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.438465 (+ 11530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102707,"raft.queue_time_us":123959,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3517,"spinlock_wait_cycles":104570752,"thread_start_us":283543,"threads_started":2,"wal-append.queue_time_us":229887}
I20260709 13:17:42.444669  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.445633  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:42.446017  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.446205  5450 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.447293  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.424911 10405 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:42.427417 10218 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.459172  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.469070  5441 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:42.470767  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.425693 10331 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:42.427578  9950 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:42.484583  5524 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:42.474819  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.429044 10233 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:42.476948  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.480821  5450 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:42.482810  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.486048  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.486675  6073 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:42.490233  5448 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:17:42.491219  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.491767  5448 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:42.493415  5441 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:42.489697  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.496062  5450 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:42.494705  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:42.497292  5441 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.497293  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2616) took 2441 ms. Trace:
I20260709 13:17:42.498133  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.497886  5374 rpcz_store.cc:276] 0709 13:17:40.055514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.672789 (+617275us) service_pool.cc:224] Handling call
0709 13:17:40.673309 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.621449 (+948140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.621507 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:41.629857 (+  8350us) log.cc:844] Serialized 26 byte log entry
0709 13:17:41.942286 (+312429us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:41.942343 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.942447 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.497045 (+554598us) raft_consensus.cc:1685] finished
0709 13:17:42.497072 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.497220 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":715837,"raft.queue_time_us":823429,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6083,"thread_start_us":521581,"threads_started":2,"wal-append.queue_time_us":551870}
I20260709 13:17:42.499722  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:42.498888  5450 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:42.500682  6070 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:42.502048  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.503655  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.504688  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.504611  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:42.505461 10361 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.505889  5450 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:17:42.507377 10183 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:42.507889 10449 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:42.508030 10192 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.509644  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:42.510627  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.511240 10338 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:42.513841  9950 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.515254  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2614) took 2460 ms. Trace:
I20260709 13:17:42.515344  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2630) took 1146 ms. Trace:
I20260709 13:17:42.520462 10231 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.484185 10405 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:42.487324 10331 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:42.524907 10327 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.527446 10182 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.529282  5442 raft_consensus.cc:2410] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:17:42.530491 10233 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.535563  5441 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:42.535706  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.494495 10427 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:42.537246  5370 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:42.539043  5368 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:42.539455  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2619) took 2483 ms. Trace:
I20260709 13:17:42.540627 10167 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.541635 10172 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.545979  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:42.586050  5446 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:42.600457  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 54553.3us
I20260709 13:17:42.601891  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:42.548760 10434 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.312s	user 0.000s	sys 0.003s
I20260709 13:17:42.550067  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:42.550305 10363 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:42.541287 10428 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.551235 10442 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.553292  5448 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:42.562703  5490 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:42.568742  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 95898.3us
I20260709 13:17:42.569068  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:42.570502  5449 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:42.573346  5366 rpcz_store.cc:276] 0709 13:17:41.368968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.681308 (+312340us) service_pool.cc:224] Handling call
0709 13:17:42.515160 (+833852us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400186ad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:42.515265 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064761728}
I20260709 13:17:42.551211 10432 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.590960  5444 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:42.592175  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2549) took 2345 ms. Trace:
I20260709 13:17:42.592859  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1936) took 2404 ms. Trace:
I20260709 13:17:42.593474  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1937) took 2372 ms. Trace:
I20260709 13:17:42.581346 10331 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.572171 10449 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:42.590605  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:42.681519  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2318) took 3636 ms. Trace:
I20260709 13:17:42.664242  5442 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:42.593601  5371 rpcz_store.cc:276] 0709 13:17:40.056411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.238516 (+1182105us) service_pool.cc:224] Handling call
0709 13:17:41.238913 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:41.506423 (+267510us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:42.022189 (+515766us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.182625 (+160436us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:42.209474 (+ 26849us) log.cc:844] Serialized 52 byte log entry
0709 13:17:42.209692 (+   218us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:42.209926 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.539132 (+329206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.539211 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.539254 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:42.539267 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.539398 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":933496,"prepare.queue_time_us":610460,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":1214,"raft.queue_time_us":677652,"raft.run_cpu_time_us":553,"raft.run_wall_time_us":52050,"thread_start_us":572588,"threads_started":2,"wal-append.queue_time_us":262381}
I20260709 13:17:42.697762  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2551) took 1998 ms. Trace:
I20260709 13:17:42.687942  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2013) took 2503 ms. Trace:
W20260709 13:17:42.677779  5373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2610) took 2712 ms (client timeout 1801 ms). Trace:
I20260709 13:17:42.786269  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:42.786593  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 217613us
I20260709 13:17:42.784157  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2550) took 2516 ms. Trace:
W20260709 13:17:42.781868  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 289834us
I20260709 13:17:42.787071  5370 rpcz_store.cc:276] 0709 13:17:40.188048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.536529 (+2348481us) service_pool.cc:224] Handling call
0709 13:17:42.536856 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.592539 (+ 55683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.592791 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.784345  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.786669  5515 rpcz_store.cc:276] 0709 13:17:40.184473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.184756 (+   283us) service_pool.cc:224] Handling call
0709 13:17:40.185147 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.680364 (+495217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.687582 (+2007218us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54003782d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:42.687865 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137330560}
W20260709 13:17:42.657727  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55927.5us
I20260709 13:17:42.798801  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:42.673902  5519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2328) took 3206 ms (client timeout 1640 ms). Trace:
I20260709 13:17:42.787045  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2056) took 1033 ms. Trace:
I20260709 13:17:42.798733  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:42.590173  5522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2037) took 1708 ms (client timeout 1814 ms). Trace:
I20260709 13:17:42.797776  5442 rpcz_store.cc:276] 0709 13:17:40.268200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.663352 (+2395152us) service_pool.cc:224] Handling call
0709 13:17:42.663799 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.783514 (+119715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.784100 (+   586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.787705  5368 rpcz_store.cc:276] 0709 13:17:40.221169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.538554 (+2317385us) service_pool.cc:224] Handling call
0709 13:17:42.538860 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.593148 (+ 54288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.593389 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.784088  5445 rpcz_store.cc:276] 0709 13:17:40.247110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.591260 (+2344150us) service_pool.cc:224] Handling call
0709 13:17:42.591656 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.591860 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.591894 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.591950 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:42.591980 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.592027 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.592122 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.785183  5446 rpcz_store.cc:276] 0709 13:17:40.699455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.696551 (+1997096us) service_pool.cc:224] Handling call
0709 13:17:42.697187 (+   636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.697400 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.697449 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.697493 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:42.697519 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.697568 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.697700 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.588057 10214 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:42.815624 10384 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.583611 10431 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.233s
I20260709 13:17:42.816949 10431 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:42.583209 10231 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.783227  5520 rpcz_store.cc:276] 0709 13:17:39.042458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.043011 (+   553us) service_pool.cc:224] Handling call
0709 13:17:39.072243 (+ 29232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:40.417257 (+1345014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.678809 (+2261552us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400379bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:42.679044 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3084358528}
I20260709 13:17:42.805075  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.573289  5367 rpcz_store.cc:276] 0709 13:17:40.054888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.433320 (+378432us) service_pool.cc:224] Handling call
0709 13:17:40.433820 (+   500us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:41.682128 (+1248308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.682157 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:41.693169 (+ 11012us) log.cc:844] Serialized 52 byte log entry
0709 13:17:41.917333 (+224164us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:42.077077 (+159744us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.077401 (+   324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.077495 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.514993 (+437498us) raft_consensus.cc:1685] finished
0709 13:17:42.515018 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.515191 (+   173us) inbound_call.cc:177] Queueing success response
0709 13:17:42.537494 (+ 22303us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b1800240460. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d7c6058f 00007fc1d0c9f571 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd
Metrics: {"mutex_wait_us":1144201,"prepare.queue_time_us":262354,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1049374,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":5497,"spinlock_wait_cycles":8229632,"thread_start_us":668584,"threads_started":3,"wal-append.queue_time_us":491224}
I20260709 13:17:42.824829  5445 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:42.802796  5449 rpcz_store.cc:276] 0709 13:17:41.753869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.510369 (+756500us) service_pool.cc:224] Handling call
0709 13:17:42.786978 (+276609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.802110  5371 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:42.592609  5341 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44090 dropped due to backpressure: service queue is full with 50 items
I20260709 13:17:42.810036  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:42.820957  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:42.807219  5522 rpcz_store.cc:269] 0709 13:17:40.881474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.895742 (+ 14268us) service_pool.cc:224] Handling call
0709 13:17:42.589994 (+1694252us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b5400277ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:42.590110 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162225024}
W20260709 13:17:42.802377  5373 rpcz_store.cc:269] 0709 13:17:39.955198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.955908 (+   710us) service_pool.cc:224] Handling call
0709 13:17:42.667165 (+2711257us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000faad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:42.667355 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140430080}
W20260709 13:17:42.802693  5519 rpcz_store.cc:269] 0709 13:17:39.458871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.461754 (+  2883us) service_pool.cc:224] Handling call
0709 13:17:42.652988 (+3191234us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400378cd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:42.664641 (+ 11653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2932471040}
I20260709 13:17:42.806273  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.826944  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2563) took 1943 ms. Trace:
I20260709 13:17:42.839496  5445 rpcz_store.cc:276] 0709 13:17:40.883925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.823725 (+1939800us) service_pool.cc:224] Handling call
0709 13:17:42.824409 (+   684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.826599 (+  2190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.826870 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.840572  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:42.804231 10320 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.825762  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:42.800516  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.705483 10377 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.653714 10427 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:42.652084 10172 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.825191  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:42.873505  5367 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:42.583701 10327 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.674739 10361 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:42.803130 10362 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:42.842509  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 363) took 1883 ms. Trace:
I20260709 13:17:42.827611  5448 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:17:42.876003  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2560) took 2159 ms. Trace:
I20260709 13:17:42.876482  5448 rpcz_store.cc:276] 0709 13:17:40.716343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.788696 (+2072353us) service_pool.cc:224] Handling call
0709 13:17:42.827234 (+ 38538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:42.875511 (+ 48277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.875889 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.589205 10173 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.242s
I20260709 13:17:42.837026 10192 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:42.822911 10328 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:42.845081  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:42.826939 10382 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:17:42.845814  5370 raft_consensus.cc:2368] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:42.847018  5445 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:42.589903 10405 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.817356 10431 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:42.851579  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:42.699452 10311 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:42.676378 10098 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 13:17:42.704288 10218 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.895228  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:42.896792  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:42.897521  5371 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:42.840644 10324 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.877779  5446 rpcz_store.cc:276] 0709 13:17:40.959310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.825107 (+1865797us) service_pool.cc:224] Handling call
0709 13:17:42.841593 (+ 16486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.841816 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.841854 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.841903 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:42.841934 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.841991 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.842433 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.797535 10428 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.797344 10442 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.886487  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2564) took 1871 ms. Trace:
I20260709 13:17:42.899219  5445 rpcz_store.cc:276] 0709 13:17:41.015276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.846362 (+1831086us) service_pool.cc:224] Handling call
0709 13:17:42.846777 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.886190 (+ 39413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.886414 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.900933  5445 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:42.651837 10167 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.822253 10432 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:42.870813 10443 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:42.854995 10427 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.875381 10377 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:42.900728 10461 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.848657 10231 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.877619 10362 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.881889 10361 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.887249 10328 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:42.833693  5341 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44090 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2661)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2654)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1960)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1962)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2649)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2650)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1948)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1952)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 387)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2651)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2658)
I20260709 13:17:42.994472  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.961295  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.933265  5518 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:42.980271  5446 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:42.903477  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2572) took 1659 ms. Trace:
I20260709 13:17:42.994493  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:42.902876  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 84295.1us
I20260709 13:17:43.003299  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.004098  5522 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:17:42.904064  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59086.2us
I20260709 13:17:43.004313  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:42.925094  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:42.961278  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47351.4us
I20260709 13:17:43.002399  5520 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:43.006847  5519 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:42.930524  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:42.932319  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.003558  5445 rpcz_store.cc:276] 0709 13:17:41.243717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.900448 (+1656731us) service_pool.cc:224] Handling call
0709 13:17:42.900764 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.903160 (+  2396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.903413 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.932864  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:43.008414  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78120.2us
W20260709 13:17:42.915968  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 353368us
I20260709 13:17:43.009853  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:43.010098  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:42.929013  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.011458  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:43.012745  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:43.012804  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2566) took 1965 ms. Trace:
I20260709 13:17:43.052500  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.052902  5446 rpcz_store.cc:276] 0709 13:17:41.047562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.899010 (+1851448us) service_pool.cc:224] Handling call
0709 13:17:42.979999 (+ 80989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.012445 (+ 32446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.012730 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.019294  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:43.054263  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.054883 10382 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.055433 10382 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.057709 10340 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:43.057798  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2562) took 2174 ms. Trace:
I20260709 13:17:43.058491 10340 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:43.058553  5442 rpcz_store.cc:276] 0709 13:17:40.883589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.822357 (+1938768us) service_pool.cc:224] Handling call
0709 13:17:42.822738 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.822972 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:43.043416 (+220444us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.055248 (+ 11832us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.055340 (+    92us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:43.055401 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.055496 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.057713 (+  2217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4493,"thread_start_us":231374,"threads_started":2}
I20260709 13:17:43.059585 10340 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.048090  5445 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: [14.9-15.10]
I20260709 13:17:43.061045  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2069) took 1003 ms. Trace:
I20260709 13:17:43.061398  5445 rpcz_store.cc:276] 0709 13:17:42.057365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.047390 (+990025us) service_pool.cc:224] Handling call
0709 13:17:43.047811 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:43.060756 (+ 12945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.060991 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.062645  9892 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:43.063202  9892 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.048894  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:43.050268  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.068451  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.070163  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.071935  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.073202  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.065356  9892 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:43.076174  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.078200  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.048115 10431 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.080530 10431 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:43.051452  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.083675 10349 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:43.084476  5369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1951) took 1287 ms (client timeout 1508 ms). Trace:
I20260709 13:17:43.085027 10349 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:43.085692 10349 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:43.084038  5518 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:43.086347 10192 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:43.088923 10192 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:43.095907 10349 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.099776 10182 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:43.084975  5369 rpcz_store.cc:269] 0709 13:17:41.797724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.815681 (+ 17957us) service_pool.cc:224] Handling call
0709 13:17:43.069331 (+1253650us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540025a3d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:43.084405 (+ 15074us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908290304}
I20260709 13:17:43.105971  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:43.112732  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.897941 10330 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:43.116389  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.128773  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.917200 10341 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:42.911731 10218 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:43.002513 10427 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.893409 10311 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:43.136165  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.130291  5520 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:43.001063 10362 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.979794 10363 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:42.902181 10173 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.921854 10098 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:42.994701 10429 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.147s
I20260709 13:17:42.923203 10321 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:43.131873  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:43.047766 10451 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 13:17:43.123826  5369 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:43.133499  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:42.902305 10326 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:43.005293 10328 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.024500 10361 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.009491 10443 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:43.013891  9855 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.050824 10233 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:43.048578 10178 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:43.047317 10312 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:43.127840  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.115923 10384 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.100636 10182 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:43.146785  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.128614 10330 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:43.155503  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:43.161559  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 356574us
I20260709 13:17:43.141889 10325 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:43.143167 10453 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:43.163154  5516 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:43.202072  6042 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:43.176308 10443 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:43.173846  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.170145  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.179884  5517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:43.254009  5517 raft_consensus.cc:606] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:43.158735 10098 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:43.148213 10449 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:43.162277 10341 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:43.159976 10321 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:43.196898  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.197849  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:43.217888 10454 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:17:43.170297 10363 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:43.294606  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:43.201421 10325 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:43.303656  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:43.304266  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 291599us
I20260709 13:17:43.305022  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:43.300854  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:43.201514 10312 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:43.285447 10172 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:43.290791  5341 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44090 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2654)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1960)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2649)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2650)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1948)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1952)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 387)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2651)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2658)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2668)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2674)
I20260709 13:17:43.324911  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:43.326213  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:43.327148  6070 raft_consensus.cc:2410] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:17:43.310706 10325 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.182973 10233 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.224118  5369 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:17:43.224515  5444 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2062) took 1424 ms (client timeout 1811 ms). Trace:
I20260709 13:17:43.225337  5450 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:43.273313  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.277788  5415 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:43.200150  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 151387us
I20260709 13:17:43.284211  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.284473  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.284960  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.285341  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.198571 10311 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.189234 10182 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.199151 10384 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.084004  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2558) took 2373 ms. Trace:
I20260709 13:17:43.325834  5341 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44090 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2654)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1960)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2649)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2650)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1948)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1952)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 387)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2651)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2658)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2668)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2674)
I20260709 13:17:43.378530  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:43.420298  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:43.381152  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56470.5us
I20260709 13:17:43.422631  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:43.309394 10464 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:43.287284  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:43.317595 10327 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:43.432539  5369 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:43.424459  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:43.434661 10467 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:17:43.436630 10459 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 13:17:43.438030 10311 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.440673 10432 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:43.392531  9892 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:17:43.441931 10456 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:17:43.441495  5341 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44090 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2654)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1960)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2670)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2649)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2650)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1948)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1952)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 387)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2651)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2658)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2668)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2674)
I20260709 13:17:43.392901 10233 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.431608 10327 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.446514 10327 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:43.430819 10349 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:43.449576 10267 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:43.425762 10182 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.451785  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2622) took 3368 ms. Trace:
I20260709 13:17:43.340873 10466 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:17:43.452510  5375 rpcz_store.cc:276] 0709 13:17:40.083789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.441747 (+2357958us) service_pool.cc:224] Handling call
0709 13:17:42.442078 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:42.546680 (+104602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.546716 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:42.547245 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.848729 (+301484us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:42.848780 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.848855 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.451546 (+602691us) raft_consensus.cc:1685] finished
0709 13:17:43.451568 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.451718 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104221,"raft.queue_time_us":109379,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":300524,"threads_started":1,"wal-append.queue_time_us":590435}
I20260709 13:17:43.454746  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:43.314940 10428 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:43.299597 10449 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:17:43.418453  5441 rpcz_store.cc:276] 0709 13:17:40.710664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.784999 (+2074335us) service_pool.cc:224] Handling call
0709 13:17:42.785344 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.785577 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:43.002259 (+216682us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.083111 (+ 80852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.083256 (+   145us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:43.083375 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.083588 (+   213us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.083860 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":382304,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":233,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":91,"thread_start_us":242370,"threads_started":2}
W20260709 13:17:43.456465 10367 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.007s	user 0.010s	sys 0.003s
I20260709 13:17:43.456997 10367 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.457410  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:43.400755  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:43.458226  5523 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:43.458648  5523 raft_consensus.cc:614] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.458771  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:43.309661 10377 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:17:43.396325 10172 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:43.459409  5441 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.460199 10377 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:43.460588 10377 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:43.461483 10377 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.462702 10377 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.379832 10167 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:43.397459 10173 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.465610 10217 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:43.466023 10173 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.466606 10217 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:43.467116 10267 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:43.467515 10217 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:43.468230 10344 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:43.468374 10173 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:43.468729 10267 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:43.384269  5444 rpcz_store.cc:269] 0709 13:17:41.806338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.337134 (+530796us) service_pool.cc:224] Handling call
0709 13:17:43.224176 (+887042us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540032fad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:43.224397 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542414720}
I20260709 13:17:43.469120 10340 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:43.469714 10340 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:43.470099  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:43.470402  5524 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:43.470546  5375 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:43.471414  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:43.471493 10312 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.459759 10172 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.469203 10267 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:43.473119 10172 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.470722  5444 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.474529  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:43.381192 10478 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:43.476342  5375 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.322248 10465 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:43.456202 10472 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:17:43.394222  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 116543us
W20260709 13:17:43.490334  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67833.8us
I20260709 13:17:43.515134  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:43.491825  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:43.519577  5369 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.521103  5441 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:43.522583  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:43.551992  5441 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.555989  5444 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:43.557193  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:43.508829 10341 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.552821  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:43.559842  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:43.562122  5375 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:43.571810  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1968) took 1021 ms. Trace:
I20260709 13:17:43.511121 10465 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:43.573808 10431 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:43.574020 10465 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:43.470628 10340 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:43.579207  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 336312us
I20260709 13:17:43.327170 10338 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 13:17:43.574411 10431 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:43.591077 10431 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:43.592975 10427 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.595883 10427 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:43.468653 10344 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:43.584337 10231 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.573105  5375 rpcz_store.cc:276] 0709 13:17:42.549906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.472466 (+922560us) service_pool.cc:224] Handling call
0709 13:17:43.571721 (+ 99255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.510625 10478 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:43.602571  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:43.608428  6041 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.005s
W20260709 13:17:43.608938  6041 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.007s	sys 0.005s
I20260709 13:17:43.608815 10231 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.570329  5441 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:43.574941 10173 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:43.589197 10362 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.590060  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:43.630324  5444 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:43.590586 10167 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:43.309561 10330 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.576059  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:43.581391  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:43.524641 10432 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.613965 10340 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:43.501349  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.341476 10098 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.509797 10363 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:43.557608  5369 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:43.379565 10321 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:43.628278  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68479.8us
W20260709 13:17:43.634685  5448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.004s
W20260709 13:17:43.879747  5448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.009s	sys 0.004s
I20260709 13:17:43.598516 10428 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:17:43.642130  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60805.1us
W20260709 13:17:43.609651  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 508389us
I20260709 13:17:43.608328 10478 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.688275  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:43.608062 10453 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:17:43.849738  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 273727us
I20260709 13:17:43.633095 10167 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.893575  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:43.895471  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1979) took 1337 ms. Trace:
W20260709 13:17:43.909951  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 323355us
I20260709 13:17:43.890046 10173 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:43.854211 10276 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.924130  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:43.911749  5369 rpcz_store.cc:276] 0709 13:17:42.558085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.491492 (+933407us) service_pool.cc:224] Handling call
0709 13:17:43.863371 (+371879us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.937640  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:43.912184 10098 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.923637 10167 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:43.931377 10328 consensus_meta.cc:287] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.003s
I20260709 13:17:43.945334  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:43.940173 10477 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:17:43.930085 10173 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.956352  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1972) took 1405 ms. Trace:
W20260709 13:17:43.987488  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63453.7us
W20260709 13:17:44.007988  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.009512  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:44.010320  5524 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
W20260709 13:17:43.952908 10233 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.003s
I20260709 13:17:44.011096  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:44.011303  5341 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44106 dropped due to backpressure: service queue is full with 50 items [suppressed 3 similar messages]
I20260709 13:17:43.979674  5369 rpcz_store.cc:276] 0709 13:17:42.551158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.944586 (+1393428us) service_pool.cc:224] Handling call
0709 13:17:43.956263 (+ 11677us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:43.957595 10484 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:17:43.953078 10231 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:44.024420  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.982826 10173 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:44.009894 10472 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.063s	user 0.004s	sys 0.003s
I20260709 13:17:43.977804 10328 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:44.063542  5416 leader_election.cc:336] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.508s (SENT)
I20260709 13:17:44.063792  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2555) took 3357 ms. Trace:
I20260709 13:17:44.064132  5447 rpcz_store.cc:276] 0709 13:17:40.706615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.695428 (+1988813us) service_pool.cc:224] Handling call
0709 13:17:42.788155 (+ 92727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:42.805296 (+ 17141us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:42.805335 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.065831 (+260496us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b2c0003b228. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:17:43.066268 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.255551 (+189283us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:43.255609 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.255708 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.061971 (+806263us) raft_consensus.cc:1685] finished
0709 13:17:44.061993 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.063613 (+  1620us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b540032f5d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:44.063737 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9853,"spinlock_wait_cycles":220956928,"thread_start_us":188845,"threads_started":1,"wal-append.queue_time_us":544723}
I20260709 13:17:44.030567 10453 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:44.018061 10384 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:44.036342 10182 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.586s	user 0.004s	sys 0.004s
I20260709 13:17:44.048269 10431 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:44.045102 10327 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.598s	user 0.003s	sys 0.003s
I20260709 13:17:44.020679  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:44.443014  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.474423  5413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.021s	sys 0.038s
W20260709 13:17:44.506099  5413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.029s	sys 0.041s
W20260709 13:17:44.432314  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.067714  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:44.511045  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 443226us
I20260709 13:17:44.444871 10517 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.166726  5515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.009s
W20260709 13:17:44.514511  5515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.000s	sys 0.010s
I20260709 13:17:44.514473 10517 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.516470  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2363) took 1550 ms. Trace:
I20260709 13:17:44.500859  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2072) took 2440 ms. Trace:
I20260709 13:17:44.066808  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:44.060690  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2565) took 3045 ms. Trace:
I20260709 13:17:44.066407  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2339) took 1773 ms. Trace:
W20260709 13:17:44.173703  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.009s
I20260709 13:17:44.518867  5447 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:44.519719  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2577) took 1389 ms. Trace:
W20260709 13:17:44.519990  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.000s	sys 0.010s
W20260709 13:17:44.520561  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 938006us
W20260709 13:17:44.210160 10432 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:17:44.520205  5447 rpcz_store.cc:276] 0709 13:17:43.130583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.066530 (+935947us) service_pool.cc:224] Handling call
0709 13:17:44.519577 (+453047us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:44.550267  5368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1964) took 2001 ms (client timeout 1757 ms). Trace:
W20260709 13:17:44.068542 10311 consensus_meta.cc:287] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.002s
W20260709 13:17:44.551362  5366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1963) took 2002 ms (client timeout 1744 ms). Trace:
I20260709 13:17:44.513269  5416 leader_election.cc:400] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
W20260709 13:17:44.550531 10167 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.572s	user 0.004s	sys 0.009s
I20260709 13:17:44.569620  5416 leader_election.cc:403] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:44.564689  5368 rpcz_store.cc:269] 0709 13:17:42.548767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.549628 (+2000861us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.549908 (+   280us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:44.520726 10517 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:44.049248 10172 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.000s
W20260709 13:17:44.136672 10502 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:17:44.583302 10172 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.584723 10349 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.585868 10349 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.588864 10431 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.589852 10432 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:44.082661 10466 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.508s
W20260709 13:17:44.222992 10479 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.918s	user 0.003s	sys 0.000s
I20260709 13:17:44.056965 10509 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:44.339561 10470 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.426s	user 0.003s	sys 0.000s
W20260709 13:17:44.143371 10325 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.002s
I20260709 13:17:44.592448 10511 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:44.315647 10382 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.021309 10233 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:44.516960  5515 rpcz_store.cc:276] 0709 13:17:42.965625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.079954 (+114329us) service_pool.cc:224] Handling call
0709 13:17:43.080398 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.080695 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:43.139583 (+ 58888us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.515489 (+1375906us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:44.515623 (+   134us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:44.515927 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.516059 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.516315 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103865,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":32664,"raft.run_cpu_time_us":14594,"raft.run_wall_time_us":211394,"thread_start_us":1433285,"threads_started":3,"wal-append.queue_time_us":984719}
W20260709 13:17:44.344237 10457 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.146s	user 0.000s	sys 0.004s
I20260709 13:17:44.183065 10363 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:44.652158  5373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1965) took 2103 ms (client timeout 1744 ms). Trace:
I20260709 13:17:44.652488  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:44.266265  9803 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:44.343086 10267 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.595052 10349 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:44.596002  5441 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2580) took 1464 ms (client timeout 1677 ms). Trace:
I20260709 13:17:44.596509  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:44.562695 10486 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.600171 10167 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.535777  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
W20260709 13:17:44.568702  5366 rpcz_store.cc:269] 0709 13:17:42.548506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.550876 (+2002370us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.551118 (+   242us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:44.601645 10507 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.303368 10340 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.006s
I20260709 13:17:44.518224  5448 rpcz_store.cc:276] 0709 13:17:41.015702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.877655 (+1861953us) service_pool.cc:224] Handling call
0709 13:17:42.889164 (+ 11509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.109989 (+220825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.110030 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.118471 (+  8441us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.892153 (+773682us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:43.892184 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.892238 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.060370 (+168132us) raft_consensus.cc:1685] finished
0709 13:17:44.060401 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.060604 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14679,"raft.queue_time_us":20971,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":966790,"threads_started":2,"wal-append.queue_time_us":939803}
I20260709 13:17:44.082959 10383 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.508s
W20260709 13:17:44.611531  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.045107 10443 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.774s	user 0.007s	sys 0.002s
W20260709 13:17:44.272991 10455 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.973s	user 0.001s	sys 0.001s
W20260709 13:17:44.151504 10465 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
W20260709 13:17:44.224968 10492 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:17:44.159442 10331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.284s	user 0.009s	sys 0.002s
I20260709 13:17:44.652856 10172 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.620368 10325 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:44.623690 10499 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:44.024618 10428 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:44.769790 10428 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:44.770349  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2621) took 4691 ms. Trace:
I20260709 13:17:44.771925 10428 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.052452 10231 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.773783 10231 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.775668 10325 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:44.776649 10231 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.138648 10328 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.122961 10508 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:44.628734  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2068) took 2572 ms. Trace:
I20260709 13:17:44.779754  5443 rpcz_store.cc:276] 0709 13:17:42.056419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.923700 (+867281us) service_pool.cc:224] Handling call
0709 13:17:42.924086 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:42.924465 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.924494 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:42.924935 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.117555 (+192620us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:43.275514 (+157959us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.275880 (+   366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.275986 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.312902 (+1036916us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:44.628130 (+315228us) raft_consensus.cc:1685] finished
0709 13:17:44.628317 (+   187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.628530 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265043,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":5421,"raft.queue_time_us":328,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":26912,"spinlock_wait_cycles":20026624,"thread_start_us":320904,"threads_started":2,"wal-append.queue_time_us":711953}
I20260709 13:17:44.783221  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:44.784196  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2598) took 1199 ms. Trace:
I20260709 13:17:44.784564  5443 rpcz_store.cc:276] 0709 13:17:43.584791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.782808 (+1198017us) service_pool.cc:224] Handling call
0709 13:17:44.784098 (+  1290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:44.371628 10173 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.788281 10173 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:44.630967  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49286.6us
W20260709 13:17:44.792153  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.771176  5372 rpcz_store.cc:276] 0709 13:17:40.078506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.425925 (+2347419us) service_pool.cc:224] Handling call
0709 13:17:42.426435 (+   510us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:42.542569 (+116134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.542609 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:42.543251 (+   642us) log.cc:844] Serialized 52 byte log entry
0709 13:17:42.883840 (+340589us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:42.883883 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.883951 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.272150 (+1388199us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:44.769514 (+497364us) raft_consensus.cc:1685] finished
0709 13:17:44.769565 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.770103 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142130,"raft.queue_time_us":119374,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":14824832,"thread_start_us":340174,"threads_started":1,"wal-append.queue_time_us":642078}
I20260709 13:17:44.632372  6072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59510 (request call id 176) took 2156 ms. Trace:
I20260709 13:17:44.793644  6072 rpcz_store.cc:276] 0709 13:17:42.476393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.488209 (+ 11816us) service_pool.cc:224] Handling call
0709 13:17:42.545798 (+ 57589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.591521 (+ 45723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.600529 (+  9008us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.651458 (+ 50929us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:42.654380 (+  2922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.631493 (+1977113us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b54005f23d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:44.631613 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.632061 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102054784}
W20260709 13:17:44.052507 10377 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.001s
I20260709 13:17:44.019893  5341 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44106 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2656)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1960)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2663)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2673)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1980)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2670)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38156 (request call id 388)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2623)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2634)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2649)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2650)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1948)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1952)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 387)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2651)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2658)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2664)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2666)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2667)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2668)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2672)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2674)
W20260709 13:17:44.798588  5372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1960) took 2251 ms (client timeout 2165 ms). Trace:
W20260709 13:17:44.799173  5372 rpcz_store.cc:269] 0709 13:17:42.547611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.798262 (+2250651us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.798482 (+   220us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:17:44.800446  5372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1969) took 2250 ms (client timeout 2213 ms). Trace:
I20260709 13:17:44.380976 10478 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.804279 10478 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.643486 10367 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.805061 10377 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:44.806640 10367 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:44.807063 10105 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:44.316282 10312 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:44.807685 10105 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:44.808136 10312 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:44.809854 10312 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.751425  5447 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:44.656391  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 143553us
W20260709 13:17:44.652767  5373 rpcz_store.cc:269] 0709 13:17:42.549033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.651737 (+2102704us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.651931 (+   194us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:17:44.206795 10361 consensus_meta.cc:287] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.023s	user 0.010s	sys 0.009s
I20260709 13:17:44.518898  5521 rpcz_store.cc:276] 0709 13:17:42.292610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.292772 (+   162us) service_pool.cc:224] Handling call
0709 13:17:42.293040 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.330094 (+ 37054us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:42.429580 (+ 99486us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.563404 (+133824us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.902105 (+338701us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b18002eb8e0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:17:42.911163 (+  9058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.911225 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:42.911277 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.065254 (+1153977us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b540016cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:44.065300 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.066348 (+  1048us) inbound_call.cc:177] Queueing success response
0709 13:17:44.178150 (+111802us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18002eb8e0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
Metrics: {"mutex_wait_us":337620,"prepare.queue_time_us":175499,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":1933,"raft.queue_time_us":351768,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":4508,"spinlock_wait_cycles":95569536,"thread_start_us":214264,"threads_started":2,"wal-append.queue_time_us":254380,"wal-append.run_cpu_time_us":3746,"wal-append.run_wall_time_us":1582960}
W20260709 13:17:44.764636 10331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.892s	user 0.022s	sys 0.054s
I20260709 13:17:44.765300 10383 consensus_queue.cc:1243] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:17:44.765632  5366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2656) took 2222 ms (client timeout 2153 ms). Trace:
W20260709 13:17:44.847493  5366 rpcz_store.cc:269] 0709 13:17:42.542643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.760207 (+2217564us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.765523 (+  5316us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:44.563632 10327 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.764753 10443 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.669404 10466 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.767935 10465 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:44.772568 10509 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:44.517732  5442 rpcz_store.cc:276] 0709 13:17:42.059749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.060482 (+1000733us) service_pool.cc:224] Handling call
0709 13:17:43.060938 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.061470 (+   532us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:43.152059 (+ 90589us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.831016 (+678957us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.856574 (+ 25558us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.856707 (+   133us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:43.856941 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.857103 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.857175 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.499877 (+642702us) raft_consensus.cc:1685] finished
0709 13:17:44.499962 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.500462 (+   500us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29859,"prepare.queue_time_us":260712,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":7781,"raft.queue_time_us":508950,"raft.run_cpu_time_us":4067,"raft.run_wall_time_us":87404,"thread_start_us":707165,"threads_started":3,"wal-append.queue_time_us":974996}
I20260709 13:17:44.068063 10362 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.807133 10367 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:44.640859 10344 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.811427 10312 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.566291 10182 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:44.815693 10330 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.872426 10367 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.761986 10499 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.873646 10499 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.874203 10367 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:44.825356  5367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2661) took 2281 ms (client timeout 1746 ms). Trace:
W20260709 13:17:44.877800  5367 rpcz_store.cc:269] 0709 13:17:42.543818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.824980 (+2281162us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.825160 (+   180us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:44.878721 10509 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.879621  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:44.826576  5370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1974) took 2274 ms (client timeout 1823 ms). Trace:
I20260709 13:17:44.827487 10324 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:44.834491  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2066) took 1683 ms (client timeout 1633 ms). Trace:
I20260709 13:17:44.833858 10320 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:44.837370  5339 leader_election.cc:336] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.640s (SENT)
W20260709 13:17:44.840461  5415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.007s	sys 0.009s
W20260709 13:17:44.810454  5371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2660) took 2266 ms (client timeout 1801 ms). Trace:
W20260709 13:17:44.800928  5372 rpcz_store.cc:269] 0709 13:17:42.550162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.800193 (+2250031us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.800382 (+   189us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:44.853549  9803 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:44.833061  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 364) took 3873 ms. Trace:
W20260709 13:17:44.870348  5366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1967) took 2316 ms (client timeout 2272 ms). Trace:
I20260709 13:17:44.884574  5374 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 16. Ops: [14.10-14.10]
W20260709 13:17:44.757717  5441 rpcz_store.cc:269] 0709 13:17:43.131937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.522094 (+390157us) service_pool.cc:224] Handling call
0709 13:17:44.595463 (+1073369us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b540007f3d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:44.595743 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22748928}
W20260709 13:17:44.668427 10214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.006s	sys 0.007s
W20260709 13:17:44.850804  5373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1977) took 2298 ms (client timeout 2238 ms). Trace:
W20260709 13:17:44.919803 10214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.620s	user 0.009s	sys 0.008s
W20260709 13:17:44.919898  5373 rpcz_store.cc:269] 0709 13:17:42.552762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.850476 (+2297714us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.850688 (+   212us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:17:44.913604  5370 rpcz_store.cc:269] 0709 13:17:42.551860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.826219 (+2274359us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.826367 (+   148us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:44.872574 10442 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.877691 10361 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.889725  5444 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:44.898207  6077 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:44.886008  5524 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:17:44.912983  5366 rpcz_store.cc:269] 0709 13:17:42.549592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.859476 (+2309884us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.866185 (+  6709us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:17:44.881048  5367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2663) took 1753 ms (client timeout 1833 ms). Trace:
I20260709 13:17:44.672657  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:44.837994 10105 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:44.922288  5415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.008s	sys 0.014s
I20260709 13:17:44.884709  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:44.924049  5367 rpcz_store.cc:269] 0709 13:17:43.127206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.878887 (+1751681us) service_pool.cc:224] Handling call
0709 13:17:44.880950 (+  2063us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:44.913810  5518 rpcz_store.cc:269] 0709 13:17:43.151385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.151655 (+   270us) service_pool.cc:224] Handling call
0709 13:17:44.833937 (+1682282us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540016c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:44.834231 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713691520}
W20260709 13:17:44.912770  5371 rpcz_store.cc:269] 0709 13:17:42.543573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.810084 (+2266511us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:44.810261 (+   177us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:17:44.924059  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.003s	sys 0.012s
W20260709 13:17:44.935760  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 400441us
I20260709 13:17:44.922627  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:44.669368 10511 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.841068 10507 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:44.940475  5368 raft_consensus.cc:2368] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:17:44.937979  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:44.941691  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:44.938494  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.004s	sys 0.012s
I20260709 13:17:44.881309 10509 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.886287 10182 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:44.882972 10344 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:44.953451 10361 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.954880 10361 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:44.955054  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 198301us
I20260709 13:17:44.955247  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:44.955750  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:44.956785  5366 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:44.957167  5366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1975) took 2405 ms (client timeout 2870 ms). Trace:
W20260709 13:17:44.957571  5366 rpcz_store.cc:269] 0709 13:17:42.552167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.937326 (+2385159us) service_pool.cc:224] Handling call
0709 13:17:44.957112 (+ 19786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:44.958652  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:44.959447  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1982) took 1034 ms. Trace:
I20260709 13:17:44.959748  5366 rpcz_store.cc:276] 0709 13:17:43.924885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.958274 (+1033389us) service_pool.cc:224] Handling call
0709 13:17:44.959379 (+  1105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:44.960719  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:44.945300 10442 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.961898  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:44.962898  5367 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
W20260709 13:17:44.963491  5367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1962) took 2415 ms (client timeout 3015 ms). Trace:
W20260709 13:17:44.963948  5367 rpcz_store.cc:269] 0709 13:17:42.548158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.949959 (+2401801us) service_pool.cc:224] Handling call
0709 13:17:44.963423 (+ 13464us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:44.964367  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 953262us
I20260709 13:17:44.965726 10105 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.967760  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:44.969487  5373 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:44.970083  5375 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:44.970258  5373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1978) took 2412 ms (client timeout 2714 ms). Trace:
I20260709 13:17:44.970947  5371 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
W20260709 13:17:44.970832  5373 rpcz_store.cc:269] 0709 13:17:42.557769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.925080 (+2367311us) service_pool.cc:224] Handling call
0709 13:17:44.970145 (+ 45065us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:44.971645  5371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2678) took 1530 ms (client timeout 2018 ms). Trace:
W20260709 13:17:44.972054  5371 rpcz_store.cc:269] 0709 13:17:43.441074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.937983 (+1496909us) service_pool.cc:224] Handling call
0709 13:17:44.971584 (+ 33601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17792}
I20260709 13:17:44.973541  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:44.945736  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:44.943883  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:44.962212 10442 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:44.965276  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:44.990097  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:44.990720  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:44.978408 10321 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:44.980222  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 1.04269e+06us
I20260709 13:17:44.941702 10331 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:44.973212  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:44.883853 10443 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:44.983206  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 128592us
I20260709 13:17:44.900676 10465 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:44.923094 10327 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.001897  5447 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
W20260709 13:17:45.003295  5368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1971) took 2440 ms (client timeout 2126 ms). Trace:
W20260709 13:17:45.004783  5368 rpcz_store.cc:269] 0709 13:17:42.550649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.651899 (+2101250us) service_pool.cc:224] Handling call
0709 13:17:44.990559 (+338660us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.004901  5447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2582) took 1871 ms (client timeout 2153 ms). Trace:
I20260709 13:17:45.008620  5366 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.012185  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2070) took 2954 ms. Trace:
I20260709 13:17:45.013967  9803 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.015693  9803 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.018142 10324 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:45.022764  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.026168 10442 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.026503  5367 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:45.028613  5271 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 42) took 30746 ms (client timeout 15000 ms). Trace:
I20260709 13:17:45.014699  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2548) took 4767 ms. Trace:
W20260709 13:17:45.005750  5447 rpcz_store.cc:269] 0709 13:17:43.156713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.595791 (+1439078us) service_pool.cc:224] Handling call
0709 13:17:45.004818 (+409027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.030862  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2665) took 1892 ms. Trace:
I20260709 13:17:45.037779  5373 rpcz_store.cc:276] 0709 13:17:43.138265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.972751 (+1834486us) service_pool.cc:224] Handling call
0709 13:17:45.030774 (+ 58023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30464}
W20260709 13:17:45.029095  5271 rpcz_store.cc:269] 0709 13:17:14.282290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.302326 (+ 20036us) service_pool.cc:224] Handling call
0709 13:17:45.028331 (+30726005us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4065168,"reported_tablets":7}
I20260709 13:17:44.914260  5449 rpcz_store.cc:276] 0709 13:17:40.959629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.833107 (+1873478us) service_pool.cc:224] Handling call
0709 13:17:42.878474 (+ 45367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:42.891017 (+ 12543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.891071 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:42.892494 (+  1423us) log.cc:844] Serialized 52 byte log entry
0709 13:17:43.155944 (+263450us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:43.303560 (+147616us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.315668 (+ 12108us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.055078 (+739410us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b1800485320. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:44.831783 (+776705us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800485320. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287
0709 13:17:44.832276 (+   493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.832460 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.832553 (+    93us) raft_consensus.cc:1685] finished
0709 13:17:44.832566 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.832865 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47281,"prepare.queue_time_us":1011562,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":41544,"raft.run_cpu_time_us":506,"raft.run_wall_time_us":28531,"spinlock_wait_cycles":44608256,"thread_start_us":358164,"threads_started":3,"wal-append.queue_time_us":321477}
W20260709 13:17:45.040957  5339 leader_election.cc:336] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.140s (SENT)
I20260709 13:17:45.042857  5372 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:45.044039  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:45.030346  5450 rpcz_store.cc:276] 0709 13:17:40.246807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.569911 (+2323104us) service_pool.cc:224] Handling call
0709 13:17:43.225066 (+655155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.384638 (+159572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.014174 (+1629536us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b540032fad0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.014487 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505795840}
W20260709 13:17:45.046926  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.046869  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:45.012748  5446 rpcz_store.cc:276] 0709 13:17:42.058112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.053710 (+995598us) service_pool.cc:224] Handling call
0709 13:17:43.054090 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:43.145058 (+ 90968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.145106 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:43.145835 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 13:17:43.342311 (+196476us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:43.342372 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.011444 (+1669072us) spinlock_profiling.cc:243] Waited 88.5 ms on lock 0x7b540007e9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:45.011516 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.011614 (+    98us) raft_consensus.cc:1685] finished
0709 13:17:45.011627 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.011974 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1873,"raft.queue_time_us":2125,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3557,"spinlock_wait_cycles":203629824,"thread_start_us":151178,"threads_started":1,"wal-append.queue_time_us":450773}
W20260709 13:17:45.050163  5370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2669) took 1870 ms (client timeout 2110 ms). Trace:
W20260709 13:17:45.050902  5370 rpcz_store.cc:269] 0709 13:17:43.174916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.937861 (+1762945us) service_pool.cc:224] Handling call
0709 13:17:45.045347 (+107486us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.054409  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:45.057847  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:45.058190  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2077) took 1771 ms. Trace:
I20260709 13:17:45.058849  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38156 (request call id 388) took 1047 ms. Trace:
I20260709 13:17:45.059254 10362 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.059417  5373 rpcz_store.cc:276] 0709 13:17:44.010956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.057465 (+1046509us) service_pool.cc:224] Handling call
0709 13:17:45.058783 (+  1318us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.058723  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.060106 10362 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:45.060817  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.061367  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.003059 10331 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:45.061784  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2670) took 1853 ms. Trace:
I20260709 13:17:45.065129  5371 rpcz_store.cc:276] 0709 13:17:43.194532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.972811 (+1778279us) service_pool.cc:224] Handling call
0709 13:17:45.045086 (+ 72275us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.066447  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 98896.6us
I20260709 13:17:45.068796  5441 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:45.073143  5450 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:45.074129  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2574) took 1944 ms. Trace:
I20260709 13:17:45.074491  5450 rpcz_store.cc:276] 0709 13:17:43.129646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.072162 (+1942516us) service_pool.cc:224] Handling call
0709 13:17:45.072702 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.073742 (+  1040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.074046 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.075294  5444 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2579) took 1943 ms (client timeout 1920 ms). Trace:
I20260709 13:17:45.075989  5450 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:45.075881  5444 rpcz_store.cc:269] 0709 13:17:43.131364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.631391 (+500027us) service_pool.cc:224] Handling call
0709 13:17:45.074942 (+1443551us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54003bdb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.075158 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274735488}
I20260709 13:17:45.076712  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2578) took 1945 ms. Trace:
I20260709 13:17:45.077075  5450 rpcz_store.cc:276] 0709 13:17:43.131035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.075297 (+1944262us) service_pool.cc:224] Handling call
0709 13:17:45.075707 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.076452 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.076640 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.078415  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 48315.9us
I20260709 13:17:45.078640  6077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59508 (request call id 158) took 1777 ms. Trace:
I20260709 13:17:45.079344  5415 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:45.079488  5450 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:17:45.077808  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 193272us
I20260709 13:17:45.069070  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2626) took 3695 ms. Trace:
I20260709 13:17:45.084756  5373 rpcz_store.cc:276] 0709 13:17:41.367907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.060413 (+3692506us) service_pool.cc:224] Handling call
0709 13:17:45.060927 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.061204 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.061227 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.061289 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:45.061327 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.061387 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.062963 (+  1576us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.089368  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.066143 10331 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.095795  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2587) took 1918 ms. Trace:
I20260709 13:17:45.096306  5450 rpcz_store.cc:276] 0709 13:17:43.168818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.078591 (+1909773us) service_pool.cc:224] Handling call
0709 13:17:45.079036 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.082579 (+  3543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.086989 (+  4410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.041932 10509 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:45.099180 10383 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:45.099632  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2588) took 1925 ms. Trace:
I20260709 13:17:45.121479  5450 rpcz_store.cc:276] 0709 13:17:43.174525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.098629 (+1924104us) service_pool.cc:224] Handling call
0709 13:17:45.099072 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.099292 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.099325 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.099381 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:45.099408 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.099456 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.099565 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.100409  5371 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:45.122741  5366 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:45.108004  5446 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:45.109720 10405 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:45.125702 10405 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:45.127293 10405 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.058719  5520 rpcz_store.cc:276] 0709 13:17:43.286445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.304985 (+ 18540us) service_pool.cc:224] Handling call
0709 13:17:44.623252 (+1318267us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:17:44.623851 (+   599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.624494 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.624532 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.625394 (+   862us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.842449 (+217055us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:44.842508 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.842582 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.057635 (+215053us) raft_consensus.cc:1685] finished
0709 13:17:45.057658 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.057892 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2979072,"thread_start_us":216207,"threads_started":1,"wal-append.queue_time_us":429893}
W20260709 13:17:45.134130  5375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1973) took 2582 ms (client timeout 2008 ms). Trace:
I20260709 13:17:45.134491  5373 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:45.134642  5375 rpcz_store.cc:269] 0709 13:17:42.551559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.602322 (+1050763us) service_pool.cc:224] Handling call
0709 13:17:45.133886 (+1531564us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001202d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.134040 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3095274880}
I20260709 13:17:45.079294  6077 rpcz_store.cc:276] 0709 13:17:43.301714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.301874 (+   160us) service_pool.cc:224] Handling call
0709 13:17:43.326245 (+ 24371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.938257 (+1612012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.078239 (+139982us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400a4c4d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:45.078533 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3614150912}
I20260709 13:17:45.115819  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2076) took 2934 ms. Trace:
I20260709 13:17:45.135808  5441 rpcz_store.cc:276] 0709 13:17:42.159464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.944918 (+2785454us) service_pool.cc:224] Handling call
0709 13:17:45.067400 (+122482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.088436 (+ 21036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.093748 (+  5312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.135437  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2628) took 3767 ms. Trace:
I20260709 13:17:45.082492  5443 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:45.137022  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2627) took 3755 ms. Trace:
I20260709 13:17:45.137380  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2586) took 1979 ms. Trace:
I20260709 13:17:45.137524  5371 rpcz_store.cc:276] 0709 13:17:41.368139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.065984 (+3697845us) service_pool.cc:224] Handling call
0709 13:17:45.100102 (+ 34118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.123293 (+ 23191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.123512 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.138264  5443 rpcz_store.cc:276] 0709 13:17:43.158149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.849756 (+1691607us) service_pool.cc:224] Handling call
0709 13:17:45.137302 (+287546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.136534  5370 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: [13.8-16.9]
I20260709 13:17:44.944659 10486 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.137099  5373 rpcz_store.cc:276] 0709 13:17:41.368374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.086424 (+3718050us) service_pool.cc:224] Handling call
0709 13:17:45.130798 (+ 44374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.135115 (+  4317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.135356 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.141902  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1983) took 1142 ms. Trace:
I20260709 13:17:45.142553  5366 rpcz_store.cc:276] 0709 13:17:43.980862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.960411 (+979549us) service_pool.cc:224] Handling call
0709 13:17:45.123512 (+163101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.144488  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.145257  5372 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
W20260709 13:17:45.146088  5372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2673) took 1925 ms (client timeout 1743 ms). Trace:
W20260709 13:17:45.146512  5372 rpcz_store.cc:269] 0709 13:17:43.220863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.939708 (+1718845us) service_pool.cc:224] Handling call
0709 13:17:45.146014 (+206306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.147578  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2575) took 2012 ms. Trace:
I20260709 13:17:45.148118  5446 rpcz_store.cc:276] 0709 13:17:43.130055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.107298 (+1977243us) service_pool.cc:224] Handling call
0709 13:17:45.107718 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.142273 (+ 34555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.142514 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.149713  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2623) took 3777 ms. Trace:
I20260709 13:17:45.150300  5370 rpcz_store.cc:276] 0709 13:17:41.367129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.052519 (+3685390us) service_pool.cc:224] Handling call
0709 13:17:45.062604 (+ 10085us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:45.143680 (+ 81076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.143994 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.116537 10443 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:45.165242  5447 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.168205  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:45.136713 10499 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.203610  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:45.206066  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:45.212932  5441 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:45.191334 10330 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.217532  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2591) took 1683 ms. Trace:
I20260709 13:17:45.222783  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:45.225564  5450 rpcz_store.cc:276] 0709 13:17:43.525785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.122631 (+1596846us) service_pool.cc:224] Handling call
0709 13:17:45.197441 (+ 74810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.208228 (+ 10787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.208281 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.208367 (+    86us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:45.208414 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.208510 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.208688 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.218813  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2592) took 1667 ms. Trace:
I20260709 13:17:45.234925  5441 rpcz_store.cc:276] 0709 13:17:43.551909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.146142 (+1594233us) service_pool.cc:224] Handling call
0709 13:17:45.203093 (+ 56951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.213744 (+ 10651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.218707 (+  4963us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.220120  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.236682  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.237125  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.242203  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 124875us
I20260709 13:17:45.249744  5446 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:45.250627  5449 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:45.252485  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2576) took 2122 ms. Trace:
W20260709 13:17:45.254613  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 90299.1us
I20260709 13:17:45.255601  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:45.255746 10324 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.257715 10509 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:45.258919 10509 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:45.252985  5449 rpcz_store.cc:276] 0709 13:17:43.130331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.109069 (+1978738us) service_pool.cc:224] Handling call
0709 13:17:45.109524 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.251379 (+141855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.252143 (+   764us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003bc754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:45.252406 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323831040}
I20260709 13:17:45.265677  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2595) took 1681 ms. Trace:
I20260709 13:17:45.266286  5446 rpcz_store.cc:276] 0709 13:17:43.583824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.149112 (+1565288us) service_pool.cc:224] Handling call
0709 13:17:45.209783 (+ 60671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.265258 (+ 55475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.265597 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.209170 10465 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:45.215915 10167 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.228183 10443 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:45.267904  5375 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
W20260709 13:17:45.277370  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 71513.9us
W20260709 13:17:45.277011  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 220793us
I20260709 13:17:45.249291 10320 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:45.288142  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:45.234527 10330 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.260965 10509 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:45.295083  5489 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.920s (SENT) [suppressed 18 similar messages]
I20260709 13:17:45.296037 10449 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:17:45.301563 10192 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.302760  9950 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.309068  5441 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:45.287820 10362 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.289851 10105 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:45.304224 10233 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:45.314721  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2597) took 1730 ms. Trace:
I20260709 13:17:45.315780  5370 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:45.316745  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:45.315927  5441 rpcz_store.cc:276] 0709 13:17:43.584459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.248410 (+1663951us) service_pool.cc:224] Handling call
0709 13:17:45.290847 (+ 42437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.314323 (+ 23476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.314632 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.318904  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:45.319056  5450 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:45.283222 10465 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:45.321020  5446 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:45.323838  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2599) took 1738 ms. Trace:
I20260709 13:17:45.324316  5446 rpcz_store.cc:276] 0709 13:17:43.585095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.267266 (+1682171us) service_pool.cc:224] Handling call
0709 13:17:45.297299 (+ 30033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.323513 (+ 26214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.323762 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.304996 10511 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.332731  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2596) took 1748 ms. Trace:
I20260709 13:17:45.340920  5450 rpcz_store.cc:276] 0709 13:17:43.584144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.231276 (+1647132us) service_pool.cc:224] Handling call
0709 13:17:45.288417 (+ 57141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.331456 (+ 43039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.332493 (+  1037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.315228 10105 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.318686  9950 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.363278  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:45.370636  5367 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:45.388511  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1980) took 1479 ms. Trace:
I20260709 13:17:45.388985  5367 rpcz_store.cc:276] 0709 13:17:43.909272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.964823 (+1055551us) service_pool.cc:224] Handling call
0709 13:17:45.388445 (+423622us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.394245  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63134.8us
I20260709 13:17:45.336688 10507 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:45.400000  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:45.404009  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:45.399652  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:45.387738 10192 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.370116  5375 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.416779  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:45.417532 10363 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.006s
I20260709 13:17:45.407760 10511 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:45.420384  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1933) took 5283 ms. Trace:
I20260709 13:17:45.437566  5374 rpcz_store.cc:276] 0709 13:17:40.136617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.504421 (+2367804us) service_pool.cc:224] Handling call
0709 13:17:43.455368 (+950947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.937056 (+1481688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.370726 (+433670us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400144e54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:45.420075 (+ 49349us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b5400144e50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.420304 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5471777920}
I20260709 13:17:45.420475 10330 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.393769 10167 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:45.443044  5372 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.443274 10167 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.445926  5446 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:45.429510 10519 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:17:45.412277 10486 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:45.429180  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.433131  5490 leader_election.cc:336] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:17:45.434631  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2077) took 3242 ms. Trace:
I20260709 13:17:45.452450  5447 rpcz_store.cc:276] 0709 13:17:42.176448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.040124 (+2863676us) service_pool.cc:224] Handling call
0709 13:17:45.123591 (+ 83467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.167167 (+ 43576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.418246 (+251079us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b54002adfd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:45.418478 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94886272}
I20260709 13:17:45.452950  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2602) took 1867 ms. Trace:
W20260709 13:17:45.436400  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.399171  9950 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:45.439852  5443 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:45.440873  5373 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:45.398306 10449 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:45.446817  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.427037 10367 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.006s
W20260709 13:17:45.406952 10429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.096s	user 0.026s	sys 0.048s
I20260709 13:17:45.368034 10105 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:45.450352  5367 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:45.470377  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2632) took 4076 ms. Trace:
I20260709 13:17:45.470890  5367 rpcz_store.cc:276] 0709 13:17:41.393866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.410839 (+4016973us) service_pool.cc:224] Handling call
0709 13:17:45.441749 (+ 30910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.469984 (+ 28235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.470305 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.363057 10466 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:45.453342  5446 rpcz_store.cc:276] 0709 13:17:43.586005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.325660 (+1739655us) service_pool.cc:224] Handling call
0709 13:17:45.394759 (+ 69099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.452664 (+ 57905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.452887 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.439298 10499 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.449864 10363 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:45.476564  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.476933  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2594) took 1893 ms. Trace:
I20260709 13:17:45.494753  5443 rpcz_store.cc:276] 0709 13:17:43.583489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.139376 (+1555887us) service_pool.cc:224] Handling call
0709 13:17:45.418588 (+279212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.455978 (+ 37390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.476712 (+ 20734us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54002adfd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.476874 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518560640}
W20260709 13:17:45.486979 10520 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.405s	user 0.005s	sys 0.000s
I20260709 13:17:45.489400 10453 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:45.430181 10331 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:45.491676  5367 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:45.499593  5374 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:45.470932  5366 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:45.455032 10511 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:45.493263 10267 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:45.473924 10429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.290s	user 0.028s	sys 0.048s
I20260709 13:17:45.505084  5524 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:45.502717  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2639) took 3949 ms. Trace:
I20260709 13:17:45.503397  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2643) took 3875 ms. Trace:
I20260709 13:17:45.505939  5372 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:45.505972  5367 rpcz_store.cc:276] 0709 13:17:41.624980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.490815 (+3865835us) service_pool.cc:224] Handling call
0709 13:17:45.491268 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.499702 (+  8434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.499911 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.505532  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 217205us
I20260709 13:17:45.466481 10233 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.512490  5373 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:45.508381  5374 rpcz_store.cc:276] 0709 13:17:41.553543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.438923 (+3885380us) service_pool.cc:224] Handling call
0709 13:17:45.460684 (+ 21761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.500095 (+ 39411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.502655 (+  2560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.501817 10453 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:45.518800 10453 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:45.520999 10331 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.521198  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2641) took 3896 ms. Trace:
I20260709 13:17:45.521730  5373 rpcz_store.cc:276] 0709 13:17:41.624359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.472585 (+3848226us) service_pool.cc:224] Handling call
0709 13:17:45.507542 (+ 34957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.513416 (+  5874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.520988 (+  7572us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400144950. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.521140 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49661824}
W20260709 13:17:45.515156  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 99042.8us
I20260709 13:17:45.514392  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:45.525625  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2073) took 3457 ms. Trace:
I20260709 13:17:45.529075  5372 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:45.529868  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2645) took 3795 ms. Trace:
I20260709 13:17:45.530190  5372 rpcz_store.cc:276] 0709 13:17:41.734174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.507447 (+3773273us) service_pool.cc:224] Handling call
0709 13:17:45.525490 (+ 18043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.529548 (+  4058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.529786 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.531533  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.531682  5372 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:17:45.534103  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1948) took 3737 ms. Trace:
I20260709 13:17:45.520515 10453 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.534533  5372 rpcz_store.cc:276] 0709 13:17:41.796659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.530948 (+3734289us) service_pool.cc:224] Handling call
0709 13:17:45.531403 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:45.532073 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.534045 (+  1972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.526141  5442 rpcz_store.cc:276] 0709 13:17:42.064782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.898944 (+2834162us) service_pool.cc:224] Handling call
0709 13:17:44.899611 (+   667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.900492 (+   881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.900540 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.912178 (+ 11638us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.284692 (+372514us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:45.284747 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.284825 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.521822 (+236997us) raft_consensus.cc:1685] finished
0709 13:17:45.521844 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.521980 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":621,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":250,"thread_start_us":239493,"threads_started":1,"wal-append.queue_time_us":502891}
I20260709 13:17:45.538226  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2581) took 2405 ms. Trace:
I20260709 13:17:45.538856  5443 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:17:45.538503 10511 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.539249  5443 pending_rounds.cc:85] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 9
I20260709 13:17:45.539580  5443 pending_rounds.cc:107] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 16.10
W20260709 13:17:45.539698 10321 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.002s
I20260709 13:17:45.539898  5443 raft_consensus.cc:2889] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.540578  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:45.541167  5446 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:45.543877  5520 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: [13.7-14.8]
I20260709 13:17:45.547245  5375 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:45.549831  5445 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:45.552213  5371 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:17:45.523146 10167 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:45.554239  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.559758  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.545145 10510 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.561316  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.561764  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:45.562572  5522 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:45.561818 10510 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.563249  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.564047  5519 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:45.564491  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:45.565624  5446 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:45.565817  5369 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:45.565953  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.566872  5372 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:17:45.551869 10499 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.567714  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1955) took 3727 ms. Trace:
I20260709 13:17:45.567751 10499 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.568212  5372 rpcz_store.cc:276] 0709 13:17:41.840445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.566096 (+3725651us) service_pool.cc:224] Handling call
0709 13:17:45.566570 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.567413 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.567634 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.568518  5369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2653) took 3026 ms (client timeout 2084 ms). Trace:
W20260709 13:17:45.569096  5369 rpcz_store.cc:269] 0709 13:17:42.541949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.019466 (+1477517us) service_pool.cc:224] Handling call
0709 13:17:45.568324 (+1548858us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000fa0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.568454 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467097344}
I20260709 13:17:45.566980  5515 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:45.538690  5444 rpcz_store.cc:276] 0709 13:17:43.133230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.077215 (+1943985us) service_pool.cc:224] Handling call
0709 13:17:45.118963 (+ 41748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.201787 (+ 82824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.201847 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.232005 (+ 30158us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.410938 (+178933us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:45.410981 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.411047 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.536681 (+125634us) raft_consensus.cc:1685] finished
0709 13:17:45.537534 (+   853us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.538159 (+   625us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8030,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":32412,"thread_start_us":126555,"threads_started":1,"wal-append.queue_time_us":203236}
I20260709 13:17:45.572842  5374 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:45.573361  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2650) took 3799 ms. Trace:
I20260709 13:17:45.561450  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.573853  5374 rpcz_store.cc:276] 0709 13:17:41.773755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.536908 (+3763153us) service_pool.cc:224] Handling call
0709 13:17:45.572703 (+ 35795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.573164 (+   461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.573319 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.575572  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.549371 10233 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:45.589280  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.591104  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2633) took 4184 ms. Trace:
I20260709 13:17:45.591593  5371 rpcz_store.cc:276] 0709 13:17:41.398583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.416859 (+4018276us) service_pool.cc:224] Handling call
0709 13:17:45.547794 (+130935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.559140 (+ 11346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.582837 (+ 23697us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001865d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.583039 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294728064}
W20260709 13:17:45.592784  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.586289  5518 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:45.567762 10510 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.575147 10465 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:45.590009  5414 connection.cc:256] RPC call timeout handler was delayed by -1.0258784410000317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 13:17:45.551635 10182 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:17:45.597952  9803 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.001s
I20260709 13:17:45.610711  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:45.616266  5369 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:45.622038  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:45.623114  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:17:45.624485  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.626047  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:45.627586  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 386) took 3403 ms. Trace:
I20260709 13:17:45.627975  5369 rpcz_store.cc:276] 0709 13:17:42.224698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.569986 (+3345288us) service_pool.cc:224] Handling call
0709 13:17:45.605840 (+ 35854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.627341 (+ 21501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.627527 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.597072 10321 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.602087 10098 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.530s	user 0.017s	sys 0.009s
I20260709 13:17:45.614569  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:45.642701  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.648939  5443 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:45.652344  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 61660.9us
I20260709 13:17:45.655735  5371 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:45.650223  5444 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:17:45.656229  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:45.660668  5374 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.663342  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2651) took 3122 ms. Trace:
I20260709 13:17:45.663866  5371 rpcz_store.cc:276] 0709 13:17:42.541356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.597002 (+3055646us) service_pool.cc:224] Handling call
0709 13:17:45.647564 (+ 50562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.663038 (+ 15474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.663228 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.667923  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:45.668813  5444 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.653328 10321 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.679585 10321 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:45.681900 10529 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:17:45.682638  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:45.683346  5443 raft_consensus.cc:2376] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15. Re-sending same reply.
I20260709 13:17:45.681136 10105 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.685789  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 387) took 3428 ms. Trace:
I20260709 13:17:45.686324  5374 rpcz_store.cc:276] 0709 13:17:42.258016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.588727 (+3330711us) service_pool.cc:224] Handling call
0709 13:17:45.653842 (+ 65115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.662818 (+  8976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.685706 (+ 22888us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.688237  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.688402  5374 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:45.689076  5340 connection.cc:256] RPC call timeout handler was delayed by -1.5283530469998823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 13:17:45.689162  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2666) took 2542 ms. Trace:
W20260709 13:17:45.689755  5340 connection.cc:256] RPC call timeout handler was delayed by -1.2344919009999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:17:45.689792  5374 rpcz_store.cc:276] 0709 13:17:43.146923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.687362 (+2540439us) service_pool.cc:224] Handling call
0709 13:17:45.687741 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.688890 (+  1149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.689086 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.690395  5340 connection.cc:256] RPC call timeout handler was delayed by -1.1728856570000517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 13:17:45.692377  5448 raft_consensus.cc:2410] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:17:45.693553  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.693490  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 214076us
I20260709 13:17:45.692054  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:45.703625  5447 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17. Re-sending same reply.
I20260709 13:17:45.706116  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2657) took 3162 ms. Trace:
I20260709 13:17:45.706684  5375 rpcz_store.cc:276] 0709 13:17:42.542872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.600865 (+3057993us) service_pool.cc:224] Handling call
0709 13:17:45.650989 (+ 50124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.697987 (+ 46998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.698013 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.705106 (+  7093us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:45.705162 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.705248 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.705399 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.714300  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:45.699599  5446 raft_consensus.cc:2376] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17. Re-sending same reply.
I20260709 13:17:45.653118 10361 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.720301  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2603) took 2133 ms. Trace:
I20260709 13:17:45.659745 10499 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.721632  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:45.686730 10105 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:45.734603  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 200740us
I20260709 13:17:45.696063 10443 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.723037  6077 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:45.743877  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:45.747161  5442 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:45.748621  5366 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:17:45.749271  5367 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:45.750542  5368 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:45.752071  5374 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:45.752749  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2667) took 2602 ms. Trace:
I20260709 13:17:45.753015  5374 rpcz_store.cc:276] 0709 13:17:43.151038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.691421 (+2540383us) service_pool.cc:224] Handling call
0709 13:17:45.719972 (+ 28551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.752534 (+ 32562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.752704 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.723151 10233 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:45.714941 10321 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.747514  5442 pending_rounds.cc:85] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 7
I20260709 13:17:45.761328  5444 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
W20260709 13:17:45.762223  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67638.5us
I20260709 13:17:45.768823  5442 pending_rounds.cc:107] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:17:45.769202  5442 raft_consensus.cc:2889] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.744737 10344 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.770077  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.770453 10344 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.775667 10344 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:45.762245  9950 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:17:45.751395 10330 raft_consensus.cc:2764] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:17:45.745975 10443 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.773125 10192 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.778023  5375 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:17:45.792081  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2668) took 2631 ms. Trace:
I20260709 13:17:45.792481  5375 rpcz_store.cc:276] 0709 13:17:43.160482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.723484 (+2563002us) service_pool.cc:224] Handling call
0709 13:17:45.766527 (+ 43043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.791807 (+ 25280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.792031 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:45.780045  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.780406  5445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2593) took 2205 ms (client timeout 1743 ms). Trace:
I20260709 13:17:45.729854 10361 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:45.790179 10536 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:17:45.790513 10340 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:45.793742  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.798050  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.798066  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.799139  9950 consensus_queue.cc:1243] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:45.799281 10528 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.800410  5369 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:45.800092 10528 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.800822  5369 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:45.802263  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2649) took 4029 ms. Trace:
I20260709 13:17:45.802465 10443 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.737335 10167 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:17:45.793378  5445 rpcz_store.cc:269] 0709 13:17:43.575521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.672006 (+1096485us) service_pool.cc:224] Handling call
0709 13:17:45.779841 (+1107835us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540029dbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.780311 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290450304}
I20260709 13:17:45.802703  5367 rpcz_store.cc:276] 0709 13:17:41.773323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.508000 (+3734677us) service_pool.cc:224] Handling call
0709 13:17:45.749111 (+241111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.749689 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.802031 (+ 52342us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54000c6550. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.802179 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489332480}
W20260709 13:17:45.795302  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.804491  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:45.807813  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.809315  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.808213  5366 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:45.811395  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2671) took 2604 ms. Trace:
I20260709 13:17:45.809288  5446 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:45.812137  5374 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.807003  5444 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:45.812345  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 77462.4us
I20260709 13:17:45.813071  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2672) took 2592 ms. Trace:
I20260709 13:17:45.811857  5366 rpcz_store.cc:276] 0709 13:17:43.206984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.749373 (+2542389us) service_pool.cc:224] Handling call
0709 13:17:45.785692 (+ 36319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.811014 (+ 25322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.811319 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.813407  5374 rpcz_store.cc:276] 0709 13:17:43.220584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.776689 (+2556105us) service_pool.cc:224] Handling call
0709 13:17:45.806155 (+ 29466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.812669 (+  6514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.813013 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.814132  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:45.782198 10510 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:17:45.805138 10533 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:17:45.803548 10340 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:45.820252  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.781495 10321 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.840854  5518 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:45.843511 10510 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:45.843003 10528 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:45.850934  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.721199  5450 rpcz_store.cc:276] 0709 13:17:43.586292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.342520 (+1756228us) service_pool.cc:224] Handling call
0709 13:17:45.411151 (+ 68631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.458461 (+ 47310us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:45.609234 (+150773us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.719039 (+109805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.719119 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:45.719175 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.719274 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.719451 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":171925,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":18401,"thread_start_us":160466,"threads_started":2}
I20260709 13:17:45.860421  5369 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:45.861599  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 169804us
W20260709 13:17:45.861775  5448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2590) took 2584 ms (client timeout 3377 ms). Trace:
W20260709 13:17:45.874948  5448 rpcz_store.cc:269] 0709 13:17:43.277302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.868855 (+1591553us) service_pool.cc:224] Handling call
0709 13:17:45.861527 (+992672us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540033c2d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.861687 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611656064}
I20260709 13:17:45.862484  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 1981) took 1952 ms. Trace:
I20260709 13:17:45.867066  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2601) took 2281 ms. Trace:
I20260709 13:17:45.876029  5368 rpcz_store.cc:276] 0709 13:17:43.924376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.008823 (+1084447us) service_pool.cc:224] Handling call
0709 13:17:45.862294 (+853471us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54001c70d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:45.862401 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082268032}
I20260709 13:17:45.869354  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:45.868494  5367 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:45.877731  5367 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:45.877946  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 65078.8us
I20260709 13:17:45.817265 10507 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.878072  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2664) took 2744 ms. Trace:
I20260709 13:17:45.880441  5375 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:45.883723  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2674) took 2605 ms. Trace:
I20260709 13:17:45.884073  5375 rpcz_store.cc:276] 0709 13:17:43.278704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.812689 (+2533985us) service_pool.cc:224] Handling call
0709 13:17:45.874858 (+ 62169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.881596 (+  6738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.883671 (+  2075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.884739  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:45.882310  5367 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:45.840514 10340 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:45.888295  5367 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:45.892459  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 108655us
W20260709 13:17:45.900163  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.901976  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:45.817549 10465 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:17:45.815708 10405 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:17:45.892277  9950 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:17:45.905055  5516 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: [16.7-16.7]
I20260709 13:17:45.905030  5446 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:45.906519  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:45.881235 10214 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.911931  5450 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:45.876085  5441 rpcz_store.cc:276] 0709 13:17:43.585727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.324619 (+1738892us) service_pool.cc:224] Handling call
0709 13:17:45.403061 (+ 78442us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:45.467835 (+ 64774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.467891 (+    56us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:45.495621 (+ 27730us) log.cc:844] Serialized 78 byte log entry
0709 13:17:45.617562 (+121941us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:45.730485 (+112923us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.737312 (+  6827us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.743993 (+  6681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.744068 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.866775 (+122707us) raft_consensus.cc:1685] finished
0709 13:17:45.866803 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.866993 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15617,"prepare.queue_time_us":22010,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":7161,"raft.queue_time_us":28106,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":14680,"spinlock_wait_cycles":46848,"thread_start_us":205902,"threads_started":2,"wal-append.queue_time_us":108380}
I20260709 13:17:45.917904  5367 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:45.918231  5490 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:45.919653 10214 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:45.925113  9950 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:45.925547  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.925863  9950 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:45.925969  5369 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.922441  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 1952) took 4112 ms. Trace:
W20260709 13:17:45.928406  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 49457.4us
I20260709 13:17:45.929358  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:45.930083  5446 raft_consensus.cc:2376] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13. Re-sending same reply.
I20260709 13:17:45.908232  9803 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:45.931207  5524 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:45.892750 10526 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:17:45.935178  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2600) took 2349 ms. Trace:
I20260709 13:17:45.937603  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:45.942674  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 56255us
I20260709 13:17:45.942864  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:45.939383  5449 rpcz_store.cc:276] 0709 13:17:43.585396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.279805 (+1694409us) service_pool.cc:224] Handling call
0709 13:17:45.316618 (+ 36813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.391228 (+ 74610us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:45.391284 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.397263 (+  5979us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.494455 (+ 97192us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:45.494509 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.494591 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.934958 (+440367us) raft_consensus.cc:1685] finished
0709 13:17:45.934980 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.935109 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":497,"raft.queue_time_us":39287,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"thread_start_us":96612,"threads_started":1,"wal-append.queue_time_us":197537}
I20260709 13:17:45.928818  5373 rpcz_store.cc:276] 0709 13:17:41.810160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.546002 (+3735842us) service_pool.cc:224] Handling call
0709 13:17:45.578784 (+ 32782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.651919 (+ 73135us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:45.743177 (+ 91258us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.921962 (+178785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.922026 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:45.922069 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.922149 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.922275 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43329,"prepare.queue_time_us":129681,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":11008,"raft.queue_time_us":39959,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":47987,"thread_start_us":212524,"threads_started":2,"wal-append.queue_time_us":151989}
I20260709 13:17:45.959502  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:45.960563  5524 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:17:45.934688  9803 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:45.966869  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:45.976159 10545 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:17:45.976612 10541 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:17:45.981117  6069 raft_consensus.cc:2410] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:17:45.975104  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:45.964640  9803 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.999634  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:45.999939  6072 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.996862  9950 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.004223 10544 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.122s	user 0.000s	sys 0.002s
W20260709 13:17:46.009594  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51836.3us
I20260709 13:17:46.015164  5516 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:46.016350  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.016987  5524 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:46.018266  5518 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.018668  5518 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.019477  5518 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.020653  5518 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:46.020825 10548 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:17:46.022310  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 384) took 3840 ms. Trace:
I20260709 13:17:46.023088  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.024768  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.025029  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:46.025691  5444 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:46.026055  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.027299  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:45.880357  5371 rpcz_store.cc:276] 0709 13:17:43.133600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.664627 (+2531027us) service_pool.cc:224] Handling call
0709 13:17:45.665106 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.665378 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:45.764892 (+ 99514us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.877734 (+112842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.877787 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:45.877828 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.877893 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.878019 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194611,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":2474,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"thread_start_us":169239,"threads_started":2}
I20260709 13:17:46.033787 10267 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:46.035669 10267 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:46.036213  6102 heartbeater.cc:646] Failed to heartbeat to 127.4.37.190:41135 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.37.190:41135 timed out after 15.000s (SENT)
I20260709 13:17:46.036311 10267 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.018311 10321 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:46.001681  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 49753.8us
I20260709 13:17:46.038919 10344 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:46.039525 10344 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.042009 10331 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.042491 10331 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:46.043438 10331 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:46.044757 10331 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.040802 10344 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.045929 10233 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:46.046224 10344 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.046363 10233 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.047452 10105 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:46.047915 10233 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:46.050220  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 88329us
I20260709 13:17:46.022696  5372 rpcz_store.cc:276] 0709 13:17:42.182153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.569241 (+3387088us) service_pool.cc:224] Handling call
0709 13:17:45.579006 (+  9765us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:45.691728 (+112722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.691760 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:45.692382 (+   622us) log.cc:844] Serialized 52 byte log entry
0709 13:17:45.781883 (+ 89501us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:45.781920 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.781998 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.003497 (+221499us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:46.022026 (+ 18529us) raft_consensus.cc:1685] finished
0709 13:17:46.022046 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.022254 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84428,"raft.queue_time_us":91381,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":11718,"spinlock_wait_cycles":9490688,"thread_start_us":89085,"threads_started":1,"wal-append.queue_time_us":189305}
I20260709 13:17:46.051198 10361 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:46.047921 10105 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.052783 10105 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.054563  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.054483 10105 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.055272 10233 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:46.058518 10540 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.391s	user 0.000s	sys 0.002s
I20260709 13:17:46.060052  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2634) took 4656 ms. Trace:
I20260709 13:17:46.060458  5370 rpcz_store.cc:276] 0709 13:17:41.403675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.431988 (+4028313us) service_pool.cc:224] Handling call
0709 13:17:45.495713 (+ 63725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.570333 (+ 74620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.570368 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.583280 (+ 12912us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.645100 (+ 61820us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:45.645144 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.645205 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.057783 (+412578us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:46.059693 (+  1910us) raft_consensus.cc:1685] finished
0709 13:17:46.059714 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.059966 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3571,"raft.queue_time_us":21064,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":15048,"spinlock_wait_cycles":62179072,"thread_start_us":28998,"threads_started":1,"wal-append.queue_time_us":62010}
I20260709 13:17:46.063709 10531 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:46.065407 10443 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:17:46.040961  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.069345 10453 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:46.070374 10546 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 13:17:46.072201 10510 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:46.073817 10192 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:46.074723  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.075153  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:46.074671 10192 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.079363  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.080899  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.082041  5516 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:46.082203 10233 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:46.083595 10233 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.051105  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:46.086716  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 84954.6us
W20260709 13:17:46.113559  5268 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 157) took 30651 ms (client timeout 15000 ms). Trace:
W20260709 13:17:46.119223  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.120121  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.120147  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.121332  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.122440  5369 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:17:46.123497 10233 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.124750  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.124986 10233 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.125509 10367 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:46.129832  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 154968us
I20260709 13:17:46.122874  5369 pending_rounds.cc:85] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 9
I20260709 13:17:46.130962  5369 pending_rounds.cc:107] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:17:46.131244  5369 raft_consensus.cc:2889] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.135543  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2658) took 3592 ms. Trace:
I20260709 13:17:46.136240  5369 rpcz_store.cc:276] 0709 13:17:42.543119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.628741 (+3085622us) service_pool.cc:224] Handling call
0709 13:17:45.629100 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.800292 (+171192us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b5400463d20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d03dc0 00007fc1d3d8e1c0 00007fc1d3d8f231 00007fc1d3d8bd8f 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c
0709 13:17:45.859865 (+ 59573us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b4c000f89c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2058a20 00007fc1d2069a29 00007fc1d202f644 00007fc1d2056f2d 00007fc1d2056b93 00007fc1d3d8718b 00007fc1d3d87cb5 00007fc1d3d82f30 00007fc1d3d847de 00007fc1d3d8eb49 00007fc1d3d8f416
0709 13:17:46.135271 (+275406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.135476 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147425792}
W20260709 13:17:46.140338  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 89331.6us
I20260709 13:17:46.142764  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:46.143703  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 133170us
I20260709 13:17:46.145938  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.147192  5524 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:17:46.151269  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.157105  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.158740 10360 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:17:46.158989  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.159708  5515 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:46.160565  5450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
mode: GRACEFUL
new_leader_uuid: "544c82a50cc4477886bb6f7d58f455ca"
 from {username='slave'} at 127.0.0.1:44768
I20260709 13:17:46.161342  5450 raft_consensus.cc:606] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:46.161697  5450 raft_consensus.cc:614] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.163024 10405 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:46.163249 10214 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:46.163527 10405 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.145599 10361 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.164242 10361 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.164589 10405 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.165966 10405 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:46.171129  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:46.166612 10361 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:46.168399 10192 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:46.173923 10267 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:46.132881 10340 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.174579  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:46.177726  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:46.176724  9803 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:46.178694 10192 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:46.185673  5269 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 41) took 46997 ms (client timeout 15000 ms). Trace:
W20260709 13:17:46.186192  5269 rpcz_store.cc:269] 0709 13:16:59.137041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.141062 (+  4021us) service_pool.cc:224] Handling call
0709 13:17:46.129630 (+46988568us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2516628,"reported_tablets":6}
I20260709 13:17:46.195130  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.197822  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.198478  5520 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:46.198792  5515 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:46.198529  5524 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:46.199865  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.200691  5416 leader_election.cc:400] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:17:46.200038  5267 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.201095  5416 leader_election.cc:403] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:17:46.201856 10509 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:17:46.202257  5267 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:46.203450  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:46.176728 10340 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:46.204717  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.122015 10511 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:17:46.114188  5268 rpcz_store.cc:269] 0709 13:17:15.461773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.522259 (+ 60486us) service_pool.cc:224] Handling call
0709 13:17:46.113281 (+30591022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:35.077047 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:35.139389 (+ 62342us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:35.139442 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:17:35.139462 (+    20us) tablet.cc:662] Decoding operations
0709 13:17:35.140612 (+  1150us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:35.140709 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:35.140736 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:17:35.316813 (+176077us) tablet.cc:701] Row locks acquired
0709 13:17:35.316919 (+   106us) write_op.cc:260] PREPARE: finished
0709 13:17:35.317175 (+   256us) write_op.cc:270] Start()
0709 13:17:35.317343 (+   168us) write_op.cc:276] Timestamp: P: 1783603055317087 usec, L: 0
0709 13:17:35.317402 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 13:17:35.324399 (+  6997us) log.cc:844] Serialized 4768 byte log entry
0709 13:17:36.067349 (+742950us) op_driver.cc:464] REPLICATION: finished
0709 13:17:36.259621 (+192272us) write_op.cc:301] APPLY: starting
0709 13:17:36.280566 (+ 20945us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:36.774331 (+493765us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:36.811447 (+ 37116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:37.208212 (+396765us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:37.208576 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:17:37.208640 (+    64us) write_op.cc:312] APPLY: finished
0709 13:17:37.261541 (+ 52901us) log.cc:844] Serialized 112 byte log entry
0709 13:17:37.380965 (+119424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.392647 (+ 11682us) write_op.cc:454] Released schema lock
0709 13:17:37.406181 (+ 13534us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:37.511350 (+105169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:37.525881 (+ 14531us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3435535,"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":105698,"apply.run_cpu_time_us":40451,"apply.run_wall_time_us":1288398,"cfile_cache_hit":46,"cfile_cache_hit_bytes":48070,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":7581,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":12,"prepare.queue_time_us":326067,"prepare.run_cpu_time_us":91517,"prepare.run_wall_time_us":597448,"raft.queue_time_us":118227,"raft.run_cpu_time_us":7870,"raft.run_wall_time_us":149682,"replication_time_us":712077,"thread_start_us":665478,"threads_started":5,"wal-append.queue_time_us":634822,"wal-append.run_cpu_time_us":11266,"wal-append.run_wall_time_us":2288119}]]}
I20260709 13:17:46.208091  5518 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:46.211318  5516 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:17:46.212939  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 73564.9us
I20260709 13:17:46.214484 10509 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.216768  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.219362  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.222729 10554 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:17:46.224037 10554 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:46.224423 10554 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.230159  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:46.231298 10367 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:46.231757  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:46.231886 10367 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:46.232776 10499 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:46.233222 10499 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.233650 10499 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.233554 10531 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:46.232941 10367 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.234882 10105 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:46.204833  5267 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 12 to 13, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 13 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.232817  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:46.244823  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.245759  5518 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:17:46.248473 10507 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.248973 10507 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:46.225333 10554 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.251284 10554 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.252312 10466 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:46.252389 10105 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:46.252898 10105 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.252970 10551 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:46.252954 10466 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:46.247459 10267 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:46.254431  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:46.254710 10267 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.255160 10466 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.255627 10267 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.256614 10552 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:46.258914 10550 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:46.260250 10550 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:46.261178  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:46.260454 10340 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:46.261998 10340 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.261677 10507 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:46.262200 10531 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:46.262660 10531 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:46.263057 10531 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.262880 10340 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.264276 10340 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.265301 10105 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.266165 10507 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.266427  9950 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:46.266902  9950 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:46.267120 10511 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.267338  9950 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:46.267680 10511 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.269912 10320 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:17:46.270341  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.270519 10320 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:46.271263 10214 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:46.237766 10192 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.257107 10267 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.278376  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.279090  5516 raft_consensus.cc:2376] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15. Re-sending same reply.
I20260709 13:17:46.279536 10320 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:46.275871 10552 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:17:46.281307  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:46.283537 10551 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:17:46.284632  9803 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:46.286449  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:46.289937  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.290333  5518 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:46.266912 10105 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.249508  5267 catalog_manager.cc:5697] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 reported cstate change: config changed from index -1 to 9, term changed from 13 to 16, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to <none>, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added, no longer has a pending config: VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129), VOTER b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130), VOTER 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131), NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 16 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:17:46.283013 10509 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.296312  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.299165  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.300169 10361 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.300173  9803 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:46.303843  9803 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.305127  5267 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:46.305574  9803 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.307097  9803 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.307147  5267 catalog_manager.cc:5697] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 6 to 15. New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:46.308846  5267 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 11 to 12, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 12 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.303877 10361 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.310777  5267 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 12 to 14, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 14 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.314199 10361 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:46.316730  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:46.317660  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.318440  5518 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:17:46.322330  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.313040  5267 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 13, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 13 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.330067  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:46.330483  5267 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 11 to 15, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 15 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.332737 10509 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:46.333024  5267 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 7 to 13, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 13 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:17:46.342614  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 71832.7us
W20260709 13:17:46.344975  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.344412 10552 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:17:46.300333 10499 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.355934  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.363622  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.352332  5267 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 13, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 13 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.364298  5516 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:46.368597  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:46.351755 10511 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:46.372367  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.373070 10550 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:46.373807  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.376439  5516 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:46.373971  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.371896 10344 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:46.369477 10526 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:46.378756 10344 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.380062 10526 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.380887 10344 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.381105 10526 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.382265 10344 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.383078 10526 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:46.386968 10499 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:46.376741 10551 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:17:46.392387  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.393244  5516 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:46.362016 10214 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:17:46.365159  5267 catalog_manager.cc:5697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 12 to 15, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 15 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.406728  5267 catalog_manager.cc:5697] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 12, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 12 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:46.409919 10550 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:46.410490 10550 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.411506 10550 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.413017  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.415555  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.416468 10551 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:46.415782 10233 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:17:46.418008 10340 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:46.418193 10551 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:46.418442 10233 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.419448 10552 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:46.416108 10405 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:17:46.419878 10552 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.421010 10552 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.419004 10233 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.421495 10405 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:46.422438 10552 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:46.422554 10233 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.415900  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.425391  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:46.428539  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62476.9us
I20260709 13:17:46.432287 10214 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:46.432801 10214 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.433501  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:46.434641 10499 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:46.435372 10499 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:46.436342 10499 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.439298 10551 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:46.451153  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:46.454146  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:46.455196 10405 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:46.455811 10405 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.408864  5267 catalog_manager.cc:5697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:46.431689 10233 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.377157 10531 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.442854  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66768.6us
I20260709 13:17:46.447095  9950 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.409924 10466 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:46.450273 10551 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.413324 10550 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.485988 10466 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:46.487247 10466 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.433696 10214 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.456871 10405 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.464154  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.492951  5370 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:46.464671  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:46.466096 10361 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.466749  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.467350 10360 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.467417 10510 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:46.467123  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:46.477113  5518 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:46.473558 10511 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:46.478621 10105 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:46.479017  9950 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:46.512600  5267 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:46.515059  5267 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 11 to 12, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 12 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.479074 10531 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:46.495487  5516 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:46.498064 10443 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:46.498438 10511 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:46.498606  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:46.501941  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:46.522219  5372 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:46.502619 10526 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.503080  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:46.498592 10360 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.504572  5369 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:46.521665  5450 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:17:46.506100  5370 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:46.533389  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:46.506414  5366 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:46.506973 10340 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:46.508513  5371 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:46.518723  5373 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:46.504619  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:46.539950  5446 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:46.479806 10344 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:46.531687  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:46.541967  5441 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:17:46.533087  5367 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:46.535666 10510 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:46.536473 10361 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:46.504604 10214 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.555606 10510 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:46.558209 10511 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.559578  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:46.531961 10443 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:46.562158  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59310.8us
I20260709 13:17:46.567898  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:46.569890  5374 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:46.540916 10340 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.572954  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:46.552623 10531 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:46.490499 10551 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.582160  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:46.561741 10510 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.573045 10443 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.596580  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:46.600257  5371 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:46.598737  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:46.599336  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:46.601753  5370 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.601343  5368 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:46.606501  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:46.607304  5375 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:46.608479  5369 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:46.609074  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:46.610452  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:46.611385  5367 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:46.617362  5372 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:46.599162 10552 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:46.623641  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.597759 10510 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:46.625126  5446 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:17:46.625115  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:46.626232  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:46.626763  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.626919 10360 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:46.572939 10568 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:17:46.636207  5368 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:46.631603  5371 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:46.642731  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:46.644481  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:46.645674 10550 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:46.645711 10551 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.647097 10550 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:46.647526 10550 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.647890 10550 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.612123 10531 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.652515 10531 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.640745  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:46.657505  5375 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:46.598533 10526 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:46.668767  5370 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:46.674734  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:46.677630 10344 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:46.678488 10344 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.680531 10344 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.663415 10552 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.625351  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:46.701537  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:46.702455  5446 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:46.717211  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.717661  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:46.719616  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.721032  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.722110  5520 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:46.724993  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:46.725718  5445 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:46.729458  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.729820  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:46.730278  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 114286us
I20260709 13:17:46.730544  5518 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:46.733693  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.734064  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:46.733589  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.735440  5519 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:46.731027  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:46.739686  5522 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:46.740262  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.740916  5524 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:46.741678  5448 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:46.742487  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:46.745704  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.746774  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.747679  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:46.748080  5370 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:46.748234  5447 raft_consensus.cc:2376] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14. Re-sending same reply.
I20260709 13:17:46.723851 10466 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:46.753078  5450 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:46.762661 10507 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:46.763206 10507 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.763550 10507 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:46.744946 10267 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:46.769619 10360 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:46.770448  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:46.771680  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.771822  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.772282  5520 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.773543  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.774052  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:46.745141 10405 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:46.775019  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.775477  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.776232 10405 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:46.776634 10405 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:46.778035  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:46.778661  5518 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:46.778803 10507 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.774246  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.783316  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:46.781216 10405 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.786304 10466 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.781728 10507 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:46.790625 10340 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.736776 10361 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:46.794936 10361 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.795362 10361 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:46.742111 10233 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:17:46.804014  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:46.734632  5267 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 11, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 11 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:46.817548 10552 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:46.842665  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.842345  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:46.848150 10340 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.841030 10405 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.860800  5450 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:46.861274  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 118920us
I20260709 13:17:46.861908  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:46.865257  5448 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:46.863442  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:46.867563  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:46.870554 10443 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:46.873860  5447 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
W20260709 13:17:46.874751  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.879566  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 85372.6us
I20260709 13:17:46.878940  5520 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:46.808305  5267 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 13, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 13 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:46.900163  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.904217  5367 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:46.902459  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:46.912720  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.916472  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:46.928198 10331 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:46.932749  5516 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:46.920210 10466 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:46.954360  5367 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:46.965691  5443 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:46.974951  5441 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:17:46.993996  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:46.995246  5441 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:46.999908  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.001349  5443 raft_consensus.cc:2368] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17.
W20260709 13:17:47.026197  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 80890.5us
I20260709 13:17:47.035655  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:47.037117  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 120748us
I20260709 13:17:47.036787  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.049583  5443 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:17:47.073540  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 231279us
W20260709 13:17:47.075203  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.044193 10233 raft_consensus.cc:2764] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:47.099733  5441 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:47.043069 10526 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.104961  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:47.110987  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 208629us
I20260709 13:17:47.122804  5339 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.048650 10568 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:47.055459  5267 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 11 to 13, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 13 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:47.144994  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.147923  5441 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:47.148998  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.123451  9803 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:47.123111 10466 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.152853  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.126412 10526 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.123237 10584 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:47.162238 10584 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:47.162909 10573 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:17:47.163012 10584 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:47.166571 10571 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:17:47.133086 10568 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.169807 10568 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:47.156293  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51460.7us
I20260709 13:17:47.157580 10526 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.158035 10466 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.154700  9950 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.185704  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.186721  5447 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:47.199527  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.198344  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:47.181289 10551 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.000s
I20260709 13:17:47.189885  5441 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
W20260709 13:17:47.184914 10550 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.006s
I20260709 13:17:47.202461  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.203047  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.233942  5443 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:47.234936  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.247596  5490 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:47.197329 10443 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.202188 10233 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:47.254709 10405 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.263291  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.259317  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.269608  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.185405  9803 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:47.280221  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 91563.1us
I20260709 13:17:47.188241 10584 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.187515 10531 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:17:47.196307 10344 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:17:47.278151  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:47.282981  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 394726us
I20260709 13:17:47.284485  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.247897  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.247867 10562 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:47.309041  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.310153  5441 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:47.312103  5441 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 17. Ops: []
I20260709 13:17:47.266613 10405 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.266839 10554 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.317343  5443 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
W20260709 13:17:47.332057  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 179291us
I20260709 13:17:47.233263 10550 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:47.334717  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 130083us
I20260709 13:17:47.347155  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.269158  9950 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:17:47.279780 10551 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:17:47.337474  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.332393 10405 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.305470 10562 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.330633 10360 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:47.363955  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.364477  5447 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:47.366031  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.338196  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56416.7us
I20260709 13:17:47.332111 10578 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.386610 10578 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:47.356667 10331 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.390558 10581 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.391254 10581 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.393931 10589 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:47.394469 10589 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.394819 10589 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.398773  9803 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:47.356667 10443 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.400846 10443 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.401520 10588 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.402532 10588 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.303284  5267 catalog_manager.cc:5697] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 8 to 14, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 14 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:47.406508  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.407243  5449 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.407469  5267 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:47.409843 10588 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.383512 10360 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.434216 10588 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.434800 10588 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.432922  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.436427 10568 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.437232  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.393566 10586 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:17:47.437980 10588 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.374810 10562 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.439899 10586 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.442922 10578 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:47.443863 10581 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.445684 10581 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:47.446192 10581 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:47.447260 10581 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.433820  5444 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:17:47.449928  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.384362  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:47.449926  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.451552  5444 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:17:47.451614  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 67330.4us
I20260709 13:17:47.452736  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.352110 10594 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:47.290149 10559 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:17:47.372391 10590 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:17:47.354041  5443 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:47.333158  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.358197 10582 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:47.427328 10466 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.409027  5267 catalog_manager.cc:5697] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 6 to 9, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 9 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:47.491557 10582 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:47.386000 10577 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:17:47.448221 10589 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:47.454389 10214 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.005s
I20260709 13:17:47.454932 10585 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.455428 10591 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:47.401358 10443 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.535341 10550 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:47.430496 10361 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.004s
I20260709 13:17:47.390177 10331 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:47.453207  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:47.460966  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:47.464025  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.549732  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96615.1us
I20260709 13:17:47.548303  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.550733  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:47.551602  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:47.479718  5441 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:47.553629  5516 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:17:47.500753  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.506850  5444 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:47.514060  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:47.440760 10586 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.438077  5442 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.429945 10584 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.523059  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.602671  5443 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.604452 10590 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:47.605007 10590 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:47.532539 10589 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.478260 10562 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.605994 10590 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.607427 10562 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:47.491732  9950 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.608243  9950 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:47.548303  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.560992 10331 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.561689 10591 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.610035  5368 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:47.562959 10105 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:47.610678 10105 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:47.611600  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.611735 10105 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.612613  9950 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:47.613001 10105 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.573936  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.613721  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:47.613889  5447 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:47.521387 10509 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:47.615419 10509 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.617211  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.618124  5367 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:47.620678 10586 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.577271  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.621847  5372 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:47.622288  5446 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:47.551028 10526 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.623304  5375 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.624500  5443 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:47.581750  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.582494 10568 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.522758 10594 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:47.625880  5516 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 15.
I20260709 13:17:47.627542  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:17:47.628007 10594 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:47.628688 10331 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.523881 10595 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:47.629601 10595 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:47.625310 10526 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:47.629876  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:47.630735 10595 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.631681  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.536727 10360 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.632475  5444 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:47.632400 10360 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.633944  5371 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:47.634851 10360 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:47.549499 10510 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.884s	user 0.016s	sys 0.000s
I20260709 13:17:47.635583 10510 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.529570 10582 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.600383 10581 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.639981 10526 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.640727 10526 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.641747  5370 raft_consensus.cc:2368] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17.
I20260709 13:17:47.643574 10526 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:47.548801 10361 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.630928 10509 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.647374 10361 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.601783  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.601408  5523 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:47.565095  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.569716 10466 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:47.649878 10466 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:47.650056  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.629194 10331 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.651435 10331 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.652073  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:47.652572  5449 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:47.652818  5515 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:47.652956 10507 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.653409 10507 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.654094  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.655531 10510 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.656229 10507 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.631850 10595 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.650941 10466 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.650975  5517 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:47.612227  5519 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:47.663980  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:47.669986  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:47.681309  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.681741  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:47.682544  5523 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.649025  5375 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:47.683347  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:47.684100  5517 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:47.687129  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.688035  5519 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:47.693722  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.694140  5442 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:47.694622  5375 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
W20260709 13:17:47.696859  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.696645  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:47.687619  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:47.678085 10340 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.818s	user 0.013s	sys 0.000s
I20260709 13:17:47.710497  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.710904  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.698576  5446 raft_consensus.cc:2410] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:47.712410  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.713101  5441 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:47.699141  5444 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:47.690933  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.714278  5446 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:47.714833  5446 pending_rounds.cc:85] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 7
I20260709 13:17:47.715106  5446 pending_rounds.cc:107] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 14.8
W20260709 13:17:47.700309  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.715536  5446 raft_consensus.cc:2889] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.716671  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:47.717450  5441 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:47.709646  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.700165  5449 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:47.718474  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.721503  5444 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 13:17:47.722512  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:47.723491  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.725301  5446 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:47.727461  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.728194  5375 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:47.679697 10233 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:47.728212  5372 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:47.729215  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.731146  5448 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:47.732302  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.737206  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.739277  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:47.740378  5366 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:47.601404 10443 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.747484  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.748118  5445 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.747547  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.742717  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.738649  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.749313  5442 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.677861 10510 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:17:47.748665  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.688133 10562 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.743883  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.723062 10568 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:47.736778 10340 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.737295 10586 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:47.689495 10360 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:17:47.678740 10405 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.750198 10509 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.776499  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.777298  5520 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:47.755326  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:47.749787  5515 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:47.717808  6069 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:47.756621  5448 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.756613  5521 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:47.757763  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.758955  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.779928  5446 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:47.780244  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.779940  5370 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:47.759449  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:47.762014  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.783401  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.762290  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.763741  5441 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:47.752358  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.784257  5447 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:17:47.772305  5519 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:47.785585  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:47.786324 10589 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:47.786767 10589 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:47.787930 10589 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.793749  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.795329  5515 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:47.796219 10233 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.796839  5515 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:17:47.797184  5515 pending_rounds.cc:85] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 7
I20260709 13:17:47.785662  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:47.782974  5450 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:47.800930  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.797385  5515 pending_rounds.cc:107] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:17:47.804574  5517 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:17:47.804776  5523 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:47.805277  5515 raft_consensus.cc:2889] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.807523  5442 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:47.808249  5449 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:47.763528 10568 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:47.818419  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57024.7us
I20260709 13:17:47.789224 10589 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.837857  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:47.827134  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.857826  5448 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:47.836009  5445 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:47.849134  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:47.862807  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:47.874027  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.863525  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:47.852865  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:47.764137 10562 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.819288 10613 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.852553  5521 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:17:47.899091  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.899979  5449 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.772297 10340 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.904371  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.837499 10568 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.898705  5521 pending_rounds.cc:85] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:17:47.910594  5521 pending_rounds.cc:107] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:17:47.911545  5521 raft_consensus.cc:2889] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.908356  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:47.908365  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59297.5us
I20260709 13:17:47.919782  5519 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:47.920332  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.921794  5489 leader_election.cc:400] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17.
I20260709 13:17:47.922169  5489 leader_election.cc:403] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:17:47.777688 10586 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:47.800400 10509 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:47.843833 10609 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.899255 10583 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:47.849635 10443 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:47.922977  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.937402  5445 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:47.898428 10613 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.931363  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.901201 10360 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:47.932904  5367 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:47.938735  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:47.911821 10610 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.927065 10526 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.985635  5367 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:47.988590  5449 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:47.975816 10613 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.995849  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.937686 10609 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.006636  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.020779  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:48.009562  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.986228  9950 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17.
I20260709 13:17:48.010211  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:48.011416  5370 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:48.012117  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:48.013549 10608 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.022634  5445 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:48.025262  5366 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:48.026252  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.026965  5445 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:48.027693  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.028179  5445 raft_consensus.cc:2376] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15. Re-sending same reply.
I20260709 13:17:48.028884  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.014917  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.029740  5447 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:17:48.015708  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:47.980964 10583 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:48.030987  5446 raft_consensus.cc:2376] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13. Re-sending same reply.
I20260709 13:17:48.024721  5368 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:48.031497 10583 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.013969  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.032671  5443 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:48.042212  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.042555  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.043581  5446 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:48.048058  5366 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
W20260709 13:17:47.992964 10621 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:48.054553  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.055645  5441 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:48.058549  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:48.060071  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54325.7us
I20260709 13:17:47.998220 10550 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:17:48.080394  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63835us
I20260709 13:17:48.056303  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:48.086982  5374 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:17:48.081096  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:47.992267 10360 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:48.059515  5373 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 15.
I20260709 13:17:48.080526  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.089056  5446 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:48.089884  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.010237 10569 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:48.110988  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.053982 10507 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.114310  5366 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:48.115038  5449 raft_consensus.cc:2410] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:48.127228  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:47.977653 10614 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:17:48.139854  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:48.141185  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 158702us
I20260709 13:17:48.137881  5446 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:17:48.590066  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.590842  5446 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:48.591831  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.152384  5373 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:48.594741  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:48.595558  5373 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:48.596764  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:48.015648 10526 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.079823 10588 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.184271  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.992329 10610 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.184347  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.193723  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.195719  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:48.195135  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.113508 10569 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:48.052680 10331 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:48.195011  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:48.613811  5375 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.202950  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.615442  5448 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:48.605773 10588 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:48.616541  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.201618  5443 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:48.617312  5516 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:48.618557  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.618944 10610 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:48.619201  5443 raft_consensus.cc:2376] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
I20260709 13:17:48.619745  5521 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:48.620152  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.194428 10609 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:48.114616  9950 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:17:48.622342 10526 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:48.622656  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.622997  5368 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:48.214538  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.624003  5445 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:48.623893  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.624534  5449 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 9.
I20260709 13:17:48.625168  5445 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:17:48.226333  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 107187us
I20260709 13:17:48.625837 10569 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:48.189116 10405 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:48.628921 10331 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.628532 10405 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:48.245666  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 137377us
I20260709 13:17:48.260166  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.153545 10507 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.189787 10551 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:17:48.271281 10562 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:48.273042  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.646714  5442 raft_consensus.cc:2376] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
I20260709 13:17:48.646787  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:48.271942 10340 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:48.284492 10624 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:17:48.286289 10595 consensus_meta.cc:287] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.006s
I20260709 13:17:48.647603  9950 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:48.284817 10581 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.648573 10581 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.649118 10609 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:48.649137  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:48.651153 10581 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.309512 10509 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:48.400065  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 264736us
W20260709 13:17:48.324877 10622 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
I20260709 13:17:48.274395 10360 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.391809 10550 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:48.437170  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.625322 10568 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.703s	user 0.007s	sys 0.002s
W20260709 13:17:48.443675 10632 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:17:48.445791  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:48.451717  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.661118  5375 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
W20260709 13:17:48.460197 10628 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:17:48.459303 10582 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.001s
W20260709 13:17:48.471274 10640 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:17:48.485846  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:48.480211 10361 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:48.678689 10361 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.496053  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:48.682264 10633 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.371s	user 0.002s	sys 0.002s
I20260709 13:17:48.682358  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:48.657217 10526 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:48.683511  5369 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:48.683897 10613 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.602s	user 0.013s	sys 0.000s
I20260709 13:17:48.684413  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:48.684305 10613 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.484931 10651 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.685457 10651 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.686515 10613 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.687714 10651 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:48.633582 10588 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:48.486159 10608 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:48.508304 10653 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.689918 10608 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:48.551795 10644 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:48.599431  5446 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:48.603859  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.693225  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.606312  5450 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.602353  5373 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:48.606815  5366 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:17:48.210615 10625 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:17:48.628539 10594 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:48.722582  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:48.578662 10583 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:48.645121  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.651449  5370 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:48.652694  5443 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:17:48.636147  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:48.727306  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 91245.8us
I20260709 13:17:48.425244 10586 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:48.658556  5490 leader_election.cc:400] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17.
I20260709 13:17:48.656164 10331 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:48.453822  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.666474  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:48.668076 10507 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.672413 10550 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.673399  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:48.689936 10653 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.606611  5441 raft_consensus.cc:2376] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14. Re-sending same reply.
W20260709 13:17:48.663724 10589 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.819s	user 0.014s	sys 0.000s
I20260709 13:17:48.664332 10568 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.723567  5515 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.630722  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:48.748116  5518 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.724123  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:48.718919  5368 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:17:48.728951  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62810.9us
I20260709 13:17:48.728641  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:48.749498  5446 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:48.749958  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:48.730979  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 76123us
I20260709 13:17:48.731029  5444 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:48.731029  5375 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:17:48.739908  5366 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:48.739728  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:48.751466  5523 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:48.742266  5373 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:48.722711  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:48.744270 10586 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:48.745100 10653 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:48.745575  5367 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:48.746143  5372 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:48.681404 10361 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.755401  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:48.766857  5444 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:48.767973  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.769696  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:48.770524  6072 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:48.756127  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.737188 10331 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.757167  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:48.772470 10331 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:48.773159  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:48.775389  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:48.777002 10507 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:48.718832 10588 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:48.777489 10507 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.777912 10507 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.777724 10588 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.778169  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:48.778925  5370 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.780272 10588 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.719069 10466 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:48.781617 10595 raft_consensus.cc:2764] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:48.781949 10466 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.764107  5449 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:48.782445 10595 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:48.746956 10581 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:48.783893 10595 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.772009  5446 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:48.719591 10582 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.787127 10608 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:48.787900 10582 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.788579  5374 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:48.748976  5521 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:48.798146  5370 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:17:48.801304 10613 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.802019 10613 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.804169  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:48.737524 10594 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.737911 10583 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.807337 10583 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.807621 10589 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.807936 10583 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:48.809024  5369 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:48.740556 10609 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:48.810370  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:48.811360 10662 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:48.812769  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:48.804384 10613 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.813578 10614 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:48.814510  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.815227  5441 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:48.816234  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.816970  5442 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:48.817870 10595 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.818631 10595 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:48.821969  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.822696  5444 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:48.823343 10595 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:48.805263  5515 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:48.790704  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:48.831107  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:48.832197  5447 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
W20260709 13:17:48.858443  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68110.6us
I20260709 13:17:48.859773  5450 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:48.860275  5518 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:17:48.863606  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:17:48.864516 10663 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:48.865242 10663 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:48.827602 10588 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:48.877100  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 101794us
I20260709 13:17:48.879165  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:48.877274  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 86699.1us
I20260709 13:17:48.881946  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:48.883172  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:48.831434 10651 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:48.883562 10653 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.868132 10663 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:48.887440  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:48.886041 10653 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.891767 10653 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:48.892819 10662 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:48.893451 10662 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:48.894388 10662 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:48.920771  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:48.900750  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:48.922631  5523 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:48.901360  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:48.923987  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:48.926347  5441 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:48.926772  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.928102  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:48.932005  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50300.3us
I20260709 13:17:48.873716 10609 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:48.932018  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53850us
I20260709 13:17:48.933136  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:48.884934 10613 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:48.936470  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57433.4us
I20260709 13:17:48.938468  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:48.944862  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.945748  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:48.920992 10578 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:48.947283  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 59935.4us
I20260709 13:17:48.923465 10649 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:48.920651 10610 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.884017 10582 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:17:48.955590  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:48.873999 10233 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:17:48.922513 10657 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.876472 10507 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:48.997493  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69533.3us
I20260709 13:17:48.895779 10581 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:48.985862  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:48.985659 10653 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:48.986992 10649 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.005818  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:48.996767 10602 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:48.993163 10568 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:48.936076 10586 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.986248 10595 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:17:49.011960  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 52467.7us
I20260709 13:17:48.981912 10614 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:48.948217 10588 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:48.982226 10669 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:49.013237 10340 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:48.988879 10590 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:17:48.990139 10651 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:49.011332 10360 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:49.033550  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:48.987241 10578 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:49.011049 10653 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.022898 10649 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.039834  5521 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:49.035514  5516 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:49.036504 10659 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:49.031162 10466 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:49.050309  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44693.8us
I20260709 13:17:49.071473 10659 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:48.953573  5443 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.7-17.7]
W20260709 13:17:49.051100  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 112697us
I20260709 13:17:49.022342  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:49.021373 10602 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:17:49.060539  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54173.4us
I20260709 13:17:49.060700  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:49.029971 10233 consensus_queue.cc:1243] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:49.058559  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:49.094592  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.064041  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:49.065387  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:49.095114  5445 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:49.093225  5524 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:48.994762 10610 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.011695 10331 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:49.062996 10568 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.065665 10653 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:49.061133 10594 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:49.106961 10667 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:17:49.008675 10657 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.107343 10651 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.107831 10659 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.098129 10671 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:17:49.109501 10657 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:49.109586  5518 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:49.075871 10656 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.110846 10656 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.111428  9950 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:49.112162  9950 consensus_queue.cc:1243] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 16.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:49.113219 10550 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:49.113616 10550 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:49.113763  5519 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:49.114504 10550 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.115759 10550 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:49.119776  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:49.118790 10657 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:17:49.138404 10331 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:49.139066  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:49.098683  6072 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:49.140201  5371 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:49.141996  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:49.142319 10670 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:49.142894  5374 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:49.144053  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:49.145146  5372 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:49.058049 10609 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.069991 10562 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:17:49.096028  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:49.097007  5441 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:49.103705 10507 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:49.099548  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:49.082582 10588 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.106628 10526 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:49.082831 10676 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:49.069759  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:49.127192 10656 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:49.150599  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:49.150643  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:49.152524  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:49.155622  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:49.208110  5368 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:49.209064  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:49.209722  5368 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:49.156678  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:49.211544  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 59113.4us
I20260709 13:17:49.104631 10233 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:49.216706 10233 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:49.197894  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101974us
I20260709 13:17:49.092948  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:49.151626 10671 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.212870  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:49.203038  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:49.228224  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:49.228806  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.152377 10568 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.230321 10568 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:49.224635  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 131822us
I20260709 13:17:49.218477  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:17:49.222617  6042 leader_election.cc:336] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.660s (SENT)
W20260709 13:17:49.219502  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 272393us
I20260709 13:17:49.234664  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.237594  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:49.238880  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:49.239319 10466 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:49.239730 10466 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:49.240087 10466 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.240334  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:49.241612 10669 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.242354 10669 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:49.243521 10669 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.244419 10669 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:49.244814 10669 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:49.246860  5366 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:49.229323  5372 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 9.
I20260709 13:17:49.248574  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:49.249190  5372 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.254027 10669 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.246505 10568 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:49.255581 10466 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.217243 10233 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:49.210994 10361 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:49.280834  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62402.6us
I20260709 13:17:49.288697  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.215915 10617 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:49.297289  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:49.298297  5521 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:49.195107 10588 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.309254  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:49.258642 10594 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:49.221568 10656 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.298992  6069 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 13: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:49.217679 10678 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.104385 10614 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:49.317415 10676 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:17:49.338971  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c2527a380a499db649c9aa30957175"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:49.341529  5372 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 14.
I20260709 13:17:49.341646  5524 raft_consensus.cc:606] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:49.342631  5524 raft_consensus.cc:614] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:49.330521 10657 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.312752 10681 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:49.357412 10105 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:49.338081  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 238621us
I20260709 13:17:49.372678  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:49.363737  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 123468us
I20260709 13:17:49.332901 10562 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.332281 10678 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.344079 10586 raft_consensus.cc:2764] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:17:49.337502 10509 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.386718  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:49.342478 10568 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:49.262563 10671 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:49.369850  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81274.9us
I20260709 13:17:49.352056 10331 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.425329  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:49.370544 10581 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:49.432981  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.333191 10656 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:49.261382 10602 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.389999 10562 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.444823  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.448755  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:49.423658 10578 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:49.423965 10678 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.468688  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.472164  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:49.473031  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:49.473708  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:49.473937  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:49.385947 10105 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.482694  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.494228  5445 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:49.367329 10657 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.438997 10581 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.488919 10466 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:49.490365  5442 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:49.447885 10568 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:49.514741  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.498716  5524 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:49.448391 10361 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:49.520067  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:49.467715 10610 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:49.467491 10562 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.375609 10681 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:49.517921 10581 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:49.586465  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 106131us
W20260709 13:17:49.562587 10690 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:17:49.564257 10696 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:49.466907 10608 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:17:49.567888 10682 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 13:17:49.572156 10361 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.563252 10687 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:49.555415 10689 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:49.561978 10635 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:49.557842 10685 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.514292 10652 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.615295  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 95329.8us
W20260709 13:17:49.630633  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 321492us
I20260709 13:17:49.580727 10671 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:49.650420  6042 leader_election.cc:336] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.019s (SENT)
I20260709 13:17:49.668067  6042 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:49.660949  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.003s
I20260709 13:17:49.665269  5518 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:17:49.666309  5340 leader_election.cc:336] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.569s (SENT)
W20260709 13:17:49.669621  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.008s	sys 0.003s
I20260709 13:17:49.669451  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.618175 10610 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:49.643514 10687 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:49.694703  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44337.5us
I20260709 13:17:49.671818 10652 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:49.728790  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 246157us
I20260709 13:17:49.734899  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:49.736071  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:49.737092  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:49.738252  5517 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.646064 10689 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.731221 10652 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:49.756054  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:49.767618  5520 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:49.671480 10610 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.698609 10608 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.697643 10578 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:49.787357 10714 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.787205 10720 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:49.697490 10687 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:49.766892 10690 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:17:49.802541  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 136179us
I20260709 13:17:49.762766 10360 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:49.805245  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65964.2us
I20260709 13:17:49.763358 10689 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.783006 10610 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.810273  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:49.818521  5340 leader_election.cc:336] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.631s (SENT)
I20260709 13:17:49.819155  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:49.819772  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 124126us
W20260709 13:17:49.832793 10697 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:17:49.803740 10679 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.368s	user 0.000s	sys 0.002s
I20260709 13:17:49.788995 10588 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:49.811445  5339 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:49.797290 10105 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:49.667752 10685 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.856554  5517 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
W20260709 13:17:49.864506  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46010.8us
W20260709 13:17:49.865906  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54592us
I20260709 13:17:49.809733 10652 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:49.871619  5340 leader_election.cc:336] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.730s (SENT)
I20260709 13:17:49.842437 10656 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:49.903653  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:49.872088 10704 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:49.913746 10704 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.914309 10704 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:49.874810 10683 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
W20260709 13:17:49.908123 10550 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.792s	user 0.005s	sys 0.008s
W20260709 13:17:49.879369 10702 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:17:50.005123  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 133247us
I20260709 13:17:50.007812  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2676) took 1138 ms. Trace:
I20260709 13:17:50.010233  5450 rpcz_store.cc:276] 0709 13:17:48.869017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.876250 (+  7233us) service_pool.cc:224] Handling call
0709 13:17:48.877105 (+   855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.931949 (+ 54844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.931982 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.942142 (+ 10160us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.075957 (+133815us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:49.076008 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.076073 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.007512 (+931439us) raft_consensus.cc:1685] finished
0709 13:17:50.007539 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.007735 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54395,"raft.queue_time_us":54915,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10285,"thread_start_us":85970,"threads_started":1,"wal-append.queue_time_us":144768}
I20260709 13:17:50.012980  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:49.998216 10233 consensus_meta.cc:287] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.698s	user 0.012s	sys 0.000s
I20260709 13:17:49.992045 10688 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:50.024017  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:49.879163 10652 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:50.032315 10691 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:17:50.034381 10588 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.035218 10588 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:50.035753 10588 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.036715 10685 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:50.059058  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2443) took 1159 ms. Trace:
I20260709 13:17:50.026067 10688 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.059826  5515 rpcz_store.cc:276] 0709 13:17:48.899328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.899505 (+   177us) service_pool.cc:224] Handling call
0709 13:17:48.900011 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.988666 (+ 88655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.988711 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.007352 (+ 18641us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.158679 (+151327us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:49.158742 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.158853 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.058742 (+899889us) raft_consensus.cc:1685] finished
0709 13:17:50.058775 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.058969 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107849,"raft.queue_time_us":102007,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3464,"thread_start_us":126614,"threads_started":1,"wal-append.queue_time_us":297901}
I20260709 13:17:50.064455  5517 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:50.039222 10725 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.042672 10681 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:50.103716  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 232182us
I20260709 13:17:50.103574  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:50.026681 10233 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.808270 10720 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:49.804420 10714 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.064248 10688 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.126922  5517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:50.127656  5517 raft_consensus.cc:606] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:50.111891 10531 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.146234  5340 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.904s (SENT)
I20260709 13:17:50.147225  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:50.128054  9950 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.120339 10716 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.162571  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:50.197738 10653 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.087s	user 0.007s	sys 0.007s
I20260709 13:17:50.198761 10653 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:50.200580 10686 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:17:50.201884  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2675) took 1343 ms. Trace:
I20260709 13:17:50.202250  5444 rpcz_store.cc:276] 0709 13:17:48.858384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.858530 (+   146us) service_pool.cc:224] Handling call
0709 13:17:48.858955 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.868911 (+  9956us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:48.868942 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.876843 (+  7901us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.226544 (+349701us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:49.226585 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.226660 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.201660 (+975000us) raft_consensus.cc:1685] finished
0709 13:17:50.201684 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.201816 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48327,"raft.queue_time_us":10024,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":2223,"thread_start_us":306135,"threads_started":1,"wal-append.queue_time_us":978143}
W20260709 13:17:50.204174 10718 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:17:50.173242 10705 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:17:50.224124 10723 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
W20260709 13:17:50.234754  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 72274.9us
W20260709 13:17:50.235087  5367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2726) took 2130 ms (client timeout 2111 ms). Trace:
W20260709 13:17:50.235765  5367 rpcz_store.cc:269] 0709 13:17:48.104585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.473819 (+369234us) service_pool.cc:224] Handling call
0709 13:17:50.234750 (+1760931us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b5400330754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:50.234974 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175223680}
I20260709 13:17:50.244148  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:50.143872 10531 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:50.241348 10649 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.162s	user 0.006s	sys 0.010s
I20260709 13:17:50.239463 10693 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.255939 10344 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.256389 10344 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:50.256831 10531 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:50.258356 10613 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.312s	user 0.016s	sys 0.000s
I20260709 13:17:50.258788 10613 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.259105  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2742) took 1103 ms. Trace:
I20260709 13:17:50.259531  5366 rpcz_store.cc:276] 0709 13:17:49.155596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.161695 (+  6099us) service_pool.cc:224] Handling call
0709 13:17:50.258910 (+1097215us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b54001c70d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:50.259044 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45423360}
I20260709 13:17:50.260505  5373 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:50.261559 10720 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.261797  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2743) took 1105 ms. Trace:
I20260709 13:17:50.262202  5373 rpcz_store.cc:276] 0709 13:17:49.155990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.156385 (+   395us) service_pool.cc:224] Handling call
0709 13:17:50.261623 (+1105238us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001e8f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:50.261736 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414569344}
I20260709 13:17:50.262555 10652 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:50.160372  9950 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:50.249085 10562 consensus_meta.cc:287] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.631s	user 0.013s	sys 0.000s
I20260709 13:17:50.251662  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:50.266348  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:50.274842  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:50.254271 10712 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:50.270382 10720 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:50.251277 10649 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.257203 10344 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.285040  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2745) took 1126 ms. Trace:
I20260709 13:17:50.266433 10562 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.288614  5368 rpcz_store.cc:276] 0709 13:17:49.157109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.219507 (+ 62398us) service_pool.cc:224] Handling call
0709 13:17:49.219981 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:49.220469 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.220510 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:49.282312 (+ 61802us) log.cc:844] Serialized 52 byte log entry
0709 13:17:49.759380 (+477068us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:49.759440 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.759545 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.283043 (+523498us) raft_consensus.cc:1685] finished
0709 13:17:50.283065 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.283205 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19127,"raft.queue_time_us":126,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":36098,"thread_start_us":438272,"threads_started":1,"wal-append.queue_time_us":534950}
I20260709 13:17:50.280151 10734 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:50.278302 10712 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:50.291684 10687 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.294319 10344 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.302114 10562 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.282967 10720 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.310913  5369 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:50.314530  9950 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.284988 10531 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:50.305881 10712 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.305650 10734 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.312978 10720 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.326893 10714 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.335409 10617 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:50.335969 10617 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:50.337939 10678 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.004s
I20260709 13:17:50.322672 10734 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:50.330078 10340 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.283s	user 0.014s	sys 0.003s
I20260709 13:17:50.353729 10712 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.354544 10405 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:50.354995 10405 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:50.355818  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2740) took 1205 ms. Trace:
I20260709 13:17:50.356237  5370 rpcz_store.cc:276] 0709 13:17:49.150267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.150405 (+   138us) service_pool.cc:224] Handling call
0709 13:17:50.355617 (+1205212us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001e9954. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:50.355756 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2469756928}
I20260709 13:17:50.356902 10340 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:50.356619 10608 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.001s
I20260709 13:17:50.357637  5523 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:50.355834 10405 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.358641 10405 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.357952 10608 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.361886  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:50.363205  5521 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:50.368894  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:50.323638 10531 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.374019 10405 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:50.374055 10663 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:50.374970 10405 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.377686 10647 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.378499 10647 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.381783 10688 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:50.385995 10695 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.852s	user 0.000s	sys 0.006s
I20260709 13:17:50.389003  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2680) took 1447 ms. Trace:
I20260709 13:17:50.389453  5448 rpcz_store.cc:276] 0709 13:17:48.942000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.983220 (+ 41220us) service_pool.cc:224] Handling call
0709 13:17:48.983537 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.075295 (+ 91758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.075343 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.088634 (+ 13291us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.334860 (+246226us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:49.334905 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.334984 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.385245 (+1050261us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:50.388676 (+  3431us) raft_consensus.cc:1685] finished
0709 13:17:50.388703 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.388935 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2279,"raft.queue_time_us":76679,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"spinlock_wait_cycles":85622656,"thread_start_us":185670,"threads_started":2,"wal-append.queue_time_us":248842}
I20260709 13:17:50.359077 10649 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:50.407357  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:50.408434  5521 raft_consensus.cc:606] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:50.412403 10669 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.418085 10687 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.329152 10588 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.420262 10712 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:50.423398 10704 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 13:17:50.423697  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2126) took 1391 ms. Trace:
I20260709 13:17:50.338402 10678 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:50.433133  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.432291  5519 rpcz_store.cc:276] 0709 13:17:49.032150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.032334 (+   184us) service_pool.cc:224] Handling call
0709 13:17:49.038023 (+  5689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.114175 (+ 76152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.423436 (+1309261us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b54001e5d54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:50.423639 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173359872}
I20260709 13:17:50.437677 10551 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.440552 10551 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.430650 10688 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.398259 10689 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.447587 10653 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:50.454833 10678 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:50.455971 10647 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:50.442345 10740 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:17:50.457012 10405 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:50.443421 10609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.007s	sys 0.004s
W20260709 13:17:50.465092 10609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.007s	sys 0.004s
I20260709 13:17:50.470918 10569 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.471251 10233 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.476888 10689 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.477591 10657 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.482030 10551 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:50.482538 10610 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.001s
I20260709 13:17:50.482923 10610 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.485800 10610 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:50.436452 10704 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:50.486040  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2739) took 1336 ms. Trace:
I20260709 13:17:50.498589  5369 rpcz_store.cc:276] 0709 13:17:49.149912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.150346 (+   434us) service_pool.cc:224] Handling call
0709 13:17:50.485853 (+1335507us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400144954. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:50.485983 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2536812288}
I20260709 13:17:50.500038  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:50.500245  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.501554 10588 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:50.501959  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2684) took 1455 ms. Trace:
I20260709 13:17:50.502332  5443 rpcz_store.cc:276] 0709 13:17:49.046365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.091198 (+ 44833us) service_pool.cc:224] Handling call
0709 13:17:49.091496 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.091688 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:49.101644 (+  9956us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.371154 (+269510us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.420980 (+1049826us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b1800387b20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c6d2a6 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1
0709 13:17:50.422580 (+  1600us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b1800387b20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:50.501397 (+ 78817us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b1800387b20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:17:50.501583 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.501640 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:50.501698 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.501771 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.501904 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12906,"prepare.queue_time_us":16612,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":113009,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":8091,"spinlock_wait_cycles":53373184,"thread_start_us":268215,"threads_started":2,"wal-append.queue_time_us":233093}
I20260709 13:17:50.504850  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:50.505699 10331 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:50.506328 10602 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:50.506927  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 1.02475e+06us
W20260709 13:17:50.507460  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.507889  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:50.507997 10594 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.508292 10602 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:50.508543 10594 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:50.508760 10466 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:50.509575  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:50.509799  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 363604us
W20260709 13:17:50.510552  5340 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.110s (SENT) [suppressed 60 similar messages]
I20260709 13:17:50.510370 10671 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:50.510948 10507 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.511341 10507 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.511698 10507 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.511859 10671 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:50.512723 10671 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.513036 10671 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:50.513768 10730 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.509047 10594 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.514379  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:50.491441 10659 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.505795  6072 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:50.506392 10331 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:17:50.506966  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 1.12026e+06us
W20260709 13:17:50.541356  5340 leader_election.cc:336] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.000s (SENT)
I20260709 13:17:50.550643  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:50.551271  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:50.553738  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:50.496380 10704 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:50.509047 10602 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.509750 10680 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:50.510396 10709 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:50.534623  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2671) took 1770 ms. Trace:
I20260709 13:17:50.568248  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:50.568588  5449 rpcz_store.cc:276] 0709 13:17:48.764416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.783425 (+ 19009us) service_pool.cc:224] Handling call
0709 13:17:48.783753 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.783979 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:50.298999 (+1515020us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b180025e700. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf
0709 13:17:50.299195 (+   196us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.534262 (+235067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.534319 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:50.534362 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.534432 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.534565 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282421,"prepare.queue_time_us":43716,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":5323,"raft.queue_time_us":188300,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":215,"spinlock_wait_cycles":13878656,"thread_start_us":97255,"threads_started":2,"wal-append.queue_time_us":150672}
I20260709 13:17:50.535569  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:50.536830 10531 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:50.495239  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.538668 10590 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.539292  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.540279  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.540952 10699 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:50.541599 10685 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:50.544332  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:50.496475  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:50.551379  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:50.558127  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:50.562359  5450 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:17:50.570060 10581 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.932s	user 0.012s	sys 0.004s
I20260709 13:17:50.538118 10720 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.502171 10727 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.571854  5340 leader_election.cc:336] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.687s (SENT)
W20260709 13:17:50.661501  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 89705us
I20260709 13:17:50.560480 10595 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.575806  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:50.640564  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.652698  5519 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:50.653748  5373 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:50.653270  5518 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:50.668254  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:50.668489  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 92807.9us
I20260709 13:17:50.669291  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:50.670063  5372 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:50.569142 10568 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.655562  5369 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:50.662251  5441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
mode: GRACEFUL
new_leader_uuid: "544c82a50cc4477886bb6f7d58f455ca"
 from {username='slave'} at 127.0.0.1:44768
W20260709 13:17:50.662317  5340 leader_election.cc:336] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.075s (SENT)
I20260709 13:17:50.677187  5441 raft_consensus.cc:606] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Received request to transfer leadership to TS 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:50.677165  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:50.677800  5441 raft_consensus.cc:614] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:50.663096  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:50.679061  5366 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:50.662361  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:50.669338  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:50.680357  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:50.681265  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:50.578126  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:50.667140  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 170726us
I20260709 13:17:50.566177  6072 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:17:50.670236  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:50.672995  5520 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:17:50.673188  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2738) took 1523 ms. Trace:
I20260709 13:17:50.665133  5444 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
W20260709 13:17:50.549649 10614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.001s	sys 0.013s
I20260709 13:17:50.679827  5442 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:50.657644  6069 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.657377 10361 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.702158 10509 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:50.578099 10466 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.643020 10678 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.697701  5374 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:50.686192  5517 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.700875  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.769964  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:50.673368  5448 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:50.771965  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.772887  5448 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:50.776546  5520 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:17:50.685132  5371 rpcz_store.cc:276] 0709 13:17:49.149491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.149630 (+   139us) service_pool.cc:224] Handling call
0709 13:17:49.149958 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.150154 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:49.301617 (+151463us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.110479 (+808862us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.505838 (+395359us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b1800438b80. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:17:50.672866 (+167028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.672924 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:50.672965 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.673027 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.673137 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24707,"prepare.queue_time_us":339502,"prepare.run_cpu_time_us":399,"prepare.run_wall_time_us":9375,"raft.queue_time_us":557571,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":5389,"spinlock_wait_cycles":4137344,"thread_start_us":1075030,"threads_started":4,"wal-append.queue_time_us":484073}
I20260709 13:17:50.708278  5521 raft_consensus.cc:2368] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15.
I20260709 13:17:50.569758 10602 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.711870  5519 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:50.493579 10734 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.663698 10671 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.663105 10699 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:50.728247  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65972.3us
W20260709 13:17:50.701915 10614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.001s	sys 0.013s
I20260709 13:17:50.731025  5366 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:50.739984 10698 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.801867 10698 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:50.804344 10698 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:50.672665 10590 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.683413 10595 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.805791  5450 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:17:50.805995 10752 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:17:50.806607 10595 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:50.582718 10709 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:50.678895 10727 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.807588 10507 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.808347  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2687) took 1336 ms. Trace:
I20260709 13:17:50.808451  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:50.573982 10680 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:50.756794  5369 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:50.690260  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.667480 10581 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.727155  5370 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:50.756909 10649 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:50.809322  5450 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.810915 10590 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:50.789899  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.792799  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:50.793926  5340 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.167s (SENT)
I20260709 13:17:50.756990 10568 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:50.753249 10703 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:50.800693  5442 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:17:50.821493  5448 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:50.785720 10685 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:50.848605  5444 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:50.837070  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.784969 10711 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:50.849990  5442 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:50.826536  5517 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
W20260709 13:17:50.823915  5340 leader_election.cc:336] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.188s (SENT)
I20260709 13:17:50.838253  5446 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:17:50.808847  5447 rpcz_store.cc:276] 0709 13:17:49.471954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.472718 (+   764us) service_pool.cc:224] Handling call
0709 13:17:49.473142 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.506878 (+1033736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.506907 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.507392 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.700159 (+192767us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:50.700335 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.700406 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.808073 (+107667us) raft_consensus.cc:1685] finished
0709 13:17:50.808098 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.808280 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1033314,"raft.queue_time_us":1035043,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":7552,"thread_start_us":192366,"threads_started":1,"wal-append.queue_time_us":296725}
I20260709 13:17:50.853482  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:50.845497  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:50.852142  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:50.861263  5448 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.865911  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:50.890873  5450 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:17:50.907601  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.727520 10331 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:50.909761  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:50.917028  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:50.918625  5446 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:50.911118  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.923606  5450 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:50.782533 10594 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.811270 10602 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:50.818521 10581 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:50.775743 10466 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:50.937752  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 113888us
I20260709 13:17:50.848241 10685 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.949293 10729 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.785953 10361 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:50.950076  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:50.951434  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:50.981357  5447 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.944947  5448 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:50.926734 10704 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:50.859668 10568 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:50.954031  5340 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.795s (SENT)
I20260709 13:17:50.910020 10671 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.860581 10510 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:17:50.972666 10685 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:50.961760  5446 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:50.997660  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:50.988659  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:50.986698  5445 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:50.991222  5442 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:51.000913  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46931.8us
W20260709 13:17:51.002460  5340 leader_election.cc:336] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.916s (SENT)
W20260709 13:17:51.003365  5340 leader_election.cc:336] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.965s (SENT)
W20260709 13:17:51.004213  5340 leader_election.cc:336] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.047s (SENT)
I20260709 13:17:50.985567  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.005402  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:51.008240  5369 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:51.017983  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:51.011088  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 340886us
I20260709 13:17:51.020264  5370 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:51.020891  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.021968  5369 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:51.010316 10617 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.000s
W20260709 13:17:51.054942  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 385629us
I20260709 13:17:51.056141  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:50.990424 10704 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.047080  5447 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:51.014829 10581 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.071655  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:51.070132 10590 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:51.075706 10590 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:51.075865  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.076233  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:51.076388 10759 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:51.048456 10727 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:51.078235  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 72911.2us
I20260709 13:17:51.082547  5369 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:51.076267 10590 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.030943 10720 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:51.037079 10507 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.114117  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:50.949326 10699 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.047870 10595 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:51.036353 10703 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:17:51.134727  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.052625 10617 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.150939  5519 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:51.152554 10669 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.739s	user 0.012s	sys 0.000s
I20260709 13:17:51.108839 10677 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:51.110548 10698 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.161242  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.162477  5369 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.136083  5370 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:51.083510 10678 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.092450 10649 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:51.080246 10581 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.071360 10714 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:51.146384 10761 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:17:51.128186 10756 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.153714 10677 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.166290  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07d1fef577c411787d1f686a4774389"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:17:51.171438  5340 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.198s (SENT)
W20260709 13:17:51.173889  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59950.4us
I20260709 13:17:51.114622 10602 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:51.180207  5369 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:51.211649  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:51.163199 10734 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:51.171530 10595 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.181007 10680 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:17:51.215634  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:51.218935  5340 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.675s (SENT)
I20260709 13:17:51.222482  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:51.223251  5369 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:51.191113 10698 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.209444 10649 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.221994 10594 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.218835 10507 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:51.217032 10709 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:51.191100 10714 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:51.246454 10659 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.006s
I20260709 13:17:51.250224  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.245810 10510 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.216921 10602 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.335570 10602 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.273167  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.337997  5370 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:51.260298 10569 consensus_meta.cc:287] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.787s	user 0.011s	sys 0.001s
I20260709 13:17:51.213276 10756 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:51.288305  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.245194 10770 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:51.295374 10763 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:51.252007 10649 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.301883 10581 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:51.302085 10765 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:17:51.261068 10507 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:51.246771 10698 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.275575 10361 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:51.323124  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 391111us
W20260709 13:17:51.325683  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 244854us
I20260709 13:17:51.331673 10590 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:51.277770  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66216.5us
I20260709 13:17:51.375475  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:51.343595  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.376710  5372 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:51.348191  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.354017  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.377859  5366 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:17:51.354331  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.355135  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.379618  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:51.380263  5375 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.345465 10737 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:51.385000  5524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.021s	sys 0.019s
W20260709 13:17:51.385483  5524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.022s	sys 0.019s
I20260709 13:17:51.386046  5522 raft_consensus.cc:606] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:51.386416  5522 raft_consensus.cc:614] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:51.370049  6069 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.004s
I20260709 13:17:51.411989  6069 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:51.381356  5369 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.396952 10507 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:51.401886  5340 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.862s (SENT)
I20260709 13:17:51.415184  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:51.418061  5340 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:51.383033 10770 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:51.395215 10712 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:51.451879  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.452517  5372 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:51.452598  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50868.6us
I20260709 13:17:51.455058  5370 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:51.459314  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.464737  5369 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:51.466511  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.467370  5369 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.446298  5375 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:17:51.450986  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75620.6us
I20260709 13:17:51.474298  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:51.458477 10712 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.477581  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:51.478019 10714 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:51.405004 10739 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:17:51.481899 10685 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.383330 10734 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:17:51.484189 10685 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.398895 10737 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:51.485154  5367 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:51.486081  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.488763 10770 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.489285 10770 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:51.489825 10770 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.494197 10569 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.494782 10569 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.496026  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:51.458033 10635 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:51.500208  5441 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:51.439071 10752 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:51.503065  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:51.398209 10720 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:17:51.508661  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:51.484826 10685 raft_consensus.cc:2764] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:17:51.515482  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.515691  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:51.450862 10677 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.510340 10594 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.487735  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.519464  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.477677 10756 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:51.520232 10569 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.520388  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:51.559440  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:51.527534 10649 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.531208 10770 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:51.532222  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56202.5us
I20260709 13:17:51.533113  5372 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:51.543284  5369 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:51.545617 10709 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:51.546337 10762 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:51.507642 10680 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:51.477635 10712 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.475101 10595 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:51.504068  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.549111 10698 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.576159  5375 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.573073  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:51.572983  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.580089  5443 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:17:51.573999  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:51.586226  5442 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:51.517412 10507 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.589169  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.565546 10685 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:51.590075  5444 raft_consensus.cc:2368] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 18. Current term is 19.
I20260709 13:17:51.575394 10594 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:51.599725  5375 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:17:51.576217 10331 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.608079  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:51.609033  5442 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.598027 10594 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:51.619248  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:51.569984 10677 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:51.625545  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.571116 10709 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:51.598421 10361 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.589537 10595 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:51.577646 10669 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:17:51.577448 10703 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:17:51.641737  5371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.023s	sys 0.036s
W20260709 13:17:51.643822  5371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.024s	sys 0.036s
I20260709 13:17:51.622053 10594 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:51.649416  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.655583  5371 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:51.658215 10510 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:51.647581 10709 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.650076 10360 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.664213  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.671396  5442 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 14.
W20260709 13:17:51.673686  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 288722us
I20260709 13:17:51.676365  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:51.696995  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:51.698812  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:51.702509  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:51.654089 10590 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:51.642232 10361 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:51.644353 10649 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:51.667516 10595 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:51.708994  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.673825 10550 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.670796 10720 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:51.714219  5371 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:51.710680  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:51.717768 10739 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:51.718536 10689 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:51.721491 10653 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.707518 10734 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:51.729909  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:51.744234  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2460) took 1191 ms. Trace:
I20260709 13:17:51.748518  5521 rpcz_store.cc:276] 0709 13:17:50.553220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.553506 (+   286us) service_pool.cc:224] Handling call
0709 13:17:51.729229 (+1175723us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400369054. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:51.744152 (+ 14923us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336731392}
I20260709 13:17:51.730685 10526 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.746636  5375 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:17:51.730769 10739 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:51.761909 10780 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:17:51.747112 10653 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:51.780927 10331 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.846001 10653 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.744166 10720 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:51.849280 10720 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:51.850253 10720 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.850781  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:51.850922 10720 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:51.829963 10787 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:17:51.767555  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.840621  5371 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
W20260709 13:17:51.767534 10785 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 13:17:51.752040 10526 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.858014  5369 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:51.859593  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.756325 10361 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:51.747193 10734 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.866170  5371 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
W20260709 13:17:51.738938  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 242967us
I20260709 13:17:51.820710  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:51.779994 10568 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.769768 10711 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:51.880492  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.765486 10466 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:51.759282 10788 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:51.895092  5371 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:51.902321  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.903647  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.906062  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.906986  5444 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:51.907706  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.908663  5443 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:51.909735  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.910738  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.913808  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.914767  5446 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:51.915925  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.918864  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.919626  5443 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:51.920639  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:51.923794  5369 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:51.873785 10526 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.929868  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:51.935122  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.935444  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.936384  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.926730  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:51.939145  5369 raft_consensus.cc:2393] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:51.884112 10734 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.873988 10507 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:51.939985  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:51.887565 10671 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.893s	user 0.017s	sys 0.000s
I20260709 13:17:51.900089 10711 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.901553 10788 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:51.729635 10550 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.975430  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.999392  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:51.975669  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.000284  5370 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.000614  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.001575  5443 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:52.001698  5444 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:51.927824 10677 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.999883 10720 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.003183  5450 raft_consensus.cc:2410] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:51.938756 10789 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:17:52.003654  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.000149 10788 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.019927  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:52.020282  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 290418us
I20260709 13:17:52.037415  5369 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:52.037946  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:52.038730  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.039630  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:52.039835  5369 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:52.040539  5490 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:52.041399  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:52.002318  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:52.020282  5445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2700) took 1380 ms (client timeout 1588 ms). Trace:
I20260709 13:17:52.021411  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2466) took 1194 ms. Trace:
I20260709 13:17:52.022815  5444 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:17:52.042192  5445 rpcz_store.cc:269] 0709 13:17:50.639896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.640150 (+   254us) service_pool.cc:224] Handling call
0709 13:17:52.020091 (+1379941us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540029ead4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:52.020220 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733273344}
I20260709 13:17:52.042900  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.042799  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.041531  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.042276  5519 rpcz_store.cc:276] 0709 13:17:50.826554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.827471 (+   917us) service_pool.cc:224] Handling call
0709 13:17:50.837406 (+  9935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.151486 (+314080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.021046 (+869560us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540016bcd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:52.021325 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720460672}
I20260709 13:17:52.044206  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:51.999528 10507 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.044986  5371 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:52.026999  5370 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:17:52.047482  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.047721  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.050299  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2708) took 1285 ms. Trace:
I20260709 13:17:52.050819  5441 rpcz_store.cc:276] 0709 13:17:50.764619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.775409 (+ 10790us) service_pool.cc:224] Handling call
0709 13:17:52.050105 (+1274696us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b540033c7d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:52.050236 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559596416}
I20260709 13:17:52.053349  5370 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:52.057542  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.036202 10709 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.059273 10712 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.064287 10712 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.059533  5444 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:52.066274  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.067111  5444 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:52.068192  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.072445 10722 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:52.072896 10722 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:52.046089 10720 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:52.075362 10720 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:52.075655 10777 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.469s	user 0.002s	sys 0.001s
I20260709 13:17:52.075919 10720 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.011914 10677 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:51.999017 10739 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.079437  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.083551  5442 raft_consensus.cc:2410] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:52.081187  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.080509  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.084771  5444 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:52.086346  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.086529  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.087096  5441 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:52.087296  5445 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:52.090087  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.090618  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.092631  5445 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:52.092904  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.043918 10689 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:52.093781  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.096832  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.097779  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.088263  5371 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:52.094714  5370 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:52.096016  5449 raft_consensus.cc:2376] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
W20260709 13:17:52.097935  5340 leader_election.cc:336] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.574s (SENT)
I20260709 13:17:52.098379  5445 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:52.098348  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.099942  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:52.101441  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.102174  5444 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:52.102679  5446 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:52.102986  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.104068  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.097934 10712 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:52.110528 10617 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.111925  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2717) took 1186 ms. Trace:
I20260709 13:17:52.112646 10709 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.113971 10550 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.116554  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2756) took 1519 ms. Trace:
I20260709 13:17:52.116986  5367 rpcz_store.cc:276] 0709 13:17:50.597136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.597283 (+   147us) service_pool.cc:224] Handling call
0709 13:17:52.116351 (+1519068us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54001e8a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:52.116482 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876947328}
I20260709 13:17:52.119495  5375 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: [14.7-15.8]
I20260709 13:17:52.120337  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2461) took 1566 ms. Trace:
I20260709 13:17:52.083626 10789 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:52.131425 10789 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:17:52.131803 10769 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.916s	user 0.002s	sys 0.009s
I20260709 13:17:52.132301  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:52.121738  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.132658 10789 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:52.133738  5444 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:52.133766  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:52.134114 10789 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.134760  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.135358  5444 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.137686 10507 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.139235  5366 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:52.112363  5450 rpcz_store.cc:276] 0709 13:17:50.926026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.946092 (+ 20066us) service_pool.cc:224] Handling call
0709 13:17:52.111701 (+1165609us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400238a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:52.111861 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2348547456}
I20260709 13:17:52.121569  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.142976  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.143584  5448 raft_consensus.cc:2376] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20. Re-sending same reply.
W20260709 13:17:52.144342  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.144552  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.145190  5448 raft_consensus.cc:2376] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18. Re-sending same reply.
I20260709 13:17:52.151000  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.152119  5448 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:52.153070  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.130308  5369 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:52.120779  5524 rpcz_store.cc:276] 0709 13:17:50.553556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.553788 (+   232us) service_pool.cc:224] Handling call
0709 13:17:50.554459 (+   671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.818252 (+263793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.818291 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.818916 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:17:51.385900 (+566984us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:51.385942 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.119875 (+733933us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54003a3754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:52.119935 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.119990 (+    55us) raft_consensus.cc:1685] finished
0709 13:17:52.120006 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.120251 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":993,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":604841344,"thread_start_us":566549,"threads_started":1,"wal-append.queue_time_us":780637}
I20260709 13:17:52.153352  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.146169 10653 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.161051 10653 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.091549 10796 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:52.162084  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.163988 10770 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.164502  5444 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:52.164898 10737 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:52.154084 10233 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.100731 10722 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.169734 10617 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.174160 10677 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.175959  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:17:52.185689 10709 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.145275  5371 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:52.202461  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.206365  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.190411  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.145553 10793 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:52.216112  5448 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:52.217630  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.219805  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.221030  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:52.222155  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:52.226315  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.227460  5370 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:52.110707 10594 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.203006 10796 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:52.236840  5517 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:52.238968  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.238852  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.241735  5370 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:52.240343  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:52.229629 10722 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.244459  5443 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:52.244225  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.247351  5518 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:52.208030 10233 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:52.249085  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 207742us
I20260709 13:17:52.234062 10793 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:52.235355 10714 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.232023 10663 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:52.250865  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:52.250846  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.255396  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.256494  5444 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:52.252502  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.214435 10617 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.258472  5522 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:52.259438  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2761) took 1484 ms. Trace:
I20260709 13:17:52.228461 10709 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.264968  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.252508 10712 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:52.268356  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.276919  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.277628  5446 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:52.278700  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.246265 10734 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.234186 10689 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.260044  5374 rpcz_store.cc:276] 0709 13:17:50.774627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.785833 (+ 11206us) service_pool.cc:224] Handling call
0709 13:17:50.801647 (+ 15814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.835552 (+ 33905us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:51.216567 (+381015us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.577840 (+361273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.577968 (+   128us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:51.578046 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.259109 (+681063us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5400330754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:52.259184 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.259355 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45791,"prepare.queue_time_us":450146,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":19717,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":28332,"spinlock_wait_cycles":45580160,"thread_start_us":632622,"threads_started":2,"wal-append.queue_time_us":447948}
I20260709 13:17:52.284363  5450 raft_consensus.cc:2410] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:52.284463  5446 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:17:52.286235  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.286365  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.287060  5370 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:52.289179 10788 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.291631 10788 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.294059 10711 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.295132  5524 raft_consensus.cc:606] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Received request to transfer leadership to TS 86b410d62f4040c39d33dc0698998562
I20260709 13:17:52.295540  5524 raft_consensus.cc:614] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:52.296283 10233 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.296459 10711 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.264315 10714 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.299216 10714 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.301131 10734 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.303865 10526 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.307860  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.308940  5518 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:52.315366  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:52.319372  5518 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:52.322892  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:52.328758  5522 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:52.344542 10594 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.337857 10793 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.352159  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.355921  5369 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:52.329768 10770 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.363284  5366 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:52.365926  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.366662  5518 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:52.369930  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.307075 10796 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.373423  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:52.376523  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.378880  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.377331  5366 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:52.379851  5518 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:52.381356  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.380817  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.383564  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.383183  5369 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.390321  5517 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:52.391867  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:52.397827  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.399092  5366 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:52.403467  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.402700  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.409391  5366 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:52.368064 10770 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.419211  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.421402  5367 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:52.422415  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.422971  5368 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.419808 10526 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:17:52.425740 10801 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:52.353704 10712 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.437932  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:52.439028  5445 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
W20260709 13:17:52.439829  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 341882us
I20260709 13:17:52.445415  5339 leader_election.cc:400] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15.
I20260709 13:17:52.445847  5339 leader_election.cc:403] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:52.447422 10662 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.448024 10662 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.450664 10662 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.458066  5368 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:52.458834  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.451835 10360 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:52.460939 10805 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:52.461350 10510 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15.
I20260709 13:17:52.461928  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:52.469327  5366 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:52.464061  5369 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:52.457746  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:52.452783 10727 raft_consensus.cc:993] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower 86b410d62f4040c39d33dc0698998562 to start an election
I20260709 13:17:52.467492  5375 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:52.451045 10704 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.459586  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.490476  5368 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:52.433802 10756 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:52.474977  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:52.468879 10657 raft_consensus.cc:993] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower 86b410d62f4040c39d33dc0698998562 to start an election
I20260709 13:17:52.451084 10720 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.481518 10617 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.481982  6069 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:17:52.493445  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.494632  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:52.494904  5517 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:52.504536  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.505370  5517 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:52.506496  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.496883  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:52.507247  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.497280  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.499075  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.500023  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.502846  5518 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:52.509865  5515 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:52.509517  5523 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:52.510730  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.511569  5517 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:52.517335  6072 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:17:52.509111 10714 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:52.519011 10657 raft_consensus.cc:1081] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Signalling peer 86b410d62f4040c39d33dc0698998562 to start an election
I20260709 13:17:52.486032 10709 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.502322 10671 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:52.486399 10800 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:17:52.521320 10800 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:52.521744 10800 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:52.522046 10807 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:17:52.485862 10653 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.522655 10800 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.523990 10770 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.524194 10800 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.521348  5446 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:52.525838  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:52.527284  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.527510  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.528177  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:52.530956  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:52.536128  5520 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:52.537948  5446 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:52.540566  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 96511.9us
I20260709 13:17:52.540723  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:52.547961  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:52.470567 10662 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:52.502341 10689 raft_consensus.cc:1081] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Signalling peer 86b410d62f4040c39d33dc0698998562 to start an election
I20260709 13:17:52.566900 10737 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:52.567651 10737 consensus_queue.cc:1243] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:52.534771 10568 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:17:52.530150 10756 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.571372  5449 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:52.572855  5449 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:52.572996 10756 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.555524 10714 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:52.562961 10727 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:52.563208  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:17:52.603194  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55341.4us
I20260709 13:17:52.565518 10360 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:52.539546 10233 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:52.556228  5519 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:52.575474  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 139665us
I20260709 13:17:52.612792 10685 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:52.592619  5449 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:17:52.533921 10810 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:52.604497  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:52.613910  5368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:44090
I20260709 13:17:52.635465  5368 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.636026  5368 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.631639  5375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
 from {username='slave'} at 127.0.0.1:44090
I20260709 13:17:52.644150  5375 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.644691  5375 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.633409  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.648479  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.608330 10360 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.650604  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:52.532114 10671 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:52.652932  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48486.2us
I20260709 13:17:52.614156 10756 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:52.557636 10361 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:17:52.651458  5368 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.660764 10797 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:52.631613 10657 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:17:52.631721 10796 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:52.675391 10671 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.614775 10233 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:52.602438 10662 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.613343 10685 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:52.678594  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39322 (request call id 378) took 1105 ms. Trace:
I20260709 13:17:52.719004  5447 rpcz_store.cc:276] 0709 13:17:51.572688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.572838 (+   150us) service_pool.cc:224] Handling call
0709 13:17:52.678312 (+1105474us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54003bc254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:52.678528 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976415104}
I20260709 13:17:52.681075  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:52.720327  5366 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
W20260709 13:17:52.682571  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 124994us
I20260709 13:17:52.686295  5369 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:17:52.689520  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:52.700443  5368 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.660548 10360 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.679689 10756 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:52.686846 10531 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.727663  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:52.733445 10739 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:52.733979 10739 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.734432 10739 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:52.714407 10712 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:52.738736 10712 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:52.739753 10712 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.730613 10799 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:52.730945  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:52.750296  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:52.683651  5375 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.758754  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:52.714890 10233 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.789844  5375 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:52.742098 10685 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.726792 10796 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:52.738045 10727 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:52.763496 10653 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.755407 10671 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:52.673022 10714 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:52.763053 10709 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:52.765715 10722 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:52.805740  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47093.8us
I20260709 13:17:52.764727 10507 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:52.810189  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:52.743265 10789 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:17:52.738029 10531 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:52.763103 10772 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:17:52.818179  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:52.805254 10685 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.823563  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:52.826260  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:52.804517 10594 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:52.804976 10823 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:52.855691  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:52.923805  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 202373us
I20260709 13:17:52.803532 10727 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:52.861935  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:52.818563 10507 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.853856 10698 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:52.880966 10720 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:52.825268 10722 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:52.875042 10832 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:52.933588  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:52.846869 10677 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:52.936347  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:52.800004 10756 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.856675 10823 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:52.847865 10594 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:52.951812  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.816329 10595 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:52.941032  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 280461us
I20260709 13:17:53.050009  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:52.935189  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 207573us
I20260709 13:17:52.941780  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:52.808669 10671 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:52.848315 10361 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:17:52.943986 10677 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.933843 10526 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:52.926867 10727 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.934482 10709 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.060772  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:53.038177  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:53.024581 10823 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:53.042759  5375 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:52.939064 10698 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.061750  5366 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.062178  5367 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:53.049341 10756 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:53.047631  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.019819 10770 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:53.019294 10569 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:53.035841 10794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.024s	sys 0.033s
I20260709 13:17:53.030606 10594 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.053370  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.058531  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:52.937369 10796 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.060144  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:53.068864  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 213257us
W20260709 13:17:53.048406  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.089993  5366 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:53.055939 10712 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:53.067878 10709 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.061245 10677 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.065678 10698 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.101114  5368 raft_consensus.cc:2376] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16. Re-sending same reply.
W20260709 13:17:53.103150  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 161453us
W20260709 13:17:53.105007  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 81343.7us
I20260709 13:17:53.086369 10531 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:53.078456 10526 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:53.102079 10794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.024s	sys 0.033s
W20260709 13:17:53.141330  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 88049.4us
I20260709 13:17:53.142634  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:53.143761  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.143985  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:53.145663 10830 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.148846 10361 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.095721 10832 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.150421 10617 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:53.151093 10657 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.096546 10662 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.138361 10526 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.154049 10662 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.108059 10770 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:53.149925 10712 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.156279 10770 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.156500 10712 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.157836  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2203) took 1084 ms. Trace:
I20260709 13:17:53.155086 10799 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:53.158247  5443 rpcz_store.cc:276] 0709 13:17:52.072985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.080947 (+  7962us) service_pool.cc:224] Handling call
0709 13:17:53.157637 (+1076690us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540019c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:53.157776 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367837056}
I20260709 13:17:53.158758 10799 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:53.123584 10821 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:17:53.151101 10617 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.099130 10722 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.162834 10617 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.169601  6069 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:17:53.138242 10820 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:17:53.153090 10550 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:53.108919 10595 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:53.188951 10800 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.002s
I20260709 13:17:53.214313 10671 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.214495 10595 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:53.199736 10824 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.234434  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2211) took 1125 ms. Trace:
I20260709 13:17:53.274513  5450 rpcz_store.cc:276] 0709 13:17:52.108795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.161789 (+ 52994us) service_pool.cc:224] Handling call
0709 13:17:53.234029 (+1072240us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b5400238a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:53.234250 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219996032}
I20260709 13:17:53.235283  5445 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:17:53.276449  5445 pending_rounds.cc:85] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 8
I20260709 13:17:53.276847  5445 pending_rounds.cc:107] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:53.277181  5445 raft_consensus.cc:2889] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:53.239816  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 96070.7us
W20260709 13:17:53.245715  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 73950us
W20260709 13:17:53.254760  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 204836us
I20260709 13:17:53.272852  5523 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:53.257462 10799 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.286262  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:53.291160  6072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59492 (request call id 188) took 1141 ms. Trace:
W20260709 13:17:53.288373  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 77178us
I20260709 13:17:53.291694  6072 rpcz_store.cc:276] 0709 13:17:52.131889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.132057 (+   168us) service_pool.cc:224] Handling call
0709 13:17:53.272906 (+1140849us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540049e654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:53.273093 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766728448}
I20260709 13:17:53.195382 10550 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:53.292783  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:17:53.187722 10361 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:53.320051  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 197508us
I20260709 13:17:53.320292  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:53.295179 10568 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:53.295992 10739 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.003s
I20260709 13:17:53.151198 10823 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.297648 10799 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:53.137243 10233 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.305151 10709 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.291766 10824 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:53.330242  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:53.315915 10677 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.208384 10788 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:53.333321 10788 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.324493  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.324920  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:53.320714 10550 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.345330 10853 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.326686 10568 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.346382 10568 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:53.346140 10853 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.338850 10831 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:53.329200 10739 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.323820 10671 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:53.340332 10361 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:53.340619 10233 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:53.340523  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:53.330044 10844 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:17:53.343822 10507 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.344372  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2190) took 1295 ms. Trace:
I20260709 13:17:53.331736 10685 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.217381 10360 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:53.354300  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 210370us
I20260709 13:17:53.355443  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2729) took 1298 ms. Trace:
I20260709 13:17:53.340014 10799 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:53.376516  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51660.8us
I20260709 13:17:53.399641  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.382771  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:53.343133 10823 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:53.386467  5445 rpcz_store.cc:276] 0709 13:17:52.049288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.454388 (+405100us) service_pool.cc:224] Handling call
0709 13:17:53.234938 (+780550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.278777 (+ 43839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.344113 (+ 65336us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400238a50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:53.344293 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762908032}
W20260709 13:17:53.344826 10838 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:17:53.396634  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.349699 10831 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.395898  5446 rpcz_store.cc:276] 0709 13:17:52.056812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.539770 (+482958us) service_pool.cc:224] Handling call
0709 13:17:52.540037 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.556614 (+ 16577us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:52.602159 (+ 45545us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.092992 (+490833us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b1800349480. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:17:53.332724 (+239732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.354959 (+ 22235us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:53.355041 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.355150 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.355362 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4490,"prepare.queue_time_us":48264,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":4443,"raft.queue_time_us":47786,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":25150,"spinlock_wait_cycles":48177920,"thread_start_us":234890,"threads_started":1,"wal-append.queue_time_us":750079}
I20260709 13:17:53.377897 10671 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:53.401511  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:53.404927  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 385716us
I20260709 13:17:53.410908  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.414130  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:53.383417 10826 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:53.418072  5373 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:53.395308 10711 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:53.415210  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:53.396037 10709 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:53.416330  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.399083 10799 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.411468 10831 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.422634  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:53.422808  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:53.421821  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.424711  5520 pending_rounds.cc:85] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 7
I20260709 13:17:53.442394  5520 pending_rounds.cc:107] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 15.8
W20260709 13:17:53.442541  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.417064  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:53.379619 10727 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:53.399292 10649 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.406719 10853 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.409746 10714 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:53.421921  5524 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:53.436642  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.442767  5520 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:53.425516  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.443140  5519 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:53.418218 10826 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.375735 10788 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.403826 10507 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:53.453318  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.453404  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.500602  5446 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.463176  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:53.463227  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.421392 10510 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:53.419169 10361 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.504700  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:53.417706 10849 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.506547  5268 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 12 to 15, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:53.507279 10849 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:53.477722 10848 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:53.508493  5268 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.421378 10711 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.489801  5518 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:53.485379 10852 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.476886  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:53.490805  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 54279.9us
I20260709 13:17:53.483309  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:53.515069  5445 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:53.491083  5517 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
W20260709 13:17:53.491539  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68996.7us
I20260709 13:17:53.515296  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.516345  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:53.491824  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:53.516978  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:53.477269  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:53.492928  5524 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.498522  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:53.498395  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.518934  5448 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:17:53.505168 10838 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:17:53.527962  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2794) took 1213 ms. Trace:
I20260709 13:17:53.528434  5370 rpcz_store.cc:276] 0709 13:17:52.314562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.315206 (+   644us) service_pool.cc:224] Handling call
0709 13:17:52.330684 (+ 15478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.451668 (+120984us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:52.807224 (+355556us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.397551 (+590327us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.398321 (+   770us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.398494 (+   173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:53.398540 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.398642 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.527685 (+129043us) raft_consensus.cc:1685] finished
0709 13:17:53.527711 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.527888 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137504,"prepare.queue_time_us":157438,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":234944,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":196,"thread_start_us":787627,"threads_started":3,"wal-append.queue_time_us":252488}
I20260709 13:17:53.530162 10839 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:53.462239  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:53.532131  5441 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:53.534220 10739 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:53.535168 10824 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.501935  5447 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:17:53.503980  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.444141  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 119505us
I20260709 13:17:53.402535 10685 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:53.482540 10854 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:17:53.446951 10526 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:53.445039 10799 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.446174 10709 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:53.517220  5521 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:53.517174  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:53.487327  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.492431  5519 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.452767 10833 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:53.492799 10714 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.522349  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:53.523496 10677 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.524379 10727 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:53.481627 10360 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:53.524653 10569 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:53.525393 10835 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:53.510092 10594 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.612367 10594 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.493920 10671 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.612668 10550 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.613502 10671 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.614231  5444 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:17:53.614329  5522 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:53.509341 10510 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.543882  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.502296 10826 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.557929  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.559612  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:53.447849 10827 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:17:53.518296 10711 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.470104 10649 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.514580 10851 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:53.516570 10657 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.512246 10845 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.567525  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:53.576603  5446 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:17:53.577044  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.578989  5443 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:53.580500  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2484) took 1053 ms. Trace:
W20260709 13:17:53.580659  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 58383us
I20260709 13:17:53.571465  5519 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.583773  5445 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:53.584055 10849 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:53.585018  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67905.4us
I20260709 13:17:53.585955 10800 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:53.586661 10839 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.559619 10859 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:53.590411 10568 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.592751 10685 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.571141 10844 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:17:53.596448 10709 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:53.562078 10788 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.567847 10770 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:17:53.600353  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.602403 10756 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.514s	user 0.013s	sys 0.000s
I20260709 13:17:53.605046 10704 raft_consensus.cc:2764] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:17:53.594594 10698 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.619555 10833 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:17:53.619720  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 55688.9us
I20260709 13:17:53.726053  5447 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.644250  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.773696  5444 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:53.627759  5450 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:53.734999  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:53.729254  5519 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.636287  5268 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 13 to 14, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 14 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.736147  5517 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 14.
I20260709 13:17:53.584081  5442 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:53.775609  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.740666  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.775921  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.776760  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:53.777045  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.778604  5518 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:53.737548  5523 rpcz_store.cc:276] 0709 13:17:52.527158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.527268 (+   110us) service_pool.cc:224] Handling call
0709 13:17:53.580301 (+1053033us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54003782d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:53.580436 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712497024}
W20260709 13:17:53.741113  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 173682us
I20260709 13:17:53.782243  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.727128  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.577512 10714 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.733008 10800 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.790753 10800 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.793359 10698 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.764933  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:53.794363 10594 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:53.794946 10594 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:53.794962  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.796519  5441 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:53.796454 10756 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:53.797142  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.797729  5446 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:53.798835  5441 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:53.800208  5442 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:53.766790 10851 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.801678  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.773806  5516 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:53.802273 10851 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:53.785792  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50916.3us
I20260709 13:17:53.785705  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:17:53.797753  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.622822 10835 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:53.770998 10842 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.790218 10657 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:53.819777  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55019.2us
I20260709 13:17:53.785283 10823 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:17:53.793985  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:53.796190 10594 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.617367 10831 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.801808  5522 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:53.580487 10526 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.738663 10510 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.722551  5521 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:53.787606 10833 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.816912  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.769523  5443 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:53.820722  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:53.820787  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:53.826807  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:53.837355 10698 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:53.832469 10657 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:53.847163 10698 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.847699 10831 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.847949 10657 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.836915 10862 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:53.849961 10862 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.852630 10862 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.832329 10853 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:17:53.827833  5444 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:17:53.827775  5490 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:53.852478 10840 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:53.823266  5446 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
W20260709 13:17:53.832144  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 105163us
I20260709 13:17:53.816455  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.834619  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.819855 10859 raft_consensus.cc:2764] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:17:53.770853 10863 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:17:53.854821 10360 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.873566  5369 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:53.855142 10756 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:53.824124 10824 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:53.843077 10550 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:53.843933 10845 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:53.856850 10846 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.894670  5524 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.827522  5447 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:17:53.861908  5368 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:53.829648  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:53.844704  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:53.857327 10704 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:53.854293 10823 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.868598  5374 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:53.867780  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:53.926851  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.903648  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:53.871592  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.870256  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:53.836807 10594 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.874444  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:53.873512 10863 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:53.868528 10844 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.894081  5369 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:53.950675  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.949714  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:53.949757  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.952016  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84320.3us
I20260709 13:17:53.966821  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:53.968873  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.943828  5367 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:53.947893  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:53.866923 10830 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:53.865792 10653 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:53.970036  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:53.971336  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 144605us
W20260709 13:17:53.945814  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 101249us
I20260709 13:17:53.866106 10840 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:53.892963 10756 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:53.960140 10859 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:53.899169 10824 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:53.903312 10698 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:53.943015 10789 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:53.986117  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:53.949611 10849 raft_consensus.cc:2764] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:53.903306 10722 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.017513  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 196797us
I20260709 13:17:54.027374  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:54.018322 10840 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.831255 10842 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:53.902899 10845 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:53.960538 10863 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:54.024408  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:54.025167  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:53.966599 10831 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.982414 10727 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:53.903183 10360 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.035259  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:54.035941  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:54.034411  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:53.982481 10852 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.987448 10850 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:54.015909 10866 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:17:53.982200 10805 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:53.952639 10846 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:54.037483 10871 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:17:54.024973 10824 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.027604 10844 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.047109 10853 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.085153  5519 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:54.069557 10859 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:54.072654  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:54.035084 10361 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:54.035288  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55153.4us
I20260709 13:17:53.985517 10526 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.036808 10698 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.978016 10823 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.036620 10722 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.845747 10839 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:53.982390 10830 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.076408  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:54.029316 10789 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:54.110909  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:54.053735 10863 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.071224 10850 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:54.181130  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 280094us
W20260709 13:17:54.142666 10799 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.001s
I20260709 13:17:54.078308 10712 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.142168 10595 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:54.078075 10617 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 13:17:54.150231  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73908.1us
I20260709 13:17:54.111719 10840 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:54.149274 10671 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.006s
I20260709 13:17:54.199864  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.200266  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.102355 10878 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.090682 10851 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:17:54.165666 10331 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.186684 10850 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:54.190382  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 79564.4us
I20260709 13:17:53.949930 10835 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.081770 10862 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:54.152510 10796 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.241081 10796 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:54.242920 10823 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.110494 10853 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:54.083530 10756 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:54.110476 10361 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:54.141651 10698 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.219255 10569 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.220117  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:54.191707 10831 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:54.218695 10671 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:17:54.209517 10874 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:54.284072 10800 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.192194 10595 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:54.286432 10595 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.235251 10331 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:54.288889 10698 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.289637 10698 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:54.290145 10875 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:17:54.290411 10722 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:54.291115 10881 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:17:54.292032 10885 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:17:54.293097 10882 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:17:54.292829 10331 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:54.190223 10799 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.295188 10789 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.295344 10799 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:54.191915 10653 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:54.101086 10844 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.299679  5443 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 19.
W20260709 13:17:54.270243  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59769.3us
I20260709 13:17:54.257479 10361 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:54.271730 10888 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:54.322860  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.274556 10830 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:54.323349 10888 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:54.352324 10888 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.354435  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.270654 10884 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:54.281877 10360 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.282258 10846 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.221082 10859 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:54.361784 10884 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.283401 10797 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.218832 10617 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:54.364451 10797 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:54.192444 10805 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:54.324388  5367 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:17:54.247996 10842 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.347692 10850 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:54.350020 10788 consensus_meta.cc:287] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.005s
W20260709 13:17:54.284407  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64440.5us
W20260709 13:17:54.370787  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 345686us
W20260709 13:17:54.457880  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 133033us
I20260709 13:17:54.459576  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:54.296571 10800 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:54.324254 10704 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.486101  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:54.478709  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:54.436017 10510 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.004s
I20260709 13:17:54.436161 10888 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:54.367069 10797 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:54.440147 10826 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.000s
I20260709 13:17:54.297274 10569 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.477018 10846 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.369825 10884 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:54.557407  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78793.2us
I20260709 13:17:54.558333  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:54.559820  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.593586  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 106323us
I20260709 13:17:54.494668 10852 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:54.628531  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:54.527755 10510 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:54.601387 10711 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.852s	user 0.009s	sys 0.003s
I20260709 13:17:54.629681  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:54.629513 10711 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.630606 10788 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:54.630923 10510 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.631119 10788 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:54.631577 10510 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.632205 10510 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.632742  5375 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:54.628482  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 70257.1us
I20260709 13:17:54.560734 10698 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:54.634415 10510 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.457894 10657 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 13:17:54.632072 10788 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.477247 10360 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.634725 10698 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.633821 10799 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:54.636286 10360 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.637344 10799 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:54.638677 10360 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.605005  5517 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:54.628747 10852 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:54.635612  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:54.299387 10833 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:54.639657 10852 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.635773 10510 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.632097 10711 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:54.640027 10360 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:54.637276  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:54.513203 10830 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:17:54.513577 10671 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:17:54.638727 10799 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.7, Last appended by leader: 7, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.514128 10823 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:17:54.662865  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.663596  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.681046  5444 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:54.681264  5446 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:54.682875  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.683915  5446 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:54.669891  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.684968  5450 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:54.597781 10896 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.598743 10526 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:17:54.531500 10704 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.593921 10846 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.559970 10826 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.678419  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.679575  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.698614  5445 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:54.645046 10835 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:54.687819  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.699661  5444 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.696462  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:54.706367  6077 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.689643  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.678357  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:54.707690  6072 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:17:54.714847  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.679499 10770 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.728600  5373 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:54.730358  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:54.731568  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:54.732209  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:54.732472  5519 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:54.732131  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.732641  5523 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:54.734525  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.736585  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:54.736925  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:54.693661 10892 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.737684  5519 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:54.738425  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:54.740476  5516 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:54.748387  5445 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:54.735440  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:54.672312 10840 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:17:54.727562 10594 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.761s	user 0.005s	sys 0.007s
I20260709 13:17:54.711463 10859 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:54.753945  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:54.772214  5522 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:54.693262 10698 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:17:54.758993  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:17:54.760454 10894 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:17:54.761035 10897 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:17:54.761091 10714 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.936s	user 0.007s	sys 0.006s
W20260709 13:17:54.764021 10863 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.002s
I20260709 13:17:54.734395 10739 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:54.768530 10846 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:54.770190 10900 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:54.693698 10722 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:17:54.777360  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.775863 10770 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:17:54.778939 10859 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:54.750953 10824 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.006s
I20260709 13:17:54.738164 10835 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:54.693718 10896 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.791699 10850 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:54.806299  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.751418 10892 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.786914 10891 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.671253 10510 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.805269 10863 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.847175 10896 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.803578 10714 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.812242 10739 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:54.842226 10831 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.004s
I20260709 13:17:54.852811 10826 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.835013 10824 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:54.864308 10863 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.853551 10833 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:54.863925 10835 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.860776 10831 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:54.849746 10891 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.876693 10891 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:54.878811 10852 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:54.506208  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:54.932680  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2838) took 1051 ms. Trace:
I20260709 13:17:54.935094  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 410) took 1048 ms. Trace:
I20260709 13:17:54.936448  5366 rpcz_store.cc:276] 0709 13:17:53.886124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.932832 (+1046708us) service_pool.cc:224] Handling call
0709 13:17:54.933745 (+   913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.934342 (+   597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.934379 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.934476 (+    97us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:54.934532 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.934636 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.934826 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:54.933586  5371 rpcz_store.cc:276] 0709 13:17:53.880529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.435380 (+554851us) service_pool.cc:224] Handling call
0709 13:17:54.435832 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.436104 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:54.719590 (+283486us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.931136 (+211546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.931294 (+   158us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:54.931448 (+   154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.931637 (+   189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.932288 (+   651us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":364284,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"spinlock_wait_cycles":3286272,"thread_start_us":493743,"threads_started":2,"wal-append.queue_time_us":143449}
I20260709 13:17:54.755409  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:54.951330  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2833) took 1074 ms. Trace:
I20260709 13:17:54.945019  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2840) took 1063 ms. Trace:
I20260709 13:17:54.923874  5268 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.954434  5373 rpcz_store.cc:276] 0709 13:17:53.881138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.655792 (+774654us) service_pool.cc:224] Handling call
0709 13:17:54.656606 (+   814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.738632 (+ 82026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.944380 (+205748us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b54001c02d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:54.944822 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164929280}
W20260709 13:17:54.957296  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 201904us
I20260709 13:17:54.963011  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:54.813547  5444 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:54.973613  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2765) took 1192 ms. Trace:
I20260709 13:17:54.973685  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.975132  5444 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:54.974407  5441 rpcz_store.cc:276] 0709 13:17:53.780934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.800576 (+ 19642us) service_pool.cc:224] Handling call
0709 13:17:53.800865 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:53.801058 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.801080 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:54.675445 (+874365us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b2c0003b228. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:17:54.675956 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:17:54.972386 (+296430us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:54.972518 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.972836 (+   318us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:54.972949 (+   113us) raft_consensus.cc:1685] finished
0709 13:17:54.972967 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.973314 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39928704,"thread_start_us":295553,"threads_started":1,"wal-append.queue_time_us":201252}
I20260709 13:17:54.977012  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.977394  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.987032  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.951947  5375 rpcz_store.cc:276] 0709 13:17:53.876968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.062046 (+185078us) service_pool.cc:224] Handling call
0709 13:17:54.078966 (+ 16920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.633518 (+554552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.950636 (+317118us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54000fa5d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:54.951124 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272066432}
I20260709 13:17:54.987514  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.977912  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:54.974893  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.984725  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:54.807219  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:55.004082  6069 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:55.005970 10831 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.006605 10677 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.008064 10824 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.011590 10510 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:54.989178  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:55.019260  5446 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:55.006110 10594 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.018494  5447 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.023190 10770 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.024065 10877 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.026845 10671 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:55.049849  5450 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:55.050648 10739 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:55.029501  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:55.051371 10714 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:55.017822  5445 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:55.052115  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:55.053560 10877 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.054378  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:55.055800  5450 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:55.056897  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2747) took 1541 ms. Trace:
I20260709 13:17:55.057950  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:55.030226  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:55.032495  5442 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:55.033784  5441 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:55.019874 10698 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:17:55.047927  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85385.1us
I20260709 13:17:55.057466  5449 rpcz_store.cc:276] 0709 13:17:53.515234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.523889 (+  8655us) service_pool.cc:224] Handling call
0709 13:17:53.524198 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.524399 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:17:53.874395 (+349996us) log.cc:844] Serialized 14 byte log entry
0709 13:17:55.018544 (+1144149us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18001ee6e0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a
0709 13:17:55.045843 (+ 27299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:55.056062 (+ 10219us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:55.056280 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.056414 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.056687 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51501,"prepare.queue_time_us":441868,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":7582,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":248,"spinlock_wait_cycles":6190464,"thread_start_us":449430,"threads_started":2,"wal-append.queue_time_us":334606}
I20260709 13:17:55.066754 10698 consensus_queue.cc:1243] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:55.067396 10863 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:55.066504  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:55.077263 10863 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.078240  5446 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:55.064572 10831 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.068871  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2839) took 1187 ms. Trace:
W20260709 13:17:55.071813  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.063908 10594 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:55.072428  5450 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:55.072582  5448 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.097651 10510 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:55.098378 10831 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.090242 10594 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.102360 10594 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.108021 10853 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:55.110797  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:55.115171 10893 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:55.116449 10893 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:55.117230  5522 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:17:55.126138 10863 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.126884 10568 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.137710  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:55.139462  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47959.1us
W20260709 13:17:55.143450 10595 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.856s	user 0.017s	sys 0.003s
I20260709 13:17:55.143990 10595 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.145174  5443 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.147746  5445 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:55.149696 10831 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.153337  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:55.155668  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.156656  5519 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:55.161499 10756 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.163727 10734 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:55.163820  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:55.165107  5444 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:17:55.164896  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:17:55.165771  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 89362.9us
I20260709 13:17:55.157929 10844 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.170992  5443 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:55.163820  5447 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:55.141214  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:55.129213  6077 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:55.211966  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:55.213037 10867 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.366s	user 0.010s	sys 0.016s
I20260709 13:17:55.218026  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:55.082428  5367 rpcz_store.cc:276] 0709 13:17:53.880806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.405016 (+524210us) service_pool.cc:224] Handling call
0709 13:17:54.405471 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.405760 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:54.745583 (+339823us) log.cc:844] Serialized 14 byte log entry
0709 13:17:55.068053 (+322470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:55.068170 (+   117us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:55.068279 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.068408 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.068629 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":394327,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":3094,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":190,"thread_start_us":639065,"threads_started":2,"wal-append.queue_time_us":304685}
I20260709 13:17:55.199116  6076 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
W20260709 13:17:55.234879  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 93671.6us
W20260709 13:17:55.257298  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45597.6us
I20260709 13:17:55.261941  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:55.264658 10360 consensus_meta.cc:287] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.015s
I20260709 13:17:55.271226  5445 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:55.275153  5445 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:17:55.267055 10361 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.860s	user 0.009s	sys 0.009s
I20260709 13:17:55.281111 10886 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.261366 10734 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:55.286384 10722 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.286685 10831 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.282627 10898 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.279699 10617 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:55.286435 10893 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:55.297916  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61320.1us
I20260709 13:17:55.298605 10709 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.301613  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:55.301738 10893 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:55.298012  5444 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:17:55.300249  5373 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:55.300664  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.279699 10832 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.287459 10360 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:55.280311 10361 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.310299 10595 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.320401 10361 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.287251 10826 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.320811 10832 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.321247  5445 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.322557  5371 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 19.
I20260709 13:17:55.323123  5445 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.323715 10832 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.300300 10722 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.327950 10722 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.328480  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:55.329007  5524 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.299870 10617 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.332501  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.338838  5368 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 9.
I20260709 13:17:55.331625 10853 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:55.340158 10853 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.340487  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:55.341787 10898 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:55.343523 10734 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:55.344099  5375 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:55.345386 10896 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:55.346045  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.347898  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.350183 10770 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.298789 10863 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:55.352290 10863 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.352663  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:55.354249 10849 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:55.355003 10849 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:55.310855  5444 pending_rounds.cc:85] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 9
W20260709 13:17:55.336962  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 162998us
I20260709 13:17:55.357663  5444 pending_rounds.cc:107] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:17:55.358100  5444 raft_consensus.cc:2889] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.358340 10826 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.358796 10886 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.341692  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.361150  5367 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:55.336731  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62091.2us
I20260709 13:17:55.374122  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:55.375245  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2183) took 1599 ms (client timeout 1548 ms). Trace:
W20260709 13:17:55.375864  5515 rpcz_store.cc:269] 0709 13:17:53.776066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.776548 (+   482us) service_pool.cc:224] Handling call
0709 13:17:55.374716 (+1598168us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b540016d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:55.374994 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706645376}
I20260709 13:17:55.376523 10685 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:55.386341  5366 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:55.386231  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.385829  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.398509  5368 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 18 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:17:55.360960 10617 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:55.380347  5517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2181) took 1560 ms (client timeout 2025 ms). Trace:
I20260709 13:17:55.385154  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.384418  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:55.385962 10922 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:17:55.405247 10863 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.406953  5374 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:55.409962 10886 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.410660 10852 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.412649  5372 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:55.416359  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:55.416882 10918 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:17:55.419677  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.421931 10833 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:55.422843 10833 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:55.424261 10833 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.425920  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.426855  5369 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:55.428507  5367 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:55.431592 10826 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.433827  5375 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:17:55.377303 10685 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:55.435200 10714 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:55.436719 10685 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.438694 10685 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.380187 10853 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.442397 10689 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:55.442955 10689 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:55.443385  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.444360  5371 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:55.444199 10689 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.383250 10845 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.446744  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:55.380760 10569 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.447808  5375 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:55.442457 10849 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:55.450655 10689 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.386605 10709 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.446823 10845 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.455011  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:55.437644 10910 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.574s	user 0.001s	sys 0.005s
I20260709 13:17:55.445353  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:55.476733 10550 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:55.435441  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:55.499781  5515 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:55.403338  5517 rpcz_store.cc:269] 0709 13:17:53.775540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.811750 (+ 36210us) service_pool.cc:224] Handling call
0709 13:17:55.330638 (+1518888us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54001e6754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:55.335820 (+  5182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196255616}
I20260709 13:17:55.477665 10550 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.508638  5445 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 13:17:55.506744  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 142873us
I20260709 13:17:55.512972  5445 pending_rounds.cc:85] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 5
W20260709 13:17:55.523495  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 88158.7us
I20260709 13:17:55.522807  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:55.525960  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.525799  5445 pending_rounds.cc:107] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:55.499877 10852 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:55.520180  5414 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.025s (SENT)
I20260709 13:17:55.534499  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:55.533877 10830 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:55.542759  5368 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:55.530421  5445 raft_consensus.cc:2889] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.536309 10826 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:55.554620  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.549520 10830 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:55.562536  5448 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:17:55.564479  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:55.557152  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.575496 10704 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.575773 10892 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.582643 10649 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.585537  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.555527 10852 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.586629  5519 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:55.587922  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:55.588825 10852 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.574637 10709 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.582857 10550 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:55.591775  5524 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:17:55.592525  5524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2486) took 2177 ms (client timeout 1923 ms). Trace:
W20260709 13:17:55.592935  5524 rpcz_store.cc:269] 0709 13:17:53.414685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.414929 (+   244us) service_pool.cc:224] Handling call
0709 13:17:53.894222 (+479293us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001fe8a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d0a06f 00007fc1d3d82f60 00007fc1d3d847de 00007fc1d3d9027c 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2
0709 13:17:55.327400 (+1433178us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b54001fe8a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d01a1d 00007fc1d3ce81a4 00007fc1d3d6a447 00007fc1d3d82fe7 00007fc1d3d847de 00007fc1d3d9027c 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591
0709 13:17:55.592426 (+265026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672688384}
I20260709 13:17:55.561055 10826 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.603192  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.574070 10849 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:55.606464  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66508.7us
I20260709 13:17:55.615926  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:55.600888 10711 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.604449 10826 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:55.629045  5368 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:55.632510 10550 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:55.618644 10594 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.651870 10550 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:55.653543 10550 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.665943  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:55.665303  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:55.668083  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:55.685202  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 179924us
I20260709 13:17:55.690644  5375 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:55.694408 10507 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:17:55.687305  5416 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.543s (SENT) [suppressed 25 similar messages]
I20260709 13:17:55.701956  5368 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:55.657794 10594 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.689996 10704 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:55.689823 10852 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:55.700907 10649 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:55.705351  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 186030us
I20260709 13:17:55.633806 10711 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.718228 10830 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.719769  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.722935 10594 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.709836  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:55.714195  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 174318us
W20260709 13:17:55.715701  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.716898  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:55.692526 10859 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:55.712108 10704 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.728965 10704 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.729089 10657 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.731264  6069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 191) took 1618 ms. Trace:
I20260709 13:17:55.714874 10852 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.732820 10852 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:55.731995  6069 rpcz_store.cc:276] 0709 13:17:54.112649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.114206 (+  1557us) service_pool.cc:224] Handling call
0709 13:17:54.144921 (+ 30715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.062153 (+917232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.730775 (+668622us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400409f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:55.731139 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1962494208}
I20260709 13:17:55.738993 10877 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.744290  5450 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:55.748085  5449 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:55.714013 10649 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.749795 10649 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.753364  5442 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:55.783437 10617 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.783834  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:55.755062 10657 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:55.755343  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:55.754841  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:55.787353  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.788841  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.790150  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.791863  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:55.793125  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.755604 10844 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:55.794732  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.794967  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.797140  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.799160  5521 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:55.759128  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.847561  5523 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:55.760174  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:55.763621  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.760259  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:55.757850  5375 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:55.760553  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:55.789098 10927 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.095s	user 0.000s	sys 0.003s
W20260709 13:17:55.817305  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.822103  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.824213 10727 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.804476 10845 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.825672 10649 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:55.830051  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 272441us
I20260709 13:17:55.759917  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:55.860396  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 105166us
W20260709 13:17:55.859664  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43765.4us
I20260709 13:17:55.863481  5450 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:55.859619  5373 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:17:55.865770  5372 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:55.865484  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81773.6us
I20260709 13:17:55.876739  5445 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:55.865599  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:55.865666  5366 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:55.881541  5441 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:55.873188  5374 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:17:55.892373  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.893827  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:55.894636  5523 raft_consensus.cc:2368] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
I20260709 13:17:55.895884  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.896983  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.901207  5370 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:55.902796  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.863988 10714 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:55.863631 10859 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.906971  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.906908 10859 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.907444  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.907871  5517 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:55.863420 10845 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:55.911652 10845 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:55.909125  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.912672  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.909092  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:55.913849  5375 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
I20260709 13:17:55.914847  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.915131  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.915948  5367 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:55.915453  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.917804  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.918290  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:55.919736  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:55.920579  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 148920us
I20260709 13:17:55.920768  5515 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:55.922259  5369 raft_consensus.cc:2368] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:55.922726  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:55.923141  5443 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:55.923955  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:55.924625  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:55.924928  5366 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:55.925937  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:55.927114  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.875905 10569 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:55.927845  5366 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:55.928243 10569 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.928720 10569 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.928911  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:55.923154  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:55.930742  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:55.931092 10938 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:55.932353 10507 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:55.933310  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:55.933068 10507 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:55.934943  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:55.909776  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:55.938567  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 54115.7us
I20260709 13:17:55.915990  5375 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:17:55.917299  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:55.942863  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 188145us
I20260709 13:17:55.913841  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.945592  5366 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.874711  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:55.944653  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.948365  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.954406  6077 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:55.955166 10886 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:55.955775 10886 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:55.956548 10649 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:55.958458  5521 raft_consensus.cc:2376] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17. Re-sending same reply.
I20260709 13:17:55.959972  6076 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:55.961717  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:55.963570  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:55.966606  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.922772  5515 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:55.965200  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.978644  5449 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:17:55.874887 10685 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:55.981009  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.989993  5367 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:55.991824  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:55.992759  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:55.995893  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:55.989172 10936 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:56.002662  5373 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:55.985340 10685 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.986158 10859 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.020852  5366 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:56.037154  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.038707  5375 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:56.031458  5374 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:56.027091  5516 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:56.046576  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:56.046830  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.053179  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:56.054133  5370 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:56.057344  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.045531  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:56.065650  5367 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:56.067487  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:56.015443 10649 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.991645 10849 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:17:56.072371  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:56.028061 10685 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:56.074592  6076 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:56.078735  5366 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:56.083371  6072 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:56.005303 10844 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:17:56.087743  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 217845us
I20260709 13:17:56.075493  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:56.010439  5442 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:56.063763 10830 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:56.097457  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:56.029733 10826 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.102656  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:56.083611 10756 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.132498  5374 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:56.115254  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:56.136833  5366 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:17:56.118479  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.121563  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 200631us
I20260709 13:17:56.126890  5367 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:56.084157 10940 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:17:56.140533  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75320us
I20260709 13:17:56.141312 10550 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:56.143102  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 131991us
W20260709 13:17:56.149866  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 136500us
I20260709 13:17:56.152616  5368 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:56.159557  5370 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:17:56.161375  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 134459us
I20260709 13:17:56.155784  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.176292  5373 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:56.188133  6043 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:56.189384  5367 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:56.191372 10940 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:56.191990 10940 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.192461 10940 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:56.194382  5449 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 13:17:56.198979 10826 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:56.200687 10944 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:17:56.203778 10507 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.205071 10507 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:56.205732 10937 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.151882 10886 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.215575  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.158998 10617 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:56.214298  5519 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:56.220878 10360 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.145574 10756 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.223721 10756 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.164371 10844 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:56.226827 10711 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:56.228359 10844 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:56.169209 10859 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.229542 10835 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.229861 10859 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.230253 10835 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.230841 10852 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.232473 10835 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.184378 10830 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:17:56.181864 10550 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:56.221347  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 65693.7us
I20260709 13:17:56.234066 10550 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:56.237931  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51055us
I20260709 13:17:56.240298  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.243371 10826 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:56.245991 10833 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:56.246878 10833 consensus_queue.cc:1243] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 19.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:56.247330 10510 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:56.247771 10510 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:56.220093  5374 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:56.246166 10360 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.249019 10617 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.249692  6043 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.251549  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:56.249699 10617 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.254730 10892 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.255373 10617 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:56.255697 10892 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.256152 10946 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:56.256958 10946 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.257364 10946 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.208227  5375 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:56.271538 10937 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.232513 10859 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.275328 10685 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.276662  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.248986 10510 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:56.285516  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69903.6us
I20260709 13:17:56.284686 10510 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:56.174721 10704 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.279808 10617 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.307772  5372 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:17:56.320377 10852 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.321573 10844 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:56.323715 10704 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.256628 10892 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.328835 10892 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.294332 10859 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.335572 10711 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:56.337718  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 61137.3us
I20260709 13:17:56.339349 10657 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:56.340428 10886 raft_consensus.cc:2764] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:17:56.332856 10946 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:56.345723 10711 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:56.347875 10943 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:17:56.339727  5339 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.349148  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:56.349888 10704 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:56.350009  5372 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.288846 10937 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:17:56.351642 10830 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:56.352778 10937 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:56.353204 10937 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:56.354578 10937 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:56.275328 10569 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.356482 10689 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:56.356295 10617 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.357704 10892 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:56.360873  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.362728 10830 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:56.408174  5372 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
W20260709 13:17:56.414335  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53556.9us
I20260709 13:17:56.416461  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.373644 10946 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:56.419237  6043 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:56.418744  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 385963us
I20260709 13:17:56.435869  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.437589  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.437834 10714 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:56.438647 10714 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:56.439394  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:56.440059 10714 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.435940 10685 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.437657 10569 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.441062  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.447907 10940 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:56.430495 10859 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:56.458135 10859 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:56.469316  5414 leader_election.cc:400] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
I20260709 13:17:56.469869  5414 leader_election.cc:403] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:56.492683  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.458067 10937 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.503585  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.503870  5518 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:56.504367  5515 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:56.505302  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:56.505867  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.506521  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.508002  5522 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:56.512142 10689 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:56.462549 10935 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:56.514129 10935 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:56.515581 10935 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:56.437981 10704 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:56.519002 10617 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:56.500779  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.520262 10617 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:56.533856  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 111127us
I20260709 13:17:56.535820  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:56.536605 10507 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15.
I20260709 13:17:56.545130  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:56.537721 10507 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:56.576686  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.581525  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:56.582428  5374 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:56.574407 10507 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:56.586776  6040 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.015s	sys 0.011s
I20260709 13:17:56.587890  5519 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:56.591684  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:56.578109 10830 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:56.596582  5521 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:56.539927 10617 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:17:56.611904  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.613184  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.614166  5519 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:56.590142 10507 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:56.617558  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.599145 10709 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:56.600044 10830 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:56.633011  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 475537us
I20260709 13:17:56.643173  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:56.645272  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:56.647737  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.656776  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 493265us
I20260709 13:17:56.665402  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:56.649843 10510 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.681926  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:56.662156 10950 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.648759 10709 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:56.690366  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 346166us
I20260709 13:17:56.692580  5519 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:56.696189  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 243328us
I20260709 13:17:56.620592 10859 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.681668 10657 consensus_queue.cc:1243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:17:56.689069 10849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.006s	sys 0.006s
I20260709 13:17:56.690279 10940 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.711665  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:56.709024 10657 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.716598  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:56.710774 10849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.007s	sys 0.007s
I20260709 13:17:56.745558  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:56.747519  5519 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.715180 10953 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.714417 10964 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:56.709714 10510 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.759946  6072 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:56.743223 10950 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:56.765386  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:56.746243 10954 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:56.777952  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:17:56.784551 10952 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:17:56.778378 10964 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.748167 10657 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:56.786468 10950 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.787319 10964 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:56.755295 10849 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:56.792982  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.793304  5519 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
W20260709 13:17:56.797953  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 96686.9us
I20260709 13:17:56.802354  6077 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:56.800770  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:56.787557 10657 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:56.808389 10956 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:56.809048 10956 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.809523 10956 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:56.761736 10953 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.815536 10953 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.725754 10830 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.818529 10830 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:56.825973 10689 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:56.828043 10510 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.830561 10892 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:56.831629 10892 consensus_queue.cc:1243] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 53eb858bdf82438d83f1be6a01da2e0e log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:56.832118 10953 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:56.832548 10953 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:56.833855 10953 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:56.835428 10953 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:56.837457  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44562.2us
I20260709 13:17:56.838287  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:56.839160  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:56.805990 10886 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:56.841830 10962 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:56.842957  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:56.843732 10569 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:56.844770 10569 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:56.845217 10569 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:56.846570 10569 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.848387  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2799) took 1003 ms. Trace:
I20260709 13:17:56.849195 10973 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.850083 10973 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.848865  5442 rpcz_store.cc:276] 0709 13:17:55.844851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.844979 (+   128us) service_pool.cc:224] Handling call
0709 13:17:55.850238 (+  5259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.877682 (+ 27444us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:56.400669 (+522987us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.760749 (+360080us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.765563 (+  4814us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.782770 (+ 17207us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.782911 (+   141us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:56.782948 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.783042 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.848113 (+ 65071us) raft_consensus.cc:1685] finished
0709 13:17:56.848137 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.848323 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60852,"prepare.queue_time_us":9923,"prepare.run_wall_time_us":49,"raft.queue_time_us":100271,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":47888,"spinlock_wait_cycles":21603840,"thread_start_us":253286,"threads_started":1,"wal-append.queue_time_us":386579}
I20260709 13:17:56.851500 10714 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:56.851933 10569 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.852382 10973 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:56.852959 10973 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:56.841899 10886 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:56.787922 10964 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:17:56.867789  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:56.860765  5374 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 20.
I20260709 13:17:56.829088 10689 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:56.853286 10973 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:56.800776 10550 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:56.844260 10852 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:56.865872 10704 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.804416 10845 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:17:56.879310 10886 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:56.886708 10657 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:56.907922  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 243783us
I20260709 13:17:56.892954 10955 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.804230 10849 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:56.885700 10510 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:17:56.902020 10852 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.806969 10954 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.909409 10689 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.913611 10972 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.911779 10657 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:56.931984  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:56.936538  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 132770us
I20260709 13:17:56.902127 10550 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.926419 10852 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.929126 10704 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:17:56.942519  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 101136us
I20260709 13:17:56.935138 10657 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:56.938769 10953 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.938825 10709 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.925642 10955 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.945798 10704 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:56.962303  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.962931 10954 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.935312 10972 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.958763 10960 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.968395 10704 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:56.939246 10974 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:17:56.958803 10950 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.947800 10973 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:56.964376 10550 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:56.983402  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:56.984333 10957 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:56.984149 10978 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:56.982057 10980 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:56.985227 10964 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:56.997885 10594 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:56.998414 10594 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:56.999585 10594 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:57.000892 10594 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.002314 10978 consensus_queue.cc:1243] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:57.003055 10978 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:57.003832 10978 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:57.005723 10978 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.007133 10978 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:57.003362 10727 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:57.008955 10827 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:17:57.009630 10727 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:57.010857 10727 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:57.013283  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.016291 10961 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:17:57.016997  5415 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:57.018366 10877 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.018811 10877 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:57.019196 10877 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.019784 10510 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:57.020517 10510 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.023240 10510 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.988370 10689 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:17:57.070415  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:57.070263 10877 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:57.075516 10971 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:17:57.078649 10844 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.079339 10844 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.082006 10844 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.084013 10877 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:57.052546 10594 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:57.054143 10507 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.088774 10507 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:57.062134 10976 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:57.088045 10852 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:57.062915 10849 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:57.063697 10964 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.090940 10964 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.091811 10886 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:57.047204  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 70543.2us
I20260709 13:17:56.977413 10979 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:17:57.066360 10980 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:57.093394 10980 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:57.065760 10955 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:56.968562 10963 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:17:57.064806 10972 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.067467 10973 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:57.084995  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.086103  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:57.093743  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:56.989033 10960 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.067131  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2848) took 1155 ms. Trace:
I20260709 13:17:57.094380 10980 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.104396  5369 rpcz_store.cc:276] 0709 13:17:55.911963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.134441 (+222478us) service_pool.cc:224] Handling call
0709 13:17:56.181613 (+ 47172us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:56.241905 (+ 60292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.241946 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:56.242678 (+   732us) log.cc:844] Serialized 52 byte log entry
0709 13:17:56.688773 (+446095us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:56.688833 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.688939 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.066894 (+377955us) raft_consensus.cc:1685] finished
0709 13:17:57.066913 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.067077 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23541,"raft.queue_time_us":28663,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":445641,"threads_started":1,"wal-append.queue_time_us":547882}
I20260709 13:17:57.115343 10980 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.103562 10852 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:57.118573  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:57.119673 10955 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:57.120507 10955 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:57.124236 10849 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:57.124785 10704 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.127108 10704 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.127012  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:57.128094 10955 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:57.128473 10955 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:57.128882 10955 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.129948  6072 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:57.131430  5415 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:57.131785 10727 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.132340 10507 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:57.132880 10507 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:57.133895 10507 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:57.134383 10956 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.135174 10960 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.134805  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:57.137059 10956 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.093210 10964 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:57.152985  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:57.151429  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 164678us
I20260709 13:17:57.155471  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:57.158367  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 174839us
W20260709 13:17:57.144429  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 276747us
I20260709 13:17:57.174675  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:17:57.178110  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.178890  5369 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:57.177488  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:57.152300 10972 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:57.176402 10594 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:57.124267 10657 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:57.182096 10960 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:57.181921 10956 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:57.199651  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:57.201327  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.200496  5521 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:17:57.202392  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.203120  5519 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:57.176760 10963 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:17:57.186522 10972 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:57.205602  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:57.235277  5516 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.206372  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:57.236570  5523 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:57.184235 10940 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:17:57.213327  5267 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 154) took 16820 ms (client timeout 15000 ms). Trace:
I20260709 13:17:57.215262  5366 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:57.194612 10594 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:57.217523 10886 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.217643  5371 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:17:57.229866 10984 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:57.193835 10982 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:57.231257 10859 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:57.238021 10972 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:57.256775 10859 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:57.258893  5521 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:17:57.218192  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43590.9us
W20260709 13:17:57.233124  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 44729.8us
I20260709 13:17:57.233558  5370 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:57.219770  5268 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 44) took 10767 ms. Trace:
I20260709 13:17:57.183243 10704 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:57.261857  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:57.216647  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:57.220209  5522 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:57.249306  5369 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:57.195561 10960 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:57.255231  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:57.256232  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:57.184199 10964 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:17:57.280025  5442 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:57.257815 10982 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:57.290025  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:57.219991 10657 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:57.291730  5366 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 8. (term mismatch)
I20260709 13:17:57.292086  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:57.251246 10594 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.301247  5449 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:57.291522  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:57.308058  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:57.305648  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:57.309437  5448 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:57.311445  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:57.255865  5269 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 16, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 16 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:17:57.300474  5366 pending_rounds.cc:85] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 7
I20260709 13:17:57.303149  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:57.318413  5446 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:57.319169  5441 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:17:57.321197  5366 pending_rounds.cc:107] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 18.8
I20260709 13:17:57.281057 10960 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:57.288829 10849 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:57.325852  5366 raft_consensus.cc:2889] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.321563  5371 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.334311  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:57.339979  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:57.343237  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53890.2us
I20260709 13:17:57.337002  5269 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 13 to 14, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 14 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.324478 10852 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.347553  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:57.324330 10886 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.319057 10704 consensus_queue.cc:1243] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 17.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:57.349841  5441 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:57.335539 10849 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.365571  5372 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:17:57.366353  5519 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:57.368844  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:57.368747  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.371917  5520 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:17:57.364243  5269 catalog_manager.cc:5697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.342428 10844 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:57.373888  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.374862  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:57.376376  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83464.6us
I20260709 13:17:57.380816  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:57.381714  5519 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:57.382004  5518 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:17:57.380921  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:57.386606  5441 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:57.391479  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:57.398607  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:57.401435  5524 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:57.363713 10569 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.353819 10886 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:57.411958  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.363464 10877 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:57.416898  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:57.405030 10953 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:57.421214  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:57.405313  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:57.360544 10985 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:57.426998  5375 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:57.413805  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.373083 10849 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.420002  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:57.434195  5449 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:57.433004  5372 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:57.425951  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:57.435235  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.436309  5521 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:57.434345  5373 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:17:57.429683  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:57.264547  5268 rpcz_store.cc:276] 0709 13:17:46.451132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.451645 (+   513us) service_pool.cc:224] Handling call
0709 13:17:57.218625 (+10766980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:55.215085 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:55.215994 (+   909us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:55.216067 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:17:55.216127 (+    60us) tablet.cc:662] Decoding operations
0709 13:17:55.217086 (+   959us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:55.217230 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:55.217275 (+    45us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:55.285687 (+ 68412us) tablet.cc:701] Row locks acquired
0709 13:17:55.303051 (+ 17364us) write_op.cc:260] PREPARE: finished
0709 13:17:55.386645 (+ 83594us) write_op.cc:270] Start()
0709 13:17:55.386848 (+   203us) write_op.cc:276] Timestamp: P: 1783603075367510 usec, L: 0
0709 13:17:55.386895 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:17:55.447260 (+ 60365us) log.cc:844] Serialized 1673 byte log entry
0709 13:17:55.736563 (+289303us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:55.836096 (+ 99533us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b18000d2e80. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d3d09190 00007fc1d3d02ae7 00007fc1d3d01dd9 00007fc1d3d0c930
0709 13:17:56.283688 (+447592us) op_driver.cc:464] REPLICATION: finished
0709 13:17:56.781562 (+497874us) write_op.cc:301] APPLY: starting
0709 13:17:56.784314 (+  2752us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:56.810337 (+ 26023us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:56.810383 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:56.812863 (+  2480us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:56.813120 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:17:56.813184 (+    64us) write_op.cc:312] APPLY: finished
0709 13:17:56.893507 (+ 80323us) log.cc:844] Serialized 48 byte log entry
0709 13:17:56.911280 (+ 17773us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:56.918595 (+  7315us) write_op.cc:454] Released schema lock
0709 13:17:56.926799 (+  8204us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:56.964540 (+ 37741us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:56.964582 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1767406,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":479464,"apply.run_cpu_time_us":9027,"apply.run_wall_time_us":174700,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20847,"num_ops":4,"prepare.queue_time_us":209755,"prepare.run_cpu_time_us":32241,"prepare.run_wall_time_us":486275,"raft.queue_time_us":544596,"raft.run_cpu_time_us":11867,"raft.run_wall_time_us":378149,"replication_time_us":896493,"spinlock_wait_cycles":167108864,"thread_start_us":881664,"threads_started":4,"wal-append.queue_time_us":247782}]]}
I20260709 13:17:57.442677  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.443251  5518 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
W20260709 13:17:57.243119  5267 rpcz_store.cc:269] 0709 13:17:40.392522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.463999 (+ 71477us) service_pool.cc:224] Handling call
0709 13:17:41.853343 (+1389344us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5400002490. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c68640 00007fc1d9b3fb76 00007fc1d9c49c3e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:57.213046 (+15359703us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:48.449366 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:48.492841 (+ 43475us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:48.517737 (+ 24896us) write_op.cc:435] Acquired schema lock
0709 13:17:48.520137 (+  2400us) tablet.cc:662] Decoding operations
0709 13:17:48.674555 (+154418us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:48.674662 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:48.674694 (+    32us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:17:48.676685 (+  1991us) tablet.cc:701] Row locks acquired
0709 13:17:48.677004 (+   319us) write_op.cc:260] PREPARE: finished
0709 13:17:48.677204 (+   200us) write_op.cc:270] Start()
0709 13:17:48.677376 (+   172us) write_op.cc:276] Timestamp: P: 1783603068677129 usec, L: 0
0709 13:17:48.691145 (+ 13769us) op_driver.cc:348] REPLICATION: starting
0709 13:17:48.800178 (+109033us) log.cc:844] Serialized 9016 byte log entry
0709 13:17:49.570501 (+770323us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d87e28 00007fc1d77c2581 00007fc1d77c1d58 00007fc1d77c69f1 00007fc1d77c69a9 00007fc1d77c6939 00007fc1d77c6901 00007fc1d77c5b2d 000000000038f354 000000000038f199
0709 13:17:50.009282 (+438781us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5400351720. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d01dbe 00007fc1d3d0c930 00007fc1d3d0c8d8 00007fc1d3d0c858 00007fc1d3d0c813 00007fc1d3d0ba9c 00007fc1d9bf7626 00007fc1d9bf1dd8 00007fc1d3d487cb 00007fc1d3d4b2c0
0709 13:17:50.298527 (+289245us) op_driver.cc:464] REPLICATION: finished
0709 13:17:50.358636 (+ 60109us) write_op.cc:301] APPLY: starting
0709 13:17:50.358742 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:50.448096 (+ 89354us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:50.448143 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:50.815702 (+367559us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5c0010610c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9f7e331 00007fc1d9f7e221 00007fc1d9f78f6c 00007fc1d76d930b 00007fc1d76d8fd3 00007fc1d77d7e34 00007fc1d77c397c 00007fc1d77c7d61 00007fc1d77c7d19 00007fc1d77c7ca9 00007fc1d77c7c71
0709 13:17:52.287838 (+1472136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:52.288467 (+   629us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:17:52.288531 (+    64us) write_op.cc:312] APPLY: finished
0709 13:17:52.289100 (+   569us) log.cc:844] Serialized 203 byte log entry
0709 13:17:52.363099 (+ 73999us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:52.363302 (+   203us) write_op.cc:454] Released schema lock
0709 13:17:52.363390 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:52.364101 (+   711us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:52.364140 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":937002,"reported_tablets":56,"spinlock_wait_cycles":6119808,"child_traces":[["op",{"apply.queue_time_us":59727,"apply.run_cpu_time_us":71518,"apply.run_wall_time_us":2005437,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100267,"num_ops":23,"prepare.queue_time_us":512358,"prepare.run_cpu_time_us":31923,"prepare.run_wall_time_us":1121418,"raft.queue_time_us":195075,"raft.run_cpu_time_us":9432,"raft.run_wall_time_us":24731,"replication_time_us":1579955,"spinlock_wait_cycles":46508416,"thread_start_us":779733,"threads_started":5,"wal-append.queue_time_us":184704,"wal-append.run_cpu_time_us":38197,"wal-append.run_wall_time_us":3437200}]]}
I20260709 13:17:57.408284 10956 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:57.367182 10852 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.450752  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:57.451347  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:57.463335  5366 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:57.438627  5269 catalog_manager.cc:5697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 16, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 16 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.446228  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:57.450454  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.374262 10988 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:17:57.419343 10886 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.466348  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:57.467206  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:57.462127  5373 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:57.476609  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:57.421620 10953 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.474259  5522 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:17:57.440361 10507 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.487124  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:57.433296 10985 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.446141 10954 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:57.394780 10844 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.493327  5269 catalog_manager.cc:5697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:57.504174  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 74599us
I20260709 13:17:57.506908  5366 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:17:57.484407  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.418906 10569 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.454816 10956 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:57.510387  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:57.491752 10953 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.460052 10951 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:17:57.522696  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:57.558423  5516 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:57.497102 10954 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.515383  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:57.511346  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 130996us
I20260709 13:17:57.497879 10985 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:57.579185 10993 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:57.577874 10964 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:57.582482  5372 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
W20260709 13:17:57.577255  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54637.5us
I20260709 13:17:57.534039 10956 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:57.566637  5269 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 12, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 12 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:17:57.560727 10709 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.496222 10657 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:17:57.618007  5269 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.577739 10859 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:57.626322  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.627656  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:57.584751 10954 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:57.518821 10983 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:17:57.702632 10709 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:57.547459 10963 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:17:57.560958 10978 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:17:57.607177 10993 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:17:57.710547  5367 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:17:57.716167 10852 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.738521  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:57.744408  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:57.645112 10689 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:17:57.755968 10689 consensus_queue.cc:1243] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 16.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:57.765151  5523 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
W20260709 13:17:57.767675  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.761147  5269 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:57.750473 10990 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 13:17:57.766525  5523 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
W20260709 13:17:57.753122 10955 consensus_meta.cc:287] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.002s
W20260709 13:17:57.787905  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43606.2us
I20260709 13:17:57.789947  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:57.792953  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 54570.7us
W20260709 13:17:57.796761  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 182647us
I20260709 13:17:57.799289  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:57.797230  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:57.761874 10951 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:57.810989  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:57.827421 10617 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:57.828120 10617 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.828585 10617 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:57.845587  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 339429us
I20260709 13:17:57.847548  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:57.811429 10989 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:17:57.819006 10963 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:57.789597 10955 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.809055 10978 raft_consensus.cc:2764] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:17:57.810757 10893 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:17:57.818809 10964 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 13:17:57.902812  5371 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.004s
I20260709 13:17:57.907104  5371 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
W20260709 13:17:57.915988  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 116669us
W20260709 13:17:57.891172 10714 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.003s	sys 0.002s
I20260709 13:17:57.918511  5444 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:57.924166  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96390.3us
W20260709 13:17:57.900127 10968 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:17:57.885490 10963 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:57.959630  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.008s	sys 0.032s
W20260709 13:17:57.960084  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.008s	sys 0.032s
W20260709 13:17:57.952584 10714 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.003s	sys 0.002s
W20260709 13:17:57.959040 10996 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 13:17:57.982304  5269 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 13 to 16, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 16 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.959751 10844 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.890623 11011 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:17:57.964679 10963 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.997749  5269 catalog_manager.cc:5697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 9 to 15, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.970165 10569 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:57.981812 10978 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:58.012977  5371 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:57.978022 10964 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:17:58.039760  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85939.7us
I20260709 13:17:58.024755 10844 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.013398 11022 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:58.028812 10994 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.307s	user 0.000s	sys 0.003s
I20260709 13:17:58.015821 10978 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.018290 10714 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:57.821095 10951 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:57.414606 10982 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:57.811618 10993 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:58.094758  5269 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.037334 10950 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:58.051440 11011 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:17:58.103489  5340 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.002s	sys 0.001s
W20260709 13:17:58.103996  5340 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.002s	sys 0.001s
W20260709 13:17:58.104362  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 507032us
I20260709 13:17:58.049255 10893 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:58.067405 10978 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:58.100085  5366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.004s
I20260709 13:17:58.105783  5269 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 13, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 13 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:58.123692  5366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.004s
W20260709 13:17:58.100248  5373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.003s
W20260709 13:17:58.124666  5373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.004s
W20260709 13:17:58.125133  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.138054 10830 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.138705 10830 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.139730 10951 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.141650 10955 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:58.143975 10727 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.012s	user 0.011s	sys 0.002s
I20260709 13:17:58.141099 10830 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.077994 11022 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.147605 11022 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.151113 10617 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.158977 11032 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:58.081128 10714 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:58.159792 11032 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.161249 10714 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.162194 11027 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:58.162688 11027 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.106094 11011 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:58.163224 11027 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:58.163753 11016 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:58.163843 10827 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:58.164438 11020 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.164530 10827 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:58.165072 11020 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:58.165894 10998 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:17:58.165691 10827 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.167049 10827 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.167726 11020 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.165022  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:58.163058  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.162725 10714 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:58.169600 11003 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:17:58.170532 11007 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:17:58.172478 10991 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.676s	user 0.002s	sys 0.000s
I20260709 13:17:58.178478  5524 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.178719  5448 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:17:58.195389  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:58.193924 10956 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.181950 10973 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.045s	user 0.010s	sys 0.003s
I20260709 13:17:58.201247 10955 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:58.197274 10980 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.081s	user 0.010s	sys 0.004s
I20260709 13:17:58.210814  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:58.184932  5370 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:17:58.273588 10849 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.807s	user 0.012s	sys 0.000s
I20260709 13:17:58.298209  5370 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:58.229197  5517 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:58.292613  5520 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
W20260709 13:17:58.171788 11000 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:17:58.269809 10967 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:58.186139  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.283483 10954 consensus_meta.cc:287] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.004s
I20260709 13:17:58.272238  5515 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:17:58.095613 11024 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:58.272920  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:58.229768 10877 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.783s	user 0.010s	sys 0.002s
I20260709 13:17:58.198805 10963 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.267937 10617 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.286161  5516 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
W20260709 13:17:58.332809  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.285408 11006 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:17:58.190551 10960 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.846s	user 0.002s	sys 0.008s
W20260709 13:17:58.190707  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.313882 10507 consensus_meta.cc:287] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.809s	user 0.005s	sys 0.007s
W20260709 13:17:58.137219 10594 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.004s
I20260709 13:17:58.180812 11032 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.301473  5370 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.322201  5490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.006s	sys 0.005s
W20260709 13:17:58.357594  5490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.006s	sys 0.005s
I20260709 13:17:58.356920  5524 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
W20260709 13:17:58.335122  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62283.1us
W20260709 13:17:58.276435 10886 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.002s
W20260709 13:17:58.343851  5450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.000s	sys 0.012s
I20260709 13:17:58.357609  5370 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:58.314306  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 394828us
I20260709 13:17:58.359182  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:58.359470  5450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.001s	sys 0.012s
I20260709 13:17:58.360881  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:58.365698  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:58.347034  6041 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.006s
W20260709 13:17:58.372130  6041 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.007s	sys 0.007s
I20260709 13:17:58.319696 10569 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.374543  5523 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:58.283766 10978 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.372473 10983 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.000s	sys 0.013s
W20260709 13:17:58.358103  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 536471us
I20260709 13:17:58.394748  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:58.396337  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:58.397897  5490 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:17:58.375574  5415 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.017s	sys 0.019s
I20260709 13:17:58.318053 10877 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:58.317629 11024 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.345790 10988 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.412196  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:58.301224 10955 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.372884  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 578207us
W20260709 13:17:58.398953  5415 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.018s	sys 0.020s
I20260709 13:17:58.385264  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:58.415673  5516 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:58.413087  5520 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:17:58.317726 10954 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.406384  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:58.355706 10704 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.368170 11018 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.410470  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:58.307746 10849 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.423478  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.422830  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:17:58.399863  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.008s	sys 0.009s
I20260709 13:17:58.163882 11011 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.373503 10510 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:58.448194  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 466280us
W20260709 13:17:58.423856  5447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.013s	sys 0.018s
W20260709 13:17:58.394166 10983 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.000s	sys 0.014s
I20260709 13:17:58.380505 10507 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:58.427322  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.427992  5524 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:17:58.430766  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:58.430787  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:58.423552 11022 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:58.393574 10973 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.313516 10967 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.408288 10727 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:58.357025 10960 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.447183  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.008s	sys 0.009s
I20260709 13:17:58.408601 10689 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:58.450445  5447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.014s	sys 0.019s
I20260709 13:17:58.452009  5441 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:58.387434 10980 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:58.373037 10594 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.373266 10886 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.408882 11024 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:58.456894  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.408326 10569 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:58.458042  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47676.2us
W20260709 13:17:58.472013  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 98060.7us
I20260709 13:17:58.462867  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:58.511198  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:58.500326  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.466344 10689 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:58.355408 11006 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.515789  5442 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:58.426091 10988 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.435793 10704 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.533300  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 685810us
I20260709 13:17:58.465162 10727 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:58.470952 11009 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.464432 11043 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:58.478711 11011 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.551000  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:58.552140 10727 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:58.553243 10978 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.576972 11014 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:58.553509 11036 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:58.580009 11006 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.580467 11036 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:58.580598 11006 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.580931 11035 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.553753 10569 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:58.553901 10983 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:58.554580 11034 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:17:58.555495 11033 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:17:58.556408 10950 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:58.556550 11026 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:17:58.557523 11038 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.564682 10849 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.565657 10830 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:58.566431 10956 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.566746 10963 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.468358 10973 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.570631 10960 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.571166 10594 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.572573 10886 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:58.573225 10981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.016s	sys 0.014s
W20260709 13:17:58.575721 10953 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.977s	user 0.008s	sys 0.003s
W20260709 13:17:58.576010 10985 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.932s	user 0.004s	sys 0.007s
I20260709 13:17:58.576067 10988 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.531805 11012 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:58.582135  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 216548us
I20260709 13:17:58.582201  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2813) took 1303 ms. Trace:
W20260709 13:17:58.589151  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.595456  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:58.663246 10985 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.665982  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 70617.4us
W20260709 13:17:58.666298 10844 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.001s
I20260709 13:17:58.666740 10844 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:58.667788 10985 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.667763 11012 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.587009 11036 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.669782 10953 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.672307 10953 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.673661  5449 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:58.674080  5372 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:58.675971  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:58.676592 10983 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:58.677093 10983 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.683353  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:58.684520  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:58.685782  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.685945  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:17:58.688064  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.603897 10709 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:17:58.581096 11006 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.607110 10704 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.607878 10877 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:17:58.608484  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.558203 11005 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:58.572573 10954 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.647835 10830 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:58.533164 10689 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:58.646790  5366 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.011s
W20260709 13:17:58.732658  5366 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.007s	sys 0.011s
I20260709 13:17:58.593993 10569 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:58.581519 11035 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:58.619275 10950 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.751947 11024 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.753551 10972 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.496s	user 0.010s	sys 0.005s
I20260709 13:17:58.754447 11024 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:58.652341 11004 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:17:58.653316 11041 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:17:58.596223  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:58.630002 11014 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:58.682766  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:58.678895 10727 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:58.692588  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.693365  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:58.674518 10981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.293s	user 0.016s	sys 0.014s
W20260709 13:17:58.698719  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 187588us
I20260709 13:17:58.701342  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:58.702414  5368 raft_consensus.cc:1217] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Deduplicated request from leader. Original: 13.5->[15.6-19.8]   Dedup: 15.6->[17.7-19.8]
I20260709 13:17:58.703716  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:58.680711  5450 rpcz_store.cc:276] 0709 13:17:57.290532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.290898 (+   366us) service_pool.cc:224] Handling call
0709 13:17:57.324394 (+ 33496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.324639 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:57.525621 (+200982us) log.cc:844] Serialized 14 byte log entry
0709 13:17:57.776925 (+251304us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.360778 (+583853us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.581842 (+221064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.581898 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:58.581939 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.582004 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.582135 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257625,"prepare.queue_time_us":159169,"prepare.run_cpu_time_us":155,"prepare.run_wall_time_us":5957,"raft.queue_time_us":631142,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":217,"thread_start_us":948361,"threads_started":3,"wal-append.queue_time_us":329270}
I20260709 13:17:58.610245 11009 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.623905  5370 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:17:58.651397 10982 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.713821 10877 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:58.714211 10709 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.715301  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:58.716251 10955 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:58.722201 11054 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:58.722942  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:58.724017  5443 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:58.665500 10973 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.725107  5448 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:58.777180  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2867) took 1518 ms. Trace:
I20260709 13:17:58.680455 10983 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:58.784340  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2815) took 1489 ms. Trace:
W20260709 13:17:58.698529 11026 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:17:58.806067  5447 rpcz_store.cc:276] 0709 13:17:57.295084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.297528 (+  2444us) service_pool.cc:224] Handling call
0709 13:17:57.297882 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.302861 (+  4979us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:57.420957 (+118096us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.468182 (+1047225us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.610118 (+141936us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.647331 (+ 37213us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.647481 (+   150us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:58.647518 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.647592 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.784054 (+136462us) raft_consensus.cc:1685] finished
0709 13:17:58.784080 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.784259 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":287227,"prepare.queue_time_us":113886,"prepare.run_cpu_time_us":174,"prepare.run_wall_time_us":8227,"raft.queue_time_us":502592,"raft.run_cpu_time_us":528,"raft.run_wall_time_us":39841,"thread_start_us":1033784,"threads_started":3,"wal-append.queue_time_us":721313}
I20260709 13:17:58.808561 10657 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:58.809032 10657 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:58.825726 10955 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.826378 10955 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:58.826510 10657 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.739675  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:58.828670 10964 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:58.744551 10859 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.746791 10830 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.748103 11035 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:17:58.711134 11033 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:17:58.754036 10972 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:58.834033 10954 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:58.755565 11012 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.757550  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2887) took 1306 ms. Trace:
I20260709 13:17:58.838871 10954 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.839076  5366 rpcz_store.cc:276] 0709 13:17:57.428587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.508026 (+ 79439us) service_pool.cc:224] Handling call
0709 13:17:57.509023 (+   997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.509210 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:57.564627 (+ 55417us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.733226 (+1168599us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.734213 (+   987us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.734305 (+    92us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:58.734370 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.734472 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.734649 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1730,"prepare.queue_time_us":325828,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":91,"raft.queue_time_us":239848,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":12890,"spinlock_wait_cycles":1321856,"thread_start_us":1167884,"threads_started":2}
I20260709 13:17:58.841063 10954 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.856462  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2886) took 1428 ms. Trace:
W20260709 13:17:58.765103 11000 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:58.529330 10980 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:58.766175 10967 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.633600 11038 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.733515 11005 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:58.864449  5518 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 14.
I20260709 13:17:58.864897 11005 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.856935  5373 rpcz_store.cc:276] 0709 13:17:57.428333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.490828 (+ 62495us) service_pool.cc:224] Handling call
0709 13:17:57.508608 (+ 17780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.125084 (+616476us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:58.424163 (+299079us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.636142 (+211979us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.647133 (+ 10991us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.647290 (+   157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:58.647323 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.647393 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.856217 (+208824us) raft_consensus.cc:1685] finished
0709 13:17:58.856238 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.856396 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39147,"prepare.queue_time_us":302766,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":289468,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":17154,"thread_start_us":1021784,"threads_started":3,"wal-append.queue_time_us":340966}
I20260709 13:17:58.867564  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:58.770241  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2875) took 1368 ms. Trace:
I20260709 13:17:58.771202 11011 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:58.774550  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2825) took 1281 ms. Trace:
I20260709 13:17:58.868407  5442 rpcz_store.cc:276] 0709 13:17:57.493645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.493768 (+   123us) service_pool.cc:224] Handling call
0709 13:17:57.501829 (+  8061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.516243 (+1014414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.774176 (+257933us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003cd054. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:58.774459 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330955008}
I20260709 13:17:58.869974  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:58.785734  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 423) took 1055 ms. Trace:
I20260709 13:17:58.870666  5442 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:58.809369  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2888) took 1375 ms. Trace:
I20260709 13:17:58.870553  5371 rpcz_store.cc:276] 0709 13:17:57.729996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.016634 (+286638us) service_pool.cc:224] Handling call
0709 13:17:58.023109 (+  6475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.030630 (+  7521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.030678 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.038680 (+  8002us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.310293 (+271613us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.310337 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.310407 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.785468 (+475061us) raft_consensus.cc:1685] finished
0709 13:17:58.785498 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.785665 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135818,"raft.queue_time_us":7733,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":152037,"thread_start_us":230760,"threads_started":1,"wal-append.queue_time_us":385976}
I20260709 13:17:58.868202  5373 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.810170  5446 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:58.786818 11014 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:58.787514 11013 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:58.787899 11019 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:58.786641  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 227558us
I20260709 13:17:58.880702  5416 leader_election.cc:400] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:58.790095 10727 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.792114  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:58.882087  6077 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:17:58.792927  5372 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:58.794266  5368 pending_rounds.cc:85] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 6
W20260709 13:17:58.789911 11027 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.626s	user 0.003s	sys 0.010s
I20260709 13:17:58.816658  6069 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 13:17:58.795718  5441 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2827) took 1233 ms (client timeout 1630 ms). Trace:
W20260709 13:17:58.890303  5441 rpcz_store.cc:269] 0709 13:17:57.562269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.591641 (+ 29372us) service_pool.cc:224] Handling call
0709 13:17:58.795421 (+1203780us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540019c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:17:58.795613 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1717240704}
I20260709 13:17:58.796664  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2822) took 1370 ms. Trace:
I20260709 13:17:58.890977  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:58.798036 10982 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.798138 11009 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.798722 10877 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.800243  5519 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:58.799249 10709 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.795395  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:58.803452  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:17:58.787180  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 104509us
I20260709 13:17:58.906929  5450 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:58.793889  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:58.799751  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.797756  5370 pending_rounds.cc:85] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 7
I20260709 13:17:58.908116  5370 pending_rounds.cc:107] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:17:58.901365  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:58.908627  5370 raft_consensus.cc:2889] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.794529  5524 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.809077  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:58.802362  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:58.803460  5374 rpcz_store.cc:276] 0709 13:17:57.259183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.259311 (+   128us) service_pool.cc:224] Handling call
0709 13:17:57.292752 (+ 33441us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:57.326590 (+ 33838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.326620 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:57.347309 (+ 20689us) log.cc:844] Serialized 78 byte log entry
0709 13:17:57.561291 (+213982us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.064805 (+503514us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.424687 (+359882us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.776397 (+351710us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54003deb20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d07733 00007fc1d3d8cdbf 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c
0709 13:17:58.776488 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.776621 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.776831 (+   210us) raft_consensus.cc:1685] finished
0709 13:17:58.776852 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.777092 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159040,"prepare.queue_time_us":411993,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":5615,"raft.queue_time_us":183129,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":126219,"spinlock_wait_cycles":86108928,"thread_start_us":1149398,"threads_started":4,"wal-append.queue_time_us":461005}
I20260709 13:17:58.794207 11063 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:17:58.740926  5445 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:58.926012  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:58.829157 10955 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:58.736943 10569 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.929375  5448 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:58.834193 10985 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:58.846607 10972 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:58.830294 10657 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:58.763180  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.865702 10980 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:58.769745  6076 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:58.768558 11006 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:58.870189  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.781270 10993 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.689118 10510 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:58.954445 10510 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:17:58.868225  5369 rpcz_store.cc:276] 0709 13:17:57.370772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.371028 (+   256us) service_pool.cc:224] Handling call
0709 13:17:57.396797 (+ 25769us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:57.397320 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.397359 (+    39us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:57.990153 (+592794us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b2c00000658. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:17:58.003166 (+ 13013us) log.cc:844] Serialized 78 byte log entry
0709 13:17:58.213765 (+210599us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.452087 (+238322us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.727675 (+275588us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b180010b8e0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:17:58.727864 (+   189us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.731238 (+  3374us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.738419 (+  7181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.738514 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.738559 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:58.738570 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.738775 (+   205us) inbound_call.cc:177] Queueing success response
0709 13:17:58.763811 (+ 25036us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:58.821120 (+ 57309us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b480030c858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
Metrics: {"mutex_wait_us":172281,"prepare.queue_time_us":563767,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":9512,"raft.queue_time_us":149087,"raft.run_cpu_time_us":3660,"raft.run_wall_time_us":112098,"spinlock_wait_cycles":96338688,"thread_start_us":398422,"threads_started":3,"wal-append.queue_time_us":279986}
I20260709 13:17:58.883388  5368 pending_rounds.cc:107] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 16.7
I20260709 13:17:58.881230  5416 leader_election.cc:403] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:58.956534  5368 raft_consensus.cc:2889] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.885272  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:58.883117  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.871732  5367 rpcz_store.cc:276] 0709 13:17:57.434361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.754542 (+320181us) service_pool.cc:224] Handling call
0709 13:17:57.773873 (+ 19331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.792474 (+ 18601us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:57.870784 (+ 78310us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.044495 (+173711us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.044729 (+   234us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.045682 (+   953us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.045888 (+   206us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:58.046083 (+   195us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.046451 (+   368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.046525 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.176444 (+129919us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b1800280000. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:58.722348 (+545904us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b1800280000. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c6d2a6 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1
0709 13:17:58.722823 (+   475us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b1800280000. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:17:58.809134 (+ 86311us) raft_consensus.cc:1685] finished
0709 13:17:58.809167 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.809310 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200230,"prepare.queue_time_us":1016017,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":134,"raft.queue_time_us":49998,"raft.run_cpu_time_us":703,"raft.run_wall_time_us":190889,"spinlock_wait_cycles":28534656,"thread_start_us":138358,"threads_started":1,"wal-append.queue_time_us":447923}
I20260709 13:17:58.957690  5371 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:58.891402  5449 rpcz_store.cc:276] 0709 13:17:57.437111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.444499 (+  7388us) service_pool.cc:224] Handling call
0709 13:17:57.444777 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.674212 (+1229435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.796326 (+122114us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540023a854. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:17:58.796588 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2825319680}
W20260709 13:17:58.957839  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.902211 11060 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:58.958359  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.903357  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:17:58.903978 10988 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.873899 10704 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:58.904866 11038 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:58.905045 11014 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:58.907402  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:58.922953  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2871) took 1592 ms. Trace:
I20260709 13:17:58.908936  5446 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:58.924158  5443 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.924188  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:17:58.975322  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 51219.8us
I20260709 13:17:58.883988 11013 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:58.927613  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 133791us
I20260709 13:17:58.924429 10983 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.928499  5450 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:58.922791  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:58.842767  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:58.930544  5374 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:17:58.992226  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69512.3us
I20260709 13:17:58.992867  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:58.993391  5366 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:17:58.995493  5366 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:17:58.931314  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:58.932111 11011 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.999660 11011 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.997130 11035 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:59.001353 11035 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:59.001953 11035 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.002261 11044 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:59.002775 11011 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.932904  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:59.003684  5441 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
W20260709 13:17:58.925876 10845 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:17:58.934546 10985 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.907598 10893 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:58.922287 10954 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:17:58.946651  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.016639  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:59.016891  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:59.017724  5520 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:17:58.946872  5524 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:17:58.951293 10689 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.942250 10974 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:17:58.891968  5372 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:17:59.026504  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:58.901314  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:58.935928 11009 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:58.963097  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:58.948280 10950 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.965269  6073 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
W20260709 13:17:58.966640  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86161us
I20260709 13:17:58.935279 10569 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:58.973199  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:58.973838  5370 rpcz_store.cc:276] 0709 13:17:57.330456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.331401 (+   945us) service_pool.cc:224] Handling call
0709 13:17:57.331710 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.184821 (+853111us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54003d4620. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d03dc0 00007fc1d3d8e1c0 00007fc1d3d8f231 00007fc1d3d8bd8f 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c
0709 13:17:58.909220 (+724399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.922892 (+ 13672us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48483584}
I20260709 13:17:58.879855 11019 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:58.983026 11051 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.982846  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:58.989809  5442 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:58.979310 10704 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:58.931427 10709 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.007099  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:59.056185  5518 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:17:59.007105  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:58.968065 10955 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.057335  5523 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:17:59.058146 11074 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.127s	user 0.001s	sys 0.002s
I20260709 13:17:59.059962 10689 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:58.905581 11027 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.009016  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:17:58.982688 11072 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.066064  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:17:59.025939 10954 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:59.066540 11072 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.020354 10893 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.025796  5522 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:59.065126 11027 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.027935  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:59.028437  6072 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:17:58.988505 11013 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.988281 10972 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:59.028689  5524 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:59.039426  5443 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:17:59.041908  5371 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:59.042609  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 143148us
I20260709 13:17:59.040524  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:59.039808  5369 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:17:58.993512  5374 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:17:59.047255  5521 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:59.048595  5517 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:58.976197 11060 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:59.051468 11069 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:17:59.022543 11012 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:59.053579 11051 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.055389 10985 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.069590  5515 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:59.069780  5447 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:58.966169 10988 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.042780 11009 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.006114 11038 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:17:59.148317  5442 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:59.147244  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.147879  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 108618us
I20260709 13:17:59.199368  5450 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:59.333437  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.043531 11014 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:59.147477  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:59.110422  5372 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:17:59.080651  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.108621  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:17:59.078083  5373 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
W20260709 13:17:59.364436  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.150480  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:17:59.366568  5516 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:17:59.374584  5520 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:17:59.119285 11016 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:17:59.249475 11076 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:17:59.041548 10950 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.048502 11019 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:59.393477  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 353016us
I20260709 13:17:59.393569  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:59.406574  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:59.408268  5371 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:17:59.285274 10983 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:59.416435  5519 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:59.422312  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:17:59.362289 11009 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:59.365360 10972 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.326725 10982 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.263675 11072 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:17:59.356060 11012 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:17:59.425977  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.383391 11047 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:59.196321 10569 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:59.444631  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.437683  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:17:59.440903  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:59.410660 11027 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:59.450340  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:17:59.448505 10982 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:59.470674  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.387009 10617 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:17:59.466007 10982 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.482131  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44559.6us
I20260709 13:17:59.483064 11072 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:59.484112 11075 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:17:59.483958 10974 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:59.485598 11044 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:59.486655  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.490497 11070 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.420s	user 0.000s	sys 0.002s
I20260709 13:17:59.412499 10978 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:17:59.417269 11038 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:17:59.540211  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.439128 11069 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:59.470242 10984 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:59.437875 10830 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:17:59.438513 10981 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:59.391498 10980 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:17:59.513644  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:17:59.513465 10983 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:59.500752 11048 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:17:59.523905 10974 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:59.526990 10955 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:17:59.501067 10982 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:59.425678 11011 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:59.432329 10972 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.546444  5519 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:17:59.508536 10993 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.555s	user 0.014s	sys 0.000s
I20260709 13:17:59.426836 11043 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:17:59.544479 10704 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.538054 11038 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:17:59.552940 10981 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.661237  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 147680us
I20260709 13:17:59.668047  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.669409  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.670537  5374 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:59.671257  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.672224  5373 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:17:59.678675  5372 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:59.680135  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.680949  5372 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:59.682453  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.684000  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.692879  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.549886 11027 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:59.640861 10984 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.646207 10709 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:59.613579 11011 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.608718 10727 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:59.709112  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.728451  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.729604  5374 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:59.730556  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.722306  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:59.724684  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 267993us
I20260709 13:17:59.563206 10983 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:17:59.733036  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:59.673040 10981 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:59.658960 10997 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.742720  5373 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:17:59.753682  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:59.760725  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.564675 10979 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.172s
I20260709 13:17:59.762766  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.736274 11011 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:59.774962  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2831) took 2045 ms. Trace:
I20260709 13:17:59.775951  5373 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:17:59.780740  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 330459us
I20260709 13:17:59.777617  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:59.781832  5450 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:17:59.782006  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:17:59.786041  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 654636us
I20260709 13:17:59.776464  5374 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:59.793483  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:59.794580  5450 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:59.788769  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:17:59.796130  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.779443  5444 rpcz_store.cc:276] 0709 13:17:57.729187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.169762 (+440575us) service_pool.cc:224] Handling call
0709 13:17:58.170132 (+   370us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:58.368687 (+198555us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:58.544745 (+176058us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.700289 (+155544us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:58.713807 (+ 13518us) log.cc:844] Serialized 78 byte log entry
0709 13:17:58.713983 (+   176us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.714015 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.714082 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.774727 (+1060645us) raft_consensus.cc:1685] finished
0709 13:17:59.774747 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.774904 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33711,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":4021,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"thread_start_us":418216,"threads_started":3,"wal-append.queue_time_us":267736}
I20260709 13:17:59.768239 10830 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:59.801704  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:59.774273 11043 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:59.774391 10709 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:59.736009 10984 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.774428 10955 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:17:59.732904 11027 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:59.811900  5441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.018s	sys 0.005s
I20260709 13:17:59.777838 10950 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.814869  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:17:59.831604  5441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.018s	sys 0.005s
I20260709 13:17:59.809026  5450 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:59.804492 11057 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:17:59.824744  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.833741  5373 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:59.824992  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:17:59.795740 11060 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.755913 10997 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:17:59.824338 11035 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.822s	user 0.012s	sys 0.004s
I20260709 13:17:59.815882 11043 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.806501 10830 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:17:59.799183 10877 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:17:59.861268 11060 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:59.861696 11060 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.861827  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:59.862057 11060 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:59.863131  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:59.865466 10950 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.861079 10709 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.867816 10950 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.868429 10950 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:59.868932 10950 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:17:59.870010 10950 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.875922 10954 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:17:59.875856  5444 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:17:59.880340 11073 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.947s	user 0.003s	sys 0.000s
I20260709 13:17:59.884636  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2893) took 1214 ms. Trace:
I20260709 13:17:59.885380  5375 rpcz_store.cc:276] 0709 13:17:58.670469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.677579 (+  7110us) service_pool.cc:224] Handling call
0709 13:17:58.678079 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.678570 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.678595 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.679248 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.859681 (+180433us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.859730 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.859825 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.879658 (+1019833us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:17:59.884257 (+  4599us) raft_consensus.cc:1685] finished
0709 13:17:59.884298 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.884566 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":128,"spinlock_wait_cycles":15868160,"thread_start_us":179915,"threads_started":1,"wal-append.queue_time_us":191997}
I20260709 13:17:59.881251  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:59.888104  5444 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:17:59.888232  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:17:59.888620 11051 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:17:59.889397  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.891371  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.893076  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.845906 11057 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.893811  5375 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:59.899459  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:17:59.817854 10569 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:17:59.872849  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.905786  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 89079.2us
I20260709 13:17:59.906921  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:17:59.910466  5374 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:17:59.912029  5373 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:17:59.915917  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:59.917848  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.919271  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:17:59.886027 11060 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.990376  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:17:59.811676 10951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.005s	sys 0.017s
I20260709 13:17:59.797523 10974 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:59.925663  5445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.018s	sys 0.034s
W20260709 13:18:00.003675  5445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.019s	sys 0.034s
I20260709 13:17:59.781137 11038 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.900225 11043 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:59.900770 10830 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:59.932045  5371 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:59.893404 10978 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:59.943059 10617 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:17:59.841235 10955 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:17:59.830055 10983 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:17:59.899629 11035 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:59.942826  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 324189us
I20260709 13:17:59.923521 11072 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:17:59.964458  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.951642  5375 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:17:59.975538 10984 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:00.023778  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:00.024612  5375 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:59.979758 10727 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:17:59.953038  5442 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.010s	sys 0.018s
I20260709 13:18:00.026186 10727 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:59.984215  5374 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:00.027734  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:00.028467  5374 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:59.999891  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.005075  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2851) took 1172 ms. Trace:
I20260709 13:18:00.030045  5445 rpcz_store.cc:276] 0709 13:17:58.832822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.188580 (+355758us) service_pool.cc:224] Handling call
0709 13:17:59.253448 (+ 64868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.253755 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:59.389759 (+136004us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.004344 (+614585us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.004609 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.004746 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.004793 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:00.004833 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.004900 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.005020 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":495721,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":97,"raft.queue_time_us":1453,"spinlock_wait_cycles":3400448,"thread_start_us":736290,"threads_started":2}
I20260709 13:18:00.032809  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:00.033993  5340 leader_election.cc:336] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.598s (SENT)
I20260709 13:18:00.034586  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:00.036095 10845 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:59.904656 11012 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:17:59.990723 10657 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.048s	user 0.014s	sys 0.001s
I20260709 13:17:59.958145 11048 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:18:00.039850 11012 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:00.045671  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.046541 10845 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.047194 10845 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:00.049914  5340 leader_election.cc:336] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.669s (SENT)
I20260709 13:18:00.054121  5445 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
W20260709 13:18:00.005038 10951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.006s	sys 0.017s
I20260709 13:18:00.062021  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:00.041282  5374 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:00.065352  5369 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:00.066237  5375 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:00.067433  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.068370  5375 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:00.069553  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.070344  5374 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:18:00.009352 11091 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:00.071058  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.013728 10978 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:00.077589  5445 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:00.073318  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:00.081364  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.083061  5375 raft_consensus.cc:2410] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:18:00.084291  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.084564  5374 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:00.086854  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.088294  5445 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:00.088900 10845 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:00.089407  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.091161  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2914) took 1148 ms. Trace:
I20260709 13:18:00.091740  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.092480  5369 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:00.091634  5367 rpcz_store.cc:276] 0709 13:17:58.942836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.258462 (+315626us) service_pool.cc:224] Handling call
0709 13:17:59.271828 (+ 13366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:59.304101 (+ 32273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.304238 (+   137us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:59.306367 (+  2129us) log.cc:844] Serialized 52 byte log entry
0709 13:17:59.785411 (+479044us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.785726 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.785807 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.090868 (+305061us) raft_consensus.cc:1685] finished
0709 13:18:00.090892 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.091074 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16524,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":29420,"thread_start_us":431659,"threads_started":1,"wal-append.queue_time_us":667159}
I20260709 13:18:00.097023  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:00.099084  5374 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:00.054286 10617 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.110335  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.110561  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:00.115960  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 327015us
I20260709 13:18:00.100147 10727 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.117810  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:00.118474  5369 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.119228 10727 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:00.121027  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.122668  5375 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:00.114507  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:00.121958 11095 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:18:00.124680  5374 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:00.125473  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2847) took 1358 ms. Trace:
I20260709 13:18:00.126482  5367 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:00.125887  5374 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:18:00.127898  5367 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:00.128336  5374 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:00.135082  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.136147  5450 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.085026 11091 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:00.125875  5441 rpcz_store.cc:276] 0709 13:17:58.767023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.004353 (+237330us) service_pool.cc:224] Handling call
0709 13:17:59.007246 (+  2893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.007647 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:59.007678 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.008175 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.832417 (+824242us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.832479 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.832580 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.125253 (+292673us) raft_consensus.cc:1685] finished
0709 13:18:00.125275 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.125397 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10375,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6822,"thread_start_us":823623,"threads_started":1,"wal-append.queue_time_us":973307}
I20260709 13:18:00.137243  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.095788 10983 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.142289  5450 raft_consensus.cc:2368] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
I20260709 13:18:00.154081  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.155123  5450 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.108697 11027 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:00.112540 11096 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:00.165961  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.170890  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.172650  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:00.173377  5516 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:00.175808  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:00.177556  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:00.180210  5515 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:18:00.178222  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.182930  5450 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.184985  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:00.186472  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.187287  5441 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.187471  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:00.188371  5519 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:00.190532  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:00.193020  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:00.194180  5519 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:00.196038  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:00.202286  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:00.210557  5521 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:00.178381 10657 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.227021 10657 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:00.214481 11013 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.784s	user 0.012s	sys 0.000s
I20260709 13:18:00.229838 11013 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.230988 10955 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:00.232189 11013 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:00.221704 11088 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:18:00.222114 11091 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.224059 10617 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:00.225903 11093 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:18:00.238058 11035 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:00.238785  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2855) took 1363 ms. Trace:
I20260709 13:18:00.239202  5443 rpcz_store.cc:276] 0709 13:17:58.875645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.358989 (+483344us) service_pool.cc:224] Handling call
0709 13:17:59.359445 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:59.382602 (+ 23157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.382638 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:59.392084 (+  9446us) log.cc:844] Serialized 52 byte log entry
0709 13:17:59.905294 (+513210us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:59.947903 (+ 42609us) log.cc:844] Serialized 14 byte log entry
0709 13:17:59.948170 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.948268 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.238555 (+290287us) raft_consensus.cc:1685] finished
0709 13:18:00.238577 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.238724 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6911,"prepare.queue_time_us":28822,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":26432,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":31226,"thread_start_us":431014,"threads_started":1,"wal-append.queue_time_us":635871}
I20260709 13:18:00.226120 10830 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:00.182082 10978 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.243110 10978 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:00.243330 10830 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:00.229267 10657 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:00.241127  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.244948  5443 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:00.245975  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.246804  5443 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:18:00.247606  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.248329  5443 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.250674  6070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 203) took 1241 ms. Trace:
I20260709 13:18:00.251255  6070 rpcz_store.cc:276] 0709 13:17:59.009135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.009478 (+   343us) service_pool.cc:224] Handling call
0709 13:17:59.042701 (+ 33223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.048860 (+  6159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.048893 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.057373 (+  8480us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.716872 (+659499us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800264ac0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:18:00.057972 (+341100us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:00.058013 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.058079 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.250236 (+192157us) raft_consensus.cc:1685] finished
0709 13:18:00.250267 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.250596 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6330,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":27237632,"thread_start_us":340880,"threads_started":1,"wal-append.queue_time_us":1125911}
I20260709 13:18:00.256127  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:00.260244 11044 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.000s
I20260709 13:18:00.260784 11044 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.219426 11060 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:00.168488 11096 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:00.265796 10964 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.266372 10964 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.267620 11096 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:00.268465 10964 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:00.271272  5516 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:18:00.249091  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.274456 11011 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:00.277355  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62493.7us
I20260709 13:18:00.277401  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.278493  5443 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:18:00.260244 11009 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.000s
I20260709 13:18:00.277038  5369 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:18:00.273375 10972 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.580s	user 0.005s	sys 0.002s
I20260709 13:18:00.200460 10877 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:18:00.273905 11014 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.891s	user 0.007s	sys 0.007s
W20260709 13:18:00.284709  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 167559us
I20260709 13:18:00.286481  5375 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:18:00.286612  5441 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:00.302345  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.302462  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.303334  5441 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:00.303843  5445 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:18:00.287384  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 230020us
W20260709 13:18:00.319224  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.325489  5340 leader_election.cc:336] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.748s (SENT)
I20260709 13:18:00.303438  5443 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.329695  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:00.339035  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53711.9us
I20260709 13:18:00.339329  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2854) took 1479 ms. Trace:
W20260709 13:18:00.295182 11019 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.005s
W20260709 13:18:00.301636 10982 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.647s	user 0.013s	sys 0.000s
I20260709 13:18:00.286470 10709 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.287590 11013 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:00.352145  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.410771  6042 leader_election.cc:336] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.601s (SENT)
I20260709 13:18:00.353065  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:00.339897  5442 rpcz_store.cc:276] 0709 13:17:58.860470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.390155 (+529685us) service_pool.cc:224] Handling call
0709 13:17:59.404560 (+ 14405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.404952 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:00.026415 (+621463us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.338945 (+312530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.339002 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.339050 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.339117 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.339255 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62857,"prepare.queue_time_us":400544,"prepare.run_cpu_time_us":180,"prepare.run_wall_time_us":179,"thread_start_us":870246,"threads_started":2}
I20260709 13:18:00.357172  5441 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:00.293773 11044 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.350693  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:00.417333  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:00.418308  6072 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:00.420222  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:00.422376  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.423345  5441 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.396327  5515 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:00.405175  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2843) took 1639 ms. Trace:
I20260709 13:18:00.478477  5447 rpcz_store.cc:276] 0709 13:17:58.765768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.808700 (+ 42932us) service_pool.cc:224] Handling call
0709 13:18:00.404900 (+1596200us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54002adad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:00.405096 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334286080}
I20260709 13:18:00.348686  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.276964 10981 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.352028  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:00.457391  5523 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:00.457975  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.457494  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:00.417913 11097 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.292762 11009 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.457536  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:00.465554 11105 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:18:00.466318 10974 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.468226 10727 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.295002 10972 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:00.468617  5340 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.527s (SENT)
W20260709 13:18:00.513051  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44472.4us
W20260709 13:18:00.513994  5340 leader_election.cc:336] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.555s (SENT)
W20260709 13:18:00.515082  5340 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.630s (SENT)
I20260709 13:18:00.515547  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:00.477267  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.468374  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:00.473795 10845 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:00.479816  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.516952  5447 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:18:00.475692  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.482514  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.460348  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:00.517326  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.517779  5443 raft_consensus.cc:2376] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
I20260709 13:18:00.501125  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:00.518253  5441 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.513129  5519 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:00.472645 10978 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.517915  6073 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:00.414510 10982 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.419268 11013 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.518666  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:00.520958  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.347175 11006 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.525478  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.550503  5441 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.518401  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.552055  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.411089 11019 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.424572 11044 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.558975  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.412379 10709 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.565759  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.566691  5441 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:00.567862  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.568591  5441 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:18:00.570261  5442 raft_consensus.cc:2368] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16.
I20260709 13:18:00.573514  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.574620  5447 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.575493  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.576298  5441 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.512315 11106 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:00.582991  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.583879  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.586611  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.586652  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.588959  5447 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:00.589311  5443 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:00.590137  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.590765  5447 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:00.593469  5444 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.546387 10985 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:00.604563  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 136257us
I20260709 13:18:00.563301 10845 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.524103 10974 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.510568 11097 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.523964 10727 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.530601 10978 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.588171 11092 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:00.631908  5450 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:18:00.598429 10964 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:00.593132 11011 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:00.642715  5339 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.656s (SENT) [suppressed 36 similar messages]
I20260709 13:18:00.643286  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.644865  5373 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:00.643718  5441 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:00.646637  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.723191  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.728269  5447 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:00.648141  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.735270  5450 raft_consensus.cc:2368] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
I20260709 13:18:00.740219  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.741871  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.671643  5521 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:00.744632  5441 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:00.749053  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.754953  5441 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.591843 11106 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.785585  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:00.643307 11043 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.000s
I20260709 13:18:00.785292  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.793110  5441 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:18:00.801890  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.643782 10964 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.810494  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.813395  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.816464  5441 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:00.660801 11027 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.781999 10981 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:00.825465  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.838297  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:00.829286 10709 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:00.824087 10964 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.824335 11043 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.877457  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:00.852834 11116 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
W20260709 13:18:00.851994 11109 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.398s	user 0.001s	sys 0.000s
W20260709 13:18:00.915145  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 414072us
I20260709 13:18:00.927561  5447 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:00.941883  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.943018  5441 raft_consensus.cc:2376] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17. Re-sending same reply.
I20260709 13:18:00.944373  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:00.947634  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.872006 11112 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:18:00.624708 11006 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:00.966773  5441 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:00.967175  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.967865  5447 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:00.968998  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2861) took 1181 ms. Trace:
I20260709 13:18:00.969617  5447 rpcz_store.cc:276] 0709 13:17:59.787721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.966877 (+1179156us) service_pool.cc:224] Handling call
0709 13:18:00.968914 (+  2037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.970435  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:00.970567  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:00.971414  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.971426  5441 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:00.972198  5448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2846) took 2199 ms (client timeout 2106 ms). Trace:
I20260709 13:18:00.972353  5445 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:00.965288  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:00.973146  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2244) took 1132 ms. Trace:
I20260709 13:18:00.837610 11027 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.974841  5445 rpcz_store.cc:276] 0709 13:17:59.841038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.971084 (+1130046us) service_pool.cc:224] Handling call
0709 13:18:00.973082 (+  1998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.974989  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:00.972630  5448 rpcz_store.cc:269] 0709 13:17:58.766715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.803197 (+ 36482us) service_pool.cc:224] Handling call
0709 13:18:00.964522 (+2161325us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b540033ccd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:00.965896 (+  1374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50548096}
I20260709 13:18:00.977998  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:00.971868 11104 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.493s	user 0.000s	sys 0.001s
I20260709 13:18:00.965703 11103 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.983074  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:00.984167  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:00.979893 10830 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:01.020767 10830 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.021203 10830 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.022136 11103 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:00.967870 10981 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:00.971665 11044 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.006510  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.027658  6070 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.986598  5489 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:00.972774 11091 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.094563  6070 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:01.084977 10954 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:18:01.030562  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47562.4us
I20260709 13:18:00.975569 10972 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:00.977116 10985 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:01.048259 11106 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:01.032773 11114 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 13:18:01.050446 11043 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.051784  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2837) took 2340 ms. Trace:
I20260709 13:18:01.009577 10727 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:01.010171 11120 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:18:01.053706 11011 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:01.053992 11097 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:01.054811 11107 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.410s	user 0.000s	sys 0.001s
I20260709 13:18:01.019104 10982 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:01.018298 10983 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.866s	user 0.010s	sys 0.002s
I20260709 13:18:01.057693 10830 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.058725 10974 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.013533 11072 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:01.068681 10704 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.073778 10893 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:01.075309  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.077400  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.159116  5369 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:00.984524 10657 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:00.984203 11013 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.092510  5441 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
W20260709 13:18:01.098266  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111710us
I20260709 13:18:00.984030 10845 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.149128 11097 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:01.099282  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.164994 11097 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:01.165367  5448 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:01.166623  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.167198  5448 raft_consensus.cc:2376] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19. Re-sending same reply.
I20260709 13:18:01.020233 10978 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.104790  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.168181  5445 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:01.168380  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:00.977288 11006 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.098544 10954 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:01.170919 10830 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.171084 10954 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.172256  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.025743 11103 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:01.128413 11081 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 1.573s	user 0.016s	sys 0.011s
W20260709 13:18:01.174610 11117 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.550s	user 0.002s	sys 0.003s
W20260709 13:18:01.129534  5522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2244) took 2446 ms (client timeout 2900 ms). Trace:
I20260709 13:18:01.113278  5449 rpcz_store.cc:276] 0709 13:17:58.711737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.965934 (+254197us) service_pool.cc:224] Handling call
0709 13:17:58.988625 (+ 22691us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:59.016368 (+ 27743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.016409 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:59.043410 (+ 27001us) log.cc:844] Serialized 52 byte log entry
0709 13:18:00.070607 (+1027197us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b1800290c20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:18:00.185176 (+114569us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.185216 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.185316 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.051371 (+866055us) raft_consensus.cc:1685] finished
0709 13:18:01.051396 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.051692 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18609,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5426,"spinlock_wait_cycles":43424640,"thread_start_us":114362,"threads_started":1,"wal-append.queue_time_us":1241542}
W20260709 13:18:01.175227  5522 rpcz_store.cc:269] 0709 13:17:58.683626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.692720 (+  9094us) service_pool.cc:224] Handling call
0709 13:18:01.129216 (+2436496us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400313654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:01.129445 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506164480}
I20260709 13:18:01.176116  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.176982  5449 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.177956  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.130975 10988 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.178793  5449 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:01.110280 11012 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.179216 11012 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:01.179623 11012 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:01.136739  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.148082 10980 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:01.095650 11102 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:18:01.106997 11091 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:01.163566  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:01.184476  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.184892  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:01.185647  5441 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.186190  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:01.151377 11011 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:01.132800 11080 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.721s	user 0.002s	sys 0.010s
I20260709 13:18:01.179687  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.044759 10981 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:01.159951 10974 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.144955  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.011s
W20260709 13:18:01.203917  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.000s	sys 0.012s
W20260709 13:18:01.204605  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 689491us
W20260709 13:18:01.205446  5340 leader_election.cc:336] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.644s (SENT)
I20260709 13:18:01.205953  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:01.169106  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.207422  5445 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.113809 10985 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.169361  5448 raft_consensus.cc:2410] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:18:01.167241 11097 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:01.173332  5442 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:01.157846 11072 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.208247  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2251) took 1253 ms. Trace:
I20260709 13:18:01.208571  5448 rpcz_store.cc:276] 0709 13:17:59.955141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.168111 (+1212970us) service_pool.cc:224] Handling call
0709 13:18:01.208178 (+ 40067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.209798  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.201416  5449 raft_consensus.cc:2410] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:18:01.149006  5374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.004s	sys 0.008s
I20260709 13:18:01.202795  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.172326 10954 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:01.181758 11006 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.230347  5441 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:18:01.230996  5374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.005s	sys 0.009s
I20260709 13:18:01.161931 10704 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.355681 11047 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.355952  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2894) took 2685 ms. Trace:
I20260709 13:18:01.356288 11047 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.354951  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2909) took 2421 ms. Trace:
I20260709 13:18:01.357295  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2920) took 1286 ms. Trace:
I20260709 13:18:01.212502  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.357180  5370 rpcz_store.cc:276] 0709 13:17:58.933557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.116865 (+183308us) service_pool.cc:224] Handling call
0709 13:17:59.117488 (+   623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.399297 (+281809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.399341 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.399402 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:59.399447 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.354578 (+1955131us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54003944d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:01.354655 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.354837 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647460736}
W20260709 13:18:01.330080  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.356566  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2274) took 1122 ms. Trace:
I20260709 13:18:01.362831  5441 rpcz_store.cc:276] 0709 13:18:00.233689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.202450 (+968761us) service_pool.cc:224] Handling call
0709 13:18:01.356463 (+154013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.364337  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.365552  5441 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.365473  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2106) took 1698 ms. Trace:
I20260709 13:18:01.314082  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.382251  5375 rpcz_store.cc:276] 0709 13:17:59.666840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.123500 (+456660us) service_pool.cc:224] Handling call
0709 13:18:00.286247 (+162747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:00.294635 (+  8388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.365183 (+1070548us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400034dd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:01.365381 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373241088}
I20260709 13:18:01.260443  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.384523  5448 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.316744  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:01.345399  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 203869us
I20260709 13:18:01.203742 11124 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:01.330776  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.358206  5368 rpcz_store.cc:276] 0709 13:17:58.670832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.679889 (+  9057us) service_pool.cc:224] Handling call
0709 13:17:58.702193 (+ 22304us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:58.965693 (+263500us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:59.020513 (+ 54820us) log.cc:844] Serialized 14 byte log entry
0709 13:17:59.164719 (+144206us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:59.165586 (+   867us) log.cc:844] Serialized 52 byte log entry
0709 13:17:59.165792 (+   206us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.165842 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.165973 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.131983 (+1966010us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:01.355590 (+223607us) raft_consensus.cc:1685] finished
0709 13:18:01.355713 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.355891 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45856,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":31138,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":8324,"spinlock_wait_cycles":905955712,"thread_start_us":143171,"threads_started":1,"wal-append.queue_time_us":250177}
I20260709 13:18:01.419889  5449 raft_consensus.cc:2410] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:01.203624 10893 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:01.359022  5442 raft_consensus.cc:2410] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:18:01.210925 10617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.003s	sys 0.010s
I20260709 13:18:01.203824 10657 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:01.223057 10964 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.212244 10997 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.226150 11038 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.425268  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.441896  5441 raft_consensus.cc:2410] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:18:01.435489 10617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.006s	sys 0.013s
W20260709 13:18:01.386462  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 181074us
W20260709 13:18:01.446476  5340 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.731s (SENT)
I20260709 13:18:01.446964  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:01.448272  5340 leader_election.cc:336] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.784s (SENT)
I20260709 13:18:01.434024  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.434357  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.435554  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.450482  5442 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.436343  5450 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.436388  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.451247  5445 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.200711 10980 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.225731 11091 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.254124 11128 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:01.442826  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.425745  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.470448  5449 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.444319  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.471246  5516 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:01.204511 10982 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.234s
I20260709 13:18:01.252334 10981 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:01.482638  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:01.212092 11072 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.424576 11006 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.434971 10893 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.457922  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.470556  5448 raft_consensus.cc:2410] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:01.471340  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.490777  5450 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:01.437561 10657 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.444308  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.493137  5441 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:18:01.477284  5340 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.812s (SENT)
I20260709 13:18:01.479848  5520 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:01.481189  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.445652 11014 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.452148  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.496356  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.358289  5374 rpcz_store.cc:276] 0709 13:18:00.070840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.129539 (+ 58699us) service_pool.cc:224] Handling call
0709 13:18:00.129943 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.130182 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:00.285770 (+155588us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.173920 (+888150us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:01.356808 (+182888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.356882 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.356933 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.357011 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.357214 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":292160,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":10927,"raft.queue_time_us":104224,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":14613,"spinlock_wait_cycles":22142848,"thread_start_us":1224661,"threads_started":3,"wal-append.queue_time_us":338427}
I20260709 13:18:01.500324  5445 raft_consensus.cc:2376] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
W20260709 13:18:01.500324  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48305.5us
W20260709 13:18:01.491081  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 298817us
I20260709 13:18:01.492439  5523 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:01.475036  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.501595  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:01.492874  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.490381  5442 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:01.501821  5449 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:01.502977  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.495410  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:01.503458  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.442646 11124 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:01.453001 10845 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:01.227990  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:01.506723  5522 raft_consensus.cc:606] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:01.506858  5340 leader_election.cc:336] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.820s (SENT)
I20260709 13:18:01.507117  5522 raft_consensus.cc:614] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:01.498298  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.498718  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.499243  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.507371  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:01.503686  5516 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:01.505002  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.508387  5450 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.507830  5441 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.252899 11011 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.469338 11101 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:01.507632  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.507831  5448 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 15.
W20260709 13:18:01.514791  5340 leader_election.cc:336] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.872s (SENT)
I20260709 13:18:01.534869  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:01.347138 11012 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.517410 11130 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.538734  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2858) took 1729 ms. Trace:
I20260709 13:18:01.538576  5448 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:01.538695  5340 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.911s (SENT)
I20260709 13:18:01.493804 10893 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:01.489614 10954 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.545677 10954 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.547212  5523 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:01.547791 10954 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.548307  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.548558  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:01.543540 11124 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:01.551707 11083 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.781s	user 0.000s	sys 0.015s
I20260709 13:18:01.553015  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2839) took 2840 ms. Trace:
W20260709 13:18:01.554100  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46633.4us
I20260709 13:18:01.554307 11044 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:01.506357 11014 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.554497 11057 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.497769 10657 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.554948  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.555284  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.556095 11044 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.556480 11014 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.549301  5516 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:01.513895 11013 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:01.499301 11006 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.553413  5446 rpcz_store.cc:276] 0709 13:17:58.712254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.981736 (+269482us) service_pool.cc:224] Handling call
0709 13:17:59.014660 (+ 32924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.026648 (+ 11988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.026695 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.069027 (+ 42332us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.184022 (+114995us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:17:59.361733 (+177711us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:59.361783 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.361870 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.551023 (+2189153us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:01.552769 (+  1746us) raft_consensus.cc:1685] finished
0709 13:18:01.552789 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.552929 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90062,"raft.queue_time_us":14275,"raft.run_cpu_time_us":2671,"raft.run_wall_time_us":140096,"spinlock_wait_cycles":98062592,"thread_start_us":174894,"threads_started":1,"wal-append.queue_time_us":453288}
I20260709 13:18:01.558465  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.559268  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2866) took 1768 ms. Trace:
I20260709 13:18:01.559495 11013 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:01.513814 11103 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:01.560587  5523 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:01.560963  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.561607 11103 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:01.562088 11103 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.562148  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.562508 11012 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.563506 11013 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.564191 11013 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.563038  5446 rpcz_store.cc:276] 0709 13:17:59.790720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.558260 (+1767540us) service_pool.cc:224] Handling call
0709 13:18:01.558774 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.558967 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.558990 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.559031 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:01.559057 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.559106 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.559213 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.506386 11051 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:01.531935  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2926) took 1057 ms. Trace:
I20260709 13:18:01.554608  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.566269  5367 rpcz_store.cc:276] 0709 13:18:00.474277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.097564 (+623287us) service_pool.cc:224] Handling call
0709 13:18:01.098027 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.098372 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.098401 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.110360 (+ 11959us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.342613 (+232253us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:01.342674 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.342773 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.531686 (+188913us) raft_consensus.cc:1685] finished
0709 13:18:01.531711 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.531867 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59912,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3583,"thread_start_us":190814,"threads_started":1,"wal-append.queue_time_us":316228}
I20260709 13:18:01.566634  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2243) took 1738 ms. Trace:
I20260709 13:18:01.569983  5446 rpcz_store.cc:276] 0709 13:17:59.828774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.565594 (+1736820us) service_pool.cc:224] Handling call
0709 13:18:01.565975 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.566190 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.566226 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.566282 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:01.566355 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.566424 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.566568 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.559574 11006 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.572815  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:01.573503  5522 raft_consensus.cc:2376] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15. Re-sending same reply.
I20260709 13:18:01.573527  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:01.574851  5523 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:01.574808  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:01.575878  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.575683 10954 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:01.576923 10954 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.590150 10954 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:01.518191 10704 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.494079 10985 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:01.539402  5450 rpcz_store.cc:276] 0709 13:17:59.786593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.514857 (+1728264us) service_pool.cc:224] Handling call
0709 13:18:01.515298 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.515510 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.515547 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.515602 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:01.515645 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.515714 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.515845 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.539778  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:01.539897  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2862) took 1751 ms. Trace:
I20260709 13:18:01.538573  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.541227 11005 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:01.605310  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.541846 10964 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.543359  5443 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:01.578070 10980 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:01.570785  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2928) took 1095 ms. Trace:
I20260709 13:18:01.582470  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.233834 10974 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:01.592823  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 177448us
I20260709 13:18:01.514635 11128 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:01.605000  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.638695  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.641885  5517 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 17.
I20260709 13:18:01.643195 10974 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:01.645479 10985 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:01.646617 10985 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:01.608299  5520 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:18:01.648605  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.607800  5445 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:01.650120  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.650485  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:01.542881 11082 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.738s	user 0.000s	sys 0.014s
I20260709 13:18:01.651362  5445 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
W20260709 13:18:01.606406  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.653360  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.653851  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2904) took 2862 ms. Trace:
I20260709 13:18:01.655094  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.591037 10954 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.656191  5445 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:01.577746 11013 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:01.585258  5441 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:01.659472  5446 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 17. Ops: []
W20260709 13:18:01.615434  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76769.8us
I20260709 13:18:01.575768  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:01.618161  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:01.662324  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.623200  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:01.663045  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.663391  5516 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:01.623500  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:01.624711  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.625862  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:01.653944  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.608708  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2864) took 1820 ms. Trace:
I20260709 13:18:01.673813  5443 rpcz_store.cc:276] 0709 13:17:59.788780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.542846 (+1754066us) service_pool.cc:224] Handling call
0709 13:18:01.543156 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.608436 (+ 65280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.608648 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.605383 11102 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.646905  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 64531.3us
I20260709 13:18:01.675410  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.688055  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.608752  5448 rpcz_store.cc:276] 0709 13:17:59.788075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.535079 (+1747004us) service_pool.cc:224] Handling call
0709 13:18:01.535410 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.539634 (+  4224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.539845 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.688884  5443 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:01.690299  5448 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:01.691143  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2257) took 1679 ms. Trace:
I20260709 13:18:01.691625  5448 rpcz_store.cc:276] 0709 13:18:00.011305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.689557 (+1678252us) service_pool.cc:224] Handling call
0709 13:18:01.690014 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.690809 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.691074 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.676398  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.612035  5369 rpcz_store.cc:276] 0709 13:18:00.474946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.182682 (+707736us) service_pool.cc:224] Handling call
0709 13:18:01.212877 (+ 30195us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:01.235037 (+ 22160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.235085 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:01.316734 (+ 81649us) log.cc:844] Serialized 52 byte log entry
0709 13:18:01.483225 (+166491us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:01.516627 (+ 33402us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.518036 (+  1409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.518123 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.568832 (+ 50709us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:01.570466 (+  1634us) raft_consensus.cc:1685] finished
0709 13:18:01.570574 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.570719 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22782,"prepare.queue_time_us":49218,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":46553,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":220,"spinlock_wait_cycles":31554304,"thread_start_us":126413,"threads_started":1,"wal-append.queue_time_us":208274}
I20260709 13:18:01.677009  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.677193  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.693367  5448 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:01.696651  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.698323  5441 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.705614  5443 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:01.706938  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2260) took 1642 ms. Trace:
I20260709 13:18:01.707469  5443 rpcz_store.cc:276] 0709 13:18:00.064629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.690051 (+1625422us) service_pool.cc:224] Handling call
0709 13:18:01.690450 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.706552 (+ 16102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.706857 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.667527  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:01.683326  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 107621us
I20260709 13:18:01.662595  5521 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:18:01.684738  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:01.709790  5370 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.654439  5366 rpcz_store.cc:276] 0709 13:17:58.791610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.996440 (+204830us) service_pool.cc:224] Handling call
0709 13:17:58.996816 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.997387 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:59.047732 (+ 50345us) log.cc:844] Serialized 14 byte log entry
0709 13:17:59.812334 (+764602us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.933401 (+121067us) log.cc:844] Serialized 26 byte log entry
0709 13:17:59.948679 (+ 15278us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:59.948725 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.948784 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.542244 (+1593460us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:01.653218 (+110974us) raft_consensus.cc:1685] finished
0709 13:18:01.653573 (+   355us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.653758 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24653,"prepare.queue_time_us":51466,"prepare.run_cpu_time_us":9342,"prepare.run_wall_time_us":96946,"raft.queue_time_us":28349,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":251,"spinlock_wait_cycles":11302784,"thread_start_us":648537,"threads_started":2,"wal-append.queue_time_us":614524}
I20260709 13:18:01.711828  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:01.685913  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:01.713536  5375 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:01.720260  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.720387  5441 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:01.720634  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.721053  5375 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:18:01.721765  5366 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:01.656102 11051 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.728705  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:01.724467  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2265) took 1613 ms. Trace:
I20260709 13:18:01.729737  5448 rpcz_store.cc:276] 0709 13:18:00.110649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.692653 (+1582004us) service_pool.cc:224] Handling call
0709 13:18:01.693091 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.724273 (+ 31182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.724421 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.726164  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.730581  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2267) took 1586 ms. Trace:
I20260709 13:18:01.726255  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.722476  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.731367  5443 rpcz_store.cc:276] 0709 13:18:00.144540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.728747 (+1584207us) service_pool.cc:224] Handling call
0709 13:18:01.729560 (+   813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.729855 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.729896 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.730040 (+   144us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:01.730086 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.730158 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.730508 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.736526  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:01.739001  5367 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:01.738004  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:01.738853  5445 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:01.739625  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:01.740960  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73565.5us
I20260709 13:18:01.741402  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.742107  5374 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:01.742295  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:01.743124  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.740052  5366 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.738813  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:01.745803  5375 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:01.746100  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:01.747121  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2273) took 1513 ms. Trace:
I20260709 13:18:01.747530  5445 rpcz_store.cc:276] 0709 13:18:00.233295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.737629 (+1504334us) service_pool.cc:224] Handling call
0709 13:18:01.738669 (+  1040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.746876 (+  8207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.747068 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.749544  5448 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:18:01.750460  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.750458  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2871) took 1401 ms. Trace:
I20260709 13:18:01.751340  5448 rpcz_store.cc:276] 0709 13:18:00.349523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.744128 (+1394605us) service_pool.cc:224] Handling call
0709 13:18:01.744366 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.750090 (+  5724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.750387 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.750811  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:01.754429  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.683212 11128 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.686537 11013 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:01.755927  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68025.9us
I20260709 13:18:01.766814  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.768082  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.756335  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.756588  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:01.757748  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.760465  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.763458  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:01.720139 11101 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:01.725857 10709 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:01.566964 11047 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:01.784529  5367 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:01.785243  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:01.795421  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 200856us
I20260709 13:18:01.790041  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:01.791296  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 63571.5us
I20260709 13:18:01.792327 10709 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.792877  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.795037  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:01.784008 11101 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.793497 10657 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.661818 11072 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.795315  5445 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:01.719588 11102 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.817811  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:01.806887  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56143.4us
I20260709 13:18:01.820029  5368 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:01.819840  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:01.808241  5370 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:18:01.803987  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:01.810068  5367 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:01.810547  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:01.811443  5369 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:01.765616 10510 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:01.826728  5374 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:01.809777  5375 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.814339  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:01.765367 11130 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:01.746594 10982 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.805658  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:01.816911  5523 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:01.770615 11051 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:01.795812 11044 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:01.813949  5366 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:01.838469  5489 leader_election.cc:400] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16.
I20260709 13:18:01.824579  5370 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:01.818310  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:01.838850  5489 leader_election.cc:403] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.738343 10845 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:18:01.804144 11057 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:01.827380  5519 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:01.828013  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.809325 11126 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.816546 11101 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.832198  5374 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:01.835944  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:01.837237  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.837587  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:01.824033  6042 leader_election.cc:336] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.573s (SENT)
I20260709 13:18:01.859901  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:01.844452  5369 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:01.860574  5374 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.841302  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:01.861531  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:01.804231 10893 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:01.870430  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64876.1us
W20260709 13:18:01.876211  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 61918.7us
I20260709 13:18:01.871086  5375 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
W20260709 13:18:01.871521  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 103526us
I20260709 13:18:01.783332 11128 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:01.843407 10510 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:01.937506  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:01.858991 11126 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:01.871048 11130 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:01.851897 11103 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.874943 10982 raft_consensus.cc:2764] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:18:02.288295 11156 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:02.268326  5374 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:18:01.918865 11132 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:01.871955 11013 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:01.853813 10709 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:02.270212  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:02.319604  5375 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:02.274700  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:02.274834  5445 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:02.275563  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.276587  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:02.273941  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.322085  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.278364 11057 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:02.285151  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 443917us
I20260709 13:18:02.285873  5524 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:02.291100 10510 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.291632 10893 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:02.294132 11048 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:02.295230 11035 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:02.296459 11103 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:02.296571 10954 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.639s	user 0.014s	sys 0.009s
I20260709 13:18:02.270115 10964 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:02.297924  5450 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:02.281975 11126 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:02.299803 11038 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.025s
I20260709 13:18:02.300849 11122 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:02.301016 11009 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.301719  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:02.284591 11143 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.466s	user 0.008s	sys 0.020s
W20260709 13:18:02.302863  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.358014  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.327750 11132 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:02.297063  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:02.360867  5518 raft_consensus.cc:606] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.306691  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:02.312886  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 475258us
W20260709 13:18:02.270596  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.327888  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:02.366189  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:02.328789  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53370.3us
I20260709 13:18:02.318259 10704 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:02.342727 11035 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:02.342926 11057 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.339627 11014 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.322254 11043 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:02.318528 11066 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:02.330350 10980 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.358486  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2924) took 2181 ms. Trace:
I20260709 13:18:02.380080  5373 rpcz_store.cc:276] 0709 13:18:00.177405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.043600 (+866195us) service_pool.cc:224] Handling call
0709 13:18:01.107996 (+ 64396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.108449 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:01.423355 (+314906us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.658887 (+235532us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.695315 (+ 36428us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.695497 (+   182us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:01.695532 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.695651 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.358252 (+662601us) raft_consensus.cc:1685] finished
0709 13:18:02.358276 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.358422 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43416,"prepare.queue_time_us":330895,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":7331,"raft.queue_time_us":56576,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":12205,"thread_start_us":536826,"threads_started":2,"wal-append.queue_time_us":335014}
I20260709 13:18:02.303361  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:02.382822  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 79546.1us
I20260709 13:18:02.337532 11130 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:02.368480  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.346040 10988 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.340129 11048 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:02.353657 11006 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.350710 11122 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.358505 11013 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:02.396303  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.349169 10954 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.371389 10704 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:02.418205  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:02.385159 10830 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:02.379776 11066 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:02.386726 10617 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:02.401937 10997 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:02.425628  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59554us
I20260709 13:18:02.406558 11122 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:02.406102 11009 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:02.431135  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:02.407263 11072 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:02.430857  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:02.442503  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:02.424247 10830 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.425555 11066 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:02.418718 11130 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:02.386234 11014 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.394300 10980 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.447975  5518 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:02.406742 11006 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.402349 10988 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.428274 10997 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.395001 11101 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.430210 11047 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.443125 11132 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:02.454317  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 74767.5us
I20260709 13:18:02.474524  5372 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:02.496869  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:02.480631  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2101) took 2815 ms. Trace:
W20260709 13:18:02.482097  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2252) took 2298 ms (client timeout 2062 ms). Trace:
I20260709 13:18:02.486405  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2253) took 2494 ms. Trace:
I20260709 13:18:02.558583  5371 rpcz_store.cc:276] 0709 13:17:59.665095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.667576 (+  2481us) service_pool.cc:224] Handling call
0709 13:17:59.931794 (+264218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.009300 (+ 77506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.480360 (+2471060us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54001856d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:02.480553 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589829376}
W20260709 13:18:02.453995 11147 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:18:02.561264  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:02.488852  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:02.559329  5446 rpcz_store.cc:276] 0709 13:17:59.992135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.571453 (+1579318us) service_pool.cc:224] Handling call
0709 13:18:01.659241 (+ 87788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.660059 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.486107 (+826048us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b540033c2d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:02.486328 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200989440}
W20260709 13:18:02.559485  5515 rpcz_store.cc:269] 0709 13:18:00.184454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.184627 (+   173us) service_pool.cc:224] Handling call
0709 13:18:02.481880 (+2297253us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400369554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:02.482019 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296434432}
I20260709 13:18:02.577445  5518 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:18:02.580235  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:02.437875 11160 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:02.581359  5515 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:02.449811 10830 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:02.508277 11084 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 2.738s	user 0.014s	sys 0.015s
I20260709 13:18:02.589221  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2312) took 1363 ms. Trace:
I20260709 13:18:02.590098  5442 rpcz_store.cc:276] 0709 13:18:01.225707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.502789 (+277082us) service_pool.cc:224] Handling call
0709 13:18:02.488726 (+985937us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b5800018998. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67eee 0000000000375939 00007fc1d8cdb1e0 00007fc1d8da40c4 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:18:02.589150 (+100424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3044096}
I20260709 13:18:02.591887  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:18:02.563308 11144 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.710s	user 0.011s	sys 0.019s
I20260709 13:18:02.451807 11131 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.495712 11170 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.494565 10967 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:02.502125 10964 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16.
I20260709 13:18:02.562403 11101 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.597985  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:02.583571 11153 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.246s	user 0.000s	sys 0.002s
I20260709 13:18:02.475601 11006 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.560238 10997 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:02.473815 10988 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.500274 11019 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.576992 11106 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:02.646781 11106 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.647343 11106 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:02.649991 10980 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:02.605722 11131 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.652685 11131 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:02.611510  5442 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:02.653189 11126 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.653947  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2315) took 1427 ms. Trace:
I20260709 13:18:02.654368  5442 rpcz_store.cc:276] 0709 13:18:01.226733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.591237 (+1364504us) service_pool.cc:224] Handling call
0709 13:18:02.611024 (+ 19787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.653595 (+ 42571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.653887 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.606848  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:02.630300  5519 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:02.630448  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 200442us
I20260709 13:18:02.442657 11035 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.505908 11169 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:18:02.586035 11160 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:02.604471 10967 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:02.603593 11170 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.656301  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:02.658787  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52007.8us
I20260709 13:18:02.451463 11048 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:02.677770  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.679212  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.691821  5519 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 17.
W20260709 13:18:02.693197  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.693316  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 247026us
I20260709 13:18:02.685032  5442 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:02.696600  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2316) took 1469 ms. Trace:
I20260709 13:18:02.700629  5442 rpcz_store.cc:276] 0709 13:18:01.227184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.655258 (+1428074us) service_pool.cc:224] Handling call
0709 13:18:02.684558 (+ 29300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.696273 (+ 11715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.696531 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.449280 10704 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:02.704798  5340 leader_election.cc:336] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.012s (SENT)
I20260709 13:18:02.674666 10893 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:02.706261  5340 leader_election.cc:336] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.637s (SENT)
I20260709 13:18:02.722259 10893 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.722829 10893 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:02.679109 11035 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.714643 10967 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.731639 10967 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.734376  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:02.735242 11173 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:02.735610  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.736744  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:02.736948 11171 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:02.737625 11134 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:02.739236 11171 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:02.739665 11134 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:02.673825 10617 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:02.679534 10980 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:02.742676  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:02.722178  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.677894 11160 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.746950  5442 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:02.747665  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2317) took 1520 ms. Trace:
I20260709 13:18:02.747998  5442 rpcz_store.cc:276] 0709 13:18:01.227540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.701954 (+1474414us) service_pool.cc:224] Handling call
0709 13:18:02.746597 (+ 44643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.747399 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.747607 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.703650 11027 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.749447 10510 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:02.740119 10893 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.750427 10974 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:02.752053 10893 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:02.752772 10893 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:02.753242 10893 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:02.754290  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.677181 11014 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:02.763074  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56829.4us
W20260709 13:18:02.745020 11168 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:02.702445 11169 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:02.770653  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:02.719619 11170 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.740202 11134 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:02.781454  5340 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.803s (SENT)
I20260709 13:18:02.707600 10954 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:02.782778  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.783165  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 400) took 1549 ms. Trace:
I20260709 13:18:02.742338 10980 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:02.783665  5442 rpcz_store.cc:276] 0709 13:18:01.234025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.748732 (+1514707us) service_pool.cc:224] Handling call
0709 13:18:02.781810 (+ 33078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.782806 (+   996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.782833 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.782890 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:02.782919 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.782976 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.783107 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.781201  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:02.781677  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.789788  5340 leader_election.cc:336] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.923s (SENT)
W20260709 13:18:02.779655 11011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.229s	user 0.018s	sys 0.038s
I20260709 13:18:02.790874  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.764137 10893 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.761999 10974 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:02.736744 11173 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:02.771189 11048 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:02.795612  5340 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 3.025s (SENT)
I20260709 13:18:02.798276  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:02.799497  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.785579 11171 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:02.794513 11011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.018s	sys 0.038s
I20260709 13:18:02.797541  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:02.790583 10510 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:02.811570  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:02.815829 11182 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:02.815974  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:02.821996 11134 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.824630 11066 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:02.829943  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.871301  5522 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:02.871459  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.831236 10617 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.804172 10988 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:02.802840 11170 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:02.856410 10974 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.869886 10657 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:02.861119 11102 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:02.807905 11171 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:02.866860  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50975.9us
W20260709 13:18:02.877359  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.833801 11124 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.878764  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:02.879777  5442 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:02.870558 10727 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:02.856560 10980 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:02.887228  5517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34858 (request call id 404) took 1501 ms (client timeout 1608 ms). Trace:
W20260709 13:18:02.887872  5517 rpcz_store.cc:269] 0709 13:18:01.386086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.386252 (+   166us) service_pool.cc:224] Handling call
0709 13:18:02.887047 (+1500795us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540025cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:02.887167 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442006784}
I20260709 13:18:02.891930  5369 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:02.894398  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:02.896365  5375 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:02.896931  5375 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:02.900239  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.901811  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.903720  5367 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:02.903802  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:02.901175  5375 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.906925  5375 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:02.907713  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:02.909540  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 634910us
I20260709 13:18:02.910907  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:02.883062 11171 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.898905 11169 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:02.915347  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:02.921756  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:02.925504  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2867) took 2713 ms. Trace:
I20260709 13:18:02.925976  5441 rpcz_store.cc:276] 0709 13:18:00.211930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.734351 (+1522421us) service_pool.cc:224] Handling call
0709 13:18:01.735727 (+  1376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:01.736244 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.736277 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:01.781590 (+ 45313us) log.cc:844] Serialized 52 byte log entry
0709 13:18:02.146894 (+365304us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:02.388417 (+241523us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.925100 (+536683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.925182 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.925222 (+    40us) raft_consensus.cc:1685] finished
0709 13:18:02.925236 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.925394 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":528920,"prepare.queue_time_us":138903,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":3070,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11268,"thread_start_us":429967,"threads_started":2,"wal-append.queue_time_us":677246}
I20260709 13:18:02.937680  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:02.938377  5441 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:02.939271  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:02.939910  5441 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:02.945560  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:02.946403  5441 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:02.896260 11124 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:02.959151  5444 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2241) took 3158 ms (client timeout 2158 ms). Trace:
W20260709 13:18:02.960249  5444 rpcz_store.cc:269] 0709 13:17:59.800773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.889291 (+ 88518us) service_pool.cc:224] Handling call
0709 13:18:02.958931 (+3069640us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540019bc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:02.959084 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592977792}
I20260709 13:18:02.961334  5442 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:02.962013  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:02.962342  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:02.963070  5442 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:02.965929  5375 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:02.915266 10709 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:02.920002 11103 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:02.962957  5373 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:02.972141  5441 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:02.972950  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 401) took 1722 ms. Trace:
W20260709 13:18:02.976712  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 700283us
W20260709 13:18:02.955533 11122 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.506s	user 0.001s	sys 0.017s
I20260709 13:18:02.978619  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:02.977188  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:02.980973  5444 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:02.947041 10727 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:02.973273  5441 rpcz_store.cc:276] 0709 13:18:01.250436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.971389 (+1720953us) service_pool.cc:224] Handling call
0709 13:18:02.971957 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.972661 (+   704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.972898 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.953665 10980 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.987128  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 402) took 1736 ms. Trace:
I20260709 13:18:02.987793  5444 rpcz_store.cc:276] 0709 13:18:01.250752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.982335 (+1731583us) service_pool.cc:224] Handling call
0709 13:18:02.986446 (+  4111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.986669 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.986711 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.986773 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:02.986817 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.986898 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.987053 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:02.991338  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 80733.3us
I20260709 13:18:02.992136  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:02.994403  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2876) took 2514 ms. Trace:
I20260709 13:18:02.994799  5443 rpcz_store.cc:276] 0709 13:18:00.479687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.733146 (+1253459us) service_pool.cc:224] Handling call
0709 13:18:01.733551 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.733850 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:01.812875 (+ 79025us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.896289 (+1083414us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.976233 (+ 79944us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.993912 (+ 17679us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.994059 (+   147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.994101 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:02.994156 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.994224 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.994345 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1057824,"prepare.queue_time_us":185386,"prepare.run_cpu_time_us":17155,"prepare.run_wall_time_us":298374,"raft.queue_time_us":1053098,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7081,"spinlock_wait_cycles":16423424,"thread_start_us":181645,"threads_started":2,"wal-append.queue_time_us":673963}
I20260709 13:18:02.997399  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:02.997570 11103 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:02.998646 11103 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.999107  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:03.001977 10954 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:03.002624 10954 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:03.002935 11035 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:03.003338 11035 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.003715 11035 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:03.003679 10954 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.010864  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:03.012967  5375 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:03.013991  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:03.002568  5441 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:18:03.014592  5441 pending_rounds.cc:85] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 9
I20260709 13:18:03.015002  5441 pending_rounds.cc:107] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:18:03.015718  5441 raft_consensus.cc:2889] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.018548  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 405) took 1767 ms. Trace:
I20260709 13:18:03.020396  5441 rpcz_store.cc:276] 0709 13:18:01.251552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.984724 (+1733172us) service_pool.cc:224] Handling call
0709 13:18:03.002129 (+ 17405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.018281 (+ 16152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.018494 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.021368  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:03.027952  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:03.002645  5521 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:03.022167  5443 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:03.028311  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2889) took 1344 ms. Trace:
I20260709 13:18:03.017581  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:03.032516  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2888) took 1391 ms. Trace:
I20260709 13:18:03.035223  5443 rpcz_store.cc:276] 0709 13:18:01.641350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.996803 (+1355453us) service_pool.cc:224] Handling call
0709 13:18:02.997104 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.032192 (+ 35088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.032448 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.036216  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:03.037281  5443 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:03.038587  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2890) took 1318 ms. Trace:
I20260709 13:18:03.038782  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:03.039251  5443 rpcz_store.cc:276] 0709 13:18:01.720206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.036523 (+1316317us) service_pool.cc:224] Handling call
0709 13:18:03.037032 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.038072 (+  1040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.038497 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.040251  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:03.031916  5521 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:03.041879  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:03.041441  5441 rpcz_store.cc:276] 0709 13:18:01.683834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.027504 (+1343670us) service_pool.cc:224] Handling call
0709 13:18:03.027819 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.027998 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.028022 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.028063 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:03.028092 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.028141 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.028256 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.047241  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2893) took 1284 ms. Trace:
I20260709 13:18:03.054867  5441 rpcz_store.cc:276] 0709 13:18:01.762873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.046306 (+1283433us) service_pool.cc:224] Handling call
0709 13:18:03.046711 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.046910 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.046935 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.046980 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:03.047012 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.047066 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.047182 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.053632  5521 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:03.025193  5442 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:02.958611 11169 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:02.986320 11044 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:03.061060  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2895) took 1265 ms. Trace:
I20260709 13:18:03.056764  5443 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:03.116756  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.060030 11128 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:03.052140 11051 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.125672 11183 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.470257  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:03.470899  6073 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:02.983301 11122 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:03.183756 11151 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:18:03.226015  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 185811us
I20260709 13:18:03.472189  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:03.403869  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.236723 10954 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:03.461470  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 394151us
I20260709 13:18:03.057875 11101 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:03.463801 11106 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.816s	user 0.010s	sys 0.015s
I20260709 13:18:03.191442 10709 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:03.465720  6042 leader_election.cc:336] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 2.995s (SENT)
I20260709 13:18:03.068427  5444 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:03.485754  6042 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:03.486114  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2887) took 1845 ms. Trace:
I20260709 13:18:03.486608  5444 rpcz_store.cc:276] 0709 13:18:01.641081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.989218 (+1348137us) service_pool.cc:224] Handling call
0709 13:18:03.057980 (+ 68762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.485821 (+427841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.486050 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.116786 11156 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:03.466856  5442 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:03.467839  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2892) took 1720 ms. Trace:
W20260709 13:18:03.467850  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.468366  5441 rpcz_store.cc:276] 0709 13:18:01.796085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.060287 (+1264202us) service_pool.cc:224] Handling call
0709 13:18:03.060597 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.060768 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.060791 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.060831 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:03.060865 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.060915 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.061006 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:03.220984  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 226506us
W20260709 13:18:03.463801 11160 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.699s	user 0.033s	sys 0.029s
W20260709 13:18:03.502002  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.472077 11150 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:03.507161  5444 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:03.470762 11183 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.485137  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2877) took 2992 ms. Trace:
I20260709 13:18:03.472450 11103 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:03.507974  5448 rpcz_store.cc:276] 0709 13:18:00.492427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.752400 (+1259973us) service_pool.cc:224] Handling call
0709 13:18:01.752807 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.753065 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:01.814317 (+ 61252us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.484614 (+1670297us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b18002c62c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287
0709 13:18:03.484723 (+   109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.484793 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:03.484847 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.484930 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.485075 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125784,"prepare.queue_time_us":219223,"prepare.run_cpu_time_us":10130,"prepare.run_wall_time_us":285618,"raft.queue_time_us":740472,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6205,"spinlock_wait_cycles":18194304,"thread_start_us":403243,"threads_started":3,"wal-append.queue_time_us":527987,"wal-append.run_cpu_time_us":11165,"wal-append.run_wall_time_us":1123648}
I20260709 13:18:03.510005 11103 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:03.491788  5443 rpcz_store.cc:276] 0709 13:18:01.747367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.054686 (+1307319us) service_pool.cc:224] Handling call
0709 13:18:03.056448 (+  1762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.467598 (+411150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.467787 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.511101 11122 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:03.516570  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:03.525188  5369 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:03.527891  5366 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:03.529285  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:03.530715  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.531424  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.531805  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.532143  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.532580  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.511417 11103 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:18:03.546416  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:03.547350  5366 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:03.476559  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:03.493412  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:03.463995 11066 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:03.553244 11066 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:03.553836 11066 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.499766  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:03.469530 11167 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:03.484401  5516 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:03.550784 11006 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.551095 11175 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:03.551640 11184 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:03.549942  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:03.499540 11035 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.506713 11160 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:03.583501  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 106996us
W20260709 13:18:03.587257  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 121845us
I20260709 13:18:03.492599 11106 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.512995 10954 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.617022  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:03.577008 11151 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:18:03.639436  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.644840  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:03.651966  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.629339  5369 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:03.543056 11122 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:18:03.611106 11150 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:03.710067 11150 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.712534 11150 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:03.713006  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34858 (request call id 406) took 1282 ms. Trace:
I20260709 13:18:03.713392  5519 rpcz_store.cc:276] 0709 13:18:02.430584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.430820 (+   236us) service_pool.cc:224] Handling call
0709 13:18:03.712849 (+1282029us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540018ef54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:03.712951 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456008064}
W20260709 13:18:03.716017 10893 consensus_meta.cc:287] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.015s
I20260709 13:18:03.716480 10893 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:03.712442  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2857) took 3926 ms. Trace:
I20260709 13:18:03.717839  5449 rpcz_store.cc:276] 0709 13:17:59.786217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.513598 (+1727381us) service_pool.cc:224] Handling call
0709 13:18:01.517101 (+  3503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.559865 (+ 42764us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:01.814462 (+254597us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.884262 (+1069800us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b180043c0c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:18:02.980615 (+ 96353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.980688 (+    73us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:02.980744 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.712197 (+731453us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b540033d6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:03.712255 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.712378 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":442843,"prepare.queue_time_us":295911,"prepare.run_cpu_time_us":10094,"prepare.run_wall_time_us":395279,"raft.queue_time_us":993770,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5877,"spinlock_wait_cycles":103506560,"thread_start_us":437417,"threads_started":3,"wal-append.queue_time_us":490946,"wal-append.run_cpu_time_us":2897,"wal-append.run_wall_time_us":1325968}
I20260709 13:18:03.663139  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:03.664618  5340 leader_election.cc:336] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.846s (SENT)
I20260709 13:18:03.609537 11006 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.666656 11190 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.667251 11106 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:03.647092 11044 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:03.670869 10980 consensus_meta.cc:287] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.677s	user 0.014s	sys 0.000s
I20260709 13:18:03.672103  5521 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
W20260709 13:18:03.673353 11048 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.869s	user 0.010s	sys 0.008s
I20260709 13:18:03.639550 11195 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.642204 11169 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:03.676303 11198 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:03.678740 10967 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:03.645048 11101 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:03.680158 11126 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:03.680502  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2878) took 2715 ms. Trace:
I20260709 13:18:03.682212  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2255) took 3671 ms. Trace:
I20260709 13:18:03.742637  5450 rpcz_store.cc:276] 0709 13:18:00.010846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.609474 (+1598628us) service_pool.cc:224] Handling call
0709 13:18:01.609812 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.340414 (+730602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.681948 (+1341534us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b540007f3d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:03.682142 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582039424}
I20260709 13:18:03.685957  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2575) took 2203 ms. Trace:
I20260709 13:18:03.744537  5524 rpcz_store.cc:276] 0709 13:18:01.482572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.482726 (+   154us) service_pool.cc:224] Handling call
0709 13:18:01.483102 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.327763 (+844661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.685686 (+1357923us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54003a3754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:03.685865 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845625088}
I20260709 13:18:03.688946 11035 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:03.689714 11124 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:03.689582  5371 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:03.690603 11160 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:03.693698 11171 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.769s	user 0.003s	sys 0.025s
I20260709 13:18:03.694905 11183 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:03.696302 10704 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:03.696966 11013 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.280s	user 0.025s	sys 0.003s
W20260709 13:18:03.698434 10997 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 1.044s	user 0.011s	sys 0.019s
W20260709 13:18:03.699113  5372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2113) took 4007 ms (client timeout 2075 ms). Trace:
W20260709 13:18:03.702035 10830 consensus_meta.cc:287] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.078s	user 0.018s	sys 0.003s
I20260709 13:18:03.603804 11167 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:03.704499 11066 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:03.722422  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57842us
W20260709 13:18:03.728009  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 64964.3us
I20260709 13:18:03.765272  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:03.729034  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.721694 10954 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:03.733310 11019 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.733829 11156 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.742560  5445 rpcz_store.cc:276] 0709 13:18:00.967704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.321052 (+1353348us) service_pool.cc:224] Handling call
0709 13:18:02.324139 (+  3087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.324395 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:02.324725 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.925332 (+600607us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.679539 (+754207us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.680093 (+   554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.680153 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:03.680192 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.680269 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.680427 (+   158us) inbound_call.cc:177] Queueing success response
0709 13:18:03.691428 (+ 11001us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b180038aee0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
Metrics: {"mutex_wait_us":474189,"prepare.queue_time_us":505222,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":1629,"raft.queue_time_us":547586,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":200,"spinlock_wait_cycles":27324544,"thread_start_us":619900,"threads_started":3,"wal-append.queue_time_us":280646}
I20260709 13:18:03.737886 11169 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.774648 11169 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:03.775563  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:03.776283  5521 raft_consensus.cc:2368] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19.
I20260709 13:18:03.777086  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:03.777705  5519 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.777807  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:03.778416  5445 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.778476  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:03.779320  5522 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:03.779615  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:03.780195  5442 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.780220  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:03.781244  5520 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:03.758502 10997 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:03.787073  6069 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:03.788368 10997 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:03.789085  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:03.791527  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:03.794775  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:03.797923  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.799034  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:03.799969  5443 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:03.757002 10510 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.739701 10967 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:03.735940 11150 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:03.756384  5372 rpcz_store.cc:269] 0709 13:17:59.691554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.721754 (+ 30200us) service_pool.cc:224] Handling call
0709 13:18:03.698814 (+3977060us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b5400051ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:03.698992 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6304806656}
I20260709 13:18:03.759048 11103 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.766166  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:03.809350  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:03.735803 11195 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.770987 11013 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.829612  5374 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:03.770709 11035 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.773305 11156 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.774060 11006 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:03.754644 11171 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.801752  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2590) took 2179 ms. Trace:
W20260709 13:18:03.749799  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 199962us
I20260709 13:18:03.804526  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:03.769515  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:03.787688  5442 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:03.853986  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:03.811578  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:03.748310  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 282607us
I20260709 13:18:03.830786  5445 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:03.834241 10617 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.861711 11019 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.862036 10617 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.836048  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:03.858664  5523 rpcz_store.cc:276] 0709 13:18:01.622169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.623713 (+  1544us) service_pool.cc:224] Handling call
0709 13:18:01.623982 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.836969 (+212987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.801415 (+1964446us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540016cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:03.801676 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443266304}
I20260709 13:18:03.800382 10954 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:03.841228 10893 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:03.841929 11035 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.844549 11167 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:03.848346 11013 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.835151 11051 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:18:03.850800 10967 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:03.854285 11200 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:18:03.893082 10617 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:03.893836  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2880) took 2924 ms. Trace:
I20260709 13:18:03.894232  5446 rpcz_store.cc:276] 0709 13:18:00.969410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.578352 (+1608942us) service_pool.cc:224] Handling call
0709 13:18:02.578795 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.462376 (+883581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.462420 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:03.463010 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.613178 (+150168us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:03.613305 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.613479 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.893600 (+280121us) raft_consensus.cc:1685] finished
0709 13:18:03.893623 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.893765 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":386794,"raft.queue_time_us":385605,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":15360,"thread_start_us":434388,"threads_started":2,"wal-append.queue_time_us":282973}
I20260709 13:18:03.839564 11156 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:03.864512  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53057.7us
I20260709 13:18:03.867522  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:03.896761  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:03.897998  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:03.768628 10830 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.898962 11169 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.868182 11206 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:03.876492  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:03.876806  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:03.877261 11195 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:03.903146  5517 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:03.876582  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:03.878734  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2600) took 1431 ms. Trace:
I20260709 13:18:03.835193 11150 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.903889  5516 rpcz_store.cc:276] 0709 13:18:02.448002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.496487 (+ 48485us) service_pool.cc:224] Handling call
0709 13:18:03.877320 (+1380833us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400379bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:03.878675 (+  1355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117069568}
I20260709 13:18:03.899426 10689 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:03.900121  5515 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:03.834419 11101 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.901901  6072 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:03.902444  5449 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:03.882570 11183 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:03.830345 10510 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.905187  5515 raft_consensus.cc:614] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:03.831914 11103 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:03.905676  6076 raft_consensus.cc:2368] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18.
I20260709 13:18:03.860867  5372 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 15.
I20260709 13:18:03.866460  6069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59508 (request call id 186) took 1109 ms. Trace:
I20260709 13:18:03.908666  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:03.921061  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:03.918125  5518 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:03.786041  5519 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:03.911412 11171 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:03.905089 10893 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:03.930830  5340 leader_election.cc:400] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18.
I20260709 13:18:03.933578  5340 leader_election.cc:403] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.912774 10967 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:03.936425  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.907002 11206 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:03.911522 10689 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:03.911895 11013 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:03.908922 11183 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.938304  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:03.905006 11156 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:03.922266 11208 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.936547 11209 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:03.909152 11048 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:18:03.934748 10893 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.966655  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:03.973318  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:03.935096 10983 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:03.978700  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:03.982048  5414 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.001s
I20260709 13:18:03.987884  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:03.958767 11131 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.930917 11106 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:03.991559  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:03.979344  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:04.010176  5370 raft_consensus.cc:2368] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:04.003640  5372 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:03.995607  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:03.948585 11207 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.993239 10954 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:03.988827  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:04.026611  5374 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:03.997833  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.027859  5443 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:04.028792  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.030169  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:03.981630 11124 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.003386  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:04.038563  5369 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:04.006182  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.040118  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.040844  5446 raft_consensus.cc:2368] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18.
I20260709 13:18:04.041597  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.042409  5446 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:18:04.043268  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.044094  5446 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.045037  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:03.998715  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:03.996477  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:03.918430  6069 rpcz_store.cc:276] 0709 13:18:02.756549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.760681 (+  4132us) service_pool.cc:224] Handling call
0709 13:18:03.859463 (+1098782us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540049d9d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:03.866358 (+  6895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188794112}
I20260709 13:18:03.993327 11051 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.005499  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:03.947227 10617 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.006592  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2905) took 1247 ms. Trace:
I20260709 13:18:04.022132  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:04.023540  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44289.1us
I20260709 13:18:04.066648  5450 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:03.980858 11183 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.011267  5373 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:04.003069  5519 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 17.
W20260709 13:18:04.031049  5367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.016s
I20260709 13:18:04.037012  5443 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 13: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:04.003252  5414 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.009s	sys 0.001s
I20260709 13:18:04.069864  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2968) took 1004 ms. Trace:
I20260709 13:18:04.029356 10983 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:04.006929 11126 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:18:04.050138  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 111953us
W20260709 13:18:04.088057  5340 leader_election.cc:336] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.656s (SENT)
I20260709 13:18:04.088171  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:04.088614  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:04.051496  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2906) took 1292 ms. Trace:
I20260709 13:18:03.996305 11209 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:04.005170 10893 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:03.980448 11157 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:18:03.977747 10973 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:18:04.054355  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.003813 11190 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:04.060286  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51720 (request call id 87) took 1603 ms. Trace:
I20260709 13:18:04.060523  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.064893  5441 rpcz_store.cc:276] 0709 13:18:02.759047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.492342 (+733295us) service_pool.cc:224] Handling call
0709 13:18:03.492691 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.492889 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:03.741281 (+248392us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.006018 (+264737us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.006260 (+   242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:04.006310 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:04.006349 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.006420 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.006534 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":224357,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":7129,"raft.queue_time_us":172,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":18522,"spinlock_wait_cycles":39191424,"thread_start_us":491684,"threads_started":2}
I20260709 13:18:03.995208 11198 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:18:04.071157  5367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.016s
I20260709 13:18:04.004041 11208 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.074084  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:04.071655  5375 rpcz_store.cc:276] 0709 13:18:03.065716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.065849 (+   133us) service_pool.cc:224] Handling call
0709 13:18:03.464449 (+398600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.464673 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:03.465086 (+   413us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.748405 (+283319us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800256540. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:18:04.067896 (+319491us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:04.067970 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:04.068028 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.068106 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.069629 (+  1523us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":52,"spinlock_wait_cycles":29004032,"thread_start_us":319161,"threads_started":2}
I20260709 13:18:04.004365 10964 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:18:04.048712  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.047333 11203 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:04.074064  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.082367  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.194293  5450 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:04.010401 11128 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:18:04.024981 11131 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.101207  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:04.119488  5446 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:04.050486 11124 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.047292  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:04.132050  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.123661  5515 rpcz_store.cc:276] 0709 13:18:02.447300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.591739 (+144439us) service_pool.cc:224] Handling call
0709 13:18:04.050084 (+1458345us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002dbc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d86853 00007fc1d8d5460a 00007fc1d22da7d4 00007fc1d22da762 00007fc1d22da691 00007fc1d22da60c 00007fc1d22d98c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:04.050212 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3007044480}
I20260709 13:18:04.249126  5373 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:04.076277 11122 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.036638 10954 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.145246  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.069518 11066 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.098420 11169 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:04.098773 10830 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:04.124447  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.202517  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.195340  5449 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:04.195516  5374 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:04.252285  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2965) took 1294 ms. Trace:
I20260709 13:18:04.282912  5446 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.283223  5368 rpcz_store.cc:276] 0709 13:18:02.957757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.958056 (+   299us) service_pool.cc:224] Handling call
0709 13:18:02.978557 (+ 20501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.978809 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:03.051098 (+ 72289us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.749989 (+698891us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b18003ee0c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:18:04.250987 (+500998us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:04.251280 (+   293us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:04.251646 (+   366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.251940 (+   294us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.252200 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":72126,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"spinlock_wait_cycles":17806208,"thread_start_us":500363,"threads_started":2}
I20260709 13:18:04.248479 11156 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.103173 11209 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.048674 10689 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.262470  5442 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.075029 10617 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.263981  5445 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:04.194308  5443 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:04.266786 11217 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.068858 11051 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.086386 11044 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:18:04.269271  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.102504 11218 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:04.279121  5416 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:04.187749  5372 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:18:04.284162  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.205446 11035 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:04.186246 10983 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:04.296614  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 249395us
I20260709 13:18:04.523686  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.527231  5450 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:18:04.470207  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 296051us
I20260709 13:18:04.529211  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.530992  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.531849 11216 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.532303  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.534910  5442 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:04.511445 11191 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:18:04.535516  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 463384us
I20260709 13:18:04.524163  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:04.469949  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 381887us
I20260709 13:18:04.552858  5450 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:04.554091  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.556320  5442 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:18:04.364840  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.249711 10709 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:04.399606  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:04.543494  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:04.535372  5445 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:04.561008  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.564025  5441 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:04.450302 11229 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:18:04.451236 11215 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:18:04.404038 11220 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:18:04.567611  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:04.565266  5450 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:04.577292  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.577958  5450 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:18:04.578260  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 299217us
I20260709 13:18:04.578802  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.579370  5416 leader_election.cc:400] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:04.280241 11027 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.371965 11048 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:04.570034  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:04.403012 11224 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:18:04.571681  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.601603  5442 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:04.269008 11122 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:04.572829  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48774.2us
I20260709 13:18:04.407119 11169 raft_consensus.cc:993] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
W20260709 13:18:04.394731 11202 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.449s	user 0.001s	sys 0.001s
I20260709 13:18:04.289330 11013 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.534618 11216 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.569542  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.623481  5443 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.580020  5416 leader_election.cc:403] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.401548 10830 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.401229 11092 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.586007  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:04.587141  5520 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:04.587523  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.629310  5523 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.629776  5516 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:18:04.595003 11134 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:04.588917  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.446888 11128 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:04.591169  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:04.592202  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:04.593914  5340 leader_election.cc:336] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.753s (SENT)
I20260709 13:18:04.526736 11218 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:04.651182  5371 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 2955) took 1760 ms (client timeout 1604 ms). Trace:
W20260709 13:18:04.657943  5371 rpcz_store.cc:269] 0709 13:18:02.890648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.890838 (+   190us) service_pool.cc:224] Handling call
0709 13:18:04.650869 (+1760031us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400185bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:04.651035 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795940224}
I20260709 13:18:04.597494  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.386336 10510 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:04.601006  5441 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 10: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:04.576047 10967 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
I20260709 13:18:04.602772  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.554806 11203 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:04.565407  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.614167  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.575713 10657 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.575575 10709 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:04.624243  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45084.7us
I20260709 13:18:04.577044 11198 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:04.280936 11066 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.631597  5516 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:18:04.699827  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:04.588260  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.634853  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.630313 11124 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:04.707258  5443 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.651937 11188 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:04.599680 11027 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.655973  5374 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 9.
W20260709 13:18:04.657011  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63135.7us
W20260709 13:18:04.601444 10704 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.002s
I20260709 13:18:04.207234 11190 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.295287 11167 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:04.660094  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.761024  5450 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.673048  5372 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:04.568166 11191 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:04.692636  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.762912  5442 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:04.619688 11048 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:04.562564 11217 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.698501  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.767174  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2910) took 2005 ms. Trace:
I20260709 13:18:04.767340  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.205096 11206 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.705055  5371 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:18:04.708196  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.345575 11156 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.647081 11092 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.709522 10967 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.712879 10709 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:04.636260 10830 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:04.715242  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 856127us
W20260709 13:18:04.716404 11227 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:18:04.717383 11203 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:04.719092 11233 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:04.720739 11230 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:18:04.727705 11066 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:04.696108 11134 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:04.729770  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:04.731338  5373 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:04.607498 11160 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.082s
W20260709 13:18:04.734887  5340 leader_election.cc:336] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Timed out: RequestConsensusVote RPC to 127.4.37.130:36703 timed out after 1.793s (SENT)
I20260709 13:18:04.778700 11232 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:04.735805  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:04.829056  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 93355.6us
I20260709 13:18:04.830060  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:04.831408  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:04.671295 11132 raft_consensus.cc:1081] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:04.731606 10657 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.667196 11218 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:04.746821  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:04.751703  6041 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.013s	sys 0.025s
W20260709 13:18:04.838548  6041 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.015s	sys 0.026s
I20260709 13:18:04.751543  5366 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:18:04.743213  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:04.703058 11044 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:04.636741 11013 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:04.845530  5517 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:04.765513  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.846553  5450 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:04.828459 11232 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:04.768049  5442 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:04.853619  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.854874  5442 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.767817  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.767635  5448 rpcz_store.cc:276] 0709 13:18:02.762275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.510006 (+747731us) service_pool.cc:224] Handling call
0709 13:18:03.510371 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.510722 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.510752 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:03.710047 (+199295us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b2c0003b228. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:18:03.710609 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.949936 (+239327us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:03.949978 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.950047 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.762159 (+812112us) raft_consensus.cc:1685] finished
0709 13:18:04.762180 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.767075 (+  4895us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131046,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":22586,"spinlock_wait_cycles":90159360,"thread_start_us":238859,"threads_started":1,"wal-append.queue_time_us":362653}
I20260709 13:18:04.855562  5441 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.649808 11238 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 13:18:04.732326 10954 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:04.863533  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.736517 11188 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:04.746845 11214 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:18:04.776392  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:04.776978  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.874559  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.874630  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.777412  5445 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:04.875808  5520 raft_consensus.cc:2410] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:18:04.876199  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.778050  5516 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:04.744220 11027 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:04.776998  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 169151us
I20260709 13:18:04.785140  5372 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:04.786631  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:04.780231  5446 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:18:04.878412 11156 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:04.782140 10967 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.876600  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:04.878750  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 92189.6us
I20260709 13:18:04.879354  5520 raft_consensus.cc:2393] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:04.773548 11012 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:04.879873 11242 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.229s	user 0.003s	sys 0.000s
I20260709 13:18:04.880470 10967 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:04.880188 11012 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.778151 11051 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:04.818015 11225 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:18:04.882411  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2970) took 1392 ms. Trace:
I20260709 13:18:04.882881 11092 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:04.819840 11236 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:18:04.785578 11234 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.321s	user 0.001s	sys 0.001s
I20260709 13:18:04.818440 11124 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:04.820283 11134 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.891716  5520 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:04.824877  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:04.894668  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 159780us
I20260709 13:18:04.639197 11235 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:04.825186  5515 raft_consensus.cc:606] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:04.849946 11219 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.806505 10709 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.847843  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:04.906306  5450 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:04.751806  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52083us
I20260709 13:18:04.701107 11244 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:04.866357  5523 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:04.874905 10657 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:04.883167 11012 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:04.821367 11217 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:04.807981 11233 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.879910  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:04.892680 10954 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:04.929234  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49411.4us
I20260709 13:18:04.887267  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.877100  5521 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:18:04.883688 10689 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:04.888197  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:04.883023  5367 rpcz_store.cc:276] 0709 13:18:03.490094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.490238 (+   144us) service_pool.cc:224] Handling call
0709 13:18:03.511549 (+ 21311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:04.131135 (+619586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:04.131177 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:04.131849 (+   672us) log.cc:844] Serialized 52 byte log entry
0709 13:18:04.585615 (+453766us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:04.653339 (+ 67724us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.668534 (+ 15195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.668650 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.882113 (+213463us) raft_consensus.cc:1685] finished
0709 13:18:04.882140 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.882330 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":949,"prepare.queue_time_us":263826,"raft.queue_time_us":91519,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":29695,"thread_start_us":933770,"threads_started":2,"wal-append.queue_time_us":449749}
I20260709 13:18:04.896054  5515 raft_consensus.cc:614] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:04.842648  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:04.849875 10617 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:04.847757 11246 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:04.846110 11245 raft_consensus.cc:2764] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:04.863222 11232 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.914004  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:04.916759  5441 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:04.943434  5448 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:04.884176 11188 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.920979  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:04.924350 11051 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:04.945644  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 114373us
I20260709 13:18:04.876540 11191 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:04.895952 10893 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.759s	user 0.012s	sys 0.002s
W20260709 13:18:04.921305 11207 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.890s	user 0.013s	sys 0.000s
I20260709 13:18:04.827874 11048 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.899039 11238 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:04.935222  5447 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:18:04.930755 10954 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:04.950913  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 65808.2us
I20260709 13:18:04.924594 10704 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:04.946062  5442 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:04.933521 11235 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:04.936736 10689 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.945684  5450 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:04.955247  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:04.938753 11012 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:04.946506  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:04.930195 11157 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.920807 10709 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.981304  6077 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:04.938607  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:04.937903 11246 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:04.967602 10954 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:04.968317 11183 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.884s	user 0.004s	sys 0.008s
I20260709 13:18:04.990281 11183 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.992499 11183 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:04.993600 11241 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:04.994640  5516 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:04.994151 11235 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.988572 11012 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:04.995939 11246 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.996359 11012 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.997558 11237 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:04.998158 11237 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.999297 11233 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:04.969175  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48279.4us
I20260709 13:18:04.965867 11207 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18.
I20260709 13:18:05.000612 11237 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:04.915098 11219 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.983665 11254 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:04.973489 10704 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.001273 11240 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:18:04.982192 10830 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:05.002983  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2913) took 1235 ms. Trace:
I20260709 13:18:05.020097  5449 rpcz_store.cc:276] 0709 13:18:03.767233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.767351 (+   118us) service_pool.cc:224] Handling call
0709 13:18:05.002789 (+1235438us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b540029dbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:05.002918 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96732032}
I20260709 13:18:04.925010 11244 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:04.980485  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:04.969352 11250 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:05.035182  5441 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:04.976890 10689 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:05.013235  5448 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:04.994029 11124 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:04.966449 10893 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.001924 11239 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:18:05.018848  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 63708.3us
I20260709 13:18:04.970963 11051 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:05.027515  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47092.7us
I20260709 13:18:05.033964 11240 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:05.034853 11019 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:05.035382 11250 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.036880 10510 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.000559  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.064126  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.082031  5373 raft_consensus.cc:2410] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:05.065223  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.066285  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:05.082715  5371 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:05.027395 11254 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:04.984074 11157 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.087891 11157 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.094529 11150 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.096853 11254 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.103953 11208 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:05.105233  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 104739us
W20260709 13:18:05.105398 11255 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:18:05.106140  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.106541 11244 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.107368  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.107941 11217 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:05.108827 11217 consensus_queue.cc:1243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:05.109404  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2602) took 2660 ms. Trace:
I20260709 13:18:05.110484 11027 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:05.112186  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.113065  5367 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:05.081283 11250 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:05.114686 11266 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.115036 11258 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:05.116596  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.118238  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.118404  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.107081  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.120357  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:05.124256  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.130616  5372 raft_consensus.cc:2410] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:05.055714 11124 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.130662  5371 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:05.109882  5518 rpcz_store.cc:276] 0709 13:18:02.448679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.675482 (+226803us) service_pool.cc:224] Handling call
0709 13:18:02.695511 (+ 20029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.931893 (+1236382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.109046 (+1177153us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002dbc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:05.109316 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2809149824}
I20260709 13:18:05.045843 11245 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:05.137861 11257 raft_consensus.cc:2764] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:05.141340  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:05.143249  5371 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.080124 11019 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.107154 11244 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.138939 11257 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.077975 11238 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.146733  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:05.144637  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.165457  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:05.148562 11256 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:18:05.129251 10510 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.151374 11103 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.147565 11013 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:05.078261 11240 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:05.160339 11252 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:18:05.161618 11051 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:05.163041 10709 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:05.168946 11262 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 13:18:05.142158 11195 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.243227 11195 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:05.171291  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.129352 11258 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:05.129604 11208 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:05.136206 11150 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.251336 11150 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.253695 11150 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.136402 11124 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:05.200644 11253 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:18:05.080279 11206 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:18:05.204416  5447 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:05.259505 11246 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.262092 11246 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.154979 11019 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:05.266544 11226 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.001s	user 0.000s	sys 0.004s
I20260709 13:18:05.198163 11238 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.217533 11240 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:05.199934 11244 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:05.220717 10510 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:05.224232 11223 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.492s	user 0.000s	sys 0.004s
I20260709 13:18:05.224890 11013 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.225468 11103 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.278365 11103 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.279372 11195 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.205925 11218 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.280915 11103 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.082195 11191 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:18:05.172608  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:05.282403 11218 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.186766 10893 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:05.245771  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:05.283186 10704 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.147128 11245 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:05.269196 11238 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.286550 11131 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:05.277295 11013 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:05.289736 11209 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.709s	user 0.013s	sys 0.001s
I20260709 13:18:05.290621 11013 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.285466 11124 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:05.290211 11209 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:05.298784 11103 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:05.306757 11019 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.292479 11245 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:05.297322 11240 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.309386 11103 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:05.302263 10954 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.313262 10954 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.291237 10689 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.316943 11126 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:05.317932 11126 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:05.319139 10689 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:05.319362 11103 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.319533 11126 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.320437 11044 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:05.307443 11232 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.320916 11126 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.286803 11250 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:05.321059 11209 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:05.320863 11103 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.319073 11266 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.328250 11124 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:05.329162 11122 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:05.324723 11232 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.185277  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:05.398396  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 213195us
I20260709 13:18:05.400519  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:05.403865  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.406544  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:05.409359  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.416290  5368 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:05.424616  5366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2155) took 1461 ms (client timeout 1913 ms). Trace:
W20260709 13:18:05.438201  5366 rpcz_store.cc:269] 0709 13:18:03.965515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.966321 (+   806us) service_pool.cc:224] Handling call
0709 13:18:05.424108 (+1457787us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b540015bdd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:05.424366 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701330816}
I20260709 13:18:05.441538  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.178526  5371 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:05.451648  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.452863  5371 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:05.430120  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.454407  5374 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:05.455672  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:05.456583  5374 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:05.457021  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.432159  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.458123  5373 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:05.459585  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.460530  5373 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:18:05.434063  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.462222  5367 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:18:05.463495  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.435794  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.466039  5369 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:05.467211  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.468075  5369 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:05.437459  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:05.470484  5370 raft_consensus.cc:2410] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:05.472136  5370 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:05.426512  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2157) took 1442 ms. Trace:
I20260709 13:18:05.426427  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.473891  5441 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:05.474574  5372 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:05.226750  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2333) took 1225 ms. Trace:
I20260709 13:18:05.473697  5375 rpcz_store.cc:276] 0709 13:18:03.983863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.184653 (+200790us) service_pool.cc:224] Handling call
0709 13:18:04.262909 (+ 78256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.518446 (+255537us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:04.800976 (+282530us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.039747 (+238771us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.040235 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.041203 (+   968us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:05.041478 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.054919 (+ 13441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.055001 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.312302 (+257301us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b18002362c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:05.425844 (+113542us) raft_consensus.cc:1685] finished
0709 13:18:05.425893 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.426275 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39728,"prepare.queue_time_us":328558,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":306773,"raft.run_cpu_time_us":613,"raft.run_wall_time_us":43656,"spinlock_wait_cycles":47385472,"thread_start_us":678364,"threads_started":4,"wal-append.queue_time_us":138773}
I20260709 13:18:05.476857  5442 rpcz_store.cc:276] 0709 13:18:04.001319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.868755 (+867436us) service_pool.cc:224] Handling call
0709 13:18:04.945882 (+ 77127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.970598 (+ 24716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.226447 (+255849us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b540007dad0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:05.226672 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130729344}
I20260709 13:18:05.479184  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:05.480535  5447 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:18:05.483253  5371 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:04.090370  5444 rpcz_store.cc:276] 0709 13:18:02.759362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.508811 (+749449us) service_pool.cc:224] Handling call
0709 13:18:03.538192 (+ 29381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.538403 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:03.902443 (+364040us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.051152 (+148709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:04.051215 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:04.051262 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.051331 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.051443 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6459,"prepare.queue_time_us":178226,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":85,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":15751,"thread_start_us":474312,"threads_started":2}
I20260709 13:18:05.484730  5375 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:18:05.446200  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.492810  5450 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:18:05.492960  5449 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:05.497963  5442 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:05.465240  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.486667  5375 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:05.333631 11066 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:05.522719 10704 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:05.523566 11066 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:05.525084  5369 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:05.525398  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:05.528765  6076 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:05.529398 11066 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.531476  5368 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:05.540620 11044 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.542567 11160 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.543064 11160 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.543460 11208 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:05.546805  5446 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2358) took 1373 ms (client timeout 1768 ms). Trace:
W20260709 13:18:05.547542  5446 rpcz_store.cc:269] 0709 13:18:04.173404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.283805 (+110401us) service_pool.cc:224] Handling call
0709 13:18:05.546260 (+1262455us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400239e54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:05.546537 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577013632}
I20260709 13:18:05.553890 11190 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.536197 11006 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.559655 11006 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.560199 11006 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.560022 11019 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.566210  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:05.568159 11191 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.569103 11195 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.569671 11128 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.570138  6077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 211) took 1027 ms. Trace:
I20260709 13:18:05.543516 11160 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:05.574254  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.573621  5366 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
I20260709 13:18:05.529407 11216 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.583366 11203 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:05.576375  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.324275 11188 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.590664 11250 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:05.593961  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:05.593784 11044 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.595022  6076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 210) took 1519 ms. Trace:
I20260709 13:18:05.595546  6076 rpcz_store.cc:276] 0709 13:18:04.075536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.075716 (+   180us) service_pool.cc:224] Handling call
0709 13:18:04.076038 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.529473 (+1453435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.594667 (+ 65194us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54005901d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:05.594929 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3303344896}
I20260709 13:18:05.596940 11044 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.594022  5443 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:05.597890  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 133044us
I20260709 13:18:05.598744  5373 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:05.598296 11203 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:05.602746 11195 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.604051 11191 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.533169 11219 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:05.613643  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 647622us
I20260709 13:18:05.576524  6077 rpcz_store.cc:276] 0709 13:18:04.542970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.543125 (+   155us) service_pool.cc:224] Handling call
0709 13:18:04.571212 (+ 28087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.981767 (+410555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.569532 (+587765us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400409f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:05.569922 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942652672}
I20260709 13:18:05.618170 11066 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:05.620080 11245 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:05.626596  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60825.9us
I20260709 13:18:05.626962 11188 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.627187 11190 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.632716 11203 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.645371 11208 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.648475 11235 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:05.649989 11235 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:05.650560 11235 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:05.654460 11245 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.652998 11235 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.679381  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2615) took 1092 ms. Trace:
I20260709 13:18:05.680075  5522 rpcz_store.cc:276] 0709 13:18:04.586560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.587510 (+   950us) service_pool.cc:224] Handling call
0709 13:18:05.678537 (+1091027us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b540016bcd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:05.679015 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859143424}
I20260709 13:18:05.684368 11101 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:05.684931 11190 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.685902 11044 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:05.686508 11044 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:05.686594 11190 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:05.688699 11044 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:05.690855 11044 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.691205 11195 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.684494  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2356) took 1583 ms. Trace:
I20260709 13:18:05.697894  5448 rpcz_store.cc:276] 0709 13:18:04.101237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.950219 (+848982us) service_pool.cc:224] Handling call
0709 13:18:04.970598 (+ 20379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.046762 (+ 76164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.683940 (+637178us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b540019cb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:05.684306 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97513856}
I20260709 13:18:05.691841 11190 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:05.711362  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 202337us
I20260709 13:18:05.706156  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:05.709360  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2934) took 1015 ms. Trace:
I20260709 13:18:05.722945  5441 rpcz_store.cc:276] 0709 13:18:04.690407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.233268 (+542861us) service_pool.cc:224] Handling call
0709 13:18:05.233893 (+   625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.474588 (+240695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.699647 (+225059us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54003bc754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:05.706141 (+  6494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535440768}
I20260709 13:18:05.742166  5374 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:05.745632 11235 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:05.739213  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.746841  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:05.684640 10954 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:18:05.744477  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 414) took 1034 ms. Trace:
I20260709 13:18:05.755990  5515 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:18:05.756778  6077 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:05.757956 11190 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.750953 11245 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:05.775578  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 247898us
I20260709 13:18:05.786530  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.754545  5447 rpcz_store.cc:276] 0709 13:18:04.710076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.486762 (+776686us) service_pool.cc:224] Handling call
0709 13:18:05.488844 (+  2082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.494323 (+  5479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.494392 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.495130 (+   738us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.563218 (+ 68088us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:05.611083 (+ 47865us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.615857 (+  4774us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:18:05.633259 (+ 17402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.633339 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:05.723422 (+ 90083us) raft_consensus.cc:1685] finished
0709 13:18:05.740174 (+ 16752us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:05.744384 (+  4210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10635,"prepare.queue_time_us":49945,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":76,"raft.queue_time_us":43883,"raft.run_cpu_time_us":3260,"raft.run_wall_time_us":59427,"spinlock_wait_cycles":24996096,"thread_start_us":67600,"threads_started":1,"wal-append.queue_time_us":149615}
I20260709 13:18:05.775518 10954 consensus_queue.cc:1243] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 53eb858bdf82438d83f1be6a01da2e0e log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:18:05.801530 11283 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:18:05.799290  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:05.804908  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 90408.4us
I20260709 13:18:05.795045 11191 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.809592 11219 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.810988  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.810806 11219 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.813409  5515 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:05.818651  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:05.819873 10983 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:05.820272 10689 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:05.820504 10983 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:05.820727 10689 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.821136 10689 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:05.821779 10983 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.824951  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.825724  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:05.826982 10984 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:05.827098  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:05.827538 10984 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.828009 10984 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:05.835383  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:05.836709 10954 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:05.842253 10967 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:05.843096 10967 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.843560 10967 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.837450 10954 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:05.852583  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.858929  5522 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:05.859491  5515 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:05.867281 11209 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:05.876358  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.880473 11006 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.888038 11126 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:05.890426  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:05.857841 11219 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.897037  5367 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:05.896486  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.895288  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:05.903501 10967 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.918407  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.919953 10984 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.912245 11219 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:05.923573  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69705.2us
I20260709 13:18:05.928164  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:05.934725  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.940644  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.941589  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.942837  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:05.943845  5524 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:05.943691  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:05.944718 11208 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.944880  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:05.945616 11128 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:05.938720  5441 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:18:05.947124 10984 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:05.947065  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:05.947983 11126 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.948155 10704 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:05.948861 11126 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:05.949048 11006 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:05.949347 11126 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:05.949824 11126 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:05.952423  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:18:05.953732 11260 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:05.953763  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.874s (SENT) [suppressed 33 similar messages]
I20260709 13:18:05.954312 11260 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.954757 11260 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.928220 11219 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.955641 11219 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:05.955127  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:05.963075 10954 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.965672 11208 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:05.966266 11208 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:05.966693 11208 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.973196  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:05.974112  5441 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:05.979472  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:05.981540  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:05.982067  5449 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:05.982474  5444 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:05.982494  5449 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:05.984462  5523 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:05.986392  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:06.012293  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58545.9us
I20260709 13:18:06.018086  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:05.953347 11160 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:05.985874 11044 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:06.027427 11066 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:06.027617  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.028271 11066 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:06.028375  5449 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:06.023428  5442 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:18:06.030244  5442 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.030638  5442 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.031275  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.032226  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:06.033006  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.033373  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:06.021713  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.033665  5369 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 13.
I20260709 13:18:06.036082  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:05.982625 11235 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:06.039547  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.038309  5371 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: [15.10-16.11]
W20260709 13:18:06.041821  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.042805  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.047431  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.049183  5366 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:06.046294  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.050185  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.052342  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.054471  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:06.055565  5523 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:06.053871  5445 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:18:06.060454  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:06.061126  5375 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.037179 10689 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.062762  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.064035  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.064749  5368 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:06.066011  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.066855  5374 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:18:06.067405  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.054571  5450 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:06.069819  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.073237  5449 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:06.075914  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:06.077685  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.087695  5366 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:06.087064  5273 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 5 to 8, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 8 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.089473  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:06.089731  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.091671  5523 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:06.092113  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:06.092911  5373 raft_consensus.cc:2393] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:06.095311  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:06.097071  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:06.098217 10704 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:06.098989 10704 consensus_queue.cc:1243] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:06.099570 10704 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:06.100641 11288 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:18:06.109277 11287 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.081s	user 0.004s	sys 0.000s
I20260709 13:18:06.110783 11160 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:06.114846 11128 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:06.115686 11128 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:06.057157 11066 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:06.037176 11044 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.144886  5375 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:18:06.077558  5371 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:06.146611  5443 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:18:06.142664  5442 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.117261 11128 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.154817  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.043304 11208 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:06.069700 10967 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:06.180856  5442 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:06.185309  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:06.142385 10983 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:06.177469  5517 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:18:06.188674  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.155990 11128 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.198959  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:06.196411  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:06.201808  6076 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:06.202036  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:06.202819  5448 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:06.206065 11260 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.208410 11260 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:06.210515 11126 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.175118 10689 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:06.212845 11290 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:18:06.213805  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 84505.5us
I20260709 13:18:06.213138  5448 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:06.217723 11066 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:06.218145  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 2984) took 1150 ms. Trace:
I20260709 13:18:06.218538  6077 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:06.218616  5370 rpcz_store.cc:276] 0709 13:18:05.067204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.473140 (+405936us) service_pool.cc:224] Handling call
0709 13:18:05.778784 (+305644us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67eee 0000000000375939 00007fc1d8cdb1e0 00007fc1d8da40c4 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:05.779015 (+   231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.784127 (+  5112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.784159 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.798554 (+ 14395us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.991848 (+193294us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:05.991886 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.991952 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.107564 (+115612us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:06.217874 (+110310us) raft_consensus.cc:1685] finished
0709 13:18:06.217901 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.218061 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2703,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":1287,"spinlock_wait_cycles":19159168,"thread_start_us":143161,"threads_started":1,"wal-append.queue_time_us":189704}
I20260709 13:18:06.228372  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:06.235707  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:06.236248  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.236886  5370 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:06.237708  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:06.238606 11245 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:06.239877  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 57122us
I20260709 13:18:06.240746  6076 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:06.238610 11208 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:06.195003 10983 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.247714  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:06.248826  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.249125  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.223522 11126 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:06.255735 10689 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:06.255964  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 106887us
I20260709 13:18:06.256399 10689 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:06.256934 10689 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:06.257823 11260 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:06.259418 11260 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:06.259862 11260 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:06.261817  5447 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:06.265076  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.265340  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.265775  5370 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:06.266819  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.267527  5375 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:06.268249  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:06.268944  5371 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:06.269038 10689 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.269827  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:06.270211  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:06.270543  5374 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.271050  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.271647  5450 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:06.272320  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.274338  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.277302  5445 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:06.265111  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:06.282766  5446 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:06.280681  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:06.285634 10689 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:06.269609  5441 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:18:06.286621  5441 pending_rounds.cc:85] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 8
I20260709 13:18:06.286851  5441 pending_rounds.cc:107] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:18:06.287184  5441 raft_consensus.cc:2889] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:06.288041 11292 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:06.290313  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:06.291216 11128 raft_consensus.cc:2764] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:18:06.294358  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:06.297684 11203 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:06.298442 11203 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:06.299594 11203 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:06.250124 10983 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:06.264387 11044 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:06.269726 11289 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:18:06.304550  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:06.306159 11044 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:06.311431  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 52726.5us
I20260709 13:18:06.315968  5449 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:18:06.316565  5449 pending_rounds.cc:85] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 11
I20260709 13:18:06.316862  5449 pending_rounds.cc:107] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:18:06.317103  5374 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:06.317834  5449 raft_consensus.cc:2889] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:06.319061  5366 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:06.326179  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:06.327281  5448 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:06.330109  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:06.331543  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:06.337073  5441 raft_consensus.cc:2368] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
W20260709 13:18:06.334645  5269 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 157) took 19795 ms (client timeout 15000 ms). Trace:
I20260709 13:18:06.261016 11260 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.342079  5445 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:06.343045  5444 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:06.346413  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:06.332964 11044 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:06.348232  5273 catalog_manager.cc:5697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 11, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 11 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.369656  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.370541  5374 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:06.376614  5446 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:06.379352  5375 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:06.381640 10984 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:06.382288 10984 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.382737 10984 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.393498  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:06.393005  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:06.396236  5369 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.361207 11044 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:06.407737  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 88129.9us
I20260709 13:18:06.411128  5448 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:06.437413  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:06.443585  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:06.445056 11191 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:06.446274 11206 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:18:06.448619 10984 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.450258  5369 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:18:06.454818  5273 catalog_manager.cc:5697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 8 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 11 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.459833  5273 catalog_manager.cc:5697] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:06.466053 10984 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:06.467146 10984 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:06.498888 11044 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:06.506552 11219 consensus_meta.cc:287] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.005s
I20260709 13:18:06.507014 11219 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.509871  5373 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:06.435695 11260 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:06.509234 11219 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:06.530916  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:06.532593  5522 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:06.560135  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 338147us
I20260709 13:18:06.566154  5446 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:18:06.339089  5269 rpcz_store.cc:269] 0709 13:17:46.545031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.552231 (+  7200us) service_pool.cc:224] Handling call
0709 13:18:06.325223 (+19772992us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:58.789470 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:58.790219 (+   749us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:58.790267 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:17:58.790280 (+    13us) tablet.cc:662] Decoding operations
0709 13:17:58.791399 (+  1119us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:58.791455 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:58.791486 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:17:58.793123 (+  1637us) tablet.cc:701] Row locks acquired
0709 13:17:58.793147 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:17:58.834316 (+ 41169us) write_op.cc:270] Start()
0709 13:17:58.855543 (+ 21227us) write_op.cc:276] Timestamp: P: 1783603078831375 usec, L: 0
0709 13:17:58.857524 (+  1981us) op_driver.cc:348] REPLICATION: starting
0709 13:17:58.930826 (+ 73302us) log.cc:844] Serialized 4764 byte log entry
0709 13:17:58.965078 (+ 34252us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d0c820ac 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b
0709 13:18:01.089620 (+2124542us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:01.563917 (+474297us) op_driver.cc:464] REPLICATION: finished
0709 13:18:01.844091 (+280174us) write_op.cc:301] APPLY: starting
0709 13:18:01.856831 (+ 12740us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:03.125377 (+1268546us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:03.125436 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:03.719894 (+594458us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:03.720127 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:18:03.720172 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:03.720514 (+   342us) log.cc:844] Serialized 112 byte log entry
0709 13:18:04.075147 (+354633us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.121362 (+ 46215us) write_op.cc:454] Released schema lock
0709 13:18:04.179428 (+ 58066us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:04.362354 (+182926us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.371758 (+  9404us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":796,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":263226,"apply.run_cpu_time_us":78596,"apply.run_wall_time_us":2437171,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":433385,"prepare.run_cpu_time_us":26708,"prepare.run_wall_time_us":492265,"raft.queue_time_us":388945,"raft.run_cpu_time_us":35251,"raft.run_wall_time_us":206913,"replication_time_us":2706203,"spinlock_wait_cycles":593702912,"thread_start_us":1257113,"threads_started":5,"wal-append.queue_time_us":1316058,"wal-append.run_cpu_time_us":47702,"wal-append.run_wall_time_us":4023390}]]}
I20260709 13:18:06.587219  5522 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:06.589088  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:06.583343 11206 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.610559 11219 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:18:06.641541 11295 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:06.642796  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:06.643986 11208 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:06.644533  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:06.646045 11066 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:06.618036 11206 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:06.666150  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.653435 11206 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.653645 11219 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:06.652254 10983 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:06.710067  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65605.7us
I20260709 13:18:06.711374  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:06.712276  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 381142us
W20260709 13:18:06.731383  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 294040us
I20260709 13:18:06.746214  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:06.749395 11126 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.761752 11126 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.767020  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:06.767935  5522 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:06.770062 11300 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.771557  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:06.774199 11066 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:06.774722 11066 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.775131 11066 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:06.780342 11126 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:06.793893 11219 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.743330 11235 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:06.732621 11191 consensus_queue.cc:1243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:18:06.811115  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62987.6us
W20260709 13:18:06.832455  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 433206us
I20260709 13:18:06.832140 11245 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:18:06.906209 11311 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:06.906795 11311 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:06.907172 11311 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:06.835469 11191 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:06.926247 10983 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:06.920243 11066 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:06.916934 10967 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:18:06.985713  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 204070us
W20260709 13:18:06.986384  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 194570us
I20260709 13:18:06.994046 11128 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.994300 11308 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:18:06.995301 11308 consensus_queue.cc:1243] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:06.994832 11044 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:06.993439  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:07.002873  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:06.995996 11044 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:07.004240 11126 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:06.995005 11128 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.008951 11128 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.006876 11126 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.010905 11126 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.010010  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:06.988653 11203 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.032045  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.033234  5522 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
W20260709 13:18:07.017515 11260 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.004s
I20260709 13:18:07.004241  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:07.035053  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 290792us
W20260709 13:18:07.039134  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 204896us
I20260709 13:18:07.040881  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:07.039783  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.048523  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.044045  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.029366 11128 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.059736  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:18:07.065321  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 164136us
I20260709 13:18:06.995962 11310 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:18:07.005527 11044 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.078850  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.063313 11260 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:07.066409 11191 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:07.088951  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84780.8us
I20260709 13:18:07.037868 11203 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:07.110126  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:07.085117 10954 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.114261 10954 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.115248 11044 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.090075 11191 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.116178 11191 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.118831 11325 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:07.119024  5490 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.120373 11316 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:07.131474  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.134080 10954 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:07.135972 11309 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:18:07.139899 10954 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:07.136600 11066 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.140813 11066 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:07.141247 11066 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.141700 11066 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.137852  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:07.145004  5517 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.138636 11203 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.136214 11235 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.063908 11293 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:18:07.086036 11322 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.154567  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:07.154546 10954 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:07.154381 11324 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:07.111145 11128 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:07.083900 11321 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.176270 11128 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.176744 11128 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.176451 11321 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.168859 11324 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.179549 11324 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.180102  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.181221 11321 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.181887 11321 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.182435 11321 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.185742  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.120831 11316 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.087785 11208 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:07.187561  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56216.6us
I20260709 13:18:07.192113  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:07.188215  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 113442us
I20260709 13:18:07.196285  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.194988  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.200364  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.161868 11322 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.204241  5367 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:07.204797  5373 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:07.204749  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.205603  5375 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:07.194684 11316 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:07.208209  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53729.1us
I20260709 13:18:07.191604 11321 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.219465  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.160816 11235 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.232014 11322 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.232190  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.221202 11260 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:07.221015 11203 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:18:07.219864  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.196926 11310 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.220218 11209 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:07.237625  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.222720  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.223474 11319 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:07.234432 11293 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:07.243414  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.244119  5515 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:07.218225 11219 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:07.250854  5340 leader_election.cc:400] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 10 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 10. Current term is 11.
I20260709 13:18:07.252012 11219 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.252545 11219 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.253643 11066 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:07.245173  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 76201.8us
I20260709 13:18:07.233680 11235 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.250396 11335 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:07.250087 10954 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.267478  5517 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:07.244451 11322 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:07.243753 11319 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.244921 11293 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:07.254393 11321 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.254639 11260 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:07.291595  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.281724 11334 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:18:07.294584  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.281473 11306 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:07.242192 11126 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.245018 11310 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.286625 11323 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.286028 11322 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.325474  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.263504 11208 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:07.291344 11319 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.309670 11331 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.326115 11322 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.327550 11306 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:07.344312 11328 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:07.346474 11343 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.344640 11312 raft_consensus.cc:2764] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:18:07.370929 11327 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:18:07.327095 11323 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.373487 11332 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:07.374521 11339 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.375178 11339 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.375615 11323 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.374414 11332 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:07.389041 11339 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.391381 11339 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.391916 11339 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:07.394394 11339 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:07.390113 11332 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.369798 11328 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:07.361790 11235 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:07.412587  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 118101us
I20260709 13:18:07.377442 11343 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.421816 11328 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:07.430581  5414 leader_election.cc:336] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.606s (SENT)
I20260709 13:18:07.364667 11333 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.440236  5517 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:07.440490  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:07.440904  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.441823 11235 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:07.442729 11323 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.446174 11323 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.446552 11235 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:07.447388 11206 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.740s	user 0.014s	sys 0.000s
I20260709 13:18:07.447906 11206 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.343825 11311 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.450073 11206 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.368111 11260 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:07.451432 11324 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.450789 11311 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:07.444052  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101708us
I20260709 13:18:07.442845 11306 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.445593  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:07.457845  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 191869us
I20260709 13:18:07.472574  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.473814  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.474519  5367 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:07.474927 11128 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.475528  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.476115  5366 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:07.462359 10983 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:18:07.477752  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.478415  5371 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:07.363790 11293 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:07.479460  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:07.479792 11293 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.480118  5368 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.482124  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:07.465813 11331 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.482762  5370 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.482973 11331 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.486271 11325 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.473984 11311 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.486825 11325 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:07.487704  5375 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:07.489137 11325 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:07.489864  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:07.477110 11128 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.493093  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.494067  5446 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
W20260709 13:18:07.494315  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 149586us
I20260709 13:18:07.501217  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.511929  5447 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 16: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:07.513717  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:07.514660  5442 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.463001 11126 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.454195 11191 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.494100 11324 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.523924  5441 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:07.485292 11331 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.528563  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:07.523301  5371 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07d1fef577c411787d1f686a4774389"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:59536
I20260709 13:18:07.531188  5371 raft_consensus.cc:606] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.531635  5371 raft_consensus.cc:614] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:07.525171 11339 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.525849 10954 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.534785 11339 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.535220 10954 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.458212 11333 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.537079 11339 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:07.556411  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 125861us
I20260709 13:18:07.556896  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.537501  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:07.538794 11333 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.537659 11310 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.560674  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:07.558102  5515 raft_consensus.cc:606] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:07.560346  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 91213us
I20260709 13:18:07.561653  5445 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:07.541522 10954 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.569468  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.569985  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:07.557621  5523 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:07.570513  5524 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:07.578557  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:07.525548 11321 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:07.526028 11311 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.584388 11128 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.587388  5373 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:07.554296 11126 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.543511 11343 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.543488 11191 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.595700  5368 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:18:07.610476  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:07.559265 11324 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.668313  5442 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:07.585124 11128 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.655632 11325 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:07.670542  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:07.671041  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84949.9us
I20260709 13:18:07.673581  5370 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:07.673712  5447 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.675778  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.676101 11337 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:07.676527 11335 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:07.677091  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.676673 11337 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.677395  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.678965  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:07.679505  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:07.680094 11337 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.680968 11350 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.681696 11350 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.681886 11324 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.680105  5516 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.684502 11324 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.685173 11209 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.685802  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.686467  5443 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:07.687356  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:07.685825 11209 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:07.688472  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.688643  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.689193  5450 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:07.690124  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.676523  5517 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:07.691272  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.692045  5450 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:07.692716  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.689106  5443 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:07.691929 11209 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.694931  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.694950 11335 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.698325 11335 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.697185  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.702071  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:07.688244  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:07.586194 11333 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.571887 11331 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:18:07.599264 11351 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:07.717175  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.720088  5442 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:07.706326  5516 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:07.692919  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:07.715657  5445 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:07.723325  5450 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.725891  5369 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:18:07.590075 11260 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:18:07.684406 11350 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.599988 11311 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:07.726785  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62979us
I20260709 13:18:07.735328  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.737771 11066 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.654371 11322 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:07.739114  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 64936.6us
I20260709 13:18:07.654894 11126 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:07.743986  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.745915  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.746490  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.746801  5515 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:07.747581  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:07.748390  5517 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:07.749413 11260 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:07.749883 11260 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:07.750696 11260 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.752566 11260 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.757848  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:07.758503  5442 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.759220  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:07.759752 11126 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:07.760329 11316 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.002s
I20260709 13:18:07.763728  5444 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 10.
I20260709 13:18:07.763854 11316 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.768018  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:07.764858 11353 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:18:07.757861  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.779613  5449 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:07.780752  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.781453  5449 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:07.782425  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.734391 11361 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.769100  5445 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:07.793248 11361 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.793828  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.795363 11219 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.796260 11343 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:07.796705 11343 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.797145 11343 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.770323  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.772697  5442 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:07.772802  5447 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:07.773003  5450 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:07.774721  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.783201  5449 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:07.785755  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.787175 10983 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:07.789201 11128 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.792044 11323 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.804134  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.712064 11325 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.815769  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.822615  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.823109  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.823448  5366 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:07.823729  5373 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:07.802815  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.824419  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.723788 11333 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.820803  5443 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:18:07.825845  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50287.8us
I20260709 13:18:07.829933  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.830289  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:07.830724  5370 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:07.831337  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:07.830824  5368 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:07.831921  5372 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.837318 11316 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:07.739094 10984 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:18:07.839241 10984 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:07.839768 10984 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:07.840359  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:07.840649 10984 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.842430  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.845974 11316 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:07.846998 10983 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:07.847138 11311 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.847625 10983 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:07.851155  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:07.818817 11359 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:07.866412 11359 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.825186  5441 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
W20260709 13:18:07.880139  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 77400.6us
I20260709 13:18:07.881366  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.819301 11219 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:07.888778  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.820210 11126 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.891865  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.901202  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.727458 11351 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.889117  5339 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:07.936229  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47173.9us
W20260709 13:18:07.936480  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44736us
I20260709 13:18:07.853242 11128 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:07.881815 11331 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.939193  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:07.944178  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.945539  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:07.946463 11066 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:07.946904 11066 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:07.947266 11066 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.947335  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:07.938673  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:07.948022 10983 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:07.951929 11369 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:07.952724 11369 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:07.953111 11369 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.953467 11369 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:07.954339 11351 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.954973 11351 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:07.884514 11359 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:07.960640  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59518us
I20260709 13:18:07.898658 11219 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:07.962139  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56575.7us
I20260709 13:18:07.979645  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:07.904393 11311 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:07.980646  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:07.934383 11340 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:07.903513 11367 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:07.943504 11128 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.959932 10954 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:07.957018 11208 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:08.028468 11208 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.028920 11208 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:08.030552  5368 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:08.031788  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.032401  5368 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:07.941812 11323 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:07.955417 11351 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:08.033814  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:07.979229 11219 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.989157 11066 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:07.988135 11337 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:08.010449 11368 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.107s	user 0.001s	sys 0.001s
I20260709 13:18:08.011576 11325 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:07.981928 11332 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.981400 10984 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.038975 11332 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:07.989872 11319 consensus_meta.cc:287] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.011s
I20260709 13:18:07.988485 11311 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.024821  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.053574  5443 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 15.
I20260709 13:18:07.995554 11191 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:08.027287  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46699.5us
I20260709 13:18:08.049783  5369 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:08.034478  5373 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:08.063596  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:08.072154 11371 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:08.068837 11347 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:18:08.074345 11366 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:18:08.043079 11319 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:08.076663 11319 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.050654 11066 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.077350 11191 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:08.061486 11367 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:08.078405 11191 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.079501 11367 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.086745  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:08.089867 11347 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:08.090423 11347 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:08.091490 11347 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.092864 11347 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.093561 11365 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:08.094208 11365 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:08.014540 11340 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.026917 11128 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.010407 11349 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:18:08.026394 11350 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:08.026815 10954 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:08.101996  5373 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:08.061651 11311 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:08.013967 11310 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:18:08.105934  5368 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:08.102423 11066 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:08.101678 11340 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:08.104213 11312 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.034406 11351 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:08.157018 11375 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:08.150040 11361 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.114576 10954 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:08.154773  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:08.155900  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.137202 11323 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:08.172729  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:08.110368 11350 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:08.165882  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.132002 11235 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:08.115463 11322 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.168730  5373 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 14: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:08.181589  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:08.192166  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:08.192742  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.193186  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:08.193574  5370 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:08.192238  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:08.095130 11365 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.202314  5518 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:08.202572  5520 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:08.179024 11350 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:08.227514  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56003.4us
I20260709 13:18:08.228403  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:08.163717 11312 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.261354  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.261909  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:08.273759  5370 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 19.
I20260709 13:18:08.184383 11323 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.275839  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:08.189338 11235 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.281855  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:08.289554  5516 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:18:08.306110 11377 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:08.274235 11327 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:18:08.311223 11312 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.260313 11333 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.312227 11333 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.312733 11333 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.315073 11333 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.316524 11208 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.322744 10967 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:08.323235 10967 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:08.324048 10967 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.325086 10967 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.288280 11354 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:08.296260 10689 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:08.327517 10689 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:08.327606  5414 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.874s (SENT)
I20260709 13:18:08.328387 10689 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.288050 11349 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:08.335075  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.333784  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.335945  5369 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 11: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:08.336812  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.336874  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.329957 11349 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:08.337993  5369 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:08.329386 10689 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:08.337356 11260 consensus_meta.cc:287] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.001s
I20260709 13:18:08.379436 11381 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:08.389146 11066 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:08.265744 11322 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.375099  5372 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
I20260709 13:18:08.450919 11322 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.451431  5372 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:08.452895  5372 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:08.454222  5372 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:08.334425 11219 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.363696 11349 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.457824 11324 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:08.458288 11324 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:08.459158 11324 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.392656 11332 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:08.460597 11324 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:08.393733  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66152.9us
W20260709 13:18:08.398700 11370 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.441s	user 0.003s	sys 0.000s
I20260709 13:18:08.402551 11208 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:08.371634 11374 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:18:08.418926  5369 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:08.420297  5373 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:18:08.438696 11381 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:08.471804  5366 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:08.471575 11381 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.415575  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:08.473737  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 58296.1us
I20260709 13:18:08.429847  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:08.475118 11294 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:08.475710 11294 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:08.476573 11294 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:08.478849  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.480065  5366 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [16.8-18.9]
I20260709 13:18:08.484289  5366 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:08.440860 11378 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:08.453218 11322 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:08.489313 11343 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.000s
I20260709 13:18:08.509939 11208 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:08.547099 11384 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:18:08.547571 11203 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:08.573354 11328 raft_consensus.cc:993] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:08.573542 11208 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.574292 11328 raft_consensus.cc:1081] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:08.576174 11208 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:08.578554 11337 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.001s
I20260709 13:18:08.578994 11337 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:08.579890  5368 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:08.580651 11219 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.559181  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.561208 11323 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:08.563109 11359 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.000s
I20260709 13:18:08.564874 11235 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.438526 11369 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.585522  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:08.606526  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:08.616595  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 354737us
I20260709 13:18:08.616881  5446 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:08.607488  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.607731  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:08.619649  5447 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.622365  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.623260  5448 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:08.608265  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:08.608465  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.614675  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:08.621495  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:08.625885  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.627067  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:08.627537  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.629172 11332 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:08.633378  5449 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:08.633623  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:08.635540 11332 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.638763 11332 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:08.640024 11203 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:08.640471 11203 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:08.640830 11203 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.531558 11343 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.648342  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:08.647588  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 317490us
I20260709 13:18:08.652390  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:08.649498  5416 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:08.653044  5414 leader_election.cc:336] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.900s (SENT)
I20260709 13:18:08.653680  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:08.653939  5371 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:08.625908 11319 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.680955  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:08.597172 11311 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.641942 11322 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:08.714015  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:08.719344  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 98133.7us
I20260709 13:18:08.722070  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:08.714119  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:08.615592 11128 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.648209 11191 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:08.665290 11312 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:08.735592  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:08.745286  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:08.750310  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:08.738862  5447 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:08.727707  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:08.714649 11347 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:08.663343 11361 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:08.755081 11306 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:08.755522 11361 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:08.755806 10689 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:08.756182 11311 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.756332  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:08.756408 10689 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:08.720867 11323 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:08.754626  5371 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:08.726540 11219 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:08.760848  5524 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:18:08.764401  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:08.658550 11310 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 13:18:08.748831 10954 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.553s	user 0.006s	sys 0.005s
I20260709 13:18:08.718884 11322 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.743530 11337 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:08.645496 11349 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.740629 11191 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.616155 11359 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.573374 11340 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.771149  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:08.749125 11312 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:08.800787  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 146863us
I20260709 13:18:08.749495 11365 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:08.717527 11319 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:08.776042  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 190641us
I20260709 13:18:08.785797  5370 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:08.787384  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:08.791889  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:08.762372 11323 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:08.753185 11328 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:18:08.747572 11354 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:18:08.770262 11208 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.768098 11219 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:08.772497  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:08.756601 11361 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.835891  5369 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:08.801985  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:08.803872  5371 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:08.837808 11369 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.838847  5371 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:18:08.838974  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47179us
I20260709 13:18:08.839996 11319 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:08.841720  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:08.843302 10967 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:08.845464  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.846261 11359 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.846820 11381 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:08.847591 11381 consensus_queue.cc:1243] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:08.848037 11381 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:08.848342 11381 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:08.783563 11322 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.809113  5523 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:08.805717 11312 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.737885 11066 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.810056  5370 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:08.808717  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:08.782091 11347 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:08.790855 11310 consensus_queue.cc:1243] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:08.796145 11191 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:08.791191 11306 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:08.832760  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.839988  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:08.852924  5516 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:08.850991 11219 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:08.831419 11325 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:08.858137 11386 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:08.787250 11337 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.841360  5524 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:18:08.866513  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57892.7us
I20260709 13:18:08.812945 11323 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:08.861536  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:08.872319  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99889.7us
I20260709 13:18:08.875582  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:08.841341  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:08.902048  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:08.878763  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:08.782711 10954 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:08.890726  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 237702us
I20260709 13:18:08.902345  5517 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.878427 11369 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:08.857730  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.903450  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:08.917322  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.903288  5370 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 15.
I20260709 13:18:08.909742  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:08.918244  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:08.918305  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.919548  5370 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:08.914898  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 74975.6us
I20260709 13:18:08.921936  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.922809  5448 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:08.927537  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.928941  5443 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 18 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:18:08.930321  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:08.930943  5441 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:08.931797  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:08.932575  5450 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:08.900192 11337 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.876813 11332 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.958263  5370 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:08.849613 10689 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.866662 11392 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.204s
I20260709 13:18:08.916960 11369 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.924944 11343 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.926394 11361 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.967829  5370 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:18:08.971716  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:08.980298  5368 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:08.951803 11128 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:08.906312 11325 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.933281 11386 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:08.982146  5517 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:08.948513 11396 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:08.990373  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 69659us
I20260709 13:18:08.973066 11369 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:08.900197 11381 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:08.991155 11351 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:08.963466 11321 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:18:09.012081 11376 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.548s	user 0.004s	sys 0.001s
I20260709 13:18:09.015563 11393 raft_consensus.cc:2764] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:18:09.015805 11385 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:09.016053 11402 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.017480 11399 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:18:09.017846 11401 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:18:09.018440 11403 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:18:09.018800 11398 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:09.019642 11381 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:09.064150 11324 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.008s
I20260709 13:18:09.020097 11405 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:08.981740 11347 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.069777 11405 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:09.072353 11405 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.073602 11388 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.998160 11306 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.036103 11415 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:09.058976 11332 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.011775 11351 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.990940 11361 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.025619 11345 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.263s
W20260709 13:18:09.080504 11408 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:09.021245 11354 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260709 13:18:09.082031  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 163921us
I20260709 13:18:09.080595 11415 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:09.078665  5441 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:09.031414 11385 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:09.098984  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.100114  5368 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:09.075130 11340 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.103878 11345 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:09.114257  5370 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:09.114897  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:09.108731  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 112698us
I20260709 13:18:09.077836 11349 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:09.100926 11351 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:09.135794  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:09.134063  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:09.137746 11327 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:09.288324  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:09.289391  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:09.138800 11325 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.075794 11402 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.134869 11332 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.143872 11361 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:09.145843 11350 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.883s	user 0.008s	sys 0.004s
I20260709 13:18:09.151129 11415 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:09.329804 11415 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:09.329504 11350 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.330356 11415 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:09.331346 11415 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.331977 11350 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.151434  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3035) took 1079 ms. Trace:
I20260709 13:18:09.335364  5372 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:09.155686 11337 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:09.156592 11208 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:09.157461 10954 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.131445 11343 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:18:09.167975  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:09.182106 10983 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:09.189875 11319 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.173111 11359 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:09.203135  5370 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:09.074244 11388 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.362665  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:09.363876  5370 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:09.210052 11219 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:09.214900  5414 leader_election.cc:336] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.519s (SENT)
I20260709 13:18:09.218971 11191 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.220854  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2218) took 1414 ms. Trace:
I20260709 13:18:09.121141 11386 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.126904 11128 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:18:09.127018 11345 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:09.232903 11385 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.215842  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:09.224789 11351 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.242847  5268 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:09.252041  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:09.255043  5520 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:09.273310 11328 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:09.274660 11308 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:09.286911  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 152920us
I20260709 13:18:09.407011 11308 consensus_queue.cc:1243] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:09.407608 11308 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:09.407968 11308 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:09.304737  5523 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:09.410919 11328 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:09.411326 11328 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:09.316476  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:09.412235 11328 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.323904 11260 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 13:18:09.413584  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 97263.3us
I20260709 13:18:09.414069 11260 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:09.414347  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:09.326229 11402 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.327752 11406 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:09.415292 11406 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:09.416252 11406 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.328475 11332 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:09.350257  6076 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:18:09.333351  5374 rpcz_store.cc:276] 0709 13:18:08.072028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.467069 (+395041us) service_pool.cc:224] Handling call
0709 13:18:08.467389 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.467717 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.467745 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:08.468219 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:18:08.720243 (+252024us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:08.720302 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.720380 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:09.151184 (+430804us) raft_consensus.cc:1685] finished
0709 13:18:09.151212 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.151373 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10032,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":251664,"threads_started":1,"wal-append.queue_time_us":336768}
W20260709 13:18:09.351717  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 393674us
W20260709 13:18:09.353376  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 227498us
I20260709 13:18:09.418978  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:09.419729  5374 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:09.419835 11332 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:09.420285  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:09.420598  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:09.421203  5374 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:09.360499  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.399281  5520 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:09.429389  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:09.429917  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.431202  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.434882  5516 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:09.364595  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:09.367487  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.367666  5368 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:09.368966  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:09.345274 11203 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.001s
I20260709 13:18:09.314939 11235 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:09.450809 11345 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.451788  5370 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:09.452047 11345 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.454291  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.455462  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.456817  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:09.458475  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.459080  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.459764  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.449295  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:09.462872  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.464540  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.466516 11235 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:09.467623 11294 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:09.467711 11235 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.469141 11392 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:09.421059 10967 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:18:09.469818 11392 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:09.470901 11392 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:09.471832  5415 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:09.357622 10983 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:09.449739  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:09.478763  5520 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:09.479979  5520 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:09.364673  5375 rpcz_store.cc:276] 0709 13:18:07.806430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.806580 (+   150us) service_pool.cc:224] Handling call
0709 13:18:07.827295 (+ 20715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.955160 (+127865us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:08.213800 (+258640us) log.cc:844] Serialized 14 byte log entry
0709 13:18:08.510377 (+296577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.510432 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:08.510479 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.220617 (+710138us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400144954. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:09.220666 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.220799 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":305168,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":4521,"raft.queue_time_us":2630,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":23616,"spinlock_wait_cycles":293424896,"thread_start_us":546785,"threads_started":2,"wal-append.queue_time_us":424804}
I20260709 13:18:09.314682 11340 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:18:09.367163 11359 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:09.393798  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.504354  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.399127  5366 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:09.414458 11260 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:09.324915  5371 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:09.438793  5339 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:09.534716  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96049.2us
I20260709 13:18:09.422919  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:09.446524  5523 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:09.447324  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:09.447705  5518 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:09.536093  5374 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:09.448447  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:09.536300  5368 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:09.536821  5370 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:09.377991  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3032) took 1306 ms. Trace:
I20260709 13:18:09.441365  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:09.386287  5369 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:09.505998  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.509615 11418 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 13:18:09.261189 11312 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.537719  5372 rpcz_store.cc:276] 0709 13:18:08.071189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.454963 (+383774us) service_pool.cc:224] Handling call
0709 13:18:08.455291 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.336012 (+880721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.377084 (+ 41072us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54000faad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:09.377403 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023039232}
I20260709 13:18:09.514515 11337 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:09.372025 11319 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:09.408879 11308 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.517480 11388 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.401360 11208 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:09.521759  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:09.524586 11322 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.001s
I20260709 13:18:09.525704 11385 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.527550 11219 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.529235 11191 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:09.590126  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.591146  5523 raft_consensus.cc:2410] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:09.529893 11328 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:09.531510 11323 consensus_meta.cc:287] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.616s	user 0.000s	sys 0.009s
I20260709 13:18:09.607611  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:09.398706 11413 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.157s
I20260709 13:18:09.536725  5521 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.449586 11203 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:09.540174  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:09.540696  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99466.6us
I20260709 13:18:09.550215  5339 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:09.562295  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 137765us
I20260709 13:18:09.443993 11293 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:09.566324  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 143523us
I20260709 13:18:09.569947 11208 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:09.498054 11369 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.577602  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.558825 11335 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:09.572441 11407 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:09.661244  5374 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:09.655267  5368 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:09.659250  5367 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:09.675153  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3051) took 1456 ms. Trace:
I20260709 13:18:09.687338  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:09.591338 11347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.090s	sys 0.185s
W20260709 13:18:09.591645  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 376760us
I20260709 13:18:09.608887  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.688670  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:09.689499  5414 leader_election.cc:336] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.776s (SENT)
I20260709 13:18:09.566242 11128 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:09.599713  6076 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:09.591161  5375 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:09.570338 11332 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:09.629248  5373 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:09.710875  5372 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:09.711503  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:09.598394 11349 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.606935  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.689896  5444 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for term 22 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:18:09.689915  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:09.685240  5369 rpcz_store.cc:276] 0709 13:18:08.219165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.836793 (+617628us) service_pool.cc:224] Handling call
0709 13:18:08.837080 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.538892 (+701812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.674688 (+135796us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54002b3254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:09.675052 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262451072}
I20260709 13:18:09.574002 11419 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:09.721861  5375 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:09.702939 11347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.090s	sys 0.185s
I20260709 13:18:09.727213  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.610502 11306 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.615307  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.608650 11365 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:09.718307  5374 raft_consensus.cc:1217] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Deduplicated request from leader. Original: 13.9->[14.10-18.12]   Dedup: 16.11->[18.12-18.12]
I20260709 13:18:09.817469  5374 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [14.10-18.12]
I20260709 13:18:09.667929 11294 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.720824  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.678092 11319 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:09.758077  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 207931us
I20260709 13:18:09.708277  5520 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:18:09.836561  5371 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:09.836827  5520 pending_rounds.cc:85] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 14
I20260709 13:18:09.837196  5520 pending_rounds.cc:107] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:18:09.837524  5520 raft_consensus.cc:2889] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.760617  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.697041 11407 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.590027 11322 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.811589  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.813768  5372 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 13:18:09.709270 11332 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:09.708997 11128 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:09.829663  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.833148  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:09.766470  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78930.8us
I20260709 13:18:09.849023  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:09.652944 10967 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:18:09.613054 11323 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.851130  5369 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:09.726866 11406 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:09.859076  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.865162  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:09.862957  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:09.862963  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.766073 11416 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.763330 11388 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.836602 11324 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:09.628664 11359 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.841163 11407 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.846575 11332 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.860059  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:09.705641 11364 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 13:18:09.835912 11294 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.816816 11335 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:09.870795  5368 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:09.888206  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:09.888778  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 202067us
W20260709 13:18:09.867063  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 177571us
W20260709 13:18:09.903129  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.852913 11321 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:09.728245 11349 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.858390 11128 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:09.812376 11340 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:18:09.709684 11260 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.990764  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:09.994295  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.912599  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.910200  5375 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 21.
I20260709 13:18:09.958257  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.958927  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:09.884354 11343 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:18:09.959908  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:09.891427 11396 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.004s
I20260709 13:18:09.827888 11306 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:09.976068  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 87994.8us
W20260709 13:18:09.981876  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 259762us
I20260709 13:18:09.906128 11235 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:09.886248 11418 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:09.890205 11406 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:10.030314 11430 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:18:10.030514 11406 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:10.031960 11426 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:18:10.032135  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3058) took 1005 ms. Trace:
I20260709 13:18:10.032656  5370 rpcz_store.cc:276] 0709 13:18:09.026457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.452810 (+426353us) service_pool.cc:224] Handling call
0709 13:18:09.536599 (+ 83789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.537335 (+   736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.031925 (+494590us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b540015ccd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:10.032078 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191881472}
I20260709 13:18:09.839361 11422 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.199s
I20260709 13:18:10.004160  5368 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:09.964488 10617 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.042164  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.043222  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:10.043262  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 73518.2us
I20260709 13:18:10.044005  5517 raft_consensus.cc:2368] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20.
I20260709 13:18:09.895495 11347 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:18:09.956995 11351 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.017192  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:10.017716  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.018203  5523 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:10.023089 11396 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:09.981776 11321 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.894016 11388 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.982475 11066 raft_consensus.cc:2764] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:18:10.026994  5375 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:18:10.059894  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:09.980553 11381 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.039881  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:09.875095 11208 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.049790  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 431) took 1450 ms. Trace:
I20260709 13:18:09.891122 11416 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:09.976596 11359 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.068714  5369 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:09.992723 11319 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:18:10.028687 11418 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:10.036054 11260 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.061458  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.061245  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.035056 11312 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:10.044603  5414 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.924s (SENT)
W20260709 13:18:10.071863  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.085151  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.068918  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:10.062459 11321 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:10.086891  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:10.068998  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.095662 11322 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.106391  5521 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:10.106987  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.100492 11349 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:10.068399  5445 rpcz_store.cc:276] 0709 13:18:08.592271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.597665 (+  5394us) service_pool.cc:224] Handling call
0709 13:18:08.618755 (+ 21090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.619220 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.619261 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.020544 (+401283us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b2c0003b228. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:18:09.020954 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.357622 (+336668us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:09.497619 (+139997us) log.cc:844] Serialized 14 byte log entry
0709 13:18:09.599583 (+101964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.599676 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.035694 (+436018us) raft_consensus.cc:1685] finished
0709 13:18:10.042091 (+  6397us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.042307 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101662,"prepare.queue_time_us":90022,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":102498,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":28997,"spinlock_wait_cycles":12805888,"thread_start_us":336282,"threads_started":1,"wal-append.queue_time_us":609322}
W20260709 13:18:10.099114 11434 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 13:18:10.065092 11350 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:10.101492 11433 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:18:10.076692 11386 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.064855 11347 consensus_queue.cc:1243] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:10.081625 11369 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.082671 11413 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:18:10.141163  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96573.3us
I20260709 13:18:10.049229 10617 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:10.121986  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.078150 11381 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.136205  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3040) took 2062 ms. Trace:
I20260709 13:18:10.124162  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.139182  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.144616  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2229) took 1553 ms. Trace:
I20260709 13:18:10.106623 11365 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:10.105791 11345 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.006s
W20260709 13:18:10.148937  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 80101.8us
I20260709 13:18:10.151218  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:10.166038  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:10.153728  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.155449  5373 rpcz_store.cc:276] 0709 13:18:08.081671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.472673 (+391002us) service_pool.cc:224] Handling call
0709 13:18:08.472963 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.711072 (+1238109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.129337 (+418265us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000e06d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:10.136107 (+  6770us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2652512000}
I20260709 13:18:10.156440  5367 rpcz_store.cc:276] 0709 13:18:08.591652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.881308 (+289656us) service_pool.cc:224] Handling call
0709 13:18:09.658775 (+777467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.684401 (+ 25626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.125909 (+441508us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400331650. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:10.144521 (+ 18612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773073664}
I20260709 13:18:10.169492  5366 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:18:10.169921  5366 pending_rounds.cc:85] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 8
I20260709 13:18:10.170181  5366 pending_rounds.cc:107] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:18:10.170431  5366 raft_consensus.cc:2889] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:10.170578  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:10.175520  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:10.176398  5368 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:10.177249  5375 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 13:18:10.171994  5414 leader_election.cc:336] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.949s (SENT)
I20260709 13:18:10.157248 11325 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.181660  5520 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:18:10.182366  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.177853  5518 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:10.146590 11323 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:10.163537 11425 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:18:10.184671  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.194686  5445 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:10.083930 11335 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.186754  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.195811  5444 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:10.196344  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.196955  5450 raft_consensus.cc:2376] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20. Re-sending same reply.
I20260709 13:18:10.153332 11351 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.175081 11349 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:18:10.197705 11351 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.199398 11437 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:10.202126  5448 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:10.202428 11349 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:10.202864 11427 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.203064 11349 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:10.168576 11350 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:10.204077 11349 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:10.205236 11436 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:10.205570 11350 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:10.206779 11429 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:18:10.185614 10967 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:10.208755 10967 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:10.209249 10967 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:10.209697 11439 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:18:10.210281 10967 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.123683 11441 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:18:10.177070 11396 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:10.153534 11413 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:10.169319 11312 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:10.214636  5516 raft_consensus.cc:2410] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:18:10.168623 11422 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:18:10.216477 11422 consensus_queue.cc:1243] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:10.190681 11325 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:10.217286 11191 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:10.217578 11306 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:10.217765 11191 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:10.218428  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.218911  5369 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:10.219094  5443 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.218750 11191 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.221210 10689 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:10.192952  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.217101  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.182214  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:10.308840  5442 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:18:10.256559  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.268409  5521 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
W20260709 13:18:10.312192  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.312331  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.248973  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.315373  5447 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:10.211676 10967 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.327692  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.232735  5519 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:10.217123 11422 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:10.366451  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:10.373935  5448 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:10.355713  5445 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
W20260709 13:18:10.331995  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 168915us
I20260709 13:18:10.333935  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.366580  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:10.372346 11391 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:10.223995 11191 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:10.422555  5516 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:18:10.423185  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.422648  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.322716 11349 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.440873  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.441778  5442 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:10.433789  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.442519  5445 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.390337  5443 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:10.443919  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.444828  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3065) took 1090 ms. Trace:
I20260709 13:18:10.446076  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.448019  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.448732  5450 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:10.377329 11406 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:10.451179  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:10.321841 11343 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:18:10.453493  5443 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.458034  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.458854  5523 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:10.324486 11333 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:10.373623 11388 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.465349  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.466059  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:10.466718  5442 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:10.467533  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:10.461483  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.373701 11422 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:10.471282  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.443156 11393 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.449275 11402 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:10.479843 11443 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:10.554773 11422 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.193035 11418 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 7, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.557093 11418 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.469482 11333 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.564220 11333 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:10.572777 11294 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.006s
I20260709 13:18:10.574111  5448 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:10.576450  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.577581  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2306) took 1069 ms. Trace:
I20260709 13:18:10.577930  5523 rpcz_store.cc:276] 0709 13:18:09.508509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.472575 (+964066us) service_pool.cc:224] Handling call
0709 13:18:10.577512 (+104937us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.579586  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.580788  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.581578  5516 raft_consensus.cc:2410] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:18:10.581962  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2293) took 1126 ms. Trace:
I20260709 13:18:10.579061  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.582266  5516 rpcz_store.cc:276] 0709 13:18:09.455302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.580553 (+1125251us) service_pool.cc:224] Handling call
0709 13:18:10.581911 (+  1358us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:10.588965  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.598371  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2305) took 1090 ms. Trace:
I20260709 13:18:10.599179  5523 rpcz_store.cc:276] 0709 13:18:09.508197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.578777 (+1070580us) service_pool.cc:224] Handling call
0709 13:18:10.598258 (+ 19481us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:10.601060  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.463375 11381 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:10.606240  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 432665us
I20260709 13:18:10.606379  5445 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:10.476605 11325 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:10.615087  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:10.658438 11416 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.604803 11388 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.660113 11388 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.662415 11388 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.447140  5372 rpcz_store.cc:276] 0709 13:18:09.354845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.842337 (+487492us) service_pool.cc:224] Handling call
0709 13:18:09.883486 (+ 41149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.883710 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:10.040697 (+156987us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.444509 (+403812us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.444567 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:10.444607 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.444672 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.444778 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":145690,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":3506,"thread_start_us":530664,"threads_started":2}
I20260709 13:18:10.617290  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:10.658162  5445 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:10.476274 11413 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:10.633821 11347 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.634337 10617 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:10.637646 11351 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.573266 11294 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:10.650895  5444 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
W20260709 13:18:10.667728  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.480468 11443 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.671432  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.672147  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.676774  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:10.678917 11347 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:10.706066  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.682945  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.670579  5450 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
W20260709 13:18:10.707576  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.708459  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.697891  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:10.709844  5445 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:18:10.715951 11235 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.003s
I20260709 13:18:10.716454 11235 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:10.718909  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.717690  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2317) took 1200 ms. Trace:
I20260709 13:18:10.721088  5516 rpcz_store.cc:276] 0709 13:18:09.517371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.590244 (+1072873us) service_pool.cc:224] Handling call
0709 13:18:10.717622 (+127378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.483188 11393 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:10.732704  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.733484  5521 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:10.737308  5443 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:10.740206  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:10.741480  5450 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:10.720323 11351 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:10.745309  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.745880  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:10.740685 11128 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.001s
W20260709 13:18:10.750737  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.747594 11128 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:10.749315 11328 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.135s	user 0.019s	sys 0.001s
I20260709 13:18:10.742247 11365 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.766018  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.753806 11364 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.775175  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.774351  5524 raft_consensus.cc:2410] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:10.759279 11414 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.782516  5523 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:10.784551  5370 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:10.788262  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.763063 11351 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:10.788918  5516 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.795130  6041 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:10.780900 10617 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:10.796802  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64969us
I20260709 13:18:10.797668 11461 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:10.801155 11443 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:10.797160 10617 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.806025  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:10.807271  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:10.807986 11388 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:10.808320  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:10.809540 11388 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:10.810132 11416 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:10.810222 11388 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:10.810745 11416 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:10.811625 11416 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.814637  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:10.820391 11325 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:10.821168  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:10.822650  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.822705  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.827097 11294 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:10.827432 11128 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.828675 11128 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:10.828738 11347 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:10.829196 11128 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:10.829890 11332 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.000s
I20260709 13:18:10.829946 11128 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:10.830529 11332 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:10.831462 11345 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:10.831983 11345 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:10.834093 11385 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.244s	user 0.010s	sys 0.003s
I20260709 13:18:10.834426  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:10.834807  5522 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:10.835160  6076 raft_consensus.cc:2368] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:18:10.776254 11365 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.827150 10954 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:10.837893 11365 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.837915 10954 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:10.788571 11414 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.839293 10954 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.840245 10954 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.840574 11414 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:10.840915  5273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 153) took 56428 ms (client timeout 15000 ms). Trace:
I20260709 13:18:10.832911 11345 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.782315 11364 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.810741 11388 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:10.842567 11388 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:10.842724 11345 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.843153 11402 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:10.843621 11364 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:10.838081  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.846802  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.847749 11351 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.837739  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:10.852157  5449 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:10.833197 11332 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:10.854275 11393 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:10.855268  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2311) took 1340 ms. Trace:
I20260709 13:18:10.855659  5518 rpcz_store.cc:276] 0709 13:18:09.515432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.760274 (+244842us) service_pool.cc:224] Handling call
0709 13:18:10.855088 (+1094814us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540016c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:10.855210 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780403072}
I20260709 13:18:10.843680 11402 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:10.864301  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.865677  5414 leader_election.cc:336] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.754s (SENT)
I20260709 13:18:10.866279  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:10.870330  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2307) took 1361 ms. Trace:
I20260709 13:18:10.870887  5520 rpcz_store.cc:276] 0709 13:18:09.508818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.016518 (+507700us) service_pool.cc:224] Handling call
0709 13:18:10.870036 (+853518us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001653d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:10.870248 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262976256}
I20260709 13:18:10.844923  5268 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.876458  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.878064  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.880074  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:10.884989  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63892.6us
I20260709 13:18:10.886948  5518 raft_consensus.cc:2410] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
W20260709 13:18:10.893678  5414 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.846s (SENT)
I20260709 13:18:10.894410  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:10.896137  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.897383  5518 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:10.898423  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.899698  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.904155  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.903208  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:10.912107  5516 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
W20260709 13:18:10.880103 11427 consensus_meta.cc:287] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.677s	user 0.004s	sys 0.007s
I20260709 13:18:10.914453  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:10.915913  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.917730 11333 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:10.917888  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.918375 11333 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:10.919260  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.919867  5523 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:10.919493 11333 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.920828  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:10.912717 11260 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.010s
I20260709 13:18:10.922629  5515 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:10.922902 11235 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:10.923487 11235 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:10.916404  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:10.924454 11235 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.925781 11323 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:10.926261 11323 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.926625 11323 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:10.928757  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.930012  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:10.917076  5518 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:10.936877 11416 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:10.938217 11416 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.889613 11332 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.942746  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:10.942940  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49344.6us
W20260709 13:18:10.946205  5414 leader_election.cc:336] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.850s (SENT)
I20260709 13:18:10.921375  5523 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:18:10.902226 11343 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.950978  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.952816  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.938683 11260 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:10.938686 11416 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:10.956192  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.961735  5516 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:10.962198  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:10.841337  5273 rpcz_store.cc:269] 0709 13:17:14.412809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.413080 (+   271us) service_pool.cc:224] Handling call
0709 13:18:10.840823 (+56427743us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:07.001767 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:07.002521 (+   754us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:07.002577 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:18:07.002597 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:07.003256 (+   659us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:07.003402 (+   146us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:07.003428 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:18:07.003971 (+   543us) tablet.cc:701] Row locks acquired
0709 13:18:07.004019 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:18:07.004186 (+   167us) write_op.cc:270] Start()
0709 13:18:07.004340 (+   154us) write_op.cc:276] Timestamp: P: 1783603087004131 usec, L: 0
0709 13:18:07.004485 (+   145us) op_driver.cc:348] REPLICATION: starting
0709 13:18:07.064352 (+ 59867us) log.cc:844] Serialized 1688 byte log entry
0709 13:18:07.443399 (+379047us) op_driver.cc:464] REPLICATION: finished
0709 13:18:07.733964 (+290565us) write_op.cc:301] APPLY: starting
0709 13:18:07.734124 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:07.839791 (+105667us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:07.839946 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:08.183835 (+343889us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:08.288517 (+104682us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:18:08.363920 (+ 75403us) write_op.cc:312] APPLY: finished
0709 13:18:08.394592 (+ 30672us) log.cc:844] Serialized 48 byte log entry
0709 13:18:08.394830 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:08.394947 (+   117us) write_op.cc:454] Released schema lock
0709 13:18:08.395017 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:08.395457 (+   440us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:08.395489 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":112044,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":289982,"apply.run_cpu_time_us":11961,"apply.run_wall_time_us":661662,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20847,"num_ops":4,"prepare.queue_time_us":340304,"prepare.run_cpu_time_us":49324,"prepare.run_wall_time_us":233778,"raft.queue_time_us":204730,"raft.run_cpu_time_us":47860,"raft.run_wall_time_us":79157,"replication_time_us":438599,"thread_start_us":619407,"threads_started":4,"wal-append.queue_time_us":162169,"wal-append.run_cpu_time_us":12742,"wal-append.run_wall_time_us":2219079}]]}
W20260709 13:18:10.955324  5414 leader_election.cc:336] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.957s (SENT)
I20260709 13:18:10.934847 11427 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:10.951881 11396 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.009s
I20260709 13:18:10.963932  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:10.958298 11260 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:10.971393  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.913518 11335 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:18:10.972294  5520 raft_consensus.cc:2410] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:18:10.972658 11260 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:10.939481 11464 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:10.974822  5339 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.543s (SENT) [suppressed 40 similar messages]
I20260709 13:18:10.973182  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:10.980125  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63800us
I20260709 13:18:10.981173  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:10.981946  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:10.984607  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.983891  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:10.986081  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.987010  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:10.988106  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:10.985796 11335 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:10.969249 11396 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:10.991840  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:10.975323 11322 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:10.978379 11350 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:10.993374  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:10.959205 11343 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:10.989552 11321 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.879s	user 0.007s	sys 0.013s
I20260709 13:18:10.999524  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:10.986109 11464 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:10.992412  5414 leader_election.cc:336] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.015s (SENT)
I20260709 13:18:10.991175 11325 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:10.991916 11351 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:10.994401 11335 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:11.011816  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2297) took 1555 ms (client timeout 1846 ms). Trace:
I20260709 13:18:11.013011 11327 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:18:11.014216  5524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2690) took 1586 ms (client timeout 1543 ms). Trace:
I20260709 13:18:11.016378  5374 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:11.043290  5515 rpcz_store.cc:269] 0709 13:18:09.456542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.487302 (+ 30760us) service_pool.cc:224] Handling call
0709 13:18:11.011608 (+1524306us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540023c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:11.011749 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2846462208}
I20260709 13:18:11.018719 11422 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:11.045151  5524 rpcz_store.cc:269] 0709 13:18:09.427585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.429024 (+  1439us) service_pool.cc:224] Handling call
0709 13:18:11.013962 (+1584938us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540016b7d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:11.014140 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085577472}
I20260709 13:18:11.047633  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.048623  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.002911 11350 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:11.023191  5415 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:11.023945 11203 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:10.989763 11388 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.044941 11327 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:11.044966 11325 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:11.045140 11335 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:11.050549  5524 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:11.047935 11351 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:11.005712  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:11.072845  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:11.004999 11322 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:11.055372  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 80569.5us
I20260709 13:18:11.056216  5415 leader_election.cc:400] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:18:11.085038  5415 leader_election.cc:403] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:11.056946 11332 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:11.041165 11427 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.043592 11396 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:11.048437  5515 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:11.070423  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:11.091857  5450 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.071404  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.092197  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:10.999608 11386 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.000s
I20260709 13:18:11.073648  5443 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.007776  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.093940  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.076018 11325 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.096478  5520 raft_consensus.cc:2410] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:18:11.082372 11327 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:11.083247  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 90852.4us
I20260709 13:18:11.055152 11350 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.058797  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.008787 11321 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.092633  5524 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:11.092425  5339 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:11.095310  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.097934  5414 leader_election.cc:336] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.039s (SENT)
W20260709 13:18:11.101195  5414 leader_election.cc:336] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.080s (SENT)
W20260709 13:18:11.102629  5414 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.218s (SENT)
I20260709 13:18:11.103055  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:11.095500  5515 raft_consensus.cc:2368] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
W20260709 13:18:11.103891  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.104643 11396 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:11.104970  5443 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:18:11.085831 11464 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.110096 11474 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:11.110553 11474 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.111864  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:11.106067  5524 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:11.114080  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2314) took 1597 ms. Trace:
I20260709 13:18:11.088610 11332 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.114472  5524 rpcz_store.cc:276] 0709 13:18:09.516473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.105591 (+1589118us) service_pool.cc:224] Handling call
0709 13:18:11.105897 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.113800 (+  7903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.114022 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.106324  5520 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:11.122519  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2312) took 1606 ms. Trace:
I20260709 13:18:11.123122  5520 rpcz_store.cc:276] 0709 13:18:09.515854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.105803 (+1589949us) service_pool.cc:224] Handling call
0709 13:18:11.106127 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.122140 (+ 16013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.122441 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:11.101724 11191 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.004s
I20260709 13:18:11.126703  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2698) took 1580 ms. Trace:
I20260709 13:18:11.132004  5524 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:11.131548  5515 rpcz_store.cc:276] 0709 13:18:09.546695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.125599 (+1578904us) service_pool.cc:224] Handling call
0709 13:18:11.125991 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.126230 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.126269 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.126329 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:11.126375 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.126448 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.126617 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.127446  5450 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:18:11.083797 11128 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.083556 11323 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.137637  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2700) took 1588 ms. Trace:
W20260709 13:18:11.108093 11359 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.020s	user 0.018s	sys 0.004s
I20260709 13:18:11.138890 11343 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:11.164621  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.120272 11327 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:11.139864  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:11.169076  5518 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:11.110916 11474 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:11.141873  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:11.144811  5522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2290) took 1691 ms (client timeout 1949 ms). Trace:
W20260709 13:18:11.173328  5522 rpcz_store.cc:269] 0709 13:18:09.453852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.454012 (+   160us) service_pool.cc:224] Handling call
0709 13:18:11.144578 (+1690566us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000a9bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:11.144724 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173289216}
I20260709 13:18:11.151038 11388 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.153932 11351 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.100224 11386 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:11.154574 10983 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.107376 11364 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16.
I20260709 13:18:11.155934  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2334) took 1151 ms. Trace:
W20260709 13:18:11.158409  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.160063  5442 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:11.162248  5524 rpcz_store.cc:276] 0709 13:18:09.549060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.131143 (+1582083us) service_pool.cc:224] Handling call
0709 13:18:11.131553 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.132788 (+  1235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.137578 (+  4790us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:11.165305  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.130059 11464 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:11.167671 11406 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.125986 11332 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:11.141607 10984 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:11.125813 11260 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.130534 11294 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:18:11.172173  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69560.3us
I20260709 13:18:11.176781 11405 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:11.156287 11471 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.183825  5521 rpcz_store.cc:276] 0709 13:18:10.004946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.327422 (+322476us) service_pool.cc:224] Handling call
0709 13:18:11.155713 (+828291us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54002dad54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:11.155871 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838460160}
I20260709 13:18:11.187860  5524 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:11.190062  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.187455 10983 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:11.202247  5522 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
W20260709 13:18:11.182569 11407 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.215s	user 0.011s	sys 0.012s
I20260709 13:18:11.207571  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2325) took 1396 ms. Trace:
I20260709 13:18:11.212245  5524 rpcz_store.cc:276] 0709 13:18:09.811098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.187322 (+1376224us) service_pool.cc:224] Handling call
0709 13:18:11.187654 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.201866 (+ 14212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.207487 (+  5621us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.214169  5524 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:18:11.214977  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2326) took 1389 ms. Trace:
I20260709 13:18:11.215399  5524 rpcz_store.cc:276] 0709 13:18:09.826156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.213345 (+1387189us) service_pool.cc:224] Handling call
0709 13:18:11.213839 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.214660 (+   821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.214906 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.216970  5524 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:11.205715  5414 leader_election.cc:336] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.744s (SENT)
I20260709 13:18:11.226625  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2327) took 1400 ms. Trace:
I20260709 13:18:11.193198 11406 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.228346  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:11.234325  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:11.236250  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.193495 10984 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:11.242108  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.242360  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.242870  5371 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:18:11.230178  5414 leader_election.cc:336] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.964s (SENT)
I20260709 13:18:11.227520  5524 rpcz_store.cc:276] 0709 13:18:09.840168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.216363 (+1376195us) service_pool.cc:224] Handling call
0709 13:18:11.216720 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.218494 (+  1774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.226567 (+  8073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.231694  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.200064 11260 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.245070  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:11.233078  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.239542  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:11.245317  5441 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:18:11.168746 11396 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:11.246557  5516 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:18:11.250058  5367 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.247076  5370 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [17.12-19.13]
I20260709 13:18:11.248211  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.206830 11294 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:11.249989  5441 pending_rounds.cc:85] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 11
W20260709 13:18:11.257408  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.257776  5441 pending_rounds.cc:107] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:18:11.258075  5441 raft_consensus.cc:2889] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:11.258352  5524 raft_consensus.cc:2368] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20.
I20260709 13:18:11.193213 11386 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:18:11.220134 11388 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.233104 11464 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:11.244825 10967 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:11.265868 10967 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.266258 10967 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.267792  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.224954 11392 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:18:11.269778 11392 consensus_queue.cc:1243] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:11.270435 11392 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:11.270821 11392 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:11.270715 10984 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:11.271953 10984 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.272115 11392 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.219267 11405 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:11.278137 11405 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:11.280861 11457 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.659s	user 0.002s	sys 0.000s
I20260709 13:18:11.225162 11393 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:18:11.283316 11128 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.289094 11308 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:11.289239 11413 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.295738 11406 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.299353  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2699) took 1750 ms. Trace:
I20260709 13:18:11.211221 11471 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.305765 11208 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.233700 11359 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:18:11.310052  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.310699 11347 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.347103 11347 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.311249 11422 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:11.348500  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2701) took 1789 ms. Trace:
I20260709 13:18:11.312475  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2431) took 1123 ms. Trace:
I20260709 13:18:11.312675 11402 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.371268 11402 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.372421  5373 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:11.373603  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.374924  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.375981  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.376951  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:11.378491  5375 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:11.379896  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.261744 11343 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.380851 11343 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.383200 11343 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.315027 11385 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.260071  5371 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:11.384114 11385 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:11.316385  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.318198  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.386449  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.386528 11385 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:11.387740  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.388193  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.388722  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.388775 11471 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:11.319244  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 89149.9us
W20260709 13:18:11.389658  5414 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.091s (SENT)
I20260709 13:18:11.390388  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:11.391773  5414 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.156s (SENT)
I20260709 13:18:11.392253  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:11.319979  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 429) took 1222 ms. Trace:
W20260709 13:18:11.323668  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.394268  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2249) took 1243 ms. Trace:
I20260709 13:18:11.394084 11427 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:11.323786  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.395618  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.394802  5369 rpcz_store.cc:276] 0709 13:18:10.151342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.219806 (+ 68464us) service_pool.cc:224] Handling call
0709 13:18:10.220170 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.220565 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.220606 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.224867 (+  4261us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.446520 (+221653us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:10.446581 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.446682 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.280494 (+833812us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b2400135608. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0b259c4 00007fc1d0b23acb 00007fc1d0cdedc9 00007fc1d0cdea55 00007fc1d0cde09d 00007fc1d391010e 00007fc1d392788c 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221
0709 13:18:11.393943 (+113449us) raft_consensus.cc:1685] finished
0709 13:18:11.393967 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.394204 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2217,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":136,"spinlock_wait_cycles":102651136,"thread_start_us":69287,"threads_started":1,"wal-append.queue_time_us":154083}
I20260709 13:18:11.396186 11332 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:11.396373 11364 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:11.397699 11364 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:11.334926  5520 rpcz_store.cc:276] 0709 13:18:09.548717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.124182 (+1575465us) service_pool.cc:224] Handling call
0709 13:18:11.161587 (+ 37405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.163087 (+  1500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.163132 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.163192 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:11.163251 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.163327 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.299145 (+135818us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b54002dad50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:11.299288 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85080832}
I20260709 13:18:11.399380 10617 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:11.399466  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.346277  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:11.237546 11191 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:18:11.226352 11407 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.349017  5518 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:11.311753 11388 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.351826  5441 rpcz_store.cc:276] 0709 13:18:10.189270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.189415 (+   145us) service_pool.cc:224] Handling call
0709 13:18:10.204272 (+ 14857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.258525 (+1054253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.312210 (+ 53685us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540033ccd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:11.312410 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2393043840}
I20260709 13:18:11.350564  5515 rpcz_store.cc:276] 0709 13:18:09.559501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.133082 (+1573581us) service_pool.cc:224] Handling call
0709 13:18:11.133458 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:11.133875 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:11.133904 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:11.145804 (+ 11900us) log.cc:844] Serialized 52 byte log entry
0709 13:18:11.251544 (+105740us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:11.251586 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.251652 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.348250 (+ 96598us) raft_consensus.cc:1685] finished
0709 13:18:11.348280 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.348443 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4813,"thread_start_us":105346,"threads_started":1,"wal-append.queue_time_us":200293}
I20260709 13:18:11.410876  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.354249  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.310123 11294 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:11.355590 11347 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:11.357671 11321 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.358464 11323 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.339576 11322 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:11.343809 11392 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:11.365795  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.366182  5523 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:11.366474 11345 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.393643  5524 rpcz_store.cc:276] 0709 13:18:10.098044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.262044 (+1164000us) service_pool.cc:224] Handling call
0709 13:18:11.262432 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.262638 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.262671 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.262726 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:11.262768 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.319733 (+ 56965us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.319907 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.396822  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.328828  5374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3070) took 1179 ms. Trace:
I20260709 13:18:11.428553  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.428886  5374 rpcz_store.cc:276] 0709 13:18:10.149370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.149528 (+   158us) service_pool.cc:224] Handling call
0709 13:18:11.016156 (+866628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.045358 (+ 29202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.328612 (+283254us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54000f9bd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:11.328739 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925001088}
I20260709 13:18:11.342623  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 430) took 1121 ms. Trace:
I20260709 13:18:11.384997  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.430060  5522 rpcz_store.cc:276] 0709 13:18:10.221762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.316205 (+1094443us) service_pool.cc:224] Handling call
0709 13:18:11.342131 (+ 25926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.342320 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.342343 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.342383 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:11.342412 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.342463 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.342567 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:11.393373  5414 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.178s (SENT)
I20260709 13:18:11.405303  5367 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
W20260709 13:18:11.414855  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.415858  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.418027  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.431398  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:11.418393  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.430123  5370 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:11.425011  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.433301  5515 raft_consensus.cc:2410] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:11.433933  5370 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:11.430462  5371 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:18:11.435110  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:11.435412  5373 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:11.435576  5371 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:11.372967 11335 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.435947  6077 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:11.361105 10967 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.445312 11345 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.445792  5368 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:11.446498  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.446766  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.465067  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:11.465387  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.465780  5515 raft_consensus.cc:2376] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16. Re-sending same reply.
I20260709 13:18:11.339533 11413 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.447497  5374 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:18:11.457010  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 63618.8us
I20260709 13:18:11.458207  5367 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:11.460014  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.475883  5370 raft_consensus.cc:2410] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:18:11.471355  5414 leader_election.cc:336] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.397s (SENT)
I20260709 13:18:11.479045  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:11.377288 11416 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:11.488106 10617 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:11.489310 10617 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:11.489821 10617 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:11.490960 10617 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.492645 10617 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:11.493692  5519 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:18:11.494951  5517 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:11.463222 11322 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:11.513733  5516 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:11.447454 11260 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:11.466812  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:11.500756  5414 leader_election.cc:336] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.402s (SENT)
W20260709 13:18:11.516122  5414 leader_election.cc:336] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.479s (SENT)
I20260709 13:18:11.499192  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.517818  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:11.522811  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.529595  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.530455  5524 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.411810 11332 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:11.532996  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.466791 11393 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:18:11.459460 11350 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.460377  5520 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:11.536973  5375 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:18:11.541028  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.534034  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.542470  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.546180  5366 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:18:11.512450 11359 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:11.554507  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.555073  5515 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.556480  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:11.544921  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.012s
W20260709 13:18:11.552464  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.557220  5373 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:11.559803  5414 leader_election.cc:336] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.618s (SENT)
I20260709 13:18:11.553262  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.535557 11422 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:11.558579  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.000s	sys 0.012s
W20260709 13:18:11.566175  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 574347us
I20260709 13:18:11.562546  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.571025  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.575879  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.561724 11385 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:18:11.586807 11385 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:18:11.587071  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.587342 11385 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:11.589815  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.591413  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.592705  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.593386  5520 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
W20260709 13:18:11.594455  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.588976  6077 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:11.595645  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.596735  5520 raft_consensus.cc:2410] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:11.538317 11260 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:18:11.598389 11260 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:11.598413  5520 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:11.599148 11260 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:11.611817 10967 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:11.616026 11476 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:11.618547 11413 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:11.624692  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64909.9us
W20260709 13:18:11.625753  5414 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.769s (SENT)
W20260709 13:18:11.627250 11456 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:18:11.650228  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.656291  5374 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:18:11.672052  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:11.672830  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84723.6us
W20260709 13:18:11.677577  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50821.2us
I20260709 13:18:11.673405  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.684453  5373 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:11.588528 11385 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.600469 11260 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.688495  5368 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: [19.14-21.15]
I20260709 13:18:11.685103  5524 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:11.699186  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.700949  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.702221  5524 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:11.702394  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.692675  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:11.693598  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.715703  5370 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.703550 11422 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:11.704334 11128 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:11.704989 11474 consensus_meta.cc:287] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.006s
I20260709 13:18:11.727970  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.691636  5515 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:11.730587  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.731982  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.742640  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:11.743728  5374 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:11.677886 11350 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.750921  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.752781  5521 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:11.731030 11386 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.755426  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:11.754640  5414 leader_election.cc:336] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.237s (SENT)
I20260709 13:18:11.688126 11308 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:18:11.755916  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.758145  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2319) took 2190 ms. Trace:
I20260709 13:18:11.758528  5518 rpcz_store.cc:276] 0709 13:18:09.568054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.178447 (+1610393us) service_pool.cc:224] Handling call
0709 13:18:11.348849 (+170402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.409220 (+ 60371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.757939 (+348719us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001e7150. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:11.758086 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391147776}
I20260709 13:18:11.757084  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.759466  5370 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
W20260709 13:18:11.761497  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.763406  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.765349  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.765409  5515 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:11.766357  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.749135 11385 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.768954  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.771214  5518 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:11.734547 11422 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:11.773671  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.733438 11474 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.774971  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.756754 11260 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.777094  5518 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:18:11.777895  5518 pending_rounds.cc:85] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 8
I20260709 13:18:11.752944 10984 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:18:11.778375  5518 pending_rounds.cc:107] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:18:11.778981  5518 raft_consensus.cc:2889] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:11.759786 11386 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:11.780645 11475 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.557s	user 0.004s	sys 0.000s
I20260709 13:18:11.781924  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2711) took 1049 ms. Trace:
I20260709 13:18:11.782373  5518 rpcz_store.cc:276] 0709 13:18:10.732262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.774317 (+1042055us) service_pool.cc:224] Handling call
0709 13:18:11.774654 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.781610 (+  6956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.781853 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.784114  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.786015  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.786779  5518 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:11.787550  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.788393  5518 raft_consensus.cc:2410] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:11.789850  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2716) took 1031 ms. Trace:
I20260709 13:18:11.790479  5518 rpcz_store.cc:276] 0709 13:18:10.758035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.788959 (+1030924us) service_pool.cc:224] Handling call
0709 13:18:11.789268 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.789478 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.789509 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.789561 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:11.789598 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.789676 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.789792 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.792204  5518 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:11.792987  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2719) took 1016 ms. Trace:
I20260709 13:18:11.793327  5518 rpcz_store.cc:276] 0709 13:18:10.776435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.791496 (+1015061us) service_pool.cc:224] Handling call
0709 13:18:11.791821 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.792510 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.792932 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:11.794341  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.794711  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.794809  5518 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:11.796367  5518 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:11.798408  5371 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:18:11.799088 11484 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:18:11.802433  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.804597  5372 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:11.811195 11393 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:11.811748 11393 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:11.816638 11345 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:11.819690 11464 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:11.820307 11464 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:11.821393 11464 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.812753 11393 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.832159 11422 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:11.837076  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.856843  5516 raft_consensus.cc:2376] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19. Re-sending same reply.
I20260709 13:18:11.858310  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:11.841442  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2709) took 1139 ms. Trace:
I20260709 13:18:11.836413 11474 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:11.834125 11483 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:18:11.865099  5520 rpcz_store.cc:276] 0709 13:18:10.702286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.600168 (+897882us) service_pool.cc:224] Handling call
0709 13:18:11.600558 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.601476 (+   918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.601517 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.602130 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.754939 (+152809us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:11.754981 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.755052 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.841072 (+ 86020us) raft_consensus.cc:1685] finished
0709 13:18:11.841105 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.841332 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":152382,"threads_started":1,"wal-append.queue_time_us":197945}
W20260709 13:18:11.861930  5414 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 3.304s (SENT)
I20260709 13:18:11.876487  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:11.881148  5515 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:11.885620  5520 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:11.887773  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:11.874980 11464 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:11.883599 11422 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:11.901600  5522 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:11.885192 11393 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:11.905573  5524 raft_consensus.cc:2410] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:18:11.906380  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:11.917246  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.945590 11385 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.946434 11385 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:11.949817 11385 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:11.951632 11294 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:11.952407 11294 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:11.953883  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.957491 11294 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:11.957769  5414 leader_election.cc:336] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.775s (SENT)
W20260709 13:18:11.962320 11492 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:18:11.966472  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.980683  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.984583  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.000401  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:12.001318  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.002385  5517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2338) took 1877 ms (client timeout 1983 ms). Trace:
W20260709 13:18:12.002969  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.002830  5517 rpcz_store.cc:269] 0709 13:18:10.125118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.156078 (+ 30960us) service_pool.cc:224] Handling call
0709 13:18:12.002127 (+1846049us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003791d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:12.002323 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016336768}
I20260709 13:18:11.978996 11422 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.008363  5446 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:12.009140  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.012869  5448 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:12.012813  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.010784  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.013837  5449 raft_consensus.cc:2410] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:12.014333  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.014815  5445 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:12.015328  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.015836  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.016050  5444 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:12.017692  5445 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:12.019027  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.019836  5445 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.022603  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.023208  5444 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:12.023700  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.026621  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.026726  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:12.027360  5446 raft_consensus.cc:2368] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18.
I20260709 13:18:12.027752  5520 raft_consensus.cc:2368] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:18:12.032655  5444 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:12.033825  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:12.034125  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.034902  5517 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:12.037496  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.038770  5443 raft_consensus.cc:2410] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:12.007294 11332 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.050688  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.050709 11332 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:12.053930  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.054407  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.054709  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.053960  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.058881  5441 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:12.068450  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.075913  5414 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 3.023s (SENT)
I20260709 13:18:12.076776  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:12.085279  5443 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:12.460906  5446 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:12.206126  5448 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:12.461553  6077 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:12.097223  5445 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
W20260709 13:18:12.136183  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.470373  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:12.478904  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 403031us
I20260709 13:18:12.471662 11322 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:12.480510 11322 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:12.480667  5414 leader_election.cc:336] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 3.066s (SENT)
I20260709 13:18:12.481362  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:12.482039  5441 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:12.483214 11322 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:12.483963  5441 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:18:12.474097  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3074) took 1233 ms. Trace:
I20260709 13:18:12.501120  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:12.475344  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.502243  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.503124  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.503804  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.503610 11333 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:12.501624  5366 rpcz_store.cc:276] 0709 13:18:11.240267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.240390 (+   123us) service_pool.cc:224] Handling call
0709 13:18:11.260368 (+ 19978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.551509 (+291141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.473795 (+922286us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002b3254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:12.474027 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648795904}
W20260709 13:18:12.464982 11464 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.002s
I20260709 13:18:12.260380 11325 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.475996 11388 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:12.471623  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2705) took 2475 ms. Trace:
I20260709 13:18:12.479080  5522 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:12.479416  5516 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:12.479537  5523 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:18:12.516947  5521 rpcz_store.cc:276] 0709 13:18:09.996410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.281345 (+1284935us) service_pool.cc:224] Handling call
0709 13:18:11.281787 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.753261 (+471474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.471376 (+718115us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540025dad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:12.471540 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082301184}
I20260709 13:18:12.518311  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2384) took 1129 ms. Trace:
I20260709 13:18:12.518803  5521 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:18:12.506142 11325 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.519305  5521 pending_rounds.cc:85] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 12
I20260709 13:18:12.519656  5521 pending_rounds.cc:107] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:18:12.519892  5521 raft_consensus.cc:2889] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:12.212646  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.521116  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.483291 11191 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:12.521730 11385 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.472589  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:12.522737  5372 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:12.522346 11385 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.523778  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:12.465015  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.391227  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 334733us
W20260709 13:18:12.525354  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.460299  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:12.525863  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.487608  5519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2304) took 2979 ms (client timeout 3023 ms). Trace:
I20260709 13:18:12.470851  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 465) took 1027 ms. Trace:
W20260709 13:18:12.526353  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.448565 11393 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.000s
I20260709 13:18:12.508827  5441 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:12.510543  5520 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:18:12.526566  5371 rpcz_store.cc:276] 0709 13:18:11.443416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.451561 (+  8145us) service_pool.cc:224] Handling call
0709 13:18:11.798187 (+346626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.798851 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.470632 (+671781us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400185bd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:12.470796 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791401216}
I20260709 13:18:12.535611  5520 pending_rounds.cc:85] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:18:12.535884  5520 pending_rounds.cc:107] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 18.10
W20260709 13:18:12.526363  5519 rpcz_store.cc:269] 0709 13:18:09.507894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.443667 (+935773us) service_pool.cc:224] Handling call
0709 13:18:12.478994 (+2035327us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003a3754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:12.487519 (+  8525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351928704}
I20260709 13:18:12.536158  5520 raft_consensus.cc:2889] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.538973  5441 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:12.539492  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:12.540520  5441 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:18:12.506371  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:12.517555  5523 pending_rounds.cc:85] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 10
I20260709 13:18:12.479581 11359 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:12.552163  5441 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.525065 11385 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:12.021997 11422 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.553572  5442 raft_consensus.cc:2368] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12.
I20260709 13:18:12.554981  5441 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 13:18:12.460238  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.494150  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:12.529320 11235 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.557758 11235 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.560233 11235 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:12.556742  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.561530  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.562167  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.562671  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.529651  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.530748  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:12.566887  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2387) took 1125 ms. Trace:
I20260709 13:18:12.532232  5521 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:18:12.567490  5520 rpcz_store.cc:276] 0709 13:18:11.442079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.509727 (+1067648us) service_pool.cc:224] Handling call
0709 13:18:12.510103 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.566533 (+ 56430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.566811 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.568060  5521 pending_rounds.cc:85] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 10
I20260709 13:18:12.568558  5521 pending_rounds.cc:107] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:18:12.568888  5521 raft_consensus.cc:2889] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.568917  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:12.540961  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:12.541536  5523 pending_rounds.cc:107] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:18:12.571338  5523 raft_consensus.cc:2889] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.542142  5366 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:12.542249  6077 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:12.518828  5522 rpcz_store.cc:276] 0709 13:18:11.388728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.478291 (+1089563us) service_pool.cc:224] Handling call
0709 13:18:12.478676 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.517963 (+ 39287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.518228 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38016}
I20260709 13:18:12.555212 11422 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:12.526830  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.576671  5517 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:12.576354  5372 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:12.576511  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:12.581404  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:12.584211  5522 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:12.590292  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2377) took 1203 ms. Trace:
I20260709 13:18:12.590919  5523 rpcz_store.cc:276] 0709 13:18:11.386514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.478200 (+1091686us) service_pool.cc:224] Handling call
0709 13:18:12.478620 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.589921 (+111301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.590215 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:12.579197  5489 connection.cc:256] RPC call timeout handler was delayed by -4.2892483839998476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 13:18:12.594484  5489 connection.cc:256] RPC call timeout handler was delayed by -3.8068483839999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2746s for a response
I20260709 13:18:12.595700  5519 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:12.596359  5519 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:12.535115 11332 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:12.599887  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:12.603436  5521 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.600271  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:12.604900  5517 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:12.606778  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:12.607854  5523 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:12.595506  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:12.608817  5518 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:12.612717  5339 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:12.576927 11393 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.585738 11385 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.617544  5339 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:12.614885  5519 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:12.599534 11402 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.613950 11208 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:12.643229  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.643712  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.645259  5521 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:12.646324  5519 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.654892  5519 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:12.656852  5523 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:12.657776  5519 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:12.660539  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:12.629217 11323 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:12.630743 11333 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:12.661976  5521 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:12.662967  5521 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:12.663553  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:12.661320 11396 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:18:12.640942 11208 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.666815  5517 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:12.666942  5339 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:12.669497 11208 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:12.663187 11235 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:18:12.671161 11308 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:12.671657 11308 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:12.666018 11343 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:12.672411 11343 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.672802 11343 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:12.673862 11350 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:12.668078 11427 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:12.674551 11350 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:12.675596 11350 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.674654 11427 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:12.677747 11427 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.679309  5441 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:12.680682  5449 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:12.669642  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.681779  5443 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:12.619844 11393 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.684407  5449 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:12.682587  5517 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:12.680490 11325 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:12.637147 11321 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:18:12.639778 11471 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:12.627993 11385 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.687094  5517 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:12.641929 11402 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.690228  5519 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:18:12.672602 11308 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:12.703315  5517 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.686930  5375 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:12.668040 11323 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:12.722947  5441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:18:12.723694  5441 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:12.724028  5441 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:12.718781  5449 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:12.732477 11488 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.835s	user 0.003s	sys 0.013s
I20260709 13:18:12.735209 11393 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:12.738236  5517 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:12.739607 11385 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:12.742300  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:12.743182  5524 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:12.744830  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.745465  5447 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:12.722193 11506 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:18:12.748049  5523 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:12.748309  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2394) took 1097 ms. Trace:
I20260709 13:18:12.748700  5515 rpcz_store.cc:276] 0709 13:18:11.650609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.766139 (+115530us) service_pool.cc:224] Handling call
0709 13:18:12.748148 (+982009us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540016d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:12.748256 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262483712}
W20260709 13:18:12.750232 11504 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:18:12.752740  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:12.754199  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:12.754927  5444 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:12.755015 11402 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:12.755868  5445 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [16.8-18.9]
I20260709 13:18:12.756325  5444 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:12.759192  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2725) took 1450 ms. Trace:
I20260709 13:18:12.758939 11323 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.759687  5516 rpcz_store.cc:276] 0709 13:18:11.308661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.859577 (+550916us) service_pool.cc:224] Handling call
0709 13:18:12.479106 (+619529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.517195 (+ 38089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.758946 (+241751us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54003a3750. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:12.759114 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423930624}
I20260709 13:18:12.763218  5447 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:12.764387 11407 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:12.767630  5369 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.690307 11321 consensus_queue.cc:1243] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:12.770859 11386 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:12.771814 11335 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:12.773793  5450 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:12.774217  5449 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.774850  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:12.775378  5450 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:12.775568  5445 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:12.775772  5449 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:12.776858  5445 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:18:12.778486 11416 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:12.782500  5442 raft_consensus.cc:2410] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:12.782631  5445 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:12.784050  5445 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:12.785061  5445 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:12.785627  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 302983us
W20260709 13:18:12.786473  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.786587 11293 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:12.788515  5449 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:12.789119  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:18:12.790294  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.790661  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.791689  5366 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:12.792320  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:12.793907 11482 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:12.795749  5443 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:12.797039  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:12.797628  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:12.797937  5449 raft_consensus.cc:1217] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Deduplicated request from leader. Original: 17.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:18:12.798856  5449 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:12.799182  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:12.802121  5450 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:12.802727  5448 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:12.803694  5367 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: [19.14-21.15]
I20260709 13:18:12.804811  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:12.806193  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 139318us
I20260709 13:18:12.986735  5520 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:18:12.987126  5520 pending_rounds.cc:85] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 11
I20260709 13:18:12.987380  5520 pending_rounds.cc:107] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:18:12.987612  5520 raft_consensus.cc:2889] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:12.806447  5447 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:12.840202 11333 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:13.000702  6043 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:12.836764  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 211308us
I20260709 13:18:12.884647  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:12.805873 11405 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
W20260709 13:18:12.968099  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 118592us
I20260709 13:18:12.968937 11293 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:12.965188 11402 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.973604 11350 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.834481  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 259382us
W20260709 13:18:13.031966  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.032437  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.032841  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.019125  5441 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.976317  5517 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:18:12.981084  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.818917  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:12.991349 11482 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.991559  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:12.991762 11416 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.992655  5523 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:12.992704 11407 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:12.993530 11386 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.994017 11335 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.995108  5521 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:12.997671  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:13.060194  5524 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:12.988947  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:13.062084  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.019523  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.064417  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.013921  5449 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:13.023988  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 2977) took 1004 ms. Trace:
I20260709 13:18:13.066792  5446 rpcz_store.cc:276] 0709 13:18:12.019033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.492731 (+473698us) service_pool.cc:224] Handling call
0709 13:18:12.493138 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.493404 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:12.639825 (+146421us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.981876 (+342051us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.023465 (+ 41589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.023548 (+    83us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:13.023612 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.023715 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.023902 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":307930,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":127972,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":8489,"thread_start_us":363561,"threads_started":2}
I20260709 13:18:13.018270  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:13.046887  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.037281  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:13.035084  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:13.070221  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.051657  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:13.071382  5367 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:13.071619  5442 raft_consensus.cc:2410] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:13.052805  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:13.072402  5517 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:13.072576  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.017865 11500 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:13.050987  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:13.055245  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:13.048566  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:13.076623  5450 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.076252  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.036867  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.077834  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:13.076642  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 76455.8us
I20260709 13:18:13.078758  5443 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:13.078475  5445 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:13.076946  5368 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:13.080683  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.082020  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:13.083379  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52799.4us
I20260709 13:18:13.083480  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.084172  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:13.084807  5445 raft_consensus.cc:2410] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:13.085144  5449 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:13.085944  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.073701  5517 pending_rounds.cc:85] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 7
I20260709 13:18:13.086191  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.054884  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:13.074138  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:13.087198  5523 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:13.086304  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:13.090624  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.086712  5517 pending_rounds.cc:107] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:18:13.091236  5441 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.091777  5517 raft_consensus.cc:2889] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.075579  5521 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:13.031507 11208 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.031766 11359 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:13.095453  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.089697  5447 raft_consensus.cc:2410] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:18:13.025868 11471 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 13:18:13.111291  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.112218  5521 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:13.114526  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.116508  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:13.117076  5441 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:13.117336  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.034976 11464 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:18:13.104823  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:13.120558  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.090127 11332 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:13.123059  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:13.120728  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 85751.5us
W20260709 13:18:13.133348  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.133882  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:13.099280 11422 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.082629 11407 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:13.059087 11416 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.077939 11335 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.091312 11128 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:13.132700  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.168967  5448 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
W20260709 13:18:13.169373  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.132797  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.049777 11350 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.139786  5441 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:13.143682  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.199515  5443 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:13.145705  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:13.202396  5446 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:13.203595 11308 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:13.067377 11386 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.207497 11386 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.036827 11402 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.210251 11402 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.150336  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:13.210995  5268 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 45) took 12714 ms (client timeout 15000 ms). Trace:
I20260709 13:18:13.211593  5447 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:13.069480  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:13.119475  5450 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:13.213367  5447 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:18:13.213878  5447 pending_rounds.cc:85] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 5
I20260709 13:18:13.214123  5447 pending_rounds.cc:107] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:18:13.214403  5447 raft_consensus.cc:2889] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.216030  5447 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:18:13.058689 11482 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.220127 11482 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.141068 11332 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:13.220970  5447 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:13.221953 11332 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:13.143887 11321 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:18:13.224447  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.234129  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.235586  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 151497us
I20260709 13:18:13.156210 11393 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:13.148157 11510 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.125702 11359 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:13.236536  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 131812us
I20260709 13:18:13.262499  5442 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:13.262792  5448 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:13.245213  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:13.268886  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.308720  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 174909us
I20260709 13:18:13.165961 11407 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.155830 11422 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:13.269213 11510 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:13.303350 11513 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:18:13.277455 11393 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:13.170305 11474 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:18:13.268234 11386 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:18:13.165756 11512 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.155s
I20260709 13:18:13.165342 11396 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:18:13.147903 11351 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
W20260709 13:18:13.489884  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.556964  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.557611  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.143232 11333 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.493032  5444 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:13.497064  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.512966  5448 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:18:13.520226  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 363863us
I20260709 13:18:13.521320  5442 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:18:13.516921 11519 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.368s	user 0.001s	sys 0.008s
I20260709 13:18:13.518077  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:13.526942  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 281792us
I20260709 13:18:13.583513  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:13.584928  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:13.517692 11343 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.844s	user 0.006s	sys 0.033s
W20260709 13:18:13.517485 11518 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.342s	user 0.011s	sys 0.015s
I20260709 13:18:13.545532 11407 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.545969 11393 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:13.598841  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.547233 11359 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.549798 11208 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.513375 11235 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:13.537642  5449 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:13.512490 11385 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.551717  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 288018us
W20260709 13:18:13.617892  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.578608  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:13.211438  5268 rpcz_store.cc:269] 0709 13:18:00.623430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.639192 (+ 15762us) service_pool.cc:224] Handling call
0709 13:18:13.210910 (+12571718us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:11.074106 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:11.192440 (+118334us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:11.195356 (+  2916us) write_op.cc:435] Acquired schema lock
0709 13:18:11.199416 (+  4060us) tablet.cc:662] Decoding operations
0709 13:18:11.316037 (+116621us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:11.338599 (+ 22562us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:11.339855 (+  1256us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:11.361733 (+ 21878us) tablet.cc:701] Row locks acquired
0709 13:18:11.361761 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:18:11.361922 (+   161us) write_op.cc:270] Start()
0709 13:18:11.362040 (+   118us) write_op.cc:276] Timestamp: P: 1783603091361877 usec, L: 0
0709 13:18:11.362061 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:11.362732 (+   671us) log.cc:844] Serialized 912 byte log entry
0709 13:18:12.465891 (+1103159us) op_driver.cc:464] REPLICATION: finished
0709 13:18:12.673597 (+207706us) write_op.cc:301] APPLY: starting
0709 13:18:12.673693 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:12.676021 (+  2328us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:12.676114 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:12.718132 (+ 42018us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:12.766213 (+ 48081us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:18:12.766260 (+    47us) write_op.cc:312] APPLY: finished
0709 13:18:12.766493 (+   233us) log.cc:844] Serialized 32 byte log entry
0709 13:18:12.766655 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:12.766741 (+    86us) write_op.cc:454] Released schema lock
0709 13:18:12.766786 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:12.767136 (+   350us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:12.767164 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1464685,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":200458,"apply.run_cpu_time_us":5503,"apply.run_wall_time_us":93544,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":102061,"prepare.run_cpu_time_us":16112,"prepare.run_wall_time_us":511641,"raft.queue_time_us":559937,"raft.run_cpu_time_us":28772,"raft.run_wall_time_us":144074,"replication_time_us":1103659,"thread_start_us":695843,"threads_started":4,"wal-append.queue_time_us":366328}]]}
W20260709 13:18:13.576764  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.530560 11514 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.332s	user 0.004s	sys 0.005s
W20260709 13:18:13.589373  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 71409.4us
I20260709 13:18:13.618752  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:13.529340 11510 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.596562 11506 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:13.622820  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.557193 11512 consensus_queue.cc:1243] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:13.596190 11343 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:13.605065  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.554579 11386 consensus_queue.cc:1243] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:18:13.617990  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.586989  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2734) took 1022 ms. Trace:
I20260709 13:18:13.643343  5518 rpcz_store.cc:276] 0709 13:18:12.564380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.610120 (+ 45740us) service_pool.cc:224] Handling call
0709 13:18:12.610432 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.610591 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:12.934616 (+324025us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.074724 (+140108us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.585460 (+510736us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.586591 (+  1131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.586663 (+    72us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:13.586713 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.586789 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.586924 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82340,"prepare.queue_time_us":802943,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":115,"raft.queue_time_us":295309,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":9575,"spinlock_wait_cycles":29607808,"thread_start_us":845933,"threads_started":3,"wal-append.queue_time_us":182763}
I20260709 13:18:13.620371  5444 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:13.558058 11335 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.587760 11392 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.635051  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.652514  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.625059  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46520.1us
I20260709 13:18:13.654419  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:13.661240  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.661226  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:13.615428 11407 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:13.664839 11128 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:13.668735 11422 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:13.669301 11343 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.670001 11128 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:13.671779 11520 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
W20260709 13:18:13.673349 11525 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 13:18:13.677255 11464 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:13.678481 11359 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:13.678916 11359 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.679343 11359 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.679126 11464 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:13.680205 11464 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:13.680693 11464 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:13.681638  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:13.682289  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.687530  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:13.644157 11536 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.688244  5516 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:13.599224 11528 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:18:13.688436  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:13.691958  5518 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:13.692124  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:13.693578  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:13.689153 11427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.008s	sys 0.006s
W20260709 13:18:13.695820 11427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.008s	sys 0.006s
I20260709 13:18:13.644309 11537 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.624769 11235 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.681799 11335 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.712041  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:13.714772  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:13.724367  5516 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:13.625030 11385 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.683542 11323 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:13.730090  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:13.690694 11422 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:18:13.727514  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 107316us
I20260709 13:18:13.682135 11547 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.728960  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:13.736699  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:13.681995 11515 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:18:13.749804 11515 consensus_queue.cc:1243] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:13.712572 11537 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.664469 11392 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.752736  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:13.723595 11335 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.696694 11536 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.711899 11407 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:18:13.732879 11323 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.763526  5519 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:13.733644 11422 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:13.796597  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:13.822906  5521 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:13.800786  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.788866  5516 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:13.732941 11546 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:13.826308  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:13.818250  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 233368us
W20260709 13:18:13.762226 11530 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:13.780534 11335 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.763700 11402 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.757701 11333 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.759231 11537 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.828498  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:13.763844 11235 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.759649 11531 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:13.763240 11392 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:13.855590 11533 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:13.863547  5521 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:13.831801 11323 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.878242  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:13.878790  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50433.2us
I20260709 13:18:13.809013 11386 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:13.887764  5516 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:13.859809 11502 raft_consensus.cc:3055] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:13.890007  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:13.875479 11402 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.896337  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:13.885869  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 151760us
W20260709 13:18:13.891423  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 179478us
I20260709 13:18:13.875689 11333 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.901081  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:13.886440 11546 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.889163 11235 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:13.908394  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:13.928318  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:13.929944  5489 leader_election.cc:400] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18.
I20260709 13:18:13.930711  5489 leader_election.cc:403] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:13.893723 11502 raft_consensus.cc:740] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:13.904400 11402 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.904525 11333 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.905555 11515 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:13.912746 11533 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.955669  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2266) took 1734 ms. Trace:
I20260709 13:18:13.956246  5373 rpcz_store.cc:276] 0709 13:18:12.220854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.230554 (+  9700us) service_pool.cc:224] Handling call
0709 13:18:12.810518 (+579964us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:12.810743 (+   225us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:13.033897 (+223154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.033952 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:13.059568 (+ 25616us) log.cc:844] Serialized 52 byte log entry
0709 13:18:13.488767 (+429199us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:13.488804 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.488872 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.942911 (+454039us) raft_consensus.cc:1685] finished
0709 13:18:13.942938 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.955591 (+ 12653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4268,"raft.queue_time_us":16927,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8724,"spinlock_wait_cycles":79410432,"thread_start_us":202249,"threads_started":1,"wal-append.queue_time_us":488264}
I20260709 13:18:13.897531 11386 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.941138 11235 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:13.919080 11392 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:13.898890 11422 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.951162 11533 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.970853 11533 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.958201 11515 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:13.982048  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52260.6us
I20260709 13:18:13.985205 11535 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:13.986397 11540 log.cc:927] Time spent T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:18:13.947525 11546 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.981168 11464 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:14.004923 11545 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:18:14.005873 11386 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.008384 11546 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:13.994540 11532 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18.
I20260709 13:18:14.009272 11515 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:13.992141 11502 consensus_queue.cc:260] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:14.014609 11332 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:14.015082 11332 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:14.009873 11551 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:18:13.991770 11539 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.282s	user 0.000s	sys 0.002s
I20260709 13:18:14.018877  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:14.020067  5339 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:14.023718  5516 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:14.028118 11416 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:13.992657 11534 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:14.037952 11549 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:18:14.038448 11416 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:14.038872 11416 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.039208 11416 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:14.042212 11550 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:18:14.049013  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.038094  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:14.002691 11422 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:14.053572  5489 leader_election.cc:400] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12.
I20260709 13:18:14.057226  5489 leader_election.cc:403] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:13.996152 11544 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:13.995605 11385 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:14.054242  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.063570  5515 pending_rounds.cc:85] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 8
I20260709 13:18:14.063941  5515 pending_rounds.cc:107] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:18:14.064194  5515 raft_consensus.cc:2889] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:14.065101  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.070066 11531 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 11. Current term is 12.
I20260709 13:18:13.992857 11516 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 19.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 13:18:14.074293  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.034230 11534 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.087990  5522 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:14.086278  5518 raft_consensus.cc:1217] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Deduplicated request from leader. Original: 15.8->[17.9-21.11]   Dedup: 17.9->[19.10-21.11]
I20260709 13:18:14.087029  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.089874  5369 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:14.088861  5518 pending_rounds.cc:85] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:18:14.090391  5518 pending_rounds.cc:107] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:18:14.090659  5518 raft_consensus.cc:2889] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:14.059566 11325 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:14.083529  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 2993) took 1313 ms. Trace:
I20260709 13:18:14.058177 11536 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.093325  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2477) took 1114 ms. Trace:
I20260709 13:18:14.094007  5522 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:14.091974  5444 rpcz_store.cc:276] 0709 13:18:12.770537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.818381 (+ 47844us) service_pool.cc:224] Handling call
0709 13:18:14.083355 (+1264974us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540028cb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:14.083473 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655937280}
I20260709 13:18:14.093818  5446 rpcz_store.cc:276] 0709 13:18:12.979013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.203322 (+224309us) service_pool.cc:224] Handling call
0709 13:18:13.203738 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.204131 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.204164 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.204784 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.273072 (+ 68288us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:13.273135 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.273253 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.093086 (+819833us) raft_consensus.cc:1685] finished
0709 13:18:14.093107 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.093268 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154255,"raft.run_cpu_time_us":8265,"raft.run_wall_time_us":160254,"thread_start_us":67822,"threads_started":1,"wal-append.queue_time_us":403892}
I20260709 13:18:14.098502  5367 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:14.099255  5373 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:14.099643  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:14.101262 11554 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:18:14.105840  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2756) took 1109 ms. Trace:
I20260709 13:18:14.106316  5524 rpcz_store.cc:276] 0709 13:18:12.996076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.061109 (+ 65033us) service_pool.cc:224] Handling call
0709 13:18:13.090286 (+ 29177us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:13.251576 (+161290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.251606 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:13.252160 (+   554us) log.cc:844] Serialized 52 byte log entry
0709 13:18:13.688946 (+436786us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:13.688986 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.689052 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.105514 (+416462us) raft_consensus.cc:1685] finished
0709 13:18:14.105542 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.105764 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48213,"raft.queue_time_us":177886,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":67951,"thread_start_us":278313,"threads_started":2,"wal-append.queue_time_us":647368}
W20260709 13:18:14.108161 11308 consensus_meta.cc:287] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.904s	user 0.014s	sys 0.000s
I20260709 13:18:14.100402  5372 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:14.111083  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2485) took 1050 ms. Trace:
I20260709 13:18:14.113921  5522 pending_rounds.cc:85] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:18:14.116086  5368 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:14.131618  5522 pending_rounds.cc:107] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:18:14.131920  5522 raft_consensus.cc:2889] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:14.122251  5372 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:14.132426  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.124212  5373 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:18:14.139147  5369 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:14.129549  5447 rpcz_store.cc:276] 0709 13:18:13.060638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.222649 (+162011us) service_pool.cc:224] Handling call
0709 13:18:13.224759 (+  2110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.225158 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:13.532218 (+307060us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.682143 (+149925us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.682271 (+   128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.682911 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.683065 (+   154us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:13.694306 (+ 11241us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.694524 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.694600 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.110842 (+416242us) raft_consensus.cc:1685] finished
0709 13:18:14.110866 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.111022 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68349,"prepare.queue_time_us":131679,"prepare.run_cpu_time_us":8386,"prepare.run_wall_time_us":186148,"raft.queue_time_us":365845,"raft.run_cpu_time_us":502,"raft.run_wall_time_us":51169,"spinlock_wait_cycles":39977216,"thread_start_us":394770,"threads_started":2,"wal-append.queue_time_us":226105}
I20260709 13:18:14.086115 11506 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:14.090068 11534 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.147387 11506 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:14.093523 11471 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:14.096462 11325 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:14.097546 11321 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.072783 11544 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.071274 11510 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:14.165064  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 54640us
I20260709 13:18:14.109359 11335 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.177771 11335 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.178835 11535 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:14.178715 11335 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:14.179385 11535 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:14.186106  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.186671  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.190150 11566 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:14.173183 11321 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:14.191401 11471 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.191984 11396 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.192517 11396 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.193822 11471 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.170190 11325 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:14.196395 11527 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.521s	user 0.000s	sys 0.002s
I20260709 13:18:14.158165 11563 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:18:14.197860  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 470) took 1394 ms. Trace:
I20260709 13:18:14.086373 11333 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.198253 11533 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.074501 11235 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.200273  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:14.207846  5367 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:14.198287  5366 rpcz_store.cc:276] 0709 13:18:12.803806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.876472 (+ 72666us) service_pool.cc:224] Handling call
0709 13:18:12.882633 (+  6161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.999166 (+116533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.999197 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.999551 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.246257 (+246706us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:13.246314 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.246417 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.195784 (+949367us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:14.197551 (+  1767us) raft_consensus.cc:1685] finished
0709 13:18:14.197573 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.197795 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32508,"raft.queue_time_us":32272,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13441,"spinlock_wait_cycles":27671424,"thread_start_us":174273,"threads_started":1,"wal-append.queue_time_us":640808}
I20260709 13:18:14.210608  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:14.085974 11531 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:18:14.222450  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:14.234676  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 134526us
I20260709 13:18:14.236594  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:14.240770  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.110549 11359 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.239354  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.153834 11516 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:18:14.249660  5339 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:14.214995 11321 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:14.225039 11308 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:14.243572 11506 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:14.269695  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 113839us
I20260709 13:18:14.214617 11563 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:14.221002 11351 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.220693 11546 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:18:14.224159 11385 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:18:14.253532 11531 consensus_queue.cc:1243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:14.280063 11533 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:14.281358  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 552440us
I20260709 13:18:14.284394  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2473) took 1306 ms. Trace:
I20260709 13:18:14.270263 11506 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.287052  5441 rpcz_store.cc:276] 0709 13:18:12.977896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.223219 (+245323us) service_pool.cc:224] Handling call
0709 13:18:13.223469 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.223908 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:13.224246 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.807364 (+583118us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.283970 (+476606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.284033 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:14.284082 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.284147 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.284300 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520896,"prepare.queue_time_us":101128,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":95,"raft.queue_time_us":106698,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10414,"thread_start_us":553145,"threads_started":3,"wal-append.queue_time_us":506943}
I20260709 13:18:14.278385 11333 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.267005 11402 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.298511 11506 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:14.326020 11567 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:14.325830 11582 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:14.276489 11294 consensus_queue.cc:1059] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:18:14.330044 11553 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.276409 11578 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:18:14.333459 11556 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:14.334682  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2757) took 1338 ms. Trace:
I20260709 13:18:14.307471 11528 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:14.335165  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2483) took 1329 ms. Trace:
I20260709 13:18:14.335757 11544 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:14.335840  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 49049.5us
I20260709 13:18:14.336625 11510 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:14.336315 11529 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:14.338083 11576 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:18:14.300284 11542 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:18:14.339073 11396 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:14.438439  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48896.5us
I20260709 13:18:14.294433 11547 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:18:14.342641  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 464437us
I20260709 13:18:14.446241  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.364533  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:14.350114 11573 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.065s	user 0.000s	sys 0.004s
I20260709 13:18:14.458971  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:14.295037 11583 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:18:14.374185  5517 rpcz_store.cc:276] 0709 13:18:12.996321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.073127 (+ 76806us) service_pool.cc:224] Handling call
0709 13:18:13.073492 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:13.495894 (+422402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.495946 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:14.069249 (+573303us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b2c00108f48. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2685a11 00007fc1d2695372 00007fc1d3dc7a01 00007fc1d3d8c43a 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:18:14.069914 (+   665us) log.cc:844] Serialized 52 byte log entry
0709 13:18:14.142476 (+ 72562us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:14.142533 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.142640 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.334383 (+191743us) raft_consensus.cc:1685] finished
0709 13:18:14.334402 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.334623 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46271,"raft.queue_time_us":211707,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":32514,"spinlock_wait_cycles":40225536,"thread_start_us":421076,"threads_started":2,"wal-append.queue_time_us":156009}
I20260709 13:18:14.278756 11351 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.299352 11392 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:18:14.360852 11575 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:18:14.378095  5450 rpcz_store.cc:276] 0709 13:18:13.012182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.215588 (+203406us) service_pool.cc:224] Handling call
0709 13:18:13.215833 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.216009 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:13.216351 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.071261 (+854910us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b180045dfc0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:18:14.334516 (+263255us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.334728 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.334788 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:14.334846 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.334941 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.335088 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182635,"prepare.queue_time_us":2899,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":185547,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":142,"spinlock_wait_cycles":36265728,"thread_start_us":80006,"threads_started":1,"wal-append.queue_time_us":931811}
I20260709 13:18:14.388723  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:14.370600 11322 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:14.391018  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:14.504395  5524 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.505236 11555 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:14.505986 11555 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:14.506446 11555 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:14.506598 11422 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.507179 11422 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.365834 11582 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.509285 11582 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:14.429207  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.460953  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 224474us
W20260709 13:18:14.511657  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.460309  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:14.470321  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:14.471638  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:14.398638 11528 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:14.461233  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:14.513237  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:14.514211  5517 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:18:14.514150 11528 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:14.515560  5517 raft_consensus.cc:1240] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:14.509502 11422 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.516937 11555 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:14.528774  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 140159us
I20260709 13:18:14.375236 11323 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.537390 11422 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:14.547851 11547 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:14.548544 11587 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:18:14.548601 11547 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:14.550736 11537 consensus_meta.cc:287] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.006s
I20260709 13:18:14.551201 11537 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.551558 11547 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:14.547857  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.537628  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.564867  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:14.565596  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:14.566515  5444 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:14.566526  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:14.565799  5441 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:14.568678  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:14.569007  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:14.569531  5441 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:14.570139  5444 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:14.378113 11553 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.579501  5450 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:14.580698  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:14.582423  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:14.596952  5445 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:14.597853  5444 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:14.598171  5445 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:14.598294  5444 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:14.582921  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:14.584841  5448 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:18:14.599689  5448 pending_rounds.cc:85] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 9
I20260709 13:18:14.600399  5448 pending_rounds.cc:107] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:18:14.600688  5448 raft_consensus.cc:2889] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:14.595438  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.522136 11322 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:14.428895 11534 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.599141  5444 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:14.614801  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77482.6us
I20260709 13:18:14.616408  5444 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.618513 11322 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.619840 11321 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:14.620162 11322 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.620442 11321 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.571339 11422 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:14.622293 11422 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.622818 11321 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.625412  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:14.630721  5366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:59536
I20260709 13:18:14.631315  5366 raft_consensus.cc:606] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:14.631632  5366 raft_consensus.cc:614] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:14.633479  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.633882  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.634457  5524 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:14.634977  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.630332 11547 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:14.635813 11547 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:14.636719  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:14.637319  5367 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:14.637398  5375 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:14.638100  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.639003 11502 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.639235  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.639916  5370 raft_consensus.cc:2368] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:18:14.641034  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.571985 11536 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.644253  5449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 3025) took 1558 ms (client timeout 1594 ms). Trace:
I20260709 13:18:14.614372 11359 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.645229  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.613194  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:14.647696  5449 rpcz_store.cc:269] 0709 13:18:13.085647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.085958 (+   311us) service_pool.cc:224] Handling call
0709 13:18:14.644028 (+1558070us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400321ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:14.644179 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036043648}
I20260709 13:18:14.648952  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:14.659662  5370 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.648649  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.646818  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:14.637676  5367 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:14.661510  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.668195  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55147us
W20260709 13:18:14.624432 11585 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:18:14.670120  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.672077  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:14.672636  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 407060us
I20260709 13:18:14.683835  5370 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:14.685734  5414 leader_election.cc:400] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:18:14.686100  5414 leader_election.cc:403] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:14.688673  5369 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:14.688948  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:14.689576  5524 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:14.688673  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.694885  5515 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:14.696837  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:14.698740  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53340.5us
I20260709 13:18:14.702337  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.623598 11579 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:18:14.697149  5444 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:14.668377 11537 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.685537 11359 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.692286 11407 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
W20260709 13:18:14.703075 11568 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:14.727587  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.731631  5441 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:14.735589  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:14.728356 11594 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:14.668429 11325 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.724336 11556 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:14.676223 11536 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:18:14.762084  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.773025 11407 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:14.724128 11542 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:18:14.756853 11592 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:18:14.781365 11402 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.782611 11323 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.783986 11534 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:14.636721 11547 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.786861 11535 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:14.748222 11416 consensus_meta.cc:287] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.709s	user 0.013s	sys 0.001s
W20260709 13:18:14.794772  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 234479us
I20260709 13:18:14.675420 11464 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:14.698397 11541 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:14.748479 11555 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.797725 11535 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.815420 11556 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:14.754635 11359 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:18:14.834591 11586 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:18:14.839309 11500 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:14.841470 11351 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.817404 11416 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.846635 11416 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.848097 11325 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:14.856267  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 109191us
I20260709 13:18:14.857525  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:14.832880 11333 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.825166 11537 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:18:14.875041 11416 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:14.876231 11536 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:14.872385 11396 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:14.882895 11556 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:14.887755  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 189657us
I20260709 13:18:14.865934 11531 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:14.897231  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 385197us
W20260709 13:18:14.899637  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 170827us
I20260709 13:18:14.900395  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.902801  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:14.893899 11322 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.901356 11323 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:18:14.907117 11322 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.904459 11536 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:18:14.850695 11506 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:14.903749  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 176247us
I20260709 13:18:14.870519 11325 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:14.887087 11582 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:14.899204 11597 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:18:14.911547  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:14.916899 11422 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:14.917624 11528 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:14.919091  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 233698us
I20260709 13:18:14.901322 11392 consensus_queue.cc:1243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:14.918361 11325 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.868360 11308 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:14.922057  5416 leader_election.cc:400] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
W20260709 13:18:14.928093  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.872587 11333 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:14.939277  5416 leader_election.cc:403] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:14.913817  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.931697  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:14.931981  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:14.936856  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:14.946302 11542 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:14.940133  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.920251 11323 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:14.939754 11325 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:14.957757  5369 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:14.928611 11471 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:14.905542 11544 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:18:14.968331  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68053.2us
I20260709 13:18:14.969647  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.960582  5374 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:14.923506 11322 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.901399 11402 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:18:14.975461  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:14.975620  5366 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.976306  5524 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:14.974485  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:14.910940 11578 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:18:14.977929  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:14.980417  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:14.981446 11593 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:14.982609 11350 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:14.983073 11322 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:14.983971 11308 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:14.984359 11308 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:14.984688 11308 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:14.967326 11471 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:14.985884 11471 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:14.987257 11506 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:14.988332 11474 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:14.988809 11474 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.989203 11474 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:14.990895 11536 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:14.992597 11594 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:14.979290 11323 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:14.996552  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2777) took 1171 ms. Trace:
I20260709 13:18:14.997151  5518 rpcz_store.cc:276] 0709 13:18:13.825063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.085636 (+260573us) service_pool.cc:224] Handling call
0709 13:18:14.086041 (+   405us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:14.165827 (+ 79786us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:14.167536 (+  1709us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.937481 (+769945us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:14.938071 (+   590us) log.cc:844] Serialized 52 byte log entry
0709 13:18:14.938349 (+   278us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:14.938397 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.938491 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.996272 (+ 57781us) raft_consensus.cc:1685] finished
0709 13:18:14.996295 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.996478 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":580007,"prepare.queue_time_us":411,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":618964,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":7925,"thread_start_us":214334,"threads_started":3,"wal-append.queue_time_us":209611}
W20260709 13:18:15.000023 11564 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.889s	user 0.006s	sys 0.008s
I20260709 13:18:15.001628  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2767) took 1285 ms. Trace:
I20260709 13:18:15.002103  5523 rpcz_store.cc:276] 0709 13:18:13.716426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.716564 (+   138us) service_pool.cc:224] Handling call
0709 13:18:13.716987 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.753097 (+ 36110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.753131 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.758079 (+  4948us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.954953 (+196874us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:13.954996 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.955167 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.945513 (+990346us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:15.001209 (+ 55696us) raft_consensus.cc:1685] finished
0709 13:18:15.001254 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.001563 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49899,"raft.queue_time_us":40263,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":34829,"spinlock_wait_cycles":6120320,"thread_start_us":100294,"threads_started":1,"wal-append.queue_time_us":253527}
I20260709 13:18:15.004803  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:15.007211 11582 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.008912  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:15.010486  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:15.011214  5518 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.015615  5523 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:15.019702  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 105958us
I20260709 13:18:14.993074 11541 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:15.025151  5414 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:15.024015  5366 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:15.033133  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:15.034168  5371 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:15.034713 11531 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.035252 11531 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.036206 11506 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:15.037899  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68360.3us
I20260709 13:18:15.039227  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:15.041005 11510 raft_consensus.cc:2764] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:18:15.041724 11510 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:15.044500 11422 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:15.044926 11422 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:15.045717 11422 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.046869 11422 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.048081 11516 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:15.048544 11516 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:15.041357  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:15.052106 11601 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:15.052522 11601 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:15.052865 11601 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:15.053761 11541 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.055606 11407 raft_consensus.cc:2764] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:18:15.056083 11541 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.018851 11322 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:15.057520 11322 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.057660  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:15.059959  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:15.060628  5516 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.061115  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:15.057953  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:15.063036  5515 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:15.064298  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:15.064949  5372 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:15.069308  5523 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:15.071162  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:15.075870  5524 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:18:15.084265  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 103904us
I20260709 13:18:15.037267 11506 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:15.079882  5518 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:15.097021  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:15.082217  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 247422us
I20260709 13:18:15.077234  5516 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:15.099537  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:14.996681 11323 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.086699  5523 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:15.102952  5515 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:15.104031  5516 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:14.981010 11547 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:15.105460  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:15.106375  5523 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:15.109105  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.109800  5441 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:15.112372  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.113054  5449 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:18:15.114094  5445 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:15.113898  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.115667  5450 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:15.113878  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.117304  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.119881  5450 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.122118  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.049057 11531 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:15.083648 11464 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.138437  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:15.101406 11582 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:15.143126  5523 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:15.101207 11583 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:15.096354 11506 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:15.121809 11532 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:15.218396  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.103948 11528 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.220319  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.107689 11393 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:15.222167  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:15.230571  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:15.183214  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75329.1us
I20260709 13:18:15.355911  6076 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:15.356592  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:15.230803  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2752) took 2235 ms. Trace:
I20260709 13:18:15.213084 11464 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.106990 11359 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:15.255828  5450 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:15.282907  5445 raft_consensus.cc:2376] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
I20260709 13:18:15.283936  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.212793 11542 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
W20260709 13:18:15.346563  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.138068 11598 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.159s
I20260709 13:18:15.220945 11582 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:15.416411 11582 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.324069  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "505e05548ee2401d969672320dea8a9b"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:15.421602  5516 raft_consensus.cc:606] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:15.138368 11335 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.148s
W20260709 13:18:15.421970 11623 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:18:15.423405 11622 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:15.413604  5449 raft_consensus.cc:2376] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16. Re-sending same reply.
I20260709 13:18:15.427547  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.422020  5516 raft_consensus.cc:614] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:15.324076  5523 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:15.126313 11385 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:15.348207  5444 raft_consensus.cc:2376] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20. Re-sending same reply.
I20260709 13:18:15.139197 11536 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.357359  5520 rpcz_store.cc:276] 0709 13:18:12.994922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.999325 (+  4403us) service_pool.cc:224] Handling call
0709 13:18:12.999742 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.000008 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:13.148449 (+148441us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.356480 (+1208031us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b1800355540. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a
0709 13:18:14.890806 (+534326us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.230372 (+339566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.230434 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:15.230485 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.230553 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.230691 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":597641,"prepare.queue_time_us":272240,"prepare.run_cpu_time_us":9571,"prepare.run_wall_time_us":150593,"raft.queue_time_us":554682,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":7159,"spinlock_wait_cycles":49658112,"thread_start_us":821632,"threads_started":4,"wal-append.queue_time_us":772109,"wal-append.run_cpu_time_us":1606,"wal-append.run_wall_time_us":1061261}
I20260709 13:18:15.061882 11516 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.245507 11621 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:15.409891  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.364272  5442 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:15.413795  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.415704 11611 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.428077  5449 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:15.431054  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.359716 11393 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:15.438398 11624 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:18:15.441865 11589 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:18:15.353400 11506 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.460390  5450 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:15.470410  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.471488  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.336012 11528 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:15.483619  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.484457  5450 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.489283  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.490671  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.494371  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:15.495081  5516 raft_consensus.cc:606] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:15.495967 11601 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:15.497977 11626 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:15.498106  5523 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:18:15.502797 11471 consensus_meta.cc:287] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.000s
I20260709 13:18:15.504055 11506 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:15.505152  5441 raft_consensus.cc:2410] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:15.504756 11332 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:15.429117 11535 consensus_meta.cc:287] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.011s
I20260709 13:18:15.535768  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.536280  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:15.431689 11385 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:15.476179 11516 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.409785 11308 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.472083 11393 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:15.412910 11359 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.558360  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.561376  5444 raft_consensus.cc:2376] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17. Re-sending same reply.
I20260709 13:18:15.562891  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:15.566121  5450 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:15.572309  5449 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:15.582409  5445 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:15.538993 11556 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.590466  5449 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:15.577350  5442 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:15.538846 11322 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:15.459002 11536 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.540040 11422 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.597991  5442 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:15.478036 11333 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.605022  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 445) took 1004 ms. Trace:
W20260709 13:18:15.605605  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 247774us
I20260709 13:18:15.542287 11471 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.605497  5522 rpcz_store.cc:276] 0709 13:18:14.600986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.898863 (+297877us) service_pool.cc:224] Handling call
0709 13:18:14.899281 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.916104 (+ 16823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.920504 (+  4400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.920553 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:14.920586 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.604786 (+684200us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b540018ef54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:15.604841 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.604968 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38016384}
W20260709 13:18:15.601715  5524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.020s	sys 0.035s
I20260709 13:18:15.580982 11332 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.557224 11385 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.613991  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:15.617590  5523 raft_consensus.cc:606] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:15.618048  5523 raft_consensus.cc:614] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:15.665475  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56704.9us
I20260709 13:18:15.712204  5339 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:15.475203 11611 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:15.732291  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.736835  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:15.744074  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:15.744741 11617 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:15.745231 11396 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:15.745604 11617 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:15.745862 11396 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:15.747622 11627 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:18:15.746886 11396 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.746862 11617 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.749713 11562 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:15.750363 11562 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:15.751403 11562 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.752542  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:15.753935 11614 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:15.754231 11536 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.754451 11614 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:15.755396 11614 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:15.758911 11629 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:15.761178 11601 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:15.762879 11537 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:15.764019 11359 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.764802  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:15.765666 11537 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:15.766650 11537 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:15.767577 11537 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.601874 11556 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.775147 11592 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:15.775987 11582 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.775794 11528 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:15.779644 11630 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.225s	user 0.000s	sys 0.005s
I20260709 13:18:15.780372 11235 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:15.714555 11559 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:15.803696  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:15.605155 11322 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:15.770895 11474 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.002s
I20260709 13:18:15.814895  5444 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.825100  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2802) took 1196 ms. Trace:
I20260709 13:18:15.825775  5518 rpcz_store.cc:276] 0709 13:18:14.628423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.098983 (+470560us) service_pool.cc:224] Handling call
0709 13:18:15.099326 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:15.103394 (+  4068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.103428 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:15.106303 (+  2875us) log.cc:844] Serialized 52 byte log entry
0709 13:18:15.339709 (+233406us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:15.339767 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.339845 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:15.768100 (+428255us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:15.824717 (+ 56617us) raft_consensus.cc:1685] finished
0709 13:18:15.824741 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.825024 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3842,"raft.queue_time_us":6346,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":21511,"spinlock_wait_cycles":14227200,"thread_start_us":126033,"threads_started":1,"wal-append.queue_time_us":393764}
I20260709 13:18:15.833848 11636 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:15.613204 11422 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.775089 11578 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:15.846884  5444 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:15.803980 11559 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:15.855293  6043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.006s	sys 0.009s
W20260709 13:18:15.863492  6043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.009s
I20260709 13:18:15.828250 11464 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.816692 11474 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:15.876051 11325 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.904s	user 0.009s	sys 0.005s
I20260709 13:18:15.870165 11235 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:15.896499 11325 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.908285 11474 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.883385 11464 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:15.936302  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 62406.5us
I20260709 13:18:15.915391 11308 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:15.934629 11625 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.384s	user 0.000s	sys 0.002s
I20260709 13:18:15.917012 11235 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:15.937153 11471 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.956557 11556 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.958956 11325 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.963677 11606 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:15.964725 11632 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:18:15.965852 11634 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:18:15.966406 11422 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.901938 11559 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:15.968111 11611 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:15.930572 11464 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.019649 11606 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:16.022799 11647 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:18:16.025322 11640 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:18:16.027634 11643 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:18:16.138365  5340 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.023s	sys 0.030s
W20260709 13:18:16.139442  5340 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.023s	sys 0.030s
W20260709 13:18:16.140102  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 599723us
I20260709 13:18:16.146194  5369 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:18:16.158025  5368 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:18:16.160748  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:16.162602  5442 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:16.164090  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:16.178175  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.183364 11610 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:16.019663 11385 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.188459 11464 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:16.184746 11610 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:16.183385 11235 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:16.190534 11611 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.192739  6076 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:16.195765 11559 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.967378 11322 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:16.178596  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2800) took 1550 ms. Trace:
I20260709 13:18:16.227689  5524 rpcz_store.cc:276] 0709 13:18:14.627803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.082885 (+455082us) service_pool.cc:224] Handling call
0709 13:18:15.083190 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.099087 (+ 15897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.099116 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.099546 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.490615 (+391069us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b48001f2858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:18:15.614261 (+123646us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:15.614306 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.614383 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.177794 (+563411us) raft_consensus.cc:1685] finished
0709 13:18:16.177835 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.178306 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12321,"raft.queue_time_us":17480,"raft.run_cpu_time_us":3413,"raft.run_wall_time_us":383399,"spinlock_wait_cycles":35659008,"thread_start_us":514412,"threads_started":1,"wal-append.queue_time_us":770939}
I20260709 13:18:16.235316 11416 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.188410 11385 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:16.205612  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.088222 11606 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:16.218053  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.211973  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:16.235526 11562 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:18:16.240711 11556 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:16.006433 11393 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.239283  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:16.244638 11562 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:16.245151 11562 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.245605 11562 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:16.211913 11611 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.236647 11416 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:16.415747  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:16.423889 11506 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.876s	user 0.008s	sys 0.012s
I20260709 13:18:16.427006 11556 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.427980 11556 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.428670 11322 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:16.429726 11322 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.427722  6077 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:16.436512 11556 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:16.440910  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.450465  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.452173 11532 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:16.453941 11534 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.454701 11534 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.455715 11611 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:16.456323  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2522) took 1104 ms. Trace:
W20260709 13:18:16.458959  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 220006us
I20260709 13:18:16.459465  5372 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 20. Ops: []
I20260709 13:18:16.461784  5368 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 20.
I20260709 13:18:16.453197 11532 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.457347 11534 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:16.444415 11322 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:16.441263  5367 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.458959 11581 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:16.457017  5444 rpcz_store.cc:276] 0709 13:18:15.351890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.562519 (+210629us) service_pool.cc:224] Handling call
0709 13:18:16.455739 (+893220us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400239454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:16.455963 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577652096}
I20260709 13:18:16.480792 11601 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:16.478072  5373 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:16.481878 11532 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:16.482528 11393 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:16.482789  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.484524 11506 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.485411 11534 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.495229  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 1.13853e+06us
I20260709 13:18:16.486414  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:16.486702 11610 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:16.487512  5375 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:16.459371 11308 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.457949 11535 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:16.488696  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.494567  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:16.500646  5449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.006s
W20260709 13:18:16.508163  5449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.002s	sys 0.007s
I20260709 13:18:16.495627 11534 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:16.510826 11601 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.530241  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.539467 11416 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:16.501907 11535 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.543280 11535 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:16.544960  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70191us
I20260709 13:18:16.546715  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:16.547436  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:16.532887 11393 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:16.549196  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:16.513789 11532 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:16.556034  5370 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:18:16.532980 11534 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:16.516717 11506 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.557531  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:16.507205 11308 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:16.566749 11322 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:16.545105  5269 catalog_manager.cc:5697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.580225 11322 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:16.581862  5269 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.557337 11610 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:16.589039  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:16.553468 11393 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:16.583141 11322 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:16.570427 11535 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:16.593807 11601 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:16.598788  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:16.565481 11416 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:18:16.603461 11601 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.597776 11335 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:16.603812  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.537s (SENT) [suppressed 28 similar messages]
I20260709 13:18:16.604053 11579 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:16.604485  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:16.612879  5368 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:16.616792  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.618743  6043 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:16.619958 11606 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:16.620361  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:16.620676 11657 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:18:16.621125  5269 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 14 to 16, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 16 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:16.623106  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2542) took 1009 ms. Trace:
I20260709 13:18:16.623533  5445 rpcz_store.cc:276] 0709 13:18:15.613637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.159875 (+546238us) service_pool.cc:224] Handling call
0709 13:18:16.594618 (+434743us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5800018998. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:18:16.623018 (+ 28400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3694336}
W20260709 13:18:16.624701 11554 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.649s	user 0.022s	sys 0.015s
I20260709 13:18:16.624297  5269 catalog_manager.cc:5697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.606230 11335 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:16.609974  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:16.628208  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:16.630502 11601 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.598559 11534 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:16.620397 11606 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.677749 11606 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:16.646431 11335 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.679749 11546 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:16.680258 11546 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:16.632064  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.682406  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.683208  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3134) took 1619 ms. Trace:
I20260709 13:18:16.684078  5374 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:16.684304 11601 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:16.684433 11546 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:16.685531  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.686605 11546 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.687429  5375 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:16.689606  5372 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:16.691213  5372 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:16.632244  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.632876  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:16.636318 11332 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.948s	user 0.005s	sys 0.016s
I20260709 13:18:16.637524 11610 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.606379 11579 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:16.640936 11599 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.837s	user 0.009s	sys 0.035s
I20260709 13:18:16.648088 11506 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:16.651329  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 102320us
I20260709 13:18:16.655544 11393 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:16.659631 11128 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:16.660145 11600 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.860s	user 0.003s	sys 0.023s
I20260709 13:18:16.608937 11532 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.656908 11533 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:16.667649  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:16.673527 11562 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.674804  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:16.675537  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 128368us
I20260709 13:18:16.676190  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2533) took 1243 ms. Trace:
I20260709 13:18:16.683629  5371 rpcz_store.cc:276] 0709 13:18:15.063818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.063965 (+   147us) service_pool.cc:224] Handling call
0709 13:18:15.092374 (+ 28409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.219683 (+127309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.219717 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.219761 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:15.219790 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.682731 (+1462941us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001c02d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:16.682800 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.683014 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292214528}
I20260709 13:18:16.706719  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:16.711262 11594 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.720230  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 116578us
I20260709 13:18:16.729573  5518 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 20.
I20260709 13:18:16.721449 11579 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:16.750725  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83227.5us
I20260709 13:18:16.760037  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2539) took 1161 ms. Trace:
I20260709 13:18:16.758508  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.764680  5375 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:16.739593  5269 catalog_manager.cc:5697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 17, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.766467  5269 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 12 to 17, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 17 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:16.767220  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2537) took 1205 ms. Trace:
I20260709 13:18:16.768496  5269 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 18, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.767922  5444 rpcz_store.cc:276] 0709 13:18:15.561762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.509324 (+947562us) service_pool.cc:224] Handling call
0709 13:18:16.568250 (+ 58926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.617394 (+ 49144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.617453 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.618025 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.738334 (+120309us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:16.745667 (+  7333us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.754270 (+  8603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.754435 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.766906 (+ 12471us) raft_consensus.cc:1685] finished
0709 13:18:16.766929 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.767136 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9561,"prepare.queue_time_us":7349,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":58,"raft.queue_time_us":18702,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":2953,"thread_start_us":118989,"threads_started":1,"wal-append.queue_time_us":145582}
I20260709 13:18:16.771461  5269 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 13 to 21. New cstate: current_term: 21 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.773674 11332 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.773252  5269 catalog_manager.cc:5697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 17, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.774601 11332 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.775673  5269 catalog_manager.cc:5697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.772706  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:16.763312  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:16.729122  5449 rpcz_store.cc:276] 0709 13:18:15.432889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.591549 (+158660us) service_pool.cc:224] Handling call
0709 13:18:15.591883 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.592124 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:15.877332 (+285208us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.599795 (+722463us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.605985 (+  6190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.608534 (+  2549us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:16.634194 (+ 25660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.643202 (+  9008us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.676097 (+ 32895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9314,"prepare.queue_time_us":351953,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":2007,"raft.queue_time_us":29741,"raft.run_cpu_time_us":516,"raft.run_wall_time_us":26058,"thread_start_us":920343,"threads_started":2,"wal-append.queue_time_us":579097}
I20260709 13:18:16.783391 11532 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:16.784950 11610 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:16.787111  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.799532  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.799968  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:16.800936 11393 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:16.801471 11559 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:16.801959 11559 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.802325 11559 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.802670 11393 raft_consensus.cc:2764] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:18:16.804395  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:16.805684 11593 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:16.806196 11593 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:16.806602 11593 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:16.806885  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:16.807760  5448 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:16.808284  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2508) took 1695 ms. Trace:
I20260709 13:18:16.808593  5448 rpcz_store.cc:276] 0709 13:18:15.112659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.112790 (+   131us) service_pool.cc:224] Handling call
0709 13:18:16.806514 (+1693724us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b5800018998. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:18:16.808202 (+  1688us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100261760}
I20260709 13:18:16.809556 11533 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:16.811473 11655 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:18:16.812438 11533 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:16.814237  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2526) took 1458 ms. Trace:
I20260709 13:18:16.818292  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3129) took 1801 ms. Trace:
I20260709 13:18:16.818761  5369 rpcz_store.cc:276] 0709 13:18:15.017214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.017528 (+   314us) service_pool.cc:224] Handling call
0709 13:18:15.061193 (+ 43665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.147140 (+1085947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.817953 (+670813us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400330c54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:16.818222 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485745536}
I20260709 13:18:16.820851  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2504) took 1709 ms. Trace:
I20260709 13:18:16.821079 11322 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:16.822049 11322 consensus_queue.cc:1243] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:16.821702 11128 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.802436 11422 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:16.822804  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44985.1us
I20260709 13:18:16.821357  5441 rpcz_store.cc:276] 0709 13:18:15.111161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.116944 (+  5783us) service_pool.cc:224] Handling call
0709 13:18:16.820422 (+1703478us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b5400309dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:16.820667 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889008512}
W20260709 13:18:16.824710  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 87133.6us
I20260709 13:18:16.834880  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:16.835939  5448 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:16.816893 11335 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.849606 11332 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:16.849901 11544 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.850594 11544 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.853071 11544 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:16.853775  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:16.814646  5450 rpcz_store.cc:276] 0709 13:18:15.361064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.578632 (+217568us) service_pool.cc:224] Handling call
0709 13:18:15.579313 (+   681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.874252 (+294939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.874307 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.881716 (+  7409us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.494065 (+612349us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:16.538337 (+ 44272us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.563615 (+ 25278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.810597 (+246982us) spinlock_profiling.cc:243] Waited 9.79 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:16.813807 (+  3210us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54003bdb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:16.813859 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.813900 (+    41us) raft_consensus.cc:1685] finished
0709 13:18:16.813913 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.814082 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13827,"prepare.queue_time_us":20338,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":4254,"raft.queue_time_us":14758,"raft.run_cpu_time_us":2039,"raft.run_wall_time_us":256689,"spinlock_wait_cycles":719038848,"thread_start_us":252609,"threads_started":1,"wal-append.queue_time_us":620653}
I20260709 13:18:16.855944  5449 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:16.754570 11594 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.777385  5269 catalog_manager.cc:5697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index 9 to 12, term changed from 16 to 21, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:16.863903 11611 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:16.868090 11464 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:16.877190  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:16.790671  5445 rpcz_store.cc:276] 0709 13:18:15.594078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.624501 (+1030423us) service_pool.cc:224] Handling call
0709 13:18:16.624953 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.625323 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:16.666119 (+ 40796us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.754986 (+ 88867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.755052 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:16.755097 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.755195 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.755370 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39443,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":13386,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":21189,"spinlock_wait_cycles":3456,"thread_start_us":74674,"threads_started":1,"wal-append.queue_time_us":113111}
I20260709 13:18:16.854452  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:16.870335 11422 consensus_queue.cc:1243] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:16.871253  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2813) took 1837 ms. Trace:
I20260709 13:18:16.834839 11529 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:16.874060  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:16.891042  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:16.902437  5448 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
W20260709 13:18:16.901686  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67268.3us
I20260709 13:18:16.900053  5522 raft_consensus.cc:606] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:16.883540 11529 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:16.910713  5522 raft_consensus.cc:614] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:16.875705 11332 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:16.914294  5444 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:16.918017  5450 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:16.912102 11506 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:16.945516  5447 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:16.879508  5515 rpcz_store.cc:276] 0709 13:18:15.022131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.106099 (+ 83968us) service_pool.cc:224] Handling call
0709 13:18:15.106352 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.106555 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:15.141149 (+ 34594us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.438037 (+1296888us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b18003c7180. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:18:16.597343 (+159306us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.758231 (+160888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.758328 (+    97us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:16.790479 (+ 32151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.826029 (+ 35550us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.859211 (+ 33182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75435,"prepare.queue_time_us":197370,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":146,"raft.queue_time_us":1323567,"raft.run_cpu_time_us":707,"raft.run_wall_time_us":17451,"spinlock_wait_cycles":18950528,"thread_start_us":229217,"threads_started":2,"wal-append.queue_time_us":166981}
I20260709 13:18:16.951790  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2543) took 1212 ms. Trace:
I20260709 13:18:16.951912 11332 consensus_queue.cc:1243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:16.955521 11332 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.956528 11332 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:16.889940 11556 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:18:16.958210  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:16.978369  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 219612us
I20260709 13:18:16.952615  5448 rpcz_store.cc:276] 0709 13:18:15.739631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.913494 (+1173863us) service_pool.cc:224] Handling call
0709 13:18:16.950875 (+ 37381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.951301 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.951331 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.951396 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:16.951472 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.951558 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.951703 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:16.995976  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:16.997742 11544 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:16.885638 11322 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:18:16.867573 11671 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:18:16.943178 11672 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.943269 11393 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.053651  5269 catalog_manager.cc:5697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 17, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.063484  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:16.911540 11606 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:16.943184 11532 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:17.057910 11562 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:16.980261 11506 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.101152  6076 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:17.068557 11669 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:17.126366  5269 catalog_manager.cc:5697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 6 to 16, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 16 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.103209 11556 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.166656 11606 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.175626  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:17.194417 11546 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:17.194605 11534 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.066169 11579 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.204278  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2538) took 1616 ms. Trace:
W20260709 13:18:17.200088  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 201305us
I20260709 13:18:17.131167 11532 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.163031 11335 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.174467 11464 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:17.204725  5442 rpcz_store.cc:276] 0709 13:18:15.587712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.514316 (+926604us) service_pool.cc:224] Handling call
0709 13:18:16.569937 (+ 55621us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:16.642326 (+ 72389us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:16.667230 (+ 24904us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.826491 (+159261us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:16.850692 (+ 24201us) log.cc:844] Serialized 52 byte log entry
0709 13:18:16.850886 (+   194us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:16.851149 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.862294 (+ 11145us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.865502 (+  3208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.865654 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.204022 (+338368us) raft_consensus.cc:1685] finished
0709 13:18:17.204046 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.204218 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72292,"prepare.queue_time_us":14236,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":142,"raft.queue_time_us":80885,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":5873,"thread_start_us":115938,"threads_started":2,"wal-append.queue_time_us":163866}
I20260709 13:18:17.144081 11393 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.176677 11128 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.242552  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:17.238462  5269 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.203433 11601 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.171460 11544 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:18:17.254194  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:17.179690 11669 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:17.243621 11332 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.128226 11672 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:17.308383  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.254382 11546 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.177872 11529 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:17.289598  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 291030us
I20260709 13:18:17.258139 11556 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.332988  5442 raft_consensus.cc:2410] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:18:17.294585 11534 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.291421 11601 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.404915  5450 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:17.458541  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:17.397878  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 259722us
I20260709 13:18:17.294034 11464 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.369864  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:17.374522  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 451) took 2273 ms. Trace:
W20260709 13:18:17.364837  5414 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.026s (SENT)
W20260709 13:18:17.490984  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.491639  5442 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:17.406437 11559 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:18:17.311159 11335 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:17.372174  5269 catalog_manager.cc:5697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:17.336745 11593 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.530s	user 0.014s	sys 0.001s
W20260709 13:18:17.364491 11662 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.364s	user 0.002s	sys 0.000s
I20260709 13:18:17.403132 11393 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.333865 11675 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:17.401530  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:17.387257 11667 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.188s	user 0.000s	sys 0.002s
I20260709 13:18:17.526988  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:17.383396 11553 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.345674 11688 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.380077 11603 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 2.575s	user 0.025s	sys 0.032s
I20260709 13:18:17.395180 11546 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.393656 11579 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:17.560909  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 229499us
I20260709 13:18:17.347517 11534 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.467649  5446 rpcz_store.cc:276] 0709 13:18:15.100610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.100902 (+   292us) service_pool.cc:224] Handling call
0709 13:18:15.218049 (+117147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.579453 (+361404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.579487 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.586880 (+  7393us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.858317 (+271437us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:16.162109 (+303792us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.162740 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.373823 (+1211083us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b540029d6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:17.373904 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.373989 (+    85us) raft_consensus.cc:1685] finished
0709 13:18:17.374096 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.374314 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":90570,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":37932,"raft.run_cpu_time_us":547,"raft.run_wall_time_us":30882,"spinlock_wait_cycles":774240512,"thread_start_us":525477,"threads_started":2,"wal-append.queue_time_us":325840,"wal-append.run_cpu_time_us":5598,"wal-append.run_wall_time_us":1283107}
I20260709 13:18:17.582712  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:17.554827 11393 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.530973 11672 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:17.523706 11559 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.369938 11582 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.556572 11332 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:17.565594 11553 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.564963 11506 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.533728 11593 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.555927 11675 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:17.590507 11611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.014s	sys 0.027s
I20260709 13:18:17.538592 11335 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:17.595728 11529 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.618150  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.618779 11534 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:17.620853  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 256081us
I20260709 13:18:17.621090 11534 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.623713 11685 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.624313 11685 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:17.620965  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.652634  5442 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:17.654165 11534 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:17.658176  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 107435us
W20260709 13:18:17.658664  5447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2492) took 3094 ms (client timeout 1560 ms). Trace:
I20260709 13:18:17.659390  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:17.592438 11688 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:17.659155  5447 rpcz_store.cc:269] 0709 13:18:14.564693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.566287 (+  1594us) service_pool.cc:224] Handling call
0709 13:18:17.658335 (+3092048us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54003ccb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:17.658534 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5348585728}
W20260709 13:18:17.618685 11611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.014s	sys 0.028s
I20260709 13:18:17.616931 11532 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:17.677542  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:17.678752  5444 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.002s
I20260709 13:18:17.680708 11542 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.681069  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:17.682159  5445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.012s	sys 0.054s
I20260709 13:18:17.683333  5444 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:17.684716  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:17.686578  5445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.012s	sys 0.054s
I20260709 13:18:17.687381  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2553) took 1056 ms. Trace:
I20260709 13:18:17.687104  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.682219  5269 catalog_manager.cc:5697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.688930  5444 rpcz_store.cc:276] 0709 13:18:16.631283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.836256 (+204973us) service_pool.cc:224] Handling call
0709 13:18:17.687165 (+850909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.694085 11675 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.697654  5450 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.698167  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2475) took 4719 ms. Trace:
I20260709 13:18:17.698670  5443 rpcz_store.cc:276] 0709 13:18:12.978411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.200356 (+221945us) service_pool.cc:224] Handling call
0709 13:18:14.644814 (+1444458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.645082 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.645113 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.645664 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.823782 (+178118us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:14.823836 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.823940 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:15.095919 (+271979us) raft_consensus.cc:1685] finished
0709 13:18:15.095954 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.697638 (+2601684us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400321ed0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:17.697924 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3320847104,"thread_start_us":177667,"threads_started":1,"wal-append.queue_time_us":256274,"wal-append.run_cpu_time_us":2790,"wal-append.run_wall_time_us":1286725}
I20260709 13:18:17.699978  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:17.700701  5519 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.701725 11542 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.702389 11692 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.703332 11692 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.704267 11542 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.701001  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:17.706368  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.707435  5444 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:17.646376 11672 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:17.691238  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:17.673951 11579 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:17.613574 11393 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.713070  5450 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:17.633558 11506 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.714022  5447 raft_consensus.cc:2410] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:17.681349 11464 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.620860 11677 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:17.715308  5446 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.708257 11546 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.720441  5515 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:17.722715  5515 raft_consensus.cc:606] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:17.723132  5515 raft_consensus.cc:614] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:17.692731 11611 consensus_queue.cc:1243] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:17.668907 11332 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:17.633725 11553 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.731716 11556 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.731110  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.731776  5442 raft_consensus.cc:2410] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:17.731542  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.735716 11208 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:17.728569 11685 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.741276  5515 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:17.741942 11689 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:17.742619 11646 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.790s	user 0.008s	sys 0.036s
I20260709 13:18:17.742759 11689 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:17.737149 11601 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.745710  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:17.746508 11559 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:17.747247 11682 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:18:17.747380 11673 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.504s	user 0.000s	sys 0.001s
I20260709 13:18:17.729862 11579 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:17.749318  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2540) took 2149 ms. Trace:
I20260709 13:18:17.749024 11579 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.749827 11610 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:17.750402 11610 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:17.735965  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76732.2us
I20260709 13:18:17.751504  5522 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:17.745779 11684 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:18:17.752662  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:17.753293  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:17.753715  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2546) took 1928 ms. Trace:
I20260709 13:18:17.754262  5515 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:17.755098  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.756327  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2310) took 1030 ms. Trace:
I20260709 13:18:17.755637  5269 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 14 to 18, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.756695  5368 rpcz_store.cc:276] 0709 13:18:16.725958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.736114 (+ 10156us) service_pool.cc:224] Handling call
0709 13:18:17.754898 (+1018784us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:18:17.756237 (+  1339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2865536}
I20260709 13:18:17.754170  5448 rpcz_store.cc:276] 0709 13:18:15.825123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.081050 (+1255927us) service_pool.cc:224] Handling call
0709 13:18:17.161048 (+ 79998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.170051 (+  9003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.170084 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.170631 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.283472 (+112841us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:17.283513 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.283598 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.753478 (+469880us) raft_consensus.cc:1685] finished
0709 13:18:17.753501 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.753653 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":319498,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":20665,"thread_start_us":112455,"threads_started":1,"wal-append.queue_time_us":426874}
I20260709 13:18:17.758909 11308 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:17.759538  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2548) took 1882 ms. Trace:
I20260709 13:18:17.751881 11610 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.760418  5367 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:17.760712 11610 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.761773  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:17.762451  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2307) took 1119 ms. Trace:
I20260709 13:18:17.764328 11593 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.765045  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:17.766845  5366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 3126) took 2836 ms (client timeout 1825 ms). Trace:
I20260709 13:18:17.767141  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:17.767307  5366 rpcz_store.cc:269] 0709 13:18:14.930272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.930403 (+   131us) service_pool.cc:224] Handling call
0709 13:18:17.766470 (+2836067us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b54000faad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:17.766635 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38320512}
I20260709 13:18:17.767927  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:17.768246 11669 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.768527 11621 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:17.768889 11335 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.769477 11621 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.770498  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:17.771169  5443 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.768582 11534 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:17.772275 11621 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.768615  5523 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:18:17.772605 11534 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:17.774314 11692 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.776046 11534 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:17.767342  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:17.777109  5516 raft_consensus.cc:2410] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:17.777966 11556 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.778577 11556 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.762830  5372 rpcz_store.cc:276] 0709 13:18:16.643540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.691892 (+ 48352us) service_pool.cc:224] Handling call
0709 13:18:16.692239 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.892320 (+200081us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:16.911165 (+ 18845us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.139265 (+228100us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.238254 (+ 98989us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.238321 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:17.238362 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.762223 (+523861us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54001e8554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:17.762281 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.762400 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4257,"prepare.queue_time_us":166002,"prepare.run_cpu_time_us":181,"prepare.run_wall_time_us":14486,"raft.queue_time_us":113073,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":26630,"spinlock_wait_cycles":411166592,"thread_start_us":303366,"threads_started":3,"wal-append.queue_time_us":585787}
I20260709 13:18:17.783170  5519 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 21.
I20260709 13:18:17.759948  5448 rpcz_store.cc:276] 0709 13:18:15.877376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.758568 (+1881192us) service_pool.cc:224] Handling call
0709 13:18:17.758921 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.759192 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.759227 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.759272 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:17.759302 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.759356 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.759455 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.749747  5449 rpcz_store.cc:276] 0709 13:18:15.600034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.871988 (+1271954us) service_pool.cc:224] Handling call
0709 13:18:16.872612 (+   624us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:17.124906 (+252294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.124950 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:17.164460 (+ 39510us) log.cc:844] Serialized 52 byte log entry
0709 13:18:17.293714 (+129254us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:17.334184 (+ 40470us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.334590 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.593090 (+258500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.593194 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.749095 (+155901us) raft_consensus.cc:1685] finished
0709 13:18:17.749118 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.749266 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42745,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":561050,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":23654,"thread_start_us":623642,"threads_started":3,"wal-append.queue_time_us":398110}
I20260709 13:18:17.782073  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2545) took 1976 ms. Trace:
W20260709 13:18:17.787170  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.783207  5269 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 15, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.781157 11556 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.791826 11208 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:17.792181  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.801646  5515 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:17.801549 11594 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.786036  5441 rpcz_store.cc:276] 0709 13:18:15.806197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.943486 (+1137289us) service_pool.cc:224] Handling call
0709 13:18:17.069589 (+126103us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:17.172684 (+103095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.172727 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:17.268037 (+ 95310us) log.cc:844] Serialized 52 byte log entry
0709 13:18:17.565480 (+297443us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:17.565546 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.565659 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.781861 (+216202us) raft_consensus.cc:1685] finished
0709 13:18:17.781882 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.782017 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378,"raft.queue_time_us":167746,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":131905,"spinlock_wait_cycles":1030912,"thread_start_us":243114,"threads_started":1,"wal-append.queue_time_us":326671}
W20260709 13:18:17.801704  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49182.9us
I20260709 13:18:17.802050  5269 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.729909 11611 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:17.804641  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:17.806912  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.818192  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.807684  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.818317  5372 raft_consensus.cc:3060] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.728696 11506 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.814078  5449 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:17.799252  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2547) took 1940 ms. Trace:
I20260709 13:18:17.815559  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2541) took 2213 ms. Trace:
I20260709 13:18:17.802590 11402 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:17.807632  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.807922  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.820526  5446 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:17.824256  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:17.823588  5445 rpcz_store.cc:276] 0709 13:18:15.602020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.878661 (+1276641us) service_pool.cc:224] Handling call
0709 13:18:16.912320 (+ 33659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.999660 (+ 87340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.999705 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.000688 (+   983us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.692919 (+692231us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:17.692948 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.692997 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.815345 (+122348us) raft_consensus.cc:1685] finished
0709 13:18:17.815363 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.815498 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12846,"raft.queue_time_us":133586,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":29200,"thread_start_us":686232,"threads_started":1,"wal-append.queue_time_us":803737}
I20260709 13:18:17.823118  5447 rpcz_store.cc:276] 0709 13:18:15.858963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.730317 (+1871354us) service_pool.cc:224] Handling call
0709 13:18:17.785143 (+ 54826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.798801 (+ 13658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.798831 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.798900 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:17.798934 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.799009 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.799170 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.826303  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.730450 11546 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.831403  5519 raft_consensus.cc:2410] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:18:17.834554  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.836391  5446 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:17.831887  5443 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:17.834565  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.845981  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.846305  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.846352  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.849059  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.844334  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.850880  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:17.852033  5519 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:17.852991  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:17.853148  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:17.857503  5445 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:17.858319  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2549) took 1241 ms. Trace:
I20260709 13:18:17.858669  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:17.860790  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2550) took 1231 ms. Trace:
I20260709 13:18:17.830788 11542 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.865043  5449 rpcz_store.cc:276] 0709 13:18:16.629193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.859901 (+1230708us) service_pool.cc:224] Handling call
0709 13:18:17.860244 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.860466 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.860488 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.860536 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:17.860566 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.860622 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.860730 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.862857 11546 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.863336 11321 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:17.861706 11611 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.864534  5269 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 19, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.858645  5445 rpcz_store.cc:276] 0709 13:18:16.616841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.856791 (+1239950us) service_pool.cc:224] Handling call
0709 13:18:17.857231 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.858029 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.858227 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.864117  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.868434  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:17.869602  5375 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:17.826983 11402 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:17.870426  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 454) took 1715 ms. Trace:
I20260709 13:18:17.871346  5515 raft_consensus.cc:2368] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:18:17.730932 11677 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.885001  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:17.886101  5519 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:18:17.878453  5443 rpcz_store.cc:276] 0709 13:18:16.150627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.844458 (+1693831us) service_pool.cc:224] Handling call
0709 13:18:17.844786 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.864816 (+ 20030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.864844 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.864888 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:17.864917 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.864979 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.865081 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.879561  5367 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:17.881655  5444 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:17.888501  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.882419  5370 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:17.892467  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:17.893504  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:17.893712 11325 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.894302  5449 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:17.894707  5449 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:17.894426 11325 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.895102  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2771) took 4166 ms. Trace:
I20260709 13:18:17.895550  5449 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:17.895769  5367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2273) took 3264 ms (client timeout 2101 ms). Trace:
I20260709 13:18:17.870723 11542 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.905017  5442 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:17.934672  5374 raft_consensus.cc:2376] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20. Re-sending same reply.
I20260709 13:18:17.935642 11586 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:17.936494 11586 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:17.938967  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.940274 11321 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:17.940635  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47275.9us
I20260709 13:18:17.896818  5449 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:17.896456  5367 rpcz_store.cc:269] 0709 13:18:14.631533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.636501 (+  4968us) service_pool.cc:224] Handling call
0709 13:18:16.440056 (+1803555us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b54000b39a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d0a06f 00007fc1d3d82f60 00007fc1d3d847de 00007fc1d3d9027c 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2
0709 13:18:17.376281 (+936225us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b18002bdfa0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3dc7646 00007fc1d3d0158e 00007fc1d3d82f9e 00007fc1d3d847de 00007fc1d3d9027c 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c
0709 13:18:17.760100 (+383819us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b580079cad0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3ce80aa 00007fc1d3d6a447 00007fc1d3d82fe7 00007fc1d3d847de 00007fc1d3d9027c 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c
0709 13:18:17.895694 (+135594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747036160}
I20260709 13:18:17.915338  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 453) took 2015 ms. Trace:
I20260709 13:18:17.944715  5447 rpcz_store.cc:276] 0709 13:18:15.899976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.830636 (+1930660us) service_pool.cc:224] Handling call
0709 13:18:17.878057 (+ 47421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.914979 (+ 36922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.915005 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.915046 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:17.915074 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.915132 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.915269 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.953743  5443 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:18:17.957139  5269 catalog_manager.cc:5697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.882072 11402 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:17.942385 11590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.006s	sys 0.013s
I20260709 13:18:17.981693  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:17.979172  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:17.914558 11676 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 13:18:17.890280 11506 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:17.995144  5445 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:17.996047  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3026) took 1176 ms. Trace:
I20260709 13:18:17.996459  5445 rpcz_store.cc:276] 0709 13:18:16.819881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.877575 (+1057694us) service_pool.cc:224] Handling call
0709 13:18:17.956981 (+ 79406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.995724 (+ 38743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.995971 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.998977 11586 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.895709  5521 rpcz_store.cc:276] 0709 13:18:13.733312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.996604 (+263292us) service_pool.cc:224] Handling call
0709 13:18:13.996892 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.021307 (+ 24415us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:14.055465 (+ 34158us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.056117 (+   652us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.056454 (+   337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.056522 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:14.056581 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.181245 (+124664us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b180046d980. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:14.955413 (+774168us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b180046d980. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c6d2a6 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419
0709 13:18:14.978664 (+ 23251us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b180046d980. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:15.053265 (+ 74601us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b180046d980. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:17.852855 (+2799590us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b54002b9654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:17.874311 (+ 21456us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.894879 (+ 20568us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68346,"prepare.queue_time_us":1028227,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":408,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":12106,"spinlock_wait_cycles":127886592}
I20260709 13:18:18.005836  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.006598  5521 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:18.012564  5489 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items
I20260709 13:18:18.013865 11208 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:17.904224 11611 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:17.917223 11553 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:17.981631 11590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.006s	sys 0.013s
I20260709 13:18:17.987001  5269 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 13 to 17, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.991139  5443 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:17.993613  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51354.4us
I20260709 13:18:17.943553 11393 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:18.018566  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.027460  5372 raft_consensus.cc:2468] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 21.
I20260709 13:18:18.019953 11675 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.056939  5447 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:18.069375  5445 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:18.076006  5449 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:18:18.076604  5449 pending_rounds.cc:85] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 10
I20260709 13:18:18.077016  5449 pending_rounds.cc:107] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:18:18.077469  5449 raft_consensus.cc:2889] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:18.078459  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2554) took 1446 ms. Trace:
I20260709 13:18:18.078860  5449 rpcz_store.cc:276] 0709 13:18:16.631530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.866656 (+1235126us) service_pool.cc:224] Handling call
0709 13:18:17.894068 (+ 27412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.078071 (+184003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.078357 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.013046  5489 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2458)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2423)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2833)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2429)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2836)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2837)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2838)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2845)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2846)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2848)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2461)
W20260709 13:18:18.082273  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.088943  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.090701  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.092162  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.093180  5516 raft_consensus.cc:2410] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:18:18.095966 11542 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:18.098047 11332 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:18.100039 11677 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:18.101256 11689 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:18.099696  5489 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36806 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2446)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2423)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2452)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2463)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2833)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2429)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2841)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2445)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2428)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2836)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2837)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2838)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2845)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2846)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2848)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2461)
W20260709 13:18:18.111994  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 345545us
I20260709 13:18:18.112365  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.129488  5269 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 13 to 18, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.139441  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.142441  5516 raft_consensus.cc:2368] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:18:18.146049  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.147387  5516 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:18:18.148615  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.168012  6041 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:18.169059 11506 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:18.170424 11506 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.170617  5269 catalog_manager.cc:5697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 20, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 20 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.172376 11532 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:18.172992 11532 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:18.172453  5269 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:18:18.173878  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46272.2us
I20260709 13:18:18.174072 11532 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.175396 11506 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.179570  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:18.180086  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44906.8us
I20260709 13:18:18.182016 11325 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:18.110942 11590 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:18:18.183878 11422 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:18:18.183645 11402 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.184753  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:18.184787  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.185325 11605 raft_consensus.cc:2804] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:18.186034  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.188686  5521 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:18.198529  5515 raft_consensus.cc:2410] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:18:18.206086  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.201040  5269 catalog_manager.cc:5697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 17, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:18.212838  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.217685  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.218612  5521 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:18.219573  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.222314  5515 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:18.223668  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.224349  5515 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:18.225373 11343 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:18.225709  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:18.225813  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.226758  5518 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:18.227731  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.228698  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.222204 11294 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:18.230371 11294 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:18.230861 11294 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.232693 11402 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:18.218231 11605 raft_consensus.cc:697] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:18.234488  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.235098 11605 consensus_queue.cc:237] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:18.235800  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.236915  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.237644  5369 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:18.238109  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.238406  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.239219  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:18.239562  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.240104  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.241269  5517 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:18.241541  5370 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:18.242273  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.242877  5517 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 22.
I20260709 13:18:18.243929  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.239326  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.246804  5523 raft_consensus.cc:2410] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:18.248483 11688 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:18.248816  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.237864  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.229552  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.249986 11579 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:18.250277  5521 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:18.250418 11579 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:18.251371 11579 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.252367  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.255064  5524 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21. Re-sending same reply.
I20260709 13:18:18.245363  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.237864  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.258706  5516 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:18.256067  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.260192  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:18.260460  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.261003  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.261907  5524 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:18:18.262403  5516 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:18.259361 11321 raft_consensus.cc:2764] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:18:18.239477  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:18.263904  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44493.2us
I20260709 13:18:18.267369  5519 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:18.273326  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.267434  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.264945  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.265367  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:18.274957  5520 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.273411  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.277324  5515 raft_consensus.cc:2393] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 21: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:18.279055  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.279458  5521 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:18.280491  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:18.287670  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.290604  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.293540  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.293932  5269 catalog_manager.cc:5697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 15, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 15 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:18.292030  5515 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:18:18.269253 11579 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:18.274784 11671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.161s	user 0.010s	sys 0.015s
I20260709 13:18:18.305646  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.272964 11532 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.307751  5269 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 12 to 15, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.307490  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.305685  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:18.319801  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.309322  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.335253  5519 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:18.337769  5366 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:18.334575  5515 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:18.340489  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.287142 11506 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:18.344439  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.342399  5518 raft_consensus.cc:2410] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:18.342463  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.309118  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:18.345355  5516 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:18.342176  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.343942  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.344544  5515 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.346391  5517 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:18.334829 11671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.014s	sys 0.017s
I20260709 13:18:18.342176  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.348331  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.348466  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.351440  5524 raft_consensus.cc:2410] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:18.353497  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.336755 11675 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.360738  5523 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:18.307688 11692 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.363576  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.368038  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.362643  5366 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:18.369182  5516 raft_consensus.cc:2410] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:18.370747  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.371749  5519 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
W20260709 13:18:18.371833  5414 leader_election.cc:336] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.537s (SENT)
I20260709 13:18:18.375830  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:18.378454  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99674.9us
I20260709 13:18:18.372196  5269 catalog_manager.cc:5697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.382496  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.384266  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.389864  5519 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:18.362998 11321 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:18.391667  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.393573  5366 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:18.351050 11681 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:18:18.394853  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.396018  5269 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.397799  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3031) took 1227 ms. Trace:
I20260709 13:18:18.399282  5444 rpcz_store.cc:276] 0709 13:18:17.170258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.887629 (+717371us) service_pool.cc:224] Handling call
0709 13:18:17.917926 (+ 30297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.918381 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.918414 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.918990 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.195007 (+276017us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:18.195083 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.195204 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.397586 (+202382us) raft_consensus.cc:1685] finished
0709 13:18:18.397607 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.397725 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7932,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":14855,"thread_start_us":275448,"threads_started":1,"wal-append.queue_time_us":400963}
W20260709 13:18:18.398504  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.403635  5523 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:18.404956  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:18.407294  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56277.9us
I20260709 13:18:18.361294 11675 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.408388  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.414813  5269 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 19, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.373122 11208 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:18:18.420418  5516 raft_consensus.cc:2410] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:18.420743  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.426229  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.429327  5366 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:18.434332  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.435065  5269 catalog_manager.cc:5697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 4 to 10, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 10 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.437110  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.442755  5519 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:18.444574  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:18.406949 11692 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.450187 11321 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:18.450817 11321 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:18.452124 11675 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:18.451951 11321 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.467160  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.467651  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.468248  5449 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:18.467274  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.469978  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.470422  5441 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:18.473307  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.469550  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.474018  5516 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:18.474365  5443 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:18.432742 11590 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:18:18.476629 11590 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:18.477082 11590 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:18.478370 11590 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.479977 11590 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:18.481688  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.482576  5414 leader_election.cc:336] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.635s (SENT)
I20260709 13:18:18.483160  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:18.485809  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.482466  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.490911  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.491252  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.491802  5443 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:18.491081  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.493037  5523 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:18:18.492519  5269 catalog_manager.cc:5697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 8 to 14, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 14 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.496130  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:18.496443  5370 pending_rounds.cc:85] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 9
I20260709 13:18:18.496819  5370 pending_rounds.cc:107] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:18:18.496820  5441 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.503471  5520 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:18.505667  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.507680  5442 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:18.497136  5370 raft_consensus.cc:2889] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:18.508430  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.511590  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.511562  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.512437  5447 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:18.514550  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.515165  5524 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:18.515782  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.516250  5524 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 20. Ops: []
I20260709 13:18:18.516582  5516 raft_consensus.cc:2410] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:18.517697  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:18.518361  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.514582  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.518980  5518 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:18.519057  5374 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:18.514561  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.520323  5518 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:18.520373  5443 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:18.521157  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.521685  5524 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:18:18.521903  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:18.522552  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.523221  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.523943  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.524598  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.524894  5520 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:18:18.527969  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:18.529697  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 96990.7us
I20260709 13:18:18.492139 11681 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:18.553539  5522 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:18.532840  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:18.532321  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:18.533077  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.557329  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.559974  6072 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:18:18.560096  5368 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:18.555016  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.498376 11675 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:18.532275  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.561400  5444 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:18.554308  5373 raft_consensus.cc:2376] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23. Re-sending same reply.
I20260709 13:18:18.564111  5445 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:18.561673  5523 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
W20260709 13:18:18.531073 11711 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:18:18.507544  5366 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:18.573908  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.568912  5269 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.570060  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.566004  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.509132 11321 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.577306  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.577955  5524 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:18.576929  5517 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:18.578701  5520 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:18:18.582096  5520 pending_rounds.cc:85] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 14
W20260709 13:18:18.578894  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 220322us
I20260709 13:18:18.587536  5520 pending_rounds.cc:107] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:18:18.588037  5520 raft_consensus.cc:2889] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:18.588305  5448 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.583590  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:18.589468  5518 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
W20260709 13:18:18.590039  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.504462 11294 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:18.598901  5524 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:18.592233  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:18.593036  5442 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
W20260709 13:18:18.592248  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.594986  5519 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:18.608670  5517 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:18.611431  5518 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:18.577962 11402 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:18.615522  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.574429 11681 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:18.617933  5517 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:18.619360  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:18.619947  5517 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:18.620891  6076 raft_consensus.cc:2393] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:18.615449 11402 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:18.622988 11402 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.624074  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.625178  5443 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:18:18.626768  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49430.3us
I20260709 13:18:18.629252  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:18.637616  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:18.631407  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66094.9us
I20260709 13:18:18.639988 11416 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:18.631543  5520 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:18.640820  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:18.624389 11402 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.642445  5524 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:18.630098  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.643887  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:18.647538  5447 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:18.648872  5449 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:18.650611  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.652272  5519 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:18.609459 11322 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:18.608718 11705 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:18.672798  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.673925  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.674602  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.677016  5414 leader_election.cc:400] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17.
I20260709 13:18:18.678603  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:18.679700 11705 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:18.684576  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43868.7us
I20260709 13:18:18.686805  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:18.688385 11335 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:18.688934 11335 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:18.689962 11335 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.695976  5524 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:18:18.699193  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.705400 11294 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:18.629887 11512 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:18.641113 11681 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:18.644667 11416 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:18.713819 11416 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.658998 11322 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:18.718457  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:18.719811 11528 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:18.720224 11528 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.720556 11528 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.726569  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:18.659781 11506 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.727756 11671 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:18.672895  5520 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:18.728328 11506 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:18.730948 11716 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:18:18.731143  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:18.732604  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.733316 11325 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:18.734069 11325 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:18.735280 11325 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.736887 11705 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:18.737331  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50612us
I20260709 13:18:18.743419  5441 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:18.752003  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:18.740634  5448 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:18.758229  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:18.731003 11506 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:18.736186 11692 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:18.750571 11601 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.781792  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.774868  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.751387 11671 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:18.749639 11675 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:18.767083 11688 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.799986  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:18.800215  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.798255  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.801265  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.801462  5519 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:18.802165  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 329076us
W20260709 13:18:18.804375  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.807768  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:18.807582  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.826261  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:18.827183  5372 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:18:18.835222  5515 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:18.835887  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 2831) took 1033 ms. Trace:
I20260709 13:18:18.836241  5515 rpcz_store.cc:276] 0709 13:18:17.802358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.339444 (+537086us) service_pool.cc:224] Handling call
0709 13:18:18.835824 (+496380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.854082  6043 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:18.782226 11506 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.793283 11692 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:18.855245 11532 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:18:18.867648  5515 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:18.811641 11671 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:18.870183 11592 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:18.876847  5515 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:18.871078 11502 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:18.872552  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.796800 11675 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.883723  5521 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:18.792125 11322 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.810530 11688 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.857637 11601 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.863142 11506 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.887406 11592 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:18.906068 11671 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.907123 11592 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.889695 11532 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:18:18.915766 11688 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:18.917199 11601 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:18.913720 11322 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:18.920876  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:18.921912  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 114779us
W20260709 13:18:18.896821 11709 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.472s	user 0.003s	sys 0.003s
I20260709 13:18:18.943109  5519 raft_consensus.cc:2468] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 17.
W20260709 13:18:18.946334  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.945772  6041 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:18.897743 11605 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:18:18.969352  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:18.949198 11675 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:18.962756 11294 raft_consensus.cc:2804] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:18.984912  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.948805 11343 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:18:18.950580 11321 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:18:18.960099 11528 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:18.998106  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 455) took 2846 ms. Trace:
W20260709 13:18:18.998936  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 251700us
I20260709 13:18:18.998827  5446 rpcz_store.cc:276] 0709 13:18:16.151333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.844993 (+1693660us) service_pool.cc:224] Handling call
0709 13:18:17.873007 (+ 28014us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.943366 (+ 70359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.943403 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.978801 (+ 35398us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.286948 (+308147us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:18.413994 (+127046us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.414244 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.414317 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.778794 (+364477us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:18.987162 (+208368us) raft_consensus.cc:1685] finished
0709 13:18:18.997190 (+ 10028us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.997404 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108890,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":6446,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":24350,"spinlock_wait_cycles":11322624,"thread_start_us":386014,"threads_started":2,"wal-append.queue_time_us":387713}
I20260709 13:18:18.987948 11294 raft_consensus.cc:697] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:18.979398 11681 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:19.014765  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.013958  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 253803us
I20260709 13:18:19.016619  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:19.018093  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 266125us
I20260709 13:18:19.027107  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.027948  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:19.007825 11579 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:18:19.034621  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2832) took 1231 ms. Trace:
I20260709 13:18:19.035395  5516 rpcz_store.cc:276] 0709 13:18:17.803019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.517109 (+714090us) service_pool.cc:224] Handling call
0709 13:18:18.517372 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.584706 (+ 67334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.584753 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.594290 (+  9537us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.924307 (+330017us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:18.924345 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.931575 (+  7230us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.034370 (+102795us) raft_consensus.cc:1685] finished
0709 13:18:19.034391 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.034560 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8785,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7672,"thread_start_us":302453,"threads_started":1,"wal-append.queue_time_us":419184}
I20260709 13:18:19.037642  5522 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:18:19.039477  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2440) took 1230 ms. Trace:
I20260709 13:18:19.039848  5522 rpcz_store.cc:276] 0709 13:18:17.809484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.554504 (+745020us) service_pool.cc:224] Handling call
0709 13:18:19.037341 (+482837us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.038223 (+   882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.039254 (+  1031us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b540016c6d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:19.039418 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057027840}
I20260709 13:18:19.041160 11601 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:19.041838 11601 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.046156 11681 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:19.047181 11506 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:19.047677 11729 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.044060 11601 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:19.048306 11729 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.050781 11528 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:19.051700 11294 consensus_queue.cc:237] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:19.021776 11512 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:18:19.060108 11416 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:19.073734  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46731.1us
I20260709 13:18:19.062278 11729 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:19.075356  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:19.075290 11675 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.093641 11692 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.094602 11416 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:19.072456 11705 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:19.095410 11562 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:19.095239  5374 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:19.095978 11562 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:19.096901 11562 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.099300 11562 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:19.095372  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.102476  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:19.106388  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 89882.7us
W20260709 13:18:19.108736  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.111214  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:19.148866  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 294901us
I20260709 13:18:19.149120  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:19.150147  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47761.9us
W20260709 13:18:19.153324  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 128002us
I20260709 13:18:19.157680  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:19.167784  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.170359  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:19.183264  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 114323us
I20260709 13:18:19.184319  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.190539  5374 raft_consensus.cc:1275] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:18:19.192906  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43845us
I20260709 13:18:19.194001  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.156442 11322 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:19.196370  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45571.8us
I20260709 13:18:19.157020 11705 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:19.153293 11692 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.181308 11528 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:19.200712  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.201006  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2848) took 1215 ms. Trace:
I20260709 13:18:19.188264 11506 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:19.207614  6076 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:19.205479  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.186345 11731 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:19.203536  5517 rpcz_store.cc:276] 0709 13:18:17.985620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.620501 (+634881us) service_pool.cc:224] Handling call
0709 13:18:18.620798 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.621056 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:18.639164 (+ 18108us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.891925 (+252761us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.200641 (+308716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.200715 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:19.200760 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.200829 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.200951 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17917,"prepare.queue_time_us":22711,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":79,"raft.queue_time_us":75424,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"thread_start_us":534251,"threads_started":2,"wal-append.queue_time_us":350328}
W20260709 13:18:19.209028  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.211223  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.198242 11322 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:19.224599  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 255820us
I20260709 13:18:19.223219  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2834) took 1406 ms. Trace:
I20260709 13:18:19.200393 11729 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:19.212482 11506 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.198135 11605 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:18:19.219060 11532 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:19.213930 11730 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:19.225394  5523 rpcz_store.cc:276] 0709 13:18:17.816935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.565924 (+748989us) service_pool.cc:224] Handling call
0709 13:18:18.589880 (+ 23956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.612243 (+ 22363us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:18.640059 (+ 27816us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.894724 (+254665us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.222851 (+328127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:19.222908 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:19.222951 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.223026 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.223151 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2366,"prepare.queue_time_us":28731,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":138,"raft.queue_time_us":48169,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":564117,"threads_started":2,"wal-append.queue_time_us":397307}
I20260709 13:18:19.224346 11528 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:19.211895 11601 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:18:19.246557  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49033.9us
I20260709 13:18:19.227106 11705 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:19.227679 11322 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.245398  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:19.224895 11731 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:19.255777  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:19.237882 11506 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.253662  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.259258 11728 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:19.258737 11731 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.213748 11294 consensus_queue.cc:1048] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:18:19.273051  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:19.273376  5374 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:19.275949  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 70609.6us
I20260709 13:18:19.282152 11321 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:19.258821 11601 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:19.287484  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:19.313033  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59474.6us
I20260709 13:18:19.315659  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:19.316196  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:19.314723  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:19.316497  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:19.288013  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.318915  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.319445  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 120768us
I20260709 13:18:19.320509  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.316648  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.321914  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.274458 11416 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:19.318847  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.323113 11579 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:19.324462  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:19.311442 11601 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:19.277925 11688 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:19.281447 11728 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:19.276816 11335 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:18:19.323454 11528 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:19.347636 11734 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:19.344103 11688 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:19.354017 11668 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:19.275628 11741 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:18:19.314388 11343 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:19.347213  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.313688 11743 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:19.336885 11735 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:18:19.373858  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55952.2us
I20260709 13:18:19.275862 11729 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:18:19.327673 11692 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.376061 11528 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:19.382485  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58449.4us
W20260709 13:18:19.374903 11748 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:19.323153 11471 consensus_queue.cc:1059] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:18:19.329135 11416 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.373926 11705 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:19.390568  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.375028 11502 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:18:19.403560  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:19.442198  5368 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:19.404425  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:19.405045 11528 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:19.407315  5367 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:19.359022 11738 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:19.413689  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:19.429867  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43798.2us
I20260709 13:18:19.379594 11668 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:18:19.440127  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.384593 11750 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:19.449990  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.391072 11741 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.436708 11208 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:18:19.461540  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47980.5us
W20260709 13:18:19.456012  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.462559  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.445204 11416 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:19.454392 11601 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.468685 11705 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:19.468854 11730 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:19.469230 11601 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.455700 11471 consensus_queue.cc:1243] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 53eb858bdf82438d83f1be6a01da2e0e log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:19.472069 11668 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:19.473660 11728 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.475214  5449 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:19.477339  5447 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:18:19.477806  5447 pending_rounds.cc:85] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 11
I20260709 13:18:19.478025  5447 pending_rounds.cc:107] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:18:19.478281  5447 raft_consensus.cc:2889] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.474220  5450 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:18:19.464915  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 117818us
I20260709 13:18:19.453493 11343 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:18:19.462023 11208 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:19.501873  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:19.537220  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.473691 11668 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.507869  5441 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:19.497396 11322 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.548583 11322 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:19.548357 11528 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.550597  5366 raft_consensus.cc:3055] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:19.550734  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:19.500088 11208 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.551172  5366 raft_consensus.cc:740] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:19.553532  5447 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:19.545619  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 83142us
I20260709 13:18:19.557145  5375 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:19.557220  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.509029 11742 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:19.559120  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.559240  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:19.558964  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47087.4us
I20260709 13:18:19.555883  5366 consensus_queue.cc:260] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:19.561949  5444 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:19.565202  5450 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.566808  5518 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:19.567026  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.567704  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:19.568423  5368 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:19.568531  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:19.569795  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:19.570382  5449 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.570804  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:19.572371  5366 raft_consensus.cc:3060] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.578958  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:19.579865  5517 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 9. (term mismatch)
I20260709 13:18:19.581351  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.584636  5516 raft_consensus.cc:1240] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:19.580403 11322 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:19.586843  5519 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:19.580255  5517 pending_rounds.cc:85] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 8
I20260709 13:18:19.594250  5517 pending_rounds.cc:107] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 19.9
I20260709 13:18:19.594089  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:19.594496  5517 raft_consensus.cc:2889] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.586226  5516 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 13:18:19.594882  5521 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:19.590814  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:19.592561  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.594688  5445 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:19.620627  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.563287 11742 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:19.658699  5441 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:19.660141  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.660369  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101328us
I20260709 13:18:19.661161  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.662395  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.662592  5445 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:19.579583  5523 raft_consensus.cc:2376] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19. Re-sending same reply.
I20260709 13:18:19.649578  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:19.664732  5520 raft_consensus.cc:2376] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21. Re-sending same reply.
I20260709 13:18:19.667237  5449 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
W20260709 13:18:19.681399  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.683388  5366 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:19.673961  5447 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
W20260709 13:18:19.700049  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.593254 11208 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:19.502786 11584 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:18:19.579602 11532 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:19.727368  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.727326  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:19.718154  5449 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:18:19.721964  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 129454us
I20260709 13:18:19.577597 11757 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:19.723278  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 60971.6us
I20260709 13:18:19.593783 11760 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:19.585086 11506 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.733775  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.725288 11731 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:19.744230  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.680608 11728 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.728214 11671 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:19.749729  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.752000  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.755009  5450 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
W20260709 13:18:19.756542  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.791378  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60651.9us
I20260709 13:18:19.792346  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.793886  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.747066 11705 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.737875 11760 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:19.798305  5450 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:18:19.744989 11528 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:19.811414  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:19.817276  5414 connection.cc:256] RPC call timeout handler was delayed by -1.2471633489999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2686s for a response
I20260709 13:18:19.817763 11675 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:19.822558  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53728.5us
W20260709 13:18:19.872169  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.877760  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 129412us
I20260709 13:18:19.767704 11532 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:19.766458 11746 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:19.759337 11743 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:19.812764 11322 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.855355 11750 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.910240  5521 raft_consensus.cc:1275] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:19.833667 11760 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:19.922286  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43903.5us
I20260709 13:18:19.923099  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.813387 11590 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:18:19.796594 11592 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
W20260709 13:18:19.933105  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 122005us
I20260709 13:18:19.936311  5489 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.814304 11416 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.884353 11746 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:19.898092 11325 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:19.834658 11705 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.907097 11741 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:19.957865  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:19.915397 11731 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:19.965724  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:19.935137 11738 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:19.937484 11562 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.939962 11325 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:19.941027 11471 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:19.906855 11754 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:18:19.985458  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:19.932339 11321 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:18:19.879108 11742 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.973340 11729 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:20.003077  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.917070 11750 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:19.994871 11755 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:18:20.033283  5369 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:20.034786  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:20.075304  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43642.7us
W20260709 13:18:20.098266  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 63584.6us
I20260709 13:18:19.991864 11743 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:20.088387  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54591.8us
I20260709 13:18:20.100275  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:20.091282  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.092883  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 93711.8us
W20260709 13:18:20.101608  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 91123.8us
I20260709 13:18:20.093780  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:19.991394 11738 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:19.988648 11771 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:20.110210  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.120836  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.110584  5373 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:20.111191  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:20.027387 11729 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:20.143330  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.199865  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 231987us
W20260709 13:18:20.202873  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 100108us
I20260709 13:18:19.990540 11562 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:19.995302 11402 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:18:20.208869  5372 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:20.211388  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.211443  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:20.211758  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:19.990113 11532 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.120023 11528 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:20.237063  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 137914us
I20260709 13:18:20.239398  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:20.222819 11765 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.455s	user 0.001s	sys 0.000s
W20260709 13:18:20.222780 11763 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.472s	user 0.001s	sys 0.000s
I20260709 13:18:20.083930 11744 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.197s
I20260709 13:18:20.246492  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:20.218753 11729 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:20.214408 11506 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:20.247860  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:20.223201 11742 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:20.242266 11732 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:18:20.238091 11471 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:20.200264 11502 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:18:20.225975 11584 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:20.234756 11590 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:18:20.289106 11705 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:20.101154 11746 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.295642 11746 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:20.216854 11325 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.297866  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:20.298426 11325 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:20.299679 11738 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.304008 11416 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:20.306473  5366 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:20.309520 11562 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:20.313721 11750 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:20.314421 11775 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:18:20.314986  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:20.315793  5366 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:20.316354 11744 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:20.316764 11744 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:20.317616 11744 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.318828 11744 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:20.320524 11728 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.000s
I20260709 13:18:20.320953 11728 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:20.321493  5372 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:20.321641 11294 consensus_queue.cc:1048] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:20.322103 11754 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:20.326095 11754 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:20.327152 11754 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.270936  5450 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:20.202278 11688 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:20.321799  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45853.3us
I20260709 13:18:20.330605  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:20.322765 11795 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:20.339396  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:20.274643 11772 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:20.266242 11512 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:20.322008  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 74355.9us
I20260709 13:18:20.333299  5450 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:20.351917  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 251220us
W20260709 13:18:20.361470  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.383410  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.282614 11592 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:20.344937 11562 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:20.401532 11692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.011s	sys 0.032s
W20260709 13:18:20.426831  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.358019 11772 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:20.392064 11601 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.002s
I20260709 13:18:20.446792 11322 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.447580 11322 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.450513 11322 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:20.453248  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:20.454160  5372 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:20.455302 11322 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.456060 11322 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.459633 11322 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:20.404711 11692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.011s	sys 0.032s
I20260709 13:18:20.391505 11790 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:20.398277 11528 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:20.488372  5446 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:20.484513  5444 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:20.355748 11755 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 13:18:20.501360  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111452us
W20260709 13:18:20.503240  5414 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.013s
I20260709 13:18:20.503875  5446 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
W20260709 13:18:20.504037  5414 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.000s	sys 0.014s
W20260709 13:18:20.504922  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 535424us
W20260709 13:18:20.505772  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 403974us
I20260709 13:18:20.507699  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:20.492617  5447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.009s	sys 0.005s
W20260709 13:18:20.508605  5447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.009s	sys 0.005s
W20260709 13:18:20.520732  5414 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.555s (SENT)
I20260709 13:18:20.521347  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:20.529989  5414 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.564s (SENT)
I20260709 13:18:20.530485  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:20.532404  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.396616 11793 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:18:20.503257 11785 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:18:20.516601 11668 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.964s	user 0.013s	sys 0.000s
I20260709 13:18:20.510417 11416 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.504519 11790 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:20.562515  5414 leader_election.cc:336] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.944s (SENT)
W20260709 13:18:20.565316  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.575901  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 220576us
I20260709 13:18:20.510036 11325 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:18:20.536267 11512 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:20.542505 11750 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:20.560647 11322 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:20.578109  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:20.567806 11732 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:18:20.578181  5445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.011s	sys 0.015s
W20260709 13:18:20.618005  5445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.011s	sys 0.016s
I20260709 13:18:20.578073 11592 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:20.593497  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.573455 11767 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.463s	user 0.000s	sys 0.002s
W20260709 13:18:20.595371 11208 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.864s	user 0.012s	sys 0.000s
W20260709 13:18:20.597734 11751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.021s	sys 0.031s
I20260709 13:18:20.631263  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2575) took 1082 ms. Trace:
I20260709 13:18:20.574759 11416 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:20.651458  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 89595.3us
I20260709 13:18:20.614665 11562 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.661401  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2577) took 1112 ms. Trace:
I20260709 13:18:20.628490 11692 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:20.640100 11751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.021s	sys 0.032s
W20260709 13:18:20.657413  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.652611 11785 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:18:20.659561  5414 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.078s (SENT)
I20260709 13:18:20.671006  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:20.573376 11772 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:20.675838  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 71213.2us
I20260709 13:18:20.661303 11730 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:20.704684 11802 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:18:20.711041  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51532.8us
I20260709 13:18:20.629802 11528 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.709811  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2569) took 1162 ms. Trace:
I20260709 13:18:20.670531 11785 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:20.718355  5443 rpcz_store.cc:276] 0709 13:18:19.546943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.549505 (+  2562us) service_pool.cc:224] Handling call
0709 13:18:19.549903 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.566553 (+ 16650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.566583 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.585706 (+ 19123us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.734099 (+148393us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:19.734305 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.734427 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.709487 (+975060us) raft_consensus.cc:1685] finished
0709 13:18:20.709520 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.709711 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7825,"raft.queue_time_us":14383,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9410,"thread_start_us":148026,"threads_started":1,"wal-append.queue_time_us":161371}
I20260709 13:18:20.664901 11562 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:20.709823 11791 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
W20260709 13:18:20.735620 11797 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:18:20.737272  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60294.2us
I20260709 13:18:20.716892 11705 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:20.748870  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:20.673228 11790 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.750305  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:20.750900  5443 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:20.724171 11592 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.767446  5446 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:20.751917 11402 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.769280 11402 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.752368 11416 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:20.707623 11512 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:20.776530 11760 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.000s
I20260709 13:18:20.758702 11471 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:20.759207  5515 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:20.759356 11729 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.782001  5372 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:20.783370  5523 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:20.757020  5516 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:18:20.778065 11671 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.017s	user 0.012s	sys 0.002s
W20260709 13:18:20.784554  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 758710us
I20260709 13:18:20.773284  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2573) took 1225 ms. Trace:
I20260709 13:18:20.794081  5444 rpcz_store.cc:276] 0709 13:18:19.548119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.565886 (+ 17767us) service_pool.cc:224] Handling call
0709 13:18:20.773036 (+1207150us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54003bc754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:20.773198 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744398208}
I20260709 13:18:20.780054 11760 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.799942 11789 consensus_queue.cc:1059] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:20.800804 11760 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:20.803459  5449 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:20.759223 11785 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.814188 11785 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.820111 11744 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.820348 11579 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.820911 11744 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.820995 11579 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.661958  5447 rpcz_store.cc:276] 0709 13:18:19.549398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.719896 (+170498us) service_pool.cc:224] Handling call
0709 13:18:19.720446 (+   550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.728468 (+  8022us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:20.509476 (+781008us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.660899 (+151423us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.661062 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.661091 (+    29us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:20.661120 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.661221 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.661343 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53252,"prepare.queue_time_us":66469,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2264,"thread_start_us":866887,"threads_started":2}
I20260709 13:18:20.787102 11757 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:20.796927 11671 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:20.834964 11744 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:20.836489  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 55936.9us
I20260709 13:18:20.837024 11729 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:20.838668  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:20.838812  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:20.839571  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:20.840322  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:20.840438  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:20.842096  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:20.843214  5450 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:20.848778 11746 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:20.852221  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2880) took 1276 ms. Trace:
I20260709 13:18:20.640535  5445 rpcz_store.cc:276] 0709 13:18:19.548672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.696320 (+147648us) service_pool.cc:224] Handling call
0709 13:18:19.718833 (+ 22513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.719107 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:19.909524 (+190417us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.629116 (+719592us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.630775 (+  1659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.630845 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:20.630906 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.631004 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.631173 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56146,"prepare.queue_time_us":76284,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":9234,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":27271,"spinlock_wait_cycles":34199552,"thread_start_us":855988,"threads_started":2}
I20260709 13:18:20.852865  5524 rpcz_store.cc:276] 0709 13:18:19.575329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.650882 (+ 75553us) service_pool.cc:224] Handling call
0709 13:18:19.722440 (+ 71558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:19.739908 (+ 17468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.739933 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:19.761506 (+ 21573us) log.cc:844] Serialized 52 byte log entry
0709 13:18:19.969313 (+207807us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:19.993362 (+ 24049us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.782594 (+789232us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b18003c63a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:18:20.851607 (+ 69013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.851693 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.851782 (+    89us) raft_consensus.cc:1685] finished
0709 13:18:20.851931 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.852136 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7401,"prepare.queue_time_us":24603,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":805645,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":8547,"spinlock_wait_cycles":41626880,"thread_start_us":154701,"threads_started":2,"wal-append.queue_time_us":146676}
W20260709 13:18:20.918022  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75993.3us
I20260709 13:18:20.919142  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:20.838572 11776 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.606s	user 0.003s	sys 0.000s
W20260709 13:18:20.936097  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 94567.4us
I20260709 13:18:20.936736  5520 pending_rounds.cc:85] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 10
I20260709 13:18:20.937233  5520 pending_rounds.cc:107] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:18:20.937589  5520 raft_consensus.cc:2889] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.937757 11471 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:20.946568  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:20.947505  5518 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:20.948782  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:20.952852  5518 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:20.935976  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:20.955127  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:20.956604  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:20.957379  5515 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:20.841094 11757 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:18:20.963773  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46290.6us
W20260709 13:18:20.965445  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.965941  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.966408  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.972114 11729 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.972690 11729 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:20.923339 11601 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:20.934784 11692 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:20.954152 11506 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:20.959085 11671 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:20.961063 11746 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:21.003044  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.923751 11728 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
W20260709 13:18:20.971114 11788 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.721s	user 0.002s	sys 0.001s
W20260709 13:18:20.994413  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 961529us
I20260709 13:18:20.970700 11801 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.958676 11838 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:20.924258 11705 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:18:20.976222 11760 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:20.964365 11771 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:20.971913 11757 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.008148  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:20.982383  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:21.011032  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:21.013516  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.013978  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78130.2us
W20260709 13:18:21.007517  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.034014  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:20.977576 11601 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:20.981133 11692 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.980037 11322 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:20.959908 11772 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:18:21.041880  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:20.983651 11742 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.989562 11671 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.053257  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:20.988754 11579 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:21.057237  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:21.001874 11750 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.003283 11562 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:21.071169  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:21.072829  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 61881.4us
I20260709 13:18:21.073985  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:21.053434 11692 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:21.041258 11601 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:21.070464 11797 log.cc:927] Time spent T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:21.088842  5515 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:21.066182 11532 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:21.091084  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.063370 11728 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:21.091317  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.073078 11506 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:21.033686 11801 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.095707  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2572) took 1547 ms. Trace:
I20260709 13:18:21.072788 11731 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:21.053187 11760 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:21.129859  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 147603us
I20260709 13:18:21.071751 11671 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.072058 11742 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.097847 11728 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:21.130504  5448 rpcz_store.cc:276] 0709 13:18:19.547863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.576593 (+ 28730us) service_pool.cc:224] Handling call
0709 13:18:19.650485 (+ 73892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.720881 (+ 70396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.720912 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.734033 (+ 13121us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.896048 (+162015us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:19.896087 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.896165 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.837848 (+941683us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:21.080901 (+243053us) raft_consensus.cc:1685] finished
0709 13:18:21.080935 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.095629 (+ 14694us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47791,"raft.queue_time_us":48349,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6835,"spinlock_wait_cycles":11102976,"thread_start_us":86068,"threads_started":1,"wal-append.queue_time_us":228743}
I20260709 13:18:21.128742 11506 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:21.138209 11837 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:21.138549 11729 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:21.062934 11322 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:21.127365 11738 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:21.159678  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68439.5us
I20260709 13:18:21.077155 11750 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.216849  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.092204 11792 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:21.206741  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 69540.1us
I20260709 13:18:21.128113 11592 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:21.218521  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:21.099071 11532 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:21.270088  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53334.8us
I20260709 13:18:21.273164  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.148144 11731 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:21.206007 11506 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.216391 11738 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:21.340277  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 121836us
I20260709 13:18:21.221868 11592 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.296263  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:21.281247 11741 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:21.274566 11532 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.266793 11792 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.266947 11821 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:21.341055 11837 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:21.345856 11738 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.268301 11343 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.115s
I20260709 13:18:21.354770 11705 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.425669  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 84586.2us
I20260709 13:18:21.383940 11781 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.359385 11741 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:21.281739 11771 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.386544 11792 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.436048  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2590) took 1767 ms. Trace:
I20260709 13:18:21.393352 11821 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.439466 11781 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:21.443311 11743 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:21.449656 11745 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.450361 11781 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:21.450474 11745 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:21.452121  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:21.452855  5374 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 17.
W20260709 13:18:21.453702 11822 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.747s	user 0.004s	sys 0.010s
I20260709 13:18:21.454331  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:21.393244 11584 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.455207 11584 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:21.454550 11834 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.364s	user 0.000s	sys 0.000s
W20260709 13:18:21.464655 11764 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.792s	user 0.007s	sys 0.004s
I20260709 13:18:21.469980  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2563) took 1997 ms. Trace:
I20260709 13:18:21.470530  5442 rpcz_store.cc:276] 0709 13:18:19.472838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.479506 (+  6668us) service_pool.cc:224] Handling call
0709 13:18:19.479829 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.480174 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.480199 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.480661 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.544215 (+ 63554us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:19.544272 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.544360 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.464193 (+1919833us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b24002bf9e8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0b259c4 00007fc1d0b23acb 00007fc1d0cdedc9 00007fc1d0cdea55 00007fc1d0cde09d 00007fc1d391010e 00007fc1d392788c 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221
0709 13:18:21.469527 (+  5334us) raft_consensus.cc:1685] finished
0709 13:18:21.469559 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.469890 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4211,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2142,"spinlock_wait_cycles":105707264,"thread_start_us":63111,"threads_started":1,"wal-append.queue_time_us":79715}
W20260709 13:18:21.473376 11830 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:18:21.443252 11821 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.473938  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2883) took 1898 ms. Trace:
I20260709 13:18:21.474737 11780 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:21.475315 11780 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:21.476321 11780 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:21.483930 11846 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:21.485970  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:21.487253  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:21.487896  5522 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:21.487551  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2578) took 1936 ms. Trace:
I20260709 13:18:21.441552 11741 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:21.493961  5449 rpcz_store.cc:276] 0709 13:18:19.550701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.730180 (+179479us) service_pool.cc:224] Handling call
0709 13:18:19.751121 (+ 20941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.804081 (+1052960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.487328 (+683247us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001793d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:21.487494 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419451136}
I20260709 13:18:21.496217 11743 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.494014 11322 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:21.500041 11731 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.501253 11847 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:21.502005 11847 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.474406  5516 rpcz_store.cc:276] 0709 13:18:19.575834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.876297 (+300463us) service_pool.cc:224] Handling call
0709 13:18:19.907692 (+ 31395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.788384 (+880692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.473640 (+685256us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b540016cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:21.473864 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952135552}
W20260709 13:18:21.499714 11785 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 13:18:21.506244  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:21.507977 11831 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:18:21.510313 11843 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:21.511979 11688 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.441632  5450 rpcz_store.cc:276] 0709 13:18:19.668379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.353318 (+684939us) service_pool.cc:224] Handling call
0709 13:18:20.353728 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.843783 (+490055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.435833 (+592050us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54003ccb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:21.435991 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121095040}
I20260709 13:18:21.403982 11837 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.357669 11592 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.512907 11692 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.528874 11817 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:21.560488  5414 leader_election.cc:336] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 3.203s (SENT)
I20260709 13:18:21.561331  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.532126 11781 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:21.307407 11728 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.497001 11743 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.574011 11781 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.553516 11837 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.437842 11705 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.583123 11745 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:21.585583 11322 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:21.560849 11792 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.586256 11836 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:21.586858  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2599) took 1078 ms. Trace:
W20260709 13:18:21.589233 11814 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.884s	user 0.000s	sys 0.007s
I20260709 13:18:21.595005  5372 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:21.598063 11416 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:21.605538 11781 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.596698 11532 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:21.613076  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.619443  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.669049  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.665252  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:21.661774  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:21.659613 11728 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:21.665704  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:21.674655  5366 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:21.662628  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:21.671934  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.666273  5443 rpcz_store.cc:276] 0709 13:18:20.508129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.768319 (+260190us) service_pool.cc:224] Handling call
0709 13:18:20.768722 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.824843 (+ 56121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.824877 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.840500 (+ 15623us) log.cc:844] Serialized 26 byte log entry
0709 13:18:21.216026 (+375526us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:21.216089 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.216185 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.586571 (+370386us) raft_consensus.cc:1685] finished
0709 13:18:21.586600 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.586782 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84211,"raft.queue_time_us":62608,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":37504,"thread_start_us":375074,"threads_started":1,"wal-append.queue_time_us":677007}
I20260709 13:18:21.684612  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:21.685499  5444 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:21.658144 11681 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:18:21.692375  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:21.693372  5446 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:18:21.693861  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 397702us
I20260709 13:18:21.694634  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.695655  5524 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:21.696165  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:21.665201 11851 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:21.697707  5375 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:21.570458 11817 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:21.696995  5446 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:21.689013 11778 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.668329 11772 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:18:21.706033  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:21.712280  5448 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:21.665782 11322 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.715283  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:21.672309 11416 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.701766 11771 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:21.724491  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.725237  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.701558 11742 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:21.727897  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.705333 11729 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.692404 11730 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:21.731858  5489 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.732143  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:21.733119  5448 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
W20260709 13:18:21.736250  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.731397 11789 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:21.746031  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:21.729722 11731 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:21.761762 11840 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:21.762091  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:21.773175  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:21.764216 11741 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.719774 11778 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.766307  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2586) took 2196 ms. Trace:
I20260709 13:18:21.766702  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:21.767025 11692 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:21.769006 11671 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.001s
I20260709 13:18:21.730142 11771 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:21.737461 11783 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.718s	user 0.020s	sys 0.016s
I20260709 13:18:21.774515  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:21.737227 11688 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:21.735167 11838 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.776780  5441 rpcz_store.cc:276] 0709 13:18:19.570091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.088419 (+518328us) service_pool.cc:224] Handling call
0709 13:18:20.121172 (+ 32753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.202843 (+ 81671us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:20.236273 (+ 33430us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.440039 (+203766us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.440567 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.440747 (+   180us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:20.440793 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.440895 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.588492 (+1147597us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:21.765928 (+177436us) raft_consensus.cc:1685] finished
0709 13:18:21.766071 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.766227 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33119,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":63,"raft.queue_time_us":115096,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":37897,"spinlock_wait_cycles":7561088,"thread_start_us":74905,"threads_started":1,"wal-append.queue_time_us":391886}
W20260709 13:18:21.793290 11783 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.793s	user 0.021s	sys 0.016s
I20260709 13:18:21.792807 11742 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:21.772476 11789 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:21.737063 11729 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.792533 11771 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.792095 11755 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:21.792582 11730 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:21.815958 11731 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:21.817806 11688 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:21.789172 11671 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.875056 11755 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.878651 11730 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:21.896862 11854 log.cc:927] Time spent T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:18:21.869789 11858 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:21.893597 11743 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:21.892171 11792 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:21.955083  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.104s (SENT) [suppressed 36 similar messages]
W20260709 13:18:21.907887  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 129999us
I20260709 13:18:21.954213  5368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2338) took 1926 ms. Trace:
I20260709 13:18:21.795818 11838 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:21.965245 11506 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.006s
I20260709 13:18:21.894327 11705 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:21.976904  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:21.901153 11755 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:21.881760 11692 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:18:21.825829 11823 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:18:21.895587 11532 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:21.976398  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:21.971864  5368 rpcz_store.cc:276] 0709 13:18:20.027514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.027755 (+   241us) service_pool.cc:224] Handling call
0709 13:18:20.028014 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.097512 (+ 69498us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:20.212643 (+115131us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.525027 (+312384us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.525334 (+   307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.525383 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:20.525456 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.839922 (+314466us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18002055a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:21.509398 (+669476us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b18002055a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:21.901847 (+392449us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b5400330754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:21.953946 (+ 52099us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.954125 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146831,"prepare.queue_time_us":161855,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":20510,"raft.queue_time_us":49707,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":36093,"spinlock_wait_cycles":168731648,"thread_start_us":285346,"threads_started":1,"wal-append.queue_time_us":550069,"wal-append.run_cpu_time_us":1604,"wal-append.run_wall_time_us":1001633}
I20260709 13:18:21.989984 11322 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:21.979555 11402 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:21.995232  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 469) took 1022 ms. Trace:
W20260709 13:18:21.997728 11861 log.cc:927] Time spent T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:18:21.997030  5517 rpcz_store.cc:276] 0709 13:18:20.972550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.099442 (+126892us) service_pool.cc:224] Handling call
0709 13:18:21.099978 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.139532 (+ 39554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.139567 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:21.140072 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:18:21.512309 (+372237us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b48001f2858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:18:21.526092 (+ 13783us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:21.526154 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.526254 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.994918 (+468664us) raft_consensus.cc:1685] finished
0709 13:18:21.994941 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.995169 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39086,"raft.queue_time_us":48086,"raft.run_cpu_time_us":2492,"raft.run_wall_time_us":363284,"spinlock_wait_cycles":150393600,"thread_start_us":253855,"threads_started":1,"wal-append.queue_time_us":493872}
W20260709 13:18:22.000222  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 225772us
W20260709 13:18:22.004070 11601 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.876s	user 0.011s	sys 0.000s
I20260709 13:18:22.004536 11601 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:22.006884 11856 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:18:22.010421 11757 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.947s	user 0.008s	sys 0.004s
I20260709 13:18:21.986335 11869 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.023337  5517 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:22.023944  5519 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:22.010933 11757 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:21.979205 11506 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.025255  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.025820 11869 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.026464 11778 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.031137  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.012053 11741 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.033377  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.034224  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.035658  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.036202  5517 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:22.035976  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.038285  5520 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:22.039860  5516 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:22.027144 11601 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.040560  5515 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:22.040905  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.042517  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.043303  5523 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:22.045452  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.045763  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.046180  5521 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:22.046432  5516 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:22.047205  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.047381  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.047821 11817 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:22.048221  5516 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:18:22.048333  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.049110  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.050623  5516 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 23. Current term is 24. Ops: []
W20260709 13:18:22.053290 11821 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.001s
I20260709 13:18:22.053747 11821 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.060416  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.065804  5521 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:21.977698 11789 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:21.988279 11688 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.071048  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.074755  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.075714  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.076131  5516 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:22.072430  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.079975  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.082134  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:21.993479 11730 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.088503 11821 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:22.091130 11592 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 13:18:22.096431  5517 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:18:22.077994 11738 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.000s
I20260709 13:18:22.104210 11738 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.105479 11869 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.106024 11671 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:22.109278  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.111725  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.116623  5516 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:22.120795  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.127092  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.127743  5521 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:22.130699  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.131431  5450 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:22.131717  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:22.122612 11730 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:22.117374 11757 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:22.103097 11592 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.147621 11729 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.151800  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2909) took 1209 ms. Trace:
I20260709 13:18:22.152273  5515 rpcz_store.cc:276] 0709 13:18:20.942215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.091815 (+149600us) service_pool.cc:224] Handling call
0709 13:18:21.131984 (+ 40169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.042293 (+910309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.151380 (+109087us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b540023c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:22.151623 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089076096}
I20260709 13:18:22.156858 11584 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.166428 11745 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:22.167023 11745 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:22.166668 11771 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:22.167953 11745 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.176955  5523 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:22.187274  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.187647  5370 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:22.188100  5446 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:22.189584  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:22.189996  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.190696  5446 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:22.193699  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.194346  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:22.200683  5450 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:22.214855  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.215888  5446 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:18:22.215168  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.186029 11815 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:22.225991  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:22.221240  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.219252 11771 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.224375  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.227870  5450 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:22.229378  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:22.217396 11729 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:22.232515  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.233028  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.243764  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.227911 11688 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:22.217820 11506 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.253454  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.254829  5450 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:22.247504  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.238250  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.259032  5446 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:22.232209 11601 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:22.241674 11837 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.001s
I20260709 13:18:22.223464 11757 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:22.255626  5489 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.260866  5445 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:22.264637  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.265280  5445 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:22.269191 11847 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.245675 11771 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:22.260275  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.241880 11729 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.282145  5445 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:22.282389  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:22.274370 11757 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.245187 11755 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.274257 11837 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:22.309242  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.310504 11837 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.261659 11601 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.231419 11815 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:22.310055 11506 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:22.292064 11729 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:22.310858  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.313767  5448 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:22.299739  5450 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
W20260709 13:18:22.299243 11781 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.009s
I20260709 13:18:22.301685  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.317688  5448 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:22.312232  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.303809  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:22.319476  5445 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:22.297390  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.320888  5441 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:22.304292  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.275651 11688 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:22.322908 11781 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:22.323307 11837 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:22.323772 11755 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.299741 11592 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.324120 11837 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:22.325608 11750 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.325327 11837 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:22.326890 11681 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:22.327374 11681 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:22.328281 11681 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.315415  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.316071  5450 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:22.331581  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.322016  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:22.342931  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.276017 11771 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.343951 11741 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:22.343998 11771 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:22.311764 11506 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.344573  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.312599 11757 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:22.313053 11601 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:22.331229 11781 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:22.354357 11882 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:22.355406  5523 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
W20260709 13:18:22.445520  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101035us
I20260709 13:18:22.356858  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.348924 11789 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:22.518507  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.518846 11789 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:22.347134 11532 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.519888 11532 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.520153 11743 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:22.350481 11681 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:22.345366 11688 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:22.348937 11506 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:22.520419 11789 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:22.534096  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.401235 11742 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:22.535060 11857 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:22.535498 11857 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:22.536397 11857 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.537065  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.348567 11858 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.538400  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.544375  5523 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:22.515496 11837 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.349071 11741 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:22.545372  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.561273  5523 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:22.561611 11741 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.562402  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.563515  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.565920 11801 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.567149  5523 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 13:18:22.558823 11532 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.559324 11857 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:22.557205 11729 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:22.542404 11835 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.692s	user 0.010s	sys 0.009s
I20260709 13:18:22.549182 11858 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.555123 11815 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.552919 11757 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.585345 11757 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.582000  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.588104  5523 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:22.582543 11506 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.590489 11506 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.591975 11601 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.596618 11325 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.587514 11755 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.602869  5523 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:22.587736 11819 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.573958 11837 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.606187  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.604259 11325 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.610946 11325 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.613924 11771 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:22.615901 11800 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 2.038s	user 0.015s	sys 0.015s
I20260709 13:18:22.617183  5523 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:22.618335  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2907) took 1676 ms. Trace:
I20260709 13:18:22.619931  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.620671  5523 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:22.617362 11819 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.622854  5366 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:22.630386  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.631340  5369 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:22.636443  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.638844  5374 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:22.641229  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.642786  5373 raft_consensus.cc:2410] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:22.618213 11601 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.648070 11836 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.648710 11836 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:22.650156  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 473) took 1654 ms. Trace:
I20260709 13:18:22.650596  5520 rpcz_store.cc:276] 0709 13:18:20.995720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.490761 (+495041us) service_pool.cc:224] Handling call
0709 13:18:21.491146 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.040663 (+549517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.649866 (+609203us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b540025c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:22.650069 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257817984}
I20260709 13:18:22.651919  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.626987 11819 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.653776 11858 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.608371 11755 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.654541 11729 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.656360 11755 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.656837 11760 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:22.663741  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.665521  5520 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:22.668000  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.669014  5523 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:22.669452  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.670369  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.671512  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.672281 11836 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.675213 11705 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.675446  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 688152us
I20260709 13:18:22.675827 11705 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:22.679524  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.682782  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.683982  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.684573  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.618718  5524 rpcz_store.cc:276] 0709 13:18:20.941696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.054338 (+112642us) service_pool.cc:224] Handling call
0709 13:18:21.076212 (+ 21874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.696217 (+620005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.618078 (+921861us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b5400164ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:22.618260 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423949568}
W20260709 13:18:22.687053  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.686913  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.690624  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.694193  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.693701  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.696722  5524 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 22.
I20260709 13:18:22.700546  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.704726  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:22.705052  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.683305 11847 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.707360  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2356) took 1081 ms. Trace:
I20260709 13:18:22.708017  5370 rpcz_store.cc:276] 0709 13:18:21.617100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.617457 (+   357us) service_pool.cc:224] Handling call
0709 13:18:22.698036 (+1080579us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54000c5b54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:22.698210 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174781312}
I20260709 13:18:22.683020 11837 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.716821  5374 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:22.719043  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.722676  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:22.723812  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:22.725021  5445 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:22.726545  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.690853 11671 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.679656 11815 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:18:22.770941  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.772715  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.774031  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.714331 11851 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.760685 11705 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.789057  5445 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:22.729941 11730 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.809988  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.811064  5373 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 22.
I20260709 13:18:22.793056  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.730227 11841 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.730132 11801 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.730227 11760 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:22.820612  5370 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:22.776950 11671 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.790493 11851 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.731052 11847 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.808635 11730 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.847247  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.848105  5515 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:22.848966  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.849592  5515 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:18:22.825786 11841 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.853981  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.854712  5515 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:22.855731  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.856284  5515 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:22.857954  5521 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
W20260709 13:18:22.858281  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 218409us
I20260709 13:18:22.862754  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.863468  5367 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:22.829882 11801 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.830780 11760 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.895727  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.901551  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.906262  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:22.908866  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 125441us
I20260709 13:18:22.909452  6041 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.909031  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:22.912045  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.913340  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:22.916023  5367 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:22.924731  6072 raft_consensus.cc:2368] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:22.917135  5515 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:22.925557  5370 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:22.926702  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.927548  5515 raft_consensus.cc:2376] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21. Re-sending same reply.
I20260709 13:18:22.928747  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.930373  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.930976  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.936858  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.938333  5524 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:22.939446  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.940722  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:22.935459 11771 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.915051 11873 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:18:22.943746 11873 consensus_queue.cc:1243] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:22.924823 11736 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:22.945776 11736 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:22.946139 11760 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.917769 11857 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:22.947103 11671 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.948182  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:22.946185 11736 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:22.951596 11730 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.952183 11730 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:22.920760 11836 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.949167  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:22.926654 11895 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:18:22.943365 11897 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:22.911088 11858 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:22.954244 11895 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:22.901553 11741 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:18:22.954656 11895 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:22.943403 11801 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.955587 11895 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.927181 11729 raft_consensus.cc:2764] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:18:22.926983 11837 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:18:22.959137 11836 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:22.959583 11836 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:22.959702 11736 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:22.960456 11836 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:22.961027  5517 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:22.962162  5524 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:22.962225  5515 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:22.962489 11838 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:22.964625  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.966188 11836 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:22.966260  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:22.965199 11730 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:22.966873 11760 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:22.966960 11294 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:22.992799 11294 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:22.993809 11294 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:22.969291 11416 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:22.994277  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:22.978418  5518 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:22.987175  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:22.997394  5517 raft_consensus.cc:2376] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24. Re-sending same reply.
I20260709 13:18:22.989789  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:22.990445 11671 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.005996  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.007496 11294 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.008669  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.005091  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:23.010217  6076 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 23: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:23.009305  5447 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:23.006569  5441 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:22.969923 11895 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.001967  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:23.003403  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.000084  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.019023  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.015121  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.026265  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.030939  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.032793  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:22.989097 11801 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:23.000756 11730 consensus_queue.cc:1243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:23.034332  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:23.035506  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.037106  5442 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.004212 11873 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:23.023785 11705 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:23.050522  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:23.036600 11335 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:23.052410 11335 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:23.052870 11335 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:23.032423 11728 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:23.060268  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.059199 11471 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:18:23.076505  5442 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:23.040562 11760 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:23.078255  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:23.088218  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.085973  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:23.090580  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:23.091512  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.091361 11873 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:23.221782  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2917) took 2086 ms. Trace:
I20260709 13:18:23.077690 11728 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:23.225620  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.090869  5371 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:23.095635  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53301us
W20260709 13:18:23.237213  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 146697us
I20260709 13:18:23.039943 11801 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.238487  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.255244  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.256742  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.258122  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.222046 11681 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.222525  5519 rpcz_store.cc:276] 0709 13:18:21.135063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.498758 (+363695us) service_pool.cc:224] Handling call
0709 13:18:21.499060 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.024366 (+525306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.221414 (+1197048us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b540013bfd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:23.221688 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206683520}
I20260709 13:18:23.224562 11738 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:23.267344  5445 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:23.276275  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:23.278177  5524 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:23.278334  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:23.220317 11772 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:18:23.255976 11760 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.264701 11736 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.308094 11754 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:23.310417  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.311353 11841 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.314868  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:23.315239  5524 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 23.
I20260709 13:18:23.257651 11705 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:23.334491  5372 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:23.336639  5372 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:23.279991 11512 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:18:23.342628  5375 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:23.256520 11671 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:23.349602  5366 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:23.352438  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:23.258848 11818 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:23.262200 11730 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:23.327448  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49239.6us
I20260709 13:18:23.319547  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.362887  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:23.362984  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.331873 11736 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:23.279608 11728 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.381074  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.382396  5373 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:23.382917  5373 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:23.382009  5441 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:23.359310 11705 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:23.386129  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.386905  5441 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.367372 11741 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.378790 11858 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:23.280122 11681 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.365980 11818 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.402120  5373 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.366593 11335 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.380934 11857 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:18:23.407783  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.410638  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:23.399573 11471 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:23.413308  5373 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:23.414741  5441 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:23.426082 11730 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:23.412501  5518 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:18:23.426697 11730 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:23.428833  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2499) took 1395 ms (client timeout 1513 ms). Trace:
I20260709 13:18:23.416585  5450 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:23.429824 11728 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.429678  5518 rpcz_store.cc:269] 0709 13:18:22.033561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.033896 (+   335us) service_pool.cc:224] Handling call
0709 13:18:23.428635 (+1394739us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400278dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:23.428740 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167392128}
I20260709 13:18:23.426275  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.430475 11728 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.431797  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.432426  5441 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:23.432572 11728 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.433329  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.428860 11730 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.433565 11671 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:23.482443 11671 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:23.434932  6076 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:23.435359 11873 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:23.485517 11873 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.451395 11681 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:23.436988 11903 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:18:23.398439 11705 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:23.438879  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2920) took 1086 ms. Trace:
I20260709 13:18:23.488919  5521 rpcz_store.cc:276] 0709 13:18:22.352223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.356410 (+  4187us) service_pool.cc:224] Handling call
0709 13:18:22.394483 (+ 38073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.858378 (+463895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.438597 (+580219us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54003a3754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:23.438815 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065388800}
I20260709 13:18:23.424294  5415 leader_election.cc:400] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:23.490212  5415 leader_election.cc:403] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:23.433139 11728 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:23.391323 11771 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
W20260709 13:18:23.495380  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 71255.5us
I20260709 13:18:23.433238  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.408892 11746 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:23.449344  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:23.471509  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55303.5us
I20260709 13:18:23.447790 11745 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.458528 11858 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:23.470661  5450 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:23.439077 11804 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:23.439728 11471 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:23.531193  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81952.1us
I20260709 13:18:23.478375  5373 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:23.409919 11820 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:18:23.486407 11818 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.480366  5371 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 23.
I20260709 13:18:23.474205 11801 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.477293 11579 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:18:23.484853 11335 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.484843 11671 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:23.545390  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.436412 11851 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.498234  5445 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:23.509057  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:23.534755 11471 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.530208  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:23.560513  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.530826  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.534893 11736 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
W20260709 13:18:23.520368 11294 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
W20260709 13:18:23.536685  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 278611us
W20260709 13:18:23.567245  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 196270us
I20260709 13:18:23.567472  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:23.567581 11736 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:23.568969  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.569757 11801 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:23.570171  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.501883 11730 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:23.539915 11857 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:23.571053 11857 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:23.571941 11857 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.573096 11857 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:23.573901  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 135646us
I20260709 13:18:23.574684  6041 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:23.481180  5441 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.526029  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.576195  5449 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:23.558904  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.577073  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.531546 11750 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:18:23.577702  5449 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:23.577754  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.578444  5445 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.533478 11847 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.561353  5448 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.531885 11858 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.525170 11728 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.537997 11804 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:23.540149 11741 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:23.570370 11801 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:23.603143  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:23.603842  5521 raft_consensus.cc:606] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.604190  5521 raft_consensus.cc:614] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:23.604363  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.565304 11335 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:18:23.581674  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 72754.8us
I20260709 13:18:23.607874  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.608667  5445 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:23.546500  5446 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:23.533951  5367 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:23.583905  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:23.582273  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 194573us
I20260709 13:18:23.609711  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.610085  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:23.575668 11923 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:23.605916  5448 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:23.606446  5441 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:23.617844  5441 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:23.591737 11818 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:23.612385  5442 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:23.598734  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.610260  5445 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.623226  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.624872  5450 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
I20260709 13:18:23.591451 11820 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:23.626317  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.625283  5374 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:18:23.607326 11851 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:23.627182  5374 pending_rounds.cc:85] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 9
I20260709 13:18:23.634215  5374 pending_rounds.cc:107] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:18:23.634565  5374 raft_consensus.cc:2889] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:23.636107  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.640733  5445 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:23.632973 11772 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:18:23.627532  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:23.624975 11325 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:18:23.644873  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.643386 11750 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:23.643891 11804 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.607807 11335 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:23.651047  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.662379  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:23.665867  5521 raft_consensus.cc:606] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.666363  5521 raft_consensus.cc:614] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:23.617141 11801 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:23.624379 11818 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:23.634347 11820 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.685603  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.688257  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.582255 11705 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.690457 11841 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:23.690934 11841 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:23.691365 11841 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.622483 11828 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:18:23.659391 11750 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.693523 11750 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.693619 11730 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:23.694139 11730 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.694486 11730 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:23.699064  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.635390 11923 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:23.699173  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.647796 11795 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:18:23.705714  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 121924us
I20260709 13:18:23.706900  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.615638 11771 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:18:23.667528 11671 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:23.716209  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 79452.6us
I20260709 13:18:23.659917 11754 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:23.634948 11584 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:18:23.720534  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2610) took 2026 ms. Trace:
I20260709 13:18:23.649600 11920 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:23.726009  5444 rpcz_store.cc:276] 0709 13:18:21.694362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.694790 (+   428us) service_pool.cc:224] Handling call
0709 13:18:21.695086 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.735615 (+ 40529us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:21.870112 (+134497us) log.cc:844] Serialized 14 byte log entry
0709 13:18:22.267573 (+397461us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b18003e8120. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a
0709 13:18:22.682305 (+414732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.682355 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:22.682396 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.720262 (+1037866us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b540019d554. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:23.720328 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.720462 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420732,"prepare.queue_time_us":215480,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":414766,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":95084544,"thread_start_us":187884,"threads_started":2,"wal-append.queue_time_us":159057,"wal-append.run_cpu_time_us":1314,"wal-append.run_wall_time_us":1019828}
I20260709 13:18:23.724079 11795 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:23.703904 11851 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:23.701483 11820 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.710583 11325 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:23.722124 11754 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:23.716792 11873 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.727340 11858 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:23.759199 11916 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:18:23.685611 11579 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:18:23.741528 11920 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.741207 11325 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:23.761482 11920 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:23.754741 11923 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:23.758265 11728 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:23.741528 11836 consensus_meta.cc:287] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.737s	user 0.013s	sys 0.000s
I20260709 13:18:23.764258  5442 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:23.770557  5443 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:23.770627  5370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:59536
I20260709 13:18:23.772027  5370 raft_consensus.cc:606] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.765656  5369 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
W20260709 13:18:23.786033  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.746482 11847 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:23.741294 11913 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:18:23.777572 11771 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:23.794785 11868 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.003s	sys 0.009s
W20260709 13:18:23.819947  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 144222us
I20260709 13:18:23.823009  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.729552 11335 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:23.826083  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 127569us
I20260709 13:18:23.769508 11325 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:23.819406 11868 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.003s	sys 0.010s
I20260709 13:18:23.818970 11841 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.766906 11795 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.835546  5374 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
W20260709 13:18:23.835964  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.767113 11801 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.815948 11754 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.817783 11771 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.851635  5441 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:23.874897  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.880268  5441 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:23.882001  5441 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:18:23.887243  5441 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:23.848917 11671 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:23.901788  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 195122us
I20260709 13:18:23.906464  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.884572 11771 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.869115 11836 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.899326  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:23.939078  5523 raft_consensus.cc:606] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.939468  5523 raft_consensus.cc:614] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:23.874792 11325 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.899786  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:23.908165  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.941592  5446 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:23.908766  5447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.025s	sys 0.015s
W20260709 13:18:23.942351  5447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.026s	sys 0.015s
I20260709 13:18:23.908267  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.910429  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.942713  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.911120  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.887321 11741 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:23.912072  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.944941  5374 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:23.945035  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.894323  5441 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:23.845330 11750 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.924942  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.840407 11471 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.926280  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:23.924785  5442 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:18:23.911510  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 212419us
I20260709 13:18:23.951815  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.952096  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.924247 11933 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.940249  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.911062  5448 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:23.943756  5370 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:23.953603 11930 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:23.954133  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.954532  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.923861 11820 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.953220 11933 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:23.941455 11857 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.948158  5446 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:23.956292  5450 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:23.961510 11750 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:23.945358 11836 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.974555  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:23.964963  5366 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:23.956377 11930 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:23.969062  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:23.975835  5523 raft_consensus.cc:606] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.976213  5523 raft_consensus.cc:614] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:23.970417  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:23.970757  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.963519 11471 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:23.979857  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53684.5us
I20260709 13:18:23.981700  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:23.978107  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:23.984481  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.991592  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:23.990732  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:23.995772  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:23.996892  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:24.004076  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:24.010241  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:24.011696 11738 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.012302 11738 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.013067 11930 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.014659 11738 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:23.996939 11857 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:24.019485 11857 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:24.020465 11857 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.021595 11851 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:24.022089 11851 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.022428 11851 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:23.999348 11729 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:24.025749 11728 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.026213 11729 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.026322 11728 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.026760 11729 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:23.979141 11671 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.031625  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:23.951076 11741 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:23.991045 11932 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:23.976668 11935 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:18:24.045095  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.994356 11772 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:24.000093 11939 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:24.053646  5445 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:24.042526 11751 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:24.026849 11728 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.995349 11730 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:24.053777 11895 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.033s	user 0.014s	sys 0.001s
I20260709 13:18:24.036844 11934 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.105939  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:24.115070 11940 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:18:24.116367 11942 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:24.117900 11921 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:24.060367 11932 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.119524 11820 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.048694 11772 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.046701 11935 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:24.059128 11903 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:24.036448 11528 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:18:24.036628 11750 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:18:24.057958 11751 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:24.268862  5449 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:24.059492 11939 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:24.294162  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:24.244633 11895 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:24.240396 11755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.008s
W20260709 13:18:24.283017 11941 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:18:24.295400  5371 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
W20260709 13:18:24.300854  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.270759 11671 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:24.278573 11772 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:24.279135 11935 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:24.303041 11755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.005s	sys 0.009s
I20260709 13:18:24.292912 11939 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:24.304010 11895 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.284071 11751 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:24.304916 11951 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.287957 11932 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.366181  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1289dc7debf403aa87416568de586e6"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:24.367611  5523 raft_consensus.cc:606] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:24.367673  5489 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:24.368351  5523 raft_consensus.cc:614] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:24.307834 11671 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:24.374030  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:24.347937 11836 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.350775 11751 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:24.384500  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:24.377454 11933 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:24.397562 11836 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.347440 11951 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.391527 11953 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:24.411957 11760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.009s	sys 0.026s
W20260709 13:18:24.421248 11760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.009s	sys 0.027s
I20260709 13:18:24.414741 11741 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.445827 11838 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:18:24.446693 11943 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:18:24.459379 11964 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:24.461767 11964 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:24.427234 11932 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.425602 11958 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.416177 11836 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:24.506017  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.508551 11932 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.509146 11932 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.509634 11868 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:24.510030 11868 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:24.509980 11958 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.511408 11932 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.511082 11868 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.512311 11868 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:24.512425 11958 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.487015 11838 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:24.513813 11965 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.514492  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:24.514317 11838 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.447862 11959 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.537029  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.537439  5524 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:24.529490  5521 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:24.532519  5517 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:18:24.480976 11841 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.545356  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:24.433157 11953 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:24.550374 11325 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.001s
W20260709 13:18:24.552631 11729 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.001s
I20260709 13:18:24.554054 11801 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.554597 11801 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.514520 11951 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.564464  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2641) took 1254 ms. Trace:
W20260709 13:18:24.566226  5369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 3193) took 1903 ms (client timeout 2176 ms). Trace:
W20260709 13:18:24.566642  5369 rpcz_store.cc:269] 0709 13:18:22.662997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.669150 (+  6153us) service_pool.cc:224] Handling call
0709 13:18:24.566037 (+1896887us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001e9954. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:24.566164 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498086144}
I20260709 13:18:24.568109  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2644) took 1257 ms. Trace:
I20260709 13:18:24.568503  5449 rpcz_store.cc:276] 0709 13:18:23.310443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.694629 (+384186us) service_pool.cc:224] Handling call
0709 13:18:23.694897 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.288625 (+593728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.567859 (+279234us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540019c154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:24.568048 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319530240}
I20260709 13:18:24.514322 11965 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:24.571642 11965 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:24.564906  5450 rpcz_store.cc:276] 0709 13:18:23.309666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.645171 (+335505us) service_pool.cc:224] Handling call
0709 13:18:23.648620 (+  3449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.972042 (+323422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.564190 (+592148us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540032f0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:24.564401 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707047168}
I20260709 13:18:24.574605 11671 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:24.540912 11741 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.576465 11741 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.463395 11851 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.578557 11741 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.578909 11851 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.553167 11729 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.584877 11953 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.585332  5520 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:24.546340 11959 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.584820 11729 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.588092  5522 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:24.431981 11818 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.592073 11818 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.587597  5520 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:24.594141 11836 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.595279 11801 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.597599  5520 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:24.599457  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.600067  5524 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:24.598927  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:24.605446  5521 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:24.603782  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 188297us
W20260709 13:18:24.582782 11771 consensus_meta.cc:287] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.634s	user 0.005s	sys 0.005s
I20260709 13:18:24.587764 11959 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.627707  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:24.627364  5516 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:24.629652  5520 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.603808 11729 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.622143 11939 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.653945  5521 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:24.667150  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:24.646869 11795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.017s	sys 0.003s
I20260709 13:18:24.671046  6076 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:24.633322 11729 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.650265 11967 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.678058  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.651245 11966 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.652029 11959 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.695410  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:24.725301 11728 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:18:24.735152 11728 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.656025 11953 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:18:24.650516 11741 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.736167 11741 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:24.736574  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 745905us
I20260709 13:18:24.738193 11745 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:24.716019 11939 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.628175 11771 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.738389 11741 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.741334  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.741788 11771 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.742612  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.757324  5521 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:24.759459 11828 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:24.759931 11828 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:24.760288  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.760923  5521 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:24.761619 11966 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:24.763031  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.763593  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.763833 11966 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.764424 11959 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.765600 11801 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.766161 11801 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.766673 11959 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.766976 11729 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.767387  6072 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:24.767596 11751 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:24.768289 11801 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.768184 11751 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.739880 11745 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:24.770548 11751 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.770236 11745 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.742784  5519 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:18:24.774502  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.775538  5519 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:24.776818  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.777468 11818 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:24.679629  5520 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:24.710636 11772 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.782152 11402 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:24.782639 11402 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:24.783615 11402 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.784595  5368 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:18:24.784686 11402 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.782709 11772 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.744846 11730 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.733785 11754 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.787499  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.788187  5516 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:24.789057  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.746177 11785 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:18:24.744261  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.854734  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.854851  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:24.749936  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.856001  5447 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:24.856138  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.857985  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:24.753644 11967 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.975864  5369 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:18:24.754853 11728 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.978049  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:24.977887  5366 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:24.978578  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.734642 11935 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.744735  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:24.983453  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 238777us
I20260709 13:18:24.759318  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:24.792341  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:24.792672  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:24.793732 11729 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.781239  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:24.991977  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 199390us
I20260709 13:18:24.992628  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.992791  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:24.993921  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.995884 11730 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.802604  5519 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:24.996362 11730 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.997320  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.998127  5519 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:24.998479 11730 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:24.997224  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:24.807895  5373 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:24.999979  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.000434 11730 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:25.000669  5442 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:25.000986 11730 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:25.001582 11730 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.001974  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.002667  5442 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:25.003602  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:24.806696  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.810003 11895 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.760807 11828 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.005208  5524 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:25.005556 11828 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.006234  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:25.007668  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:25.008253  5524 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:24.847900  5449 raft_consensus.cc:1240] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:25.009778  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.010594  5449 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:25.011665  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.012954  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:24.858865  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:24.860169  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:25.019830  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:24.860090  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.022435  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.023227  5375 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
W20260709 13:18:24.852901  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 75486.4us
I20260709 13:18:25.026156  5339 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:25.027266 11772 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:25.028219  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:24.864238  5518 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:24.862540  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.028990 11790 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:25.029588  5444 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:25.030041 11790 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:18:24.677549 11795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.018s	sys 0.004s
I20260709 13:18:25.030496 11790 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:24.865763  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:24.868563  5448 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:25.031420 11790 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:24.871985  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:24.884080  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.033761  5441 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:18:24.978859  5371 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:25.034731 11935 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:24.755165 11335 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.035650  5515 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:24.976284  5369 pending_rounds.cc:85] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 13
I20260709 13:18:25.037990  5369 pending_rounds.cc:107] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:18:24.981462  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:25.038354  5369 raft_consensus.cc:2889] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.038591  5374 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.994052  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:24.671047 11857 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:18:24.994588 11729 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.049525  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:25.049911  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:25.050552  5449 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:24.995234 11967 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:24.994539  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 235295us
I20260709 13:18:24.999238  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.803643  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:25.058496  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:24.834981 11952 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.402s	user 0.000s	sys 0.003s
I20260709 13:18:24.858878  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.016947  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.059959  5519 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:25.060097  5366 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:25.061550  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.028448 11208 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:24.979422  5516 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 13: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:25.040920  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.041256  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.024466  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:25.038327 11705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.346s	user 0.022s	sys 0.027s
W20260709 13:18:25.042685  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45531.5us
I20260709 13:18:25.055270  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:24.975467 11785 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.026002 11402 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:25.095044  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:24.989297 11728 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.096186  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:25.062978  5367 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:25.104036  5521 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:25.096498  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.105517  5448 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
W20260709 13:18:25.100651  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 107941us
I20260709 13:18:25.107712  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:25.109390  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:25.110971  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:25.113026  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:25.113834  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.116952  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.066728  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:25.122512  5449 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.096967  5366 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:25.125908  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:24.979676 11754 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:18:25.049296 11818 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.127808  5523 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:25.134161  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.124552  5524 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:25.134991  5449 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:25.141587  5366 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:25.053004 11790 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.143168  5375 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:25.063036 11836 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:25.089345 11780 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:18:25.092389 11705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.400s	user 0.023s	sys 0.028s
W20260709 13:18:25.180575  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68044us
I20260709 13:18:25.177038  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:25.184062  5448 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:25.176950  5524 pending_rounds.cc:85] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:18:25.153297  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.187062  5524 pending_rounds.cc:107] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:18:25.028271 11772 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:18:25.188179  5524 raft_consensus.cc:2889] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:25.199764  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 71783.2us
I20260709 13:18:25.127269 11913 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.189700  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.212527  5442 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:25.101698 11939 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:25.100926 11962 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.192689  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:25.193140  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:25.203047  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:25.097991 11208 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.191098 11847 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.190618 11838 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.145591  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:25.235381  5449 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:25.131091 11751 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:25.219758  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.220412  5445 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:25.189556 11836 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.144199 11818 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:25.230285  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:25.232255  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.129243 11512 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:25.215718  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:25.195077 11958 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.229564  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:25.189284 11967 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.124835 11929 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:18:25.177821 11949 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.109s
I20260709 13:18:25.198486 11728 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:25.262928  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 69864.3us
I20260709 13:18:25.248621  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.246057  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2381) took 1272 ms. Trace:
W20260709 13:18:25.395236  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 165744us
I20260709 13:18:25.221113 11705 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.303367  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:25.283270 11903 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:18:25.397831  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:25.398806  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:25.218685 11939 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:25.340703  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 227772us
I20260709 13:18:25.232895 11780 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.396821 11818 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.237534 11208 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.406450  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.396188  5370 rpcz_store.cc:276] 0709 13:18:23.973765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.973902 (+   137us) service_pool.cc:224] Handling call
0709 13:18:23.974231 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.974459 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:23.990779 (+ 16320us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.735249 (+744470us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b1800055ea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:18:25.203118 (+467869us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.245567 (+ 42449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.245645 (+    78us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:25.245709 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.245802 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.245975 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53428,"prepare.queue_time_us":591462,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":85,"raft.queue_time_us":789917,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":8874,"spinlock_wait_cycles":8609024,"thread_start_us":467012,"threads_started":1}
I20260709 13:18:25.455894  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:25.127470 11801 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.451345 11804 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:25.417500  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:25.467393  5374 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:25.233945 11935 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.261682 11751 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:25.470268  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 72148.5us
W20260709 13:18:25.448220 11977 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:25.398651 11836 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.278752 11402 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:25.221800 11785 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.473951  5368 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:25.246490 11325 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.229s
I20260709 13:18:25.475709  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:25.477850  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 60491.5us
I20260709 13:18:25.474830  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.479386  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:25.499888  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.500195  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:25.481142  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.412730 11949 consensus_queue.cc:1243] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:25.491112  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:25.460673 11939 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.342391 11921 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.130s
I20260709 13:18:25.503691  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:25.300827 11913 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.175s
I20260709 13:18:25.513679 11913 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:25.514112 11913 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.514482 11913 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.517668 11771 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:25.402477 11895 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:25.518729 11895 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.519158 11895 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:25.492604 11983 log.cc:927] Time spent T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:18:25.522471 11928 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:25.477053 11946 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:25.525362 11946 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.501899 11801 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:18:25.530035 11946 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.531212 11801 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.531738 11801 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:25.532162 11801 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:25.525990 11978 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:18:25.526396 11979 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:18:25.496696 11929 raft_consensus.cc:2764] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:25.493593 11962 consensus_queue.cc:1059] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:18:25.537114 11962 raft_consensus.cc:3055] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:25.508299 11402 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.504588  5522 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:25.489770 11751 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.538928  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:25.539531  5522 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:25.540428  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:25.505585  5374 raft_consensus.cc:2410] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:25.528538  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:25.402590 11728 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:25.507537 11772 consensus_queue.cc:1175] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b781c7e31b7145aea647a7ff649e6ac7" responder_term: 16 status { last_received { term: 16 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 16 index: 10 } }
I20260709 13:18:25.262305 11838 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:25.548645 11838 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:25.549726  5522 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:18:25.552016  5522 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [16.11-18.12]
W20260709 13:18:25.552845  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.553052 11730 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.000s
I20260709 13:18:25.554282  5522 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:18:25.476357 11804 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.558769 11804 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.560030 11804 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.449028 11512 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.511219  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:25.562561  5373 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2380) took 1591 ms (client timeout 1623 ms). Trace:
I20260709 13:18:25.562697 11771 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:25.563123 11771 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:25.562996  5373 rpcz_store.cc:269] 0709 13:18:23.973295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.983095 (+  9800us) service_pool.cc:224] Handling call
0709 13:18:25.562388 (+1579293us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b5400144e54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:25.562502 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862926208}
I20260709 13:18:25.563624 11771 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:25.564822 11335 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.004s
I20260709 13:18:25.512616 11584 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:25.565639 11584 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.566576 11584 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.537622 11962 raft_consensus.cc:740] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:25.528728 11785 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.569779 11579 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.570216 11962 consensus_queue.cc:260] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.512171 11325 consensus_queue.cc:1243] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:25.562182 11512 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:25.562225  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51141.9us
I20260709 13:18:25.574980  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:25.527278 11828 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.001s
I20260709 13:18:25.402981 11958 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.402689 11967 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.542101 11986 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:25.565280 11729 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:25.601138 11838 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.609593 11838 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.412606 11705 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.606496 11962 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:25.594035 11681 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:18:25.627125  5522 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:25.628409  5517 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:25.597054 11325 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:25.570303 11579 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.639452  5520 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:25.572587 11730 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.648718 11958 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:25.658250 11728 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:25.662954 11730 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:25.583596 11780 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.666831 11471 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:25.667116 11967 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:25.667443 11471 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.639763 11402 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.668649 11471 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.674018  5521 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:25.660784 11939 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.687578  5490 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:25.696113 11471 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.695858 11946 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.698627 11838 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:25.704274 11913 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.711131  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:25.708477  5372 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:25.631201 11729 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:18:25.620442 11986 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.709182 11958 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.695899 11939 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:25.720336 11987 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:25.716578 11728 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:25.717020 11967 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:18:25.760080 11730 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:25.761132 11946 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:25.722698 11838 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:25.770906  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.716349 11950 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 13:18:25.795610  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 492295us
I20260709 13:18:25.801466  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:25.774039 11730 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:25.788254 11958 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.795231 11946 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.777350  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.838122  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:18:25.773116 11836 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:25.768628 11962 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:18:25.778690 11208 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.774623 11728 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:25.853048 11790 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.007s
I20260709 13:18:25.775349 11987 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.857118  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:25.858968  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2551) took 1191 ms. Trace:
W20260709 13:18:25.864720  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 408923us
I20260709 13:18:25.858517 11771 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.872135 11987 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:25.872684 11771 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:25.872887 11987 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:25.874768 11987 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:25.865077  5522 rpcz_store.cc:276] 0709 13:18:24.667629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.584072 (+916443us) service_pool.cc:224] Handling call
0709 13:18:25.596654 (+ 12582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.627721 (+ 31067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.854847 (+227126us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5400153bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:25.858885 (+  4038us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68940160}
I20260709 13:18:25.875550  5520 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:25.875495 11987 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:25.876713 11987 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.879611 11579 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:25.880612 11745 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:25.881050 11745 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.882089 11745 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.883770 11745 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:25.886337  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2949) took 1356 ms. Trace:
I20260709 13:18:25.886821  5515 rpcz_store.cc:276] 0709 13:18:24.530482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.530688 (+   206us) service_pool.cc:224] Handling call
0709 13:18:24.531021 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.036146 (+505125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.886072 (+849926us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b5400154354. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:25.886271 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160031104}
I20260709 13:18:25.892979  5366 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:25.865607  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:25.897382 11208 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:25.898182  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:25.899392 11728 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:25.899590  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:25.900017 11728 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.900444 11728 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:25.900795 11728 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.902887  5370 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:25.903349  5370 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:25.904255  5370 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:18:25.908049  5372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2373) took 1983 ms (client timeout 1824 ms). Trace:
W20260709 13:18:25.908516  5372 rpcz_store.cc:269] 0709 13:18:23.924437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.924677 (+   240us) service_pool.cc:224] Handling call
0709 13:18:25.907833 (+1983156us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400051ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:25.907972 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4042750336}
W20260709 13:18:25.909972  5518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2538) took 1245 ms (client timeout 1542 ms). Trace:
W20260709 13:18:25.910398  5518 rpcz_store.cc:269] 0709 13:18:24.664189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.666907 (+  2718us) service_pool.cc:224] Handling call
0709 13:18:25.909774 (+1242867us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400165dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:25.909914 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450609024}
I20260709 13:18:25.912352  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2958) took 1368 ms. Trace:
I20260709 13:18:25.912901  5523 rpcz_store.cc:276] 0709 13:18:24.544161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.544283 (+   122us) service_pool.cc:224] Handling call
0709 13:18:24.545484 (+  1201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.144764 (+599280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.911977 (+767213us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001e6254. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:25.912269 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338792832}
I20260709 13:18:25.916388  5370 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.805229 11751 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:25.930738  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.933456  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:26.004388 11705 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.005772 11705 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:26.006232 11705 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.006669 11705 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:26.008553  5367 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:26.004961 11730 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.012583 11987 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.032347  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.033617  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.034663  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:26.034991  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.011s	sys 0.012s
W20260709 13:18:26.035313  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.011s	sys 0.012s
W20260709 13:18:26.035549  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 513741us
I20260709 13:18:26.035653  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.036259  5374 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:26.037356  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.038879  5374 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:26.039907  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:26.031885  5372 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:26.041234  5372 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:26.043292  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.855760 11946 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:25.856091 11958 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.042204  5372 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.045746  5374 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:26.060487  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:26.062744  5374 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:26.063349  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:26.060604  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.070516  5372 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.014926 11208 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:26.074425 11962 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:26.081702 11962 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.082077 11962 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.084723 11992 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:26.085312 11992 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:26.074256 11959 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:26.085898 11959 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.086273 11959 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.086309 11992 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.087764 11987 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.088459 11987 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:26.094579  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.068799  5374 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.097972  5374 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:26.110610  5524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.001s	sys 0.024s
W20260709 13:18:26.111291  5524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.001s	sys 0.024s
W20260709 13:18:26.122444  5489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.016s	sys 0.023s
W20260709 13:18:26.122897  5489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.016s	sys 0.023s
W20260709 13:18:26.123183  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 536119us
I20260709 13:18:26.123922  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:26.124676  5369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.030s	sys 0.057s
W20260709 13:18:26.125131  5369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.030s	sys 0.057s
W20260709 13:18:26.125528 11964 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.024s	sys 0.024s
I20260709 13:18:26.125670 11325 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:26.126252 11964 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.025s	sys 0.024s
I20260709 13:18:26.126953 11325 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.129272  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:26.130730 11967 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:26.132587  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:26.133738 11967 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:26.135484  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:26.136561 11967 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:26.138427 11967 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:26.140664  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:26.141737 11967 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.143429  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:26.143919  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.010s	sys 0.014s
W20260709 13:18:26.144279  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.010s	sys 0.014s
I20260709 13:18:26.144519 11967 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:26.145054 11967 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:25.935624  5370 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:26.145807 11967 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:26.144556  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 551127us
I20260709 13:18:26.149971  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:26.151185  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:26.154856  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55583.4us
I20260709 13:18:26.157965 11785 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:26.158039 11754 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:26.060590 11804 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:26.166359  5487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.013s	sys 0.053s
W20260709 13:18:26.167019  5487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.013s	sys 0.053s
W20260709 13:18:26.097275 11935 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.004s
W20260709 13:18:26.169406  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 236107us
I20260709 13:18:26.127987 12014 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:26.147625 12001 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:18:26.077131 11994 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:26.061687 11995 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.190753  5372 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:18:26.191134  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 334555us
I20260709 13:18:26.191916  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:26.171701  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:26.197526 11994 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.199693  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:26.166028 11755 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
W20260709 13:18:26.235438  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43613.7us
I20260709 13:18:26.236387  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:26.076792 11208 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.241444 11997 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:26.239428  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:26.245213  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.250563  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:26.189970 11935 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.252918  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.255470  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:26.255811  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.256249  5375 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.257340  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.258810  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:26.247112 11990 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:18:26.272111  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.246593 11994 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:26.173082 11804 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.239136 11986 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.269873  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:26.254590 11772 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:26.243140 11996 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:26.247417 12009 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.371853  5374 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:26.342278 11935 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.325181 11994 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:26.394316  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 125303us
I20260709 13:18:26.339998 11997 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:26.349952 11987 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.347383 11847 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:26.347981 11772 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:26.389825  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.352434 11996 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:26.400645  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 3247) took 1119 ms. Trace:
I20260709 13:18:26.388402 11986 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:26.390427 12016 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:26.377887 11836 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:26.437852  5367 rpcz_store.cc:276] 0709 13:18:25.281354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.472680 (+191326us) service_pool.cc:224] Handling call
0709 13:18:26.400374 (+927694us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400186ad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:26.400567 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160715008}
I20260709 13:18:26.396302 11994 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.377767 11967 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:26.464159  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.465197  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 2976) took 1687 ms. Trace:
I20260709 13:18:26.388447 11964 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:18:26.397964 11935 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.427840 11751 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:26.467136  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 315999us
I20260709 13:18:26.498134  5520 rpcz_store.cc:276] 0709 13:18:24.778065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.640409 (+862344us) service_pool.cc:224] Handling call
0709 13:18:25.640737 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.876117 (+235380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.401717 (+525600us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540016c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:26.465140 (+ 63423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539420928}
I20260709 13:18:26.501278  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2532) took 1838 ms. Trace:
I20260709 13:18:26.518980  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:26.519788  5524 rpcz_store.cc:276] 0709 13:18:24.662701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.136504 (+473803us) service_pool.cc:224] Handling call
0709 13:18:25.136853 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:25.213545 (+ 76692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.213664 (+   119us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:25.214726 (+  1062us) log.cc:844] Serialized 52 byte log entry
0709 13:18:25.511809 (+297083us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:26.111977 (+600168us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.157049 (+ 45072us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.500631 (+343582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.500772 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.500843 (+    71us) raft_consensus.cc:1685] finished
0709 13:18:26.500860 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.501061 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8031,"prepare.queue_time_us":691091,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":6187,"raft.queue_time_us":95043,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":12367,"spinlock_wait_cycles":42185856,"thread_start_us":1103496,"threads_started":3,"wal-append.queue_time_us":534340}
I20260709 13:18:26.444572 11996 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:26.442176 11579 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.466656 11946 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:26.572463  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.573549  5367 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 22 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 13:18:26.574057 12020 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:26.574894 11804 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.470011 11705 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.577322 11705 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.443238 11987 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.577899 11705 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.578364 11705 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.579468 11987 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.580014 11987 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:26.580523 12029 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:26.581082 12029 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.497190 11208 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:26.575438 12000 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
I20260709 13:18:26.443013 11997 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.618081  5375 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:26.454253 11986 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.571107 11751 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.618332 11801 consensus_meta.cc:287] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 1.086s	user 0.011s	sys 0.012s
W20260709 13:18:26.631669 12005 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:18:26.631476 11801 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:26.633292 11818 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 1.160s	user 0.008s	sys 0.002s
I20260709 13:18:26.633942 11801 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.633791 11818 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.634536 12034 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:26.635094 12034 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.635941 11818 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.590200 11828 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.636721 11828 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.634563 12029 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.637972 12030 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.638513 12030 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.638968 11828 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.463869 12016 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.640820 12030 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.641532 12016 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.580518 11987 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:26.643903 11987 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:26.643875 11994 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.646342 11705 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.547142 11772 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.647361 11986 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.551911 11579 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.649691 11754 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.649894 11771 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:26.650197 11579 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.650278 11771 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:26.651322 11771 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.652751 11771 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:26.654206 11847 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:26.654461 12036 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.654976 12036 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:26.659219 11989 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.864s	user 0.005s	sys 0.001s
I20260709 13:18:26.519134  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3231) took 1506 ms. Trace:
I20260709 13:18:26.659855 11579 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.660887 11579 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.661401 11836 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.661787  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3132) took 1568 ms. Trace:
I20260709 13:18:26.663726 11579 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.659649 12033 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.664551  5366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 3237) took 1516 ms (client timeout 1768 ms). Trace:
I20260709 13:18:26.664651 12033 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:26.665094  5366 rpcz_store.cc:269] 0709 13:18:25.147900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.152907 (+  5007us) service_pool.cc:224] Handling call
0709 13:18:26.664340 (+1511433us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54001865d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:26.664485 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620926208}
W20260709 13:18:26.665535  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:26.666469  5517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2558) took 1488 ms (client timeout 1780 ms). Trace:
I20260709 13:18:26.646728 11994 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.667338 12033 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:26.667644 11751 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.663729 11772 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:26.666976  5517 rpcz_store.cc:269] 0709 13:18:25.177826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.528221 (+350395us) service_pool.cc:224] Handling call
0709 13:18:26.666278 (+1138057us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54002783d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:26.666411 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195777408}
I20260709 13:18:26.670480  5369 rpcz_store.cc:276] 0709 13:18:25.012789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.129176 (+116387us) service_pool.cc:224] Handling call
0709 13:18:25.195164 (+ 65988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.195406 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:25.600125 (+404719us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.518504 (+918379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.518583 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:26.518650 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.518741 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.519046 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64551,"prepare.queue_time_us":132942,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":121855,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9105,"spinlock_wait_cycles":12311424,"thread_start_us":1257639,"threads_started":3,"wal-append.queue_time_us":658168}
I20260709 13:18:26.663890  5443 rpcz_store.cc:276] 0709 13:18:25.093395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.093562 (+   167us) service_pool.cc:224] Handling call
0709 13:18:25.093997 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.101571 (+  7574us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:25.146957 (+ 45386us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.862844 (+715887us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.863556 (+   712us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.863727 (+   171us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:25.864017 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.902380 (+ 38363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.902483 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.658358 (+755875us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:26.661566 (+  3208us) raft_consensus.cc:1685] finished
0709 13:18:26.661590 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.661729 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44786,"prepare.queue_time_us":75291,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":435940,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":27453,"spinlock_wait_cycles":3580800,"thread_start_us":643839,"threads_started":2,"wal-append.queue_time_us":554062}
I20260709 13:18:26.637226 12034 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.687995  5524 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:26.688153  5523 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:18:26.686813 11959 consensus_meta.cc:287] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 13:18:26.692494  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:26.694802  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:26.677219 11751 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.695410  5517 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
W20260709 13:18:26.705972  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 187080us
I20260709 13:18:26.706791  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:26.710453  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:26.711074  5523 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:26.660144 11997 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.650324 11754 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.687983 11847 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.714095  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:26.714327 12046 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:26.715377 11838 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:26.705319 11959 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:26.698344 11745 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.003s
W20260709 13:18:26.715397 12035 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:18:26.709568 12036 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.722595 11838 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:26.730386 11728 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.829s	user 0.013s	sys 0.000s
I20260709 13:18:26.731004 11838 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.732285 11838 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.732645 11754 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.730998 11728 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:26.735025 11959 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:26.738901 11895 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 1.219s	user 0.006s	sys 0.007s
I20260709 13:18:26.739359 11895 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:26.737074 11962 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.655s	user 0.012s	sys 0.000s
I20260709 13:18:26.742188 11730 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.741818 11962 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.744591 11895 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:26.721472 11847 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.748021 11847 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.724403 12046 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:26.753021 11995 consensus_meta.cc:287] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:18:26.752815 12046 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:26.754582 12038 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:18:26.753669 11995 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:26.745159 11962 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:26.759148 11935 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:26.759452 11958 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:26.760619 11728 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:26.766868 11967 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:26.767856 11936 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:18:26.767854 11928 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:26.768955 11928 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:26.769397 11996 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.771778 11996 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.709764  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:26.829182  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 119344us
I20260709 13:18:26.831281  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:26.831996  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.835749  5441 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:26.838080  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 268785us
I20260709 13:18:26.840888  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:26.842549  5441 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:18:26.850576  5520 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:26.851445  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2549) took 2184 ms. Trace:
I20260709 13:18:26.875097  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:26.873865  5519 rpcz_store.cc:276] 0709 13:18:24.666941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.566290 (+899349us) service_pool.cc:224] Handling call
0709 13:18:25.566682 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:25.567078 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.567105 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:25.567668 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 13:18:26.028973 (+461305us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:26.351881 (+322908us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.850145 (+498264us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.850703 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.850844 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.850892 (+    48us) raft_consensus.cc:1685] finished
0709 13:18:26.850903 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.851198 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":947633,"prepare.queue_time_us":219518,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":250167,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":41200,"thread_start_us":740588,"threads_started":2,"wal-append.queue_time_us":635860}
I20260709 13:18:26.876325  5520 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:26.718854  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:26.852465  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:26.878540  5522 raft_consensus.cc:2393] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:26.878872  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:26.879454  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:26.879849  5515 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:26.880144  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:26.880366  5520 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:26.713590  5516 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:26.885608 11471 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.885777  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:26.715581  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:26.886611 11471 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.885138  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:26.717618  5524 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:18:26.885130  5515 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:18:26.857232  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:26.888420  5524 pending_rounds.cc:85] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:18:26.888978  5524 pending_rounds.cc:107] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:18:26.889345  5524 raft_consensus.cc:2889] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.887372  5518 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:26.854135  5521 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:26.890807 11471 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.888394  5515 pending_rounds.cc:85] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 13
I20260709 13:18:26.892688  5515 pending_rounds.cc:107] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:18:26.805066  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:26.893115  5515 raft_consensus.cc:2889] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.901453 11728 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.907310 11728 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.903136 11705 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:26.891733  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:26.910058 11705 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:26.911906 11729 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:26.912634 11729 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.913172 11729 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.910861  5519 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:26.916352  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:26.919669  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.923454 11741 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:26.910584 11728 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.923962  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.924440 11728 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.924618 11741 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:26.925642 11728 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.927937 11741 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:26.893011 11471 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:26.928870  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.933993 11751 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.935091 11751 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.934036  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.921250  5370 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
W20260709 13:18:26.948213  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.948660  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:26.949813  5372 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:26.944722 12014 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:26.928511 11728 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.977849 11294 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:26.979032 11913 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:26.979024  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.979535 11751 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:26.943600 11471 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:26.983718 11928 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.006518 11928 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:27.008113 12036 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:27.008412  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.008565 12036 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:27.009356  5441 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:27.009766  5369 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:27.010437 12036 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:27.012172 12036 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.013151  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.014142  5441 raft_consensus.cc:2410] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:18:27.016644  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:27.017899 11471 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:27.018417  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.018530  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:27.019456  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.024401 11962 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.024995  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:27.025164 11962 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.047343 11751 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:27.047446  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.047875  5519 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:27.048486  5450 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.034307  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.034698  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.049165  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:27.035154  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.035992  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:27.036381  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.036923  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.037463  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.038250  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.039057  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:27.039295  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.052929  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.040966  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.054286  5449 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 22 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:27.054625  5446 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:27.056190  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:27.057019  6072 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.049254  5369 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:27.062230  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.062731  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.063630  5446 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:27.041109  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.064798  5448 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.043320  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.048028 11751 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:27.069976  5445 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:27.070420  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 167853us
I20260709 13:18:27.070628 11751 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.048604 11962 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:27.074173 11729 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.076988 11729 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:26.999910  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.542s (SENT) [suppressed 10 similar messages]
I20260709 13:18:27.091218  5450 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:27.088937  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.094661  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.095587  5444 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.094672  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:27.093264  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.090546  5370 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:27.106225  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:27.106791  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.108176  5447 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:18:27.099108 11705 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:27.110109  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.111018  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:27.110998  5447 raft_consensus.cc:2393] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:27.113515 11913 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:27.114126 11913 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:27.115572 11913 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.117596  5448 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:27.105126  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.119472  6072 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:27.113309  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.123193  5447 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.121901  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:27.122180 12036 raft_consensus.cc:2764] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:27.132637  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.132851  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.133540  5442 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:27.134138  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:27.134439  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.135020  5515 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:27.135747  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.136437  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.137863  5518 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
W20260709 13:18:27.138545  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.133674  5448 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:27.139833  5524 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:27.139976  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.141331  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.142477  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.143630  5369 pending_rounds.cc:85] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 7
I20260709 13:18:27.144253  5369 pending_rounds.cc:107] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:18:27.144547  5369 raft_consensus.cc:2889] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.144649  5367 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:27.145002  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.145892  5375 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:27.146188  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.146561  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.147032  5367 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:27.147078  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:27.147382  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:27.146992  5448 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.150395  5523 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:27.144354  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:27.149266  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.154301  5446 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.140079  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.156152  5448 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:27.147276  5374 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:27.159982  5444 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:27.162046  5522 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:18:27.162864  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.165673  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.168555  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:27.169898  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.171131  5524 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:18:27.159500  5442 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:27.182475  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.175099  5368 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:27.189884  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.190913  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.193019  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.195922  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.196480  5523 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:27.200394  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.206106  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:27.210213  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.210433  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:27.209378  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.211094  5368 raft_consensus.cc:2410] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:27.211364  5450 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:27.205878  5441 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:27.211853  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.209892  5442 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:27.206876  5370 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:18:27.211195  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:27.214185  5370 pending_rounds.cc:85] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 8
I20260709 13:18:27.221190  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.221845  5370 pending_rounds.cc:107] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:18:27.222283  5370 raft_consensus.cc:2889] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.197911 11729 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.228212  5448 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:27.234153  5524 raft_consensus.cc:2368] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19.
I20260709 13:18:27.235941  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:27.239426  5521 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.242873  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.243718  5448 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:27.245087  5448 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:27.245592  5371 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.250494 11785 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:27.251943  5444 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:27.251732 11785 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:27.253748  5444 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:27.255182  5444 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:27.256536  5444 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:27.256940  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:27.259444  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.259882  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:27.256739 11785 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:27.261801 11579 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:27.262452  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.263532  5368 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:27.263476 11579 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:27.265697 11579 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:27.266731 11579 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.268867 11579 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.268766 11729 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.270246 11936 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:27.271368 11729 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:27.272076 11929 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:27.272465 11929 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:27.273701 11929 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.275077 11929 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.271272 11936 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:27.281400  5450 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:27.282773  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.283437  5523 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:27.285018  5445 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:27.286990  5517 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:27.289757  5447 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:27.291356  5521 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:27.292510  5446 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:27.292213  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.295962  5371 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:27.296207  5518 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:27.300725  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.302024  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:27.313213  5442 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: [18.11-19.12]
I20260709 13:18:27.314071  5446 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:27.314481  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.322860  5445 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:27.335888  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.341792  5450 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:18:27.344686  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.347813  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.348603  5447 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:27.349177  5521 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:27.354027 12024 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.365434 11928 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:27.366746 11928 consensus_queue.cc:1243] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:27.367482 11928 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:27.367914 11928 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:27.369374  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.373863  5517 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:27.378441  5443 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:27.381227  5447 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:18:27.388130  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.391579  5450 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:27.394034  5442 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:27.396432  5447 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:27.403580  5446 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:27.407049  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:27.405463  5517 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:27.411123  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:27.411973  5269 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 158) took 18284 ms (client timeout 15000 ms). Trace:
I20260709 13:18:27.412196  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:27.412911  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:27.385675 12024 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.425925  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:27.423352  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.433519  5522 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:27.436170  5442 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:27.413724  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:27.441515  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.442263  5523 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:27.444588  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.445555  5519 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:27.454737  5447 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:27.461681  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:27.419230 11828 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:27.466641  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.413647 11928 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.468176  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:27.470429  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:27.496614  5450 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.473498  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:27.473569  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.473855  5443 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:27.473577 11755 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:27.475353  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:27.412510  5269 rpcz_store.cc:269] 0709 13:18:09.135914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.159483 (+ 23569us) service_pool.cc:224] Handling call
0709 13:18:27.411650 (+18252167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:19.325444 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:19.326222 (+   778us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:19.326303 (+    81us) write_op.cc:435] Acquired schema lock
0709 13:18:19.326339 (+    36us) tablet.cc:662] Decoding operations
0709 13:18:19.457454 (+131115us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:19.457557 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:19.457594 (+    37us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:18:19.498178 (+ 40584us) tablet.cc:701] Row locks acquired
0709 13:18:19.498243 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:18:19.498502 (+   259us) write_op.cc:270] Start()
0709 13:18:19.498719 (+   217us) write_op.cc:276] Timestamp: P: 1783603099498411 usec, L: 0
0709 13:18:19.498758 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:18:19.499816 (+  1058us) log.cc:844] Serialized 13257 byte log entry
0709 13:18:20.000207 (+500391us) op_driver.cc:464] REPLICATION: finished
0709 13:18:21.502214 (+1502007us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d0c820ac 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d77c2ef0
0709 13:18:21.900451 (+398237us) write_op.cc:301] APPLY: starting
0709 13:18:21.964112 (+ 63661us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:22.968148 (+1004036us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:22.968189 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:24.718887 (+1750698us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:24.719422 (+   535us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=68,mrs_lookups=0
0709 13:18:24.719495 (+    73us) write_op.cc:312] APPLY: finished
0709 13:18:24.720228 (+   733us) log.cc:844] Serialized 291 byte log entry
0709 13:18:25.124932 (+404704us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.201103 (+ 76171us) write_op.cc:454] Released schema lock
0709 13:18:25.232819 (+ 31716us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:25.309322 (+ 76503us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.317759 (+  8437us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1367794,"reported_tablets":56,"spinlock_wait_cycles":34688,"child_traces":[["op",{"apply.queue_time_us":1877662,"apply.run_cpu_time_us":112781,"apply.run_wall_time_us":3407749,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146247,"num_ops":34,"prepare.queue_time_us":427200,"prepare.run_cpu_time_us":21938,"prepare.run_wall_time_us":250604,"raft.queue_time_us":199954,"raft.run_cpu_time_us":44564,"raft.run_wall_time_us":1826679,"replication_time_us":501223,"spinlock_wait_cycles":8323968,"thread_start_us":2590434,"threads_started":5,"wal-append.queue_time_us":833439,"wal-append.run_cpu_time_us":29811,"wal-append.run_wall_time_us":2437516}]]}
I20260709 13:18:27.434883 11729 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:27.481613 11785 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:27.482801  5371 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:27.483255  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.484972  5368 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:27.485656  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.485890  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.486917  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:27.487191  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 73554.8us
I20260709 13:18:27.519994  5524 raft_consensus.cc:2393] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:27.512178  5445 raft_consensus.cc:2410] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:27.515748  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:27.527406  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:27.531426  5442 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:27.508172  5270 catalog_manager.cc:5697] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 11 to 12, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 12 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:27.493359 11929 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.540030  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:27.508224 11755 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:27.540781  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 51012.2us
I20260709 13:18:27.549512  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:27.517020 11729 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:27.551239  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 87411.7us
I20260709 13:18:27.562979  5443 raft_consensus.cc:2410] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:18:27.567239  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:27.568295  5366 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:18:27.568858  5366 pending_rounds.cc:85] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 11
I20260709 13:18:27.569188  5366 pending_rounds.cc:107] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:18:27.569648  5366 raft_consensus.cc:2889] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.545022 11962 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:27.558652 11729 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.581362  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:27.553505 11755 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.586037 11929 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:27.588094  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 112899us
W20260709 13:18:27.606331  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 86496.6us
I20260709 13:18:27.608575 11838 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:27.594909 11936 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:27.607254  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:27.614661  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43911.5us
I20260709 13:18:27.616592 11820 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:27.616447  5270 catalog_manager.cc:5697] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 13 to 16, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 16 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:27.620976 11820 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.605800 11946 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.625483  5518 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:27.630838 11828 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:27.639025  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:27.639487 11828 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.640167 11828 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.640864  5340 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:27.645573 11804 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.646111 11804 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.646498 11804 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.617442 11936 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.637068 11946 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.649789 11936 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.650055 11946 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.614255 11962 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:27.636394  5450 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:27.639394  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:27.658540  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.672536 11828 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.675711 11929 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:27.676384 11929 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.676757 11929 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.677114 11929 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.630368 11820 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:27.683794  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60686.2us
I20260709 13:18:27.637701 11838 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:18:27.710263  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.717103  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:27.718803  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 80170.3us
I20260709 13:18:27.719590  5270 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 9 to 11, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 11 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:18:27.721093  5414 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.024s	sys 0.021s
W20260709 13:18:27.740356  5414 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.025s	sys 0.022s
W20260709 13:18:27.740768  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 740853us
I20260709 13:18:27.785696 11681 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:27.779147 11838 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:27.771354 11828 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:27.813336 12024 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:27.815241 11579 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
W20260709 13:18:27.817588  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 344617us
W20260709 13:18:27.845276  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.822212 11838 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:27.866562 11928 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.890038 11946 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:27.892462 11946 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:27.896656 11838 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:27.916142  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 347223us
W20260709 13:18:27.928181  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 371053us
I20260709 13:18:27.941830  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:27.944459  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.947026  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.927589  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:27.968942  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51809.2us
I20260709 13:18:27.952374 11751 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:18:27.979408  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:27.985548  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 344728us
I20260709 13:18:27.963371 11728 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:18:27.992599  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:27.994017  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 474788us
I20260709 13:18:27.987655 11962 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:28.010128  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:28.015930  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 331326us
I20260709 13:18:28.019660 11681 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:28.024427 11681 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:28.024930 11681 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:28.027882  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 247282us
I20260709 13:18:27.993369 11755 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:28.050055  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.025682 11579 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.098922  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 123687us
W20260709 13:18:28.100387  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.113874  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66533.1us
I20260709 13:18:28.077521 11751 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:28.124655  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 132120us
W20260709 13:18:28.125512  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 152480us
I20260709 13:18:28.060976 11828 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:18:28.134970  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:28.132305  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 114789us
I20260709 13:18:28.128301 11728 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:28.143080 11936 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.143760 11804 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.141571  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:28.161509 12068 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
I20260709 13:18:28.162215 11936 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.162602 11804 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.162937 12080 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:28.163568 12080 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.163951 12080 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:28.164062  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:28.165490 12072 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.165795 11936 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:28.166018 12072 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.166442 11936 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:28.166507 12072 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.167169 12079 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:28.156702 12024 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:18:28.171077 12024 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:28.153453 12082 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:28.175823 12082 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.176355 12082 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.154294  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.178328 11755 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.172878 11936 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.182082 12076 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:18:28.183326  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3160) took 1068 ms. Trace:
I20260709 13:18:28.193082  5339 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:28.127175 11579 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:28.189392  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51423.6us
I20260709 13:18:28.180660 11929 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.193192  5444 rpcz_store.cc:276] 0709 13:18:27.115346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.257258 (+141912us) service_pool.cc:224] Handling call
0709 13:18:27.288357 (+ 31099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.321243 (+ 32886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.321294 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.357947 (+ 36653us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.744842 (+386895us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:27.744914 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.745010 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.183087 (+438077us) raft_consensus.cc:1685] finished
0709 13:18:28.183110 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.183263 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5721,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":338096,"threads_started":1,"wal-append.queue_time_us":515133}
I20260709 13:18:28.142382 11705 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.206290 12073 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:18:28.208016 11729 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 13:18:28.208366 12076 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:28.208525 11838 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.145356 11728 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:28.215952 11913 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:28.114668 11962 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:28.226814  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69656.6us
I20260709 13:18:28.228961  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:28.231101 11838 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.231918 12092 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.232421 12092 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.233821 12084 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:28.223073 11728 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.234412 12084 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:28.234575 12092 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.235227 11946 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.235685 12084 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.236068 11946 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.136400 11751 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.238584 12094 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.239089 12094 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.229555 11785 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:28.223242 11729 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.230274 11928 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:28.230882 11579 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:28.231252  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 92528.4us
W20260709 13:18:28.294814  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 130726us
I20260709 13:18:28.222182 12076 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:28.298983  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75470.7us
I20260709 13:18:28.300177  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:28.303347  5375 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:28.304631  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.234388 12082 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.309176 12071 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:18:28.309631 12076 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.333602 12081 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:28.334102 12081 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.310817  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.245904 11838 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.334226  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.334482 12081 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.335690  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.336270  5367 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:28.336975  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.312784  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.344129  5370 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:28.316243  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:28.345171  5369 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.293319 11828 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:18:28.317385 12094 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:28.320281 11820 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.005s
I20260709 13:18:28.322727  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:28.331341 12096 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:28.332021 12090 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:28.334275 12076 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.312433 11729 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.338040  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.338255 11913 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:28.338079 12093 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.223335 11705 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.304364 11751 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.293588 11681 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.355772  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.352865  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.364429  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.358981  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.361573 12087 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:28.368346  5366 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:28.370246  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65480.6us
I20260709 13:18:28.341362 12072 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.375770  5371 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:28.375996  5517 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:18:28.378916  5372 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:28.380859  5518 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:28.383946 11751 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:28.387888  5414 leader_election.cc:400] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19.
I20260709 13:18:28.388978  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.377774 11929 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:28.390921  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.395341  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.395430  5414 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.395824  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3161) took 1280 ms. Trace:
W20260709 13:18:28.393908  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 266521us
I20260709 13:18:28.396944  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:28.396277  5448 rpcz_store.cc:276] 0709 13:18:27.115649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.290948 (+175299us) service_pool.cc:224] Handling call
0709 13:18:27.293847 (+  2899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.303913 (+ 10066us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:27.769944 (+466031us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.128731 (+358787us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.137349 (+  8618us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.139636 (+  2287us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:28.139697 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.139780 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.395333 (+255553us) raft_consensus.cc:1685] finished
0709 13:18:28.395359 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.395661 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53171,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":28402,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":3101,"thread_start_us":777880,"threads_started":2,"wal-append.queue_time_us":433682}
I20260709 13:18:28.403258 11913 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.403935 11913 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:28.404390 11913 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:28.407584  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.374603 11928 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:28.416733  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.350975 11820 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.416008 11751 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:28.433097 11751 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:28.386909 11729 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:28.379938 11946 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.463886 11729 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.464453 11729 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:28.467666  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:28.469753  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:28.469985 11728 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.470674  5521 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:28.471083  5520 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:28.469911  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:28.471969  5517 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.472187 11728 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.418293 12082 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:28.468317  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:28.474246  5516 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.474359  5524 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:28.475883  5368 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:28.469750 11705 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.480715 12093 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:28.483316  5524 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:18:28.405941 12081 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:28.436672  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84655.6us
W20260709 13:18:28.441769  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46442.1us
I20260709 13:18:28.442663  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:28.446245 11751 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.498605  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:28.498478 11962 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:28.499905  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.449558 12099 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.451496  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 54644.5us
I20260709 13:18:28.451633 11681 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.436548 11929 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:28.361930 12090 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.458608 12072 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.461063  5369 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:28.487829  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:28.491417  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.535243  5515 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.491731  5518 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:18:28.491747  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.498019 12082 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:28.498481  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:28.538376  5524 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:28.499758 11962 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.450606 12071 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:28.501942  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:28.501168  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:28.517288  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 79207.6us
I20260709 13:18:28.519416  5516 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:28.520913  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.522670 11705 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:28.529983  5523 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:28.522399 12093 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:28.549089 12092 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:28.550354 12090 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.550405 12092 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.550971 12092 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:28.485383 11729 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:28.554529  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53459.8us
I20260709 13:18:28.531601 12094 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:18:28.570820  5369 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:18:28.571460  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 79790us
I20260709 13:18:28.574514  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:28.521947 11936 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:18:28.541123 12071 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.544508 11705 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:28.580418  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.539144 11681 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:28.554570 11928 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.582995  5521 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:28.583436  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.587898  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.537799 11929 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.561595 12087 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:28.541924 12082 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.594234 12079 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:28.594326  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.561779 12072 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:28.598372 12094 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:28.602340 12113 raft_consensus.cc:2764] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:18:28.560254 12084 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:18:28.574661 11755 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:18:28.609763 11681 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.592542 11728 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:28.592540 12093 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:28.584997  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.529870 12099 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.582351 11936 consensus_queue.cc:1243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:28.590317 12071 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.625874  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.587062 11888 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.593677 11705 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:28.629472  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86986.9us
W20260709 13:18:28.632056  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.635113  5524 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:28.641583 11785 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:28.642257  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:28.642757 11729 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.644101 12072 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:28.621061 11751 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:28.647996 12092 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.644688 12080 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.653229  5515 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:28.710579  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:28.656678 11962 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.657315 12081 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.592935 12024 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:18:28.618794 11828 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:28.626855 12079 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.669687 11820 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.685532  5517 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
W20260709 13:18:28.690282  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 106927us
I20260709 13:18:28.692935 11728 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:18:28.693866  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 108930us
I20260709 13:18:28.738916  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.622838 11928 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.702592  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.711292  5373 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:28.744407  5522 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:18:28.708871 12093 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:28.715304  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.716800  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:28.751881  5524 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:28.697556 12087 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:28.719805  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 94244.9us
I20260709 13:18:28.722800  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:28.767310  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.627789 12094 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:28.708680 12096 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:28.784018  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45197.7us
I20260709 13:18:28.741962 11785 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:28.714088  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.757297  5371 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:28.763827  5370 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:28.733968 12079 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:28.723985 11929 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.786233  5372 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:28.704267 11888 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:28.826187  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 123669us
I20260709 13:18:28.815037  5524 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:28.769513 12115 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:28.828333 12115 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.828914 12099 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.830821 12115 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.831892 11888 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:28.833024  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47389us
I20260709 13:18:28.832788 12094 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.833711 12113 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:28.809296 12087 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.838754 12113 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:28.839160  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:28.840233  5524 raft_consensus.cc:2393] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:18:28.832814  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 89079.3us
I20260709 13:18:28.838982 12087 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.842592 12114 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:28.842730  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.843077 12114 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:28.843237 12087 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.840003 12113 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.834817 11728 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:28.842316 11913 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.844275 12114 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.845566 12095 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.840561 12080 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.833480 12098 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
W20260709 13:18:28.852551  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 75225.3us
I20260709 13:18:28.853663  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.767915 11751 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:18:28.860538  5522 pending_rounds.cc:85] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 10
W20260709 13:18:28.834892 12105 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.182s	user 0.001s	sys 0.001s
I20260709 13:18:28.860982  5522 pending_rounds.cc:107] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:18:28.866389  5522 raft_consensus.cc:2889] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:28.861335  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.846272 11913 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.846083 12095 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.851974 12090 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:28.861254 12114 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:28.891885  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.817157 11962 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:18:28.895650  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.863787 12082 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.837808 11705 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.900035 11828 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:28.897564 12024 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:28.900660 12111 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:28.891315 11929 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:28.903236 12094 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.876332 11681 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:28.906883 12093 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:28.907791 12116 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:18:28.908022 12090 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:28.938709 12097 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:28.939915  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.940019  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.940779  5367 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:28.941285 12111 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:28.941817  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:28.942612  5374 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:28.942906 12097 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:28.943643  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:28.944412  5372 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:28.944025 12097 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.947068 12082 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:28.947629 12082 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:28.949838  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:28.918602  5373 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:28.883587 12118 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:18:28.901125 12084 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.965691  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.893859 11751 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:28.929692  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:28.883747 12088 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.149s
I20260709 13:18:28.857055 12072 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:28.928853 11913 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:28.920358 11828 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:28.955215  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.075610  5441 raft_consensus.cc:2410] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 20 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 13:18:28.955410  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:28.956652  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.076314  5446 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.958271  5447 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:18:29.077332  5449 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:28.959743  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:28.961591  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:28.963408  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:28.948114 12082 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.970146  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:28.930205 11929 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.078243  5442 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:28.998328  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:28.937667 12092 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:28.952279 11728 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:28.971750 11751 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.898679 11785 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:29.051234  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 198864us
I20260709 13:18:29.000890 12087 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:29.066062  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 131520us
W20260709 13:18:29.058285  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 108540us
I20260709 13:18:29.078161  5450 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:29.081518  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.076814 11913 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.079834  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:29.078734  5448 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:18:29.078365  5443 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.083534 11705 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.085033  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:29.064895 12070 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.078363  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.076978 11681 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:18:29.086534  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:28.942677 12111 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.064560 11928 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.091087  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.091486  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:29.000703 12084 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.067207 12024 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.093040  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:29.094151  5446 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:29.096866  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:29.097998  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:28.986233  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.102690  5373 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:29.103662 11962 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:29.106626  5372 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:29.119352  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:29.090941 11728 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:29.149334  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 219712us
I20260709 13:18:29.096238 11751 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.142192  5445 raft_consensus.cc:2393] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:29.142267  5370 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:29.098392 12087 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.150413  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.110621 11913 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:29.149001 12137 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:18:29.152411 12127 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:18:29.153446 12138 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:29.153784 12135 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.158342  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.158437 12120 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:29.158838  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59888.8us
I20260709 13:18:29.161540 12134 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:29.168912  5443 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:29.175287 12087 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:29.162318 11755 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:29.181159  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.194278  5445 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 17.
I20260709 13:18:29.113415 12125 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.185177  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65959.6us
I20260709 13:18:29.191926  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.086480 11828 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.177822  5450 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:29.196962  5370 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:29.162385 12132 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:29.184839 12115 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.185776 12076 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:29.183697 11705 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.189365 11962 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:29.201210  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.122162 12070 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:29.205750  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 108993us
I20260709 13:18:29.197259 12120 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.209599 12130 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:18:29.210395 11828 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:29.128563 12079 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.108047 12090 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.204646 12132 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:29.177263 11929 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.204788 12118 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:29.217242 12076 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.238047 12084 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.232199 12088 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:18:29.250538 12120 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.250953 11928 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:29.251873 11804 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:29.252228 12098 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:29.252977 12079 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.213183 12115 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.250976 12126 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:18:29.212522 11728 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.285624 11728 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.253926 12070 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.200860 12125 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.254647  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.246640  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:29.295025  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48461.8us
I20260709 13:18:29.232595 12091 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:29.297585 12125 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.297791 12036 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:29.298359 12036 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.298791 12036 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.297638 11946 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:18:29.305917  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.307410  5489 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:29.191553 12135 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.216506 11579 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:18:29.244416 12118 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:29.240761 12095 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.202227 12134 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:29.326437  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 81145.2us
I20260709 13:18:29.240885 12093 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:29.231705 12081 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:29.321787  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 87441.2us
I20260709 13:18:29.280959 12098 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.308869 11729 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.324152 11946 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:29.338984  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 167861us
I20260709 13:18:29.326362 12118 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:29.259455 12024 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.339923  5339 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.341909  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.342398  5443 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:29.343621  5366 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 16.
I20260709 13:18:29.332041 12081 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.328814 12091 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:29.347579  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:29.351280 11956 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:29.351787 11956 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.352146 11956 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.337150 11785 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:18:29.354882 12135 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.355733 12148 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:29.344491 11705 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:29.365320  5518 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:29.344924 12076 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.341410 12079 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:18:29.362084 11946 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:29.348894 12081 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:29.346246 12126 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:29.392503  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.400229  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.402660  5517 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:29.403846  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.401181  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.404826  5522 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
W20260709 13:18:29.409024  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101677us
I20260709 13:18:29.404524  5520 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:29.412319  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.413044  5517 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:29.333912 11962 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.415679  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:29.417588  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.418953  5521 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:29.407861 12084 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.422667  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.424237  5443 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:29.424299  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.422748  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.427197  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.427956  5445 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:29.430054  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.430728  5443 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:29.431915  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.408336 11946 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:29.433808  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.434474  5447 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:29.396090 11705 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.436268  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.438007  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.440294  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:29.440550  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.438697  5441 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:29.441723  5446 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:29.442181  5446 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:29.442651  5443 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:29.451436 11936 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:29.451983 11936 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.456195 12080 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:29.461493 11579 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.462163  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.462755  5442 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:29.412424 12126 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.477873  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.444972  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:29.469103  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:29.480260  5516 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:29.480612  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.481261  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:29.443014  5446 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.482229  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.483300  5443 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:29.475270  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:29.484925  5369 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:29.473796  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:29.486541  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.487396  5517 raft_consensus.cc:2368] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:29.488260  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.482630  5446 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.489811  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.456863 12080 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.491268  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.491330  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.483173  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.489378  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:29.495625  5446 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:18:29.506726  5446 pending_rounds.cc:85] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 11
I20260709 13:18:29.507025  5446 pending_rounds.cc:107] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:18:29.507256  5446 raft_consensus.cc:2889] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:29.499229  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:29.511268  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.512640  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.513336  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.515321  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.518380  5521 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:18:29.461153 12091 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.522853  5517 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: [19.12-21.13]
I20260709 13:18:29.529495  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.530587  5443 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:29.535523 11705 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.452952 11936 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.442196 11681 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:18:29.543890  5447 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:29.545599  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.547474 12130 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.547609 12152 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:29.548285 12134 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:29.550168  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:29.551031  5523 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:29.512432 11928 raft_consensus.cc:2764] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:18:29.555051 12080 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.558295 12118 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.560570  5515 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
W20260709 13:18:29.562409  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47586.2us
I20260709 13:18:29.562326  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.563663  5443 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:29.530226 12071 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.825s	user 0.007s	sys 0.006s
I20260709 13:18:29.564007  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.457271 11956 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:29.575318  5516 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:29.576821  5444 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:29.577718  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.579041  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.579404  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.579775  5448 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:29.580709  5447 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:29.581200  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.573002  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:29.584971  5517 raft_consensus.cc:2368] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21.
W20260709 13:18:29.589797  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 128149us
I20260709 13:18:29.590898  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.579488  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.591886  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.593091  5519 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:29.594257  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.590758  5490 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:29.595112  5444 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:29.596745  5441 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:29.598716  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.596571 12114 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:29.602185 12114 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:29.601845 12126 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.602689 12114 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:29.603447 12118 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.604281  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:29.571379 12036 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:29.606357  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.607426 12036 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.607561  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.571285 12079 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:29.609300  5516 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:29.610422  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.610984  5449 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:29.573580 12071 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.602357 11913 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.597694  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:29.614233  5444 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:18:29.615278  5524 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:29.620751  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:29.622236  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.623016  5441 raft_consensus.cc:3060] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:29.625090  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.625799  5444 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:29.618165 12080 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:29.642102  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50253us
I20260709 13:18:29.731678  5449 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:18:29.732169  5447 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:18:29.642848 11681 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:29.622444 11751 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:29.618077 12094 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260709 13:18:29.592854 11946 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:29.739187  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 140513us
I20260709 13:18:29.739041  5442 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
W20260709 13:18:29.761816  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 225466us
W20260709 13:18:29.763859  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 237568us
W20260709 13:18:29.767198  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 269541us
I20260709 13:18:29.742062 12097 raft_consensus.cc:2804] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:29.743201 11681 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.771814  5450 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:29.738971 11785 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.770464  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.782368  5442 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.766168 12134 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:29.795333  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:29.796512  6072 raft_consensus.cc:2368] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18.
I20260709 13:18:29.802601  6076 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:29.780498 11681 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:29.790980 12082 consensus_meta.cc:287] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.003s
I20260709 13:18:29.821902  5442 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:29.823307  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:29.823891  5517 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:29.825941  5372 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:29.792075 12097 raft_consensus.cc:697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:29.844983  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.845739  5442 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.830092 12071 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.789361 11785 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.866880  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.871883 11820 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:29.872429 11820 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.872735 12169 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:29.873865 12169 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:29.873585 11820 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.875108 11820 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.874887 12169 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:29.821993 12082 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.852330 11913 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.851317 11956 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:29.895408 12161 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:29.899662  5442 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 19.
W20260709 13:18:29.865969 11728 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:18:29.908000 12092 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:29.908715 12092 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.908593 12097 consensus_queue.cc:237] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:29.915453 12168 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:29.901393  5441 raft_consensus.cc:2468] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:29.923892 11785 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.857095 11755 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:18:29.924036 12092 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.926956 11751 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.932334 12152 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:29.935171 12082 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.944759  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:29.946276 12087 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.756s	user 0.013s	sys 0.001s
I20260709 13:18:29.947978 12087 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:29.949754 12081 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.009s
I20260709 13:18:29.950201 12081 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.951454  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:29.952459 12081 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.950480  5446 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:29.953861 12087 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.955565  5442 raft_consensus.cc:2393] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:29.956315  5448 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:29.945415 12114 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.959707 12114 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:29.961001  5521 raft_consensus.cc:2368] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:29.942358 12082 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.963475  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:29.969058  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:29.970106 12157 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:29.966964 12134 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:29.977490 12082 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.979583 12121 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:29.988943 12134 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:29.994390 12082 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.983291  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:29.987763 12072 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.989010 12121 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:29.998155 12072 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.998816 12121 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:29.999878 12121 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.000959 12072 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.003448  5448 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:29.981287  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.005275 12153 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:30.005983 12153 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:30.006461 12153 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:30.007308  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:30.010702  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:30.011442  5448 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.023132 12132 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:30.028149  5448 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:30.032784 12129 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:30.033788 12134 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.033404 12129 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:30.035470 12129 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.036762 12129 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.945585 11681 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.040947 12157 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:30.042089  5443 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260709 13:18:30.080894  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 280282us
I20260709 13:18:30.083246  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:30.042798 12157 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:30.043660 12115 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:30.044402  5442 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:18:30.052223  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 281364us
I20260709 13:18:30.101565 12132 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.102555 12132 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.104545  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.105232 12132 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.102938 12136 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:30.106077 12136 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.108202 12136 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.092553 12084 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:30.095548  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:30.113922  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 106680us
I20260709 13:18:30.131698  5340 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:30.141777  5448 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:30.143060  5447 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:30.150054  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:30.150952  5447 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
W20260709 13:18:30.144279  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 321020us
I20260709 13:18:30.157034  5340 leader_election.cc:400] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18.
I20260709 13:18:30.157481  5340 leader_election.cc:403] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.158516  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:30.158631  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:30.158968  6042 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:30.130621 12136 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:30.166544  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 170361us
W20260709 13:18:30.162932  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.126096 12084 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.122888 12132 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.165675  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48609.9us
I20260709 13:18:30.144467 11828 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:30.170138  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:30.175945  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:30.138839 12121 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:30.165448 12169 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:30.182114  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:30.186319  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:30.186764  5448 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.177397  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:30.167847 11681 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.166344 12136 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.169884 12084 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:30.169796 12148 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:30.200668  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:30.172959 12118 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:30.210197 12169 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:30.211192 12136 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.172698 12132 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.256851  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.257511  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.170220 12115 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:18:30.258117  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.225561 12094 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:30.259279  5368 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:18:30.259672 12094 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:30.260582 11804 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:30.260720 12094 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.261266 11804 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.263561 11804 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.225557 11928 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:30.155871 12126 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:18:30.264396 11928 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.227437 12134 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.265031 11928 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:30.228142 12180 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:18:30.180932 12152 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:18:30.268178 12152 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:30.229374 12153 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.190328 12080 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:30.235914 12098 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.238425  5449 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:30.245667  5371 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:30.247715  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.249377  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.270685  5367 raft_consensus.cc:2410] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:30.269285  5449 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:30.276702  5448 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:30.243640  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:30.251307  5372 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:30.180882 11828 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:30.253495 12169 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:30.253983  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:30.279678  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.279955  5441 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 26 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:18:30.264725 12126 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:30.290258  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:30.291119  5448 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:30.291143  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.282658  5449 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.292479  5449 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:30.293996  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50458.4us
I20260709 13:18:30.294968  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.299727 12178 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:30.300824 12178 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.288542 12126 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:30.302270  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.301508  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:30.304790 11751 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:30.305534 11913 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:30.308348  5449 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 10. (term mismatch)
I20260709 13:18:30.308816  5449 pending_rounds.cc:85] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 9
I20260709 13:18:30.307775 11828 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.308218 12178 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.306924  5414 leader_election.cc:400] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:30.310901  5414 leader_election.cc:403] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.314306  5449 pending_rounds.cc:107] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 21.10
I20260709 13:18:30.315068  5449 raft_consensus.cc:2889] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.319952  5449 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:30.269323 12082 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:18:30.252174 12097 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:30.268633 12152 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:30.331964  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:30.258153 12132 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.335659  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:30.336869 12185 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:18:30.340571 11936 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.337381 12153 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:30.338217 12126 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.342346 12126 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.330894 11728 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:30.331707 12098 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.348060  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:30.348923  5450 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:30.351626 12178 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.352224 12178 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.352975 11728 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:30.353173 12113 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.353727 12113 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.357685 11728 consensus_queue.cc:1059] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:30.358614 12132 raft_consensus.cc:3055] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:30.364301  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.354594  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:30.373924  5524 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:30.382524  5521 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260709 13:18:30.385496  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 88686.5us
I20260709 13:18:30.392302  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.393600  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.394797  5521 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:30.361106 12132 raft_consensus.cc:740] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:30.403514  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.365327 12157 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:30.340516 12152 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.406912  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.411381  5517 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:30.366135 12182 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.375305 11728 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.409201  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.411538  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.510406  5521 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:30.389463 11928 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.528111  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.534442  5368 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:18:30.534668  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 180157us
I20260709 13:18:30.535782  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:30.538199  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.392153 12153 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.125s
W20260709 13:18:30.558507  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.511289 12152 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:30.597008  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.596875  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.517351 12113 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:30.600247  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.603359  5367 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:30.520861 11751 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.610580  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.615209  5521 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 13:18:30.604400  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62677.1us
W20260709 13:18:30.605252  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.516703 12182 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.620034  5414 leader_election.cc:400] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21.
I20260709 13:18:30.624632  5414 leader_election.cc:403] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.625547  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:30.631106  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.539157 12084 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.627899  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:30.637468  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.616802 11728 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:30.625725 12094 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.649137  5374 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:30.650128  5521 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:30.617774 11751 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.658557  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.655249  5371 raft_consensus.cc:2368] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:30.660252  5374 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.661921  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.663060  5520 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.665663 11728 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21.
I20260709 13:18:30.665776 12178 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.666666 11728 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:30.667306 11728 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:30.671403 12136 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.607589 12132 consensus_queue.cc:260] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.673667  5369 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:30.674265 12132 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:30.675105  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.676613  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:30.682674  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.683758  5367 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:18:30.684008 12082 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.684618  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.684569 12082 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:30.685906 12197 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:18:30.687417 12082 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:30.687690 12182 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.694973  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.695509  5517 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:30.695943 12084 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.696276  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.696704  5517 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:18:30.697700  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.654629 12094 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.698289  5522 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:30.698464 11928 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.700088 12094 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:30.700408 11751 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.701943  5523 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:30.702400  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.704180  5447 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:30.709704  6076 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:18:30.710727  5521 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:30.711711  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:30.714488  5370 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:30.715703  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.717985  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:30.729229  5518 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:30.728754 12123 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:30.719878 11751 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:18:30.738817 12123 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:30.739410 12118 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:30.740370  5373 raft_consensus.cc:2410] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:18:30.741712  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:30.743052  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:30.741096 12123 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:30.751134  5374 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:30.755004  5367 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 13:18:30.755806  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 109343us
I20260709 13:18:30.720779 12115 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:30.752810  5340 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:30.745796 11828 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.758596  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:30.741134 12167 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:30.706537 12178 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:30.785511 12178 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:30.786666 12123 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:30.792909  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:30.795694  5339 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:30.797914 12136 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:30.798579 12136 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:30.799072 12130 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:30.799206 12136 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:30.799711  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:30.800469  5449 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:30.780941  5367 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:30.786165 11928 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:30.769778 12118 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:18:30.802781  5444 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:30.773180  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:30.803807  5522 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:30.808979  5449 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:30.759842 12072 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:30.810987  5520 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:30.813365 11820 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:30.833114  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:30.833832  5449 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:30.816066 12118 consensus_queue.cc:1243] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 53eb858bdf82438d83f1be6a01da2e0e log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:18:30.866055  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:30.866786  5374 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:30.836375  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:30.779796 12082 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:30.805013 12087 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:18:30.815897 11928 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:30.802428 11828 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.822360 12113 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:30.880088  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.880649  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.882893  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.883490  5522 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:30.820896 12098 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:18:30.877498 12148 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.006s
I20260709 13:18:30.894171  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:30.900709  5518 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:30.895187  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:30.831029 12084 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:18:30.873448 12122 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:30.905725  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:30.907536  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 279716us
I20260709 13:18:30.867985 12097 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:18:30.868625 11755 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:18:30.917917 12080 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:30.873979 12181 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:18:30.874126 12167 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:30.924768 12090 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:30.908037 12148 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18.
I20260709 13:18:30.899977 12113 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:30.918923 12126 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:30.918648 12122 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:30.938868 12136 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.941260  5372 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:30.919245  5449 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:30.964442  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:30.965199  5449 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:30.962807 12126 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.934062 12205 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:30.950425  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:30.942027 11928 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.969043 12126 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:30.943871  5518 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:30.953280 11751 consensus_queue.cc:1243] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:30.987406  5369 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:30.955438 12080 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.972123 12084 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:30.978253 12134 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:30.994439 12084 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.972838 12205 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:30.996475  5339 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:30.996356 12205 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.997442 12097 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:30.957276 12090 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:30.998075 12097 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.999011 12090 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:31.000644 12097 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:31.000917 12090 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.970587 12136 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:30.976867  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:30.994534 12134 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:31.002002  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:31.004868  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:30.988390 12202 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:18:30.997982 12205 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:31.011544  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.014108  5414 leader_election.cc:400] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:31.014454  5414 leader_election.cc:403] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.012494 12134 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:31.014223  5450 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:30.988056 12209 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.018985  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:31.008850  5449 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:30.998118 12148 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:31.029452  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:31.036427  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 197426us
W20260709 13:18:31.037473  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.016021 12132 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:31.020275 11751 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.048933 11804 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:31.050347 12080 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:31.050678 11929 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.030880 12122 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.053941 11828 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.048158  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:31.088515  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:31.089208  5524 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:31.091922  5370 raft_consensus.cc:1240] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:31.098171  5368 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:31.103403 11936 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:31.104092 11936 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:31.112372  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2729) took 1533 ms. Trace:
I20260709 13:18:31.118593 12178 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:31.120783  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:31.113062  5443 rpcz_store.cc:276] 0709 13:18:29.579037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.605200 (+ 26163us) service_pool.cc:224] Handling call
0709 13:18:30.041833 (+436633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.042530 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.112062 (+1069532us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54003bdb50. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:31.112282 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003173248}
I20260709 13:18:31.123601  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:31.124110  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.124293  5443 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.126394  5371 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 13:18:31.126838  5371 pending_rounds.cc:85] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 9
I20260709 13:18:31.127067  5371 pending_rounds.cc:107] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:18:31.127324  5371 raft_consensus.cc:2889] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.127175  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:31.130811  5373 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:31.130802 12153 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:31.080775  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.131790 12153 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:31.134833 12092 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:31.135406 12153 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:31.136019  5441 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:31.139752  5449 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:31.141847  5374 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:31.138187  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:31.129187 12157 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:31.144169 12157 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:31.135462 12092 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.145239 12157 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.146380 12157 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.148516 12092 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:31.153198  5441 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:31.156085 12072 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:31.156911 12072 consensus_queue.cc:1243] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:31.156332 11888 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:31.157389 12072 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.133304  5450 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:31.169955 12118 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.171774 12118 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.172366  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:31.169962  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:31.176941 12118 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:29.974349  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:31.182322  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:31.177531 11936 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.183653 11751 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:31.184249  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:31.184266 11751 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.185648 12072 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:31.186653 11936 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:31.186746 12072 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:31.228492 12072 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.229076 12072 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.185654 11751 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.210922 12118 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:31.022686 12210 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
W20260709 13:18:31.250810  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 164251us
I20260709 13:18:31.038841 12148 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:31.218115 12157 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:31.226575 12169 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:31.256409  5522 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:31.218281  5490 leader_election.cc:400] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
W20260709 13:18:31.268539  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 94604.4us
I20260709 13:18:31.272944  5339 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:31.273959  5490 leader_election.cc:403] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:18:31.013595 12113 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:31.278496  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 60387.2us
I20260709 13:18:31.083627 12132 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:31.085559 12182 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.252390 12134 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.059286 12209 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.228s
I20260709 13:18:31.261437 12118 consensus_queue.cc:1243] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 21.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:31.300913  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:31.311959  5367 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:31.302613  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:31.303527  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:31.304369  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:31.318032  5443 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:31.330176 12094 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.085183 11804 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.281577 12153 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:31.346469  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:31.308049 12098 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:18:31.353679  5448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.044s	sys 0.125s
W20260709 13:18:31.373338  5448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.044s	sys 0.125s
I20260709 13:18:31.330701 12094 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:31.285943 12082 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:18:31.378877  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:31.381145  5369 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:18:31.389547  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 370631us
I20260709 13:18:31.390884  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:31.306193 12097 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:18:31.418183  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:31.422356  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:31.306811 12182 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.376806 12098 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.390913 12094 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.451186 12084 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.452131 11804 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:31.421860 12208 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
I20260709 13:18:31.379482 12148 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.426759 12206 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.449548 12210 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:31.449369 12098 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:31.457294 12087 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:31.490137  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.456485 12132 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:31.492703 12211 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:18:31.459981 12136 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.497870 12152 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.498615 12152 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.500293  5375 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:31.491796 12206 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:31.501605 12206 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:31.502585 12206 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.503067  5444 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:31.503597  5444 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:31.503692 12206 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:31.538816  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 265981us
I20260709 13:18:31.545784  5366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3318) took 1036 ms. Trace:
I20260709 13:18:31.547729  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:31.549100  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:31.549784  5520 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:31.550644  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:31.558725  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 270447us
I20260709 13:18:31.554479  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:31.481004 11928 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.546281  5366 rpcz_store.cc:276] 0709 13:18:30.508991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.509271 (+   280us) service_pool.cc:224] Handling call
0709 13:18:30.524479 (+ 15208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.524736 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:30.587585 (+ 62849us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.155049 (+567464us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b1800442e40. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:18:31.545450 (+390401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.545502 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:31.545542 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.545600 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.545712 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62663,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":4487,"spinlock_wait_cycles":16716672,"thread_start_us":390154,"threads_started":1}
I20260709 13:18:31.538527 11929 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.561079  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:31.584400  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3061) took 1207 ms. Trace:
I20260709 13:18:31.482064 11751 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.584956  5515 rpcz_store.cc:276] 0709 13:18:30.376575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.376684 (+   109us) service_pool.cc:224] Handling call
0709 13:18:30.402967 (+ 26283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.410008 (+  7041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.410059 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.410624 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:18:30.862531 (+451907us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:30.862572 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.862647 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.584096 (+721449us) raft_consensus.cc:1685] finished
0709 13:18:31.584124 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.584324 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74861,"raft.queue_time_us":2384,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6985,"thread_start_us":265813,"threads_started":1,"wal-append.queue_time_us":416157}
I20260709 13:18:31.595067 12092 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:31.575757 12178 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:31.588934  5340 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:31.571866 11755 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
W20260709 13:18:31.626672  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.597622 12136 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:31.628197 12182 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:31.631649 12217 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:18:31.573751 11936 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 13:18:31.642788  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53926.6us
I20260709 13:18:31.662979  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:31.581434 11928 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.586048 11929 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.666652 11928 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.668135 12084 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.635362 12178 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:31.669795 12178 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:31.669945 11828 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:18:31.649067 12218 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:31.647679 11804 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:31.673517 12221 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:31.668185 12072 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.652884  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:31.674062 12221 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.675503 12182 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:31.675979  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.676343 11804 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:31.677191  5446 raft_consensus.cc:2410] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:31.677613 12210 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:31.677510 11804 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.678401  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.678337 12210 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.679078  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:31.680029  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.674494  5443 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:18:31.667901 11929 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.692979 12120 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:31.625859 12092 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:31.645553 12136 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:31.719486  5446 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:31.747936  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.748939  5446 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:31.713755 12230 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.754779  5490 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:31.691272 12094 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.710119 12084 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:18:31.762719  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.734166 12136 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:31.735811 12120 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:31.760913 12090 consensus_meta.cc:287] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.757s	user 0.012s	sys 0.000s
W20260709 13:18:31.805799  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.839301  5524 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:18:31.839867  5524 pending_rounds.cc:85] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 14
I20260709 13:18:31.840137  5524 pending_rounds.cc:107] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:18:31.840404  5524 raft_consensus.cc:2889] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.758844 12230 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:31.820715  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 278774us
I20260709 13:18:31.838089 12226 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.821990  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3199) took 1550 ms. Trace:
W20260709 13:18:31.823386  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 68697.7us
I20260709 13:18:31.753984 12130 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:31.852427  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:31.827898 12244 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:31.864223  5369 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:31.865978  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2460) took 1025 ms. Trace:
I20260709 13:18:31.865840  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:31.870455 12082 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.870973 12082 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:31.871343 12082 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.875180  5489 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:31.855401 12232 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.856209 11751 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:31.867010  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 444723us
W20260709 13:18:31.884676 12234 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:18:31.903046  5375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2449) took 1656 ms. Trace:
I20260709 13:18:31.903503  5375 rpcz_store.cc:276] 0709 13:18:30.244300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.244838 (+   538us) service_pool.cc:224] Handling call
0709 13:18:30.247840 (+  3002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.500661 (+1252821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.890629 (+389968us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400393ad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:31.900346 (+  9717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2879532672}
I20260709 13:18:31.904021  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2761) took 1090 ms. Trace:
W20260709 13:18:31.876672 12222 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 13:18:31.904860 12094 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:31.878069 12244 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.878262 12233 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:31.906164 12233 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:31.906019 12244 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:31.906826 12233 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.904491  5449 rpcz_store.cc:276] 0709 13:18:30.814118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.140508 (+326390us) service_pool.cc:224] Handling call
0709 13:18:31.140850 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.457667 (+316817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.457714 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.464671 (+  6957us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.732381 (+267710us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:31.732429 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.732516 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.903783 (+171267us) raft_consensus.cc:1685] finished
0709 13:18:31.903807 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.903966 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18841,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":53,"thread_start_us":559108,"threads_started":2,"wal-append.queue_time_us":358437}
I20260709 13:18:31.907963  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.908677  5443 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:31.908908  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.909636  5449 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:31.867375  5448 rpcz_store.cc:276] 0709 13:18:30.271518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.359415 (+ 87897us) service_pool.cc:224] Handling call
0709 13:18:30.384439 (+ 25024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.746632 (+362193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.746666 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.750536 (+  3870us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.373944 (+623408us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:31.411011 (+ 37067us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.821514 (+410503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.821628 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.821700 (+    72us) raft_consensus.cc:1685] finished
0709 13:18:31.821730 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.821911 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13216,"prepare.queue_time_us":45657,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":54,"raft.queue_time_us":90914,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":158820,"thread_start_us":1380061,"threads_started":3,"wal-append.queue_time_us":727092}
I20260709 13:18:31.901255  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:31.866052 12226 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.909978 12251 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.828989 12092 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.900728 12232 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.878996  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:31.931769  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52859.1us
I20260709 13:18:31.902781  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:31.918311  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:31.934175  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.952397  5443 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:31.934625  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:18:31.877593 12126 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.889s	user 0.014s	sys 0.000s
I20260709 13:18:31.876992 12072 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.934010  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:31.950404  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47721.5us
I20260709 13:18:31.951036  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.906944 12244 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.952543 12090 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:18:31.955605  5449 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:31.962034  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.955905  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:31.954668 12092 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:31.964527 12082 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.956182 11828 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:31.986253 12252 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:18:31.987807 12228 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.288s	user 0.001s	sys 0.002s
I20260709 13:18:31.897984 12120 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.935415 12251 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.990532 12152 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.982481  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.991962 12221 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.992316  5448 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:31.993387  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:31.994210 12232 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:31.995005  5448 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:31.996342  5448 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:18:31.988976  5444 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:31.998536  5444 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:32.002008 12130 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:32.002554 12130 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:31.989840  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:32.006335 12227 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:32.006589  5450 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:31.990116  5447 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:18:31.954084 12249 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:18:32.010303  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.011273  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.012902  5450 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:32.016525  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.018319  5450 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:32.019889  5450 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:31.991999 12251 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.023144 12130 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:32.024627 12229 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 13:18:32.025581 12130 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:32.026885  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 71054.1us
I20260709 13:18:32.027670  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:32.028570  5450 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:32.021263  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2741) took 1869 ms. Trace:
W20260709 13:18:32.031134  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.032217  5444 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:18:32.032788  5444 pending_rounds.cc:85] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 12
I20260709 13:18:32.033070  5444 pending_rounds.cc:107] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:18:32.033347  5444 raft_consensus.cc:2889] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:32.033881  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.034804  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2749) took 1308 ms. Trace:
I20260709 13:18:32.035455  5444 rpcz_store.cc:276] 0709 13:18:30.725990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.803523 (+ 77533us) service_pool.cc:224] Handling call
0709 13:18:30.803788 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.502936 (+699148us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540002cea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d03dc0 00007fc1d3d8e1c0 00007fc1d3d8f231 00007fc1d3d8bd8f 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c
0709 13:18:31.988601 (+485665us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b4c001f2dc0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2058a20 00007fc1d2069a29 00007fc1d202f644 00007fc1d2056f2d 00007fc1d2056b93 00007fc1d3d8718b 00007fc1d3d87cb5 00007fc1d3d82f30 00007fc1d3d847de 00007fc1d3d8eb49 00007fc1d3d8f416
0709 13:18:32.034466 (+ 45865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.034746 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504082048}
I20260709 13:18:31.997365  5448 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:32.044008  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:31.970920 12113 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:32.047698  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.026827 12097 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:32.048875 12118 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:32.044696  5523 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
W20260709 13:18:32.050561 12098 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.004s
I20260709 13:18:32.050959 12098 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.030772  5442 rpcz_store.cc:276] 0709 13:18:30.152319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.177028 (+ 24709us) service_pool.cc:224] Handling call
0709 13:18:30.199578 (+ 22550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.269912 (+ 70334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.269946 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.289195 (+ 19249us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.138045 (+848850us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b18002bfc60. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:18:31.420248 (+282203us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:31.711079 (+290831us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.711521 (+   442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.020341 (+308820us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b18002bfc60. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c6d2a6 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419
0709 13:18:32.020928 (+   587us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b540007dfd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:32.020978 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.021029 (+    51us) raft_consensus.cc:1685] finished
0709 13:18:32.021043 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.021202 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1981,"prepare.queue_time_us":43537,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2570,"raft.queue_time_us":9983,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":9610,"spinlock_wait_cycles":203527552,"thread_start_us":572234,"threads_started":2,"wal-append.queue_time_us":1262285}
I20260709 13:18:32.054816  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:32.057960  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.026063 12251 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:32.063191  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.064478  5518 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:32.066920  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 523) took 1039 ms. Trace:
I20260709 13:18:32.025704 12233 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:32.043663 11728 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:18:32.059988 12072 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:32.067731  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:32.074801  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:32.073033  5449 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:32.071735  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:32.043380 12209 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:32.025089 12230 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.054708 12115 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:32.043509 12099 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:31.977993 12126 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.071774 12251 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.084187  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:32.059585  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.067521  5441 rpcz_store.cc:276] 0709 13:18:31.027971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.163707 (+135736us) service_pool.cc:224] Handling call
0709 13:18:31.164227 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.189078 (+ 24851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.189129 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.192011 (+  2882us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.515563 (+323552us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:31.515612 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.515678 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.023997 (+508319us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:32.061441 (+ 37444us) raft_consensus.cc:1685] finished
0709 13:18:32.061465 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.066822 (+  5357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9065,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":12146048,"thread_start_us":323001,"threads_started":1,"wal-append.queue_time_us":513530}
I20260709 13:18:32.080885 12072 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:32.104143  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.104741  5441 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:31.987712 12178 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.077291 12118 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:32.089475  5448 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:32.096830  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:32.077055 12094 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:32.082690 12152 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:32.115072  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.116103  5448 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:32.119979  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.094674 12090 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:32.141860  5441 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:32.125406 11828 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:32.126062 12094 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:32.126909 12251 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.126636 12244 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.134754 12233 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.105633 12209 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.137312 12126 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.138947 12098 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.095024  5444 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:32.123651 12178 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.145653  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.109869 12099 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:32.109380 12118 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:32.118927 12230 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:32.120982 12167 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:32.105414 11946 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:18:32.117962 12152 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:32.160075  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.104562 12113 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:18:32.163412  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 84916.7us
W20260709 13:18:32.164132  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.169529  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 525) took 1016 ms. Trace:
W20260709 13:18:32.171705  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57795.6us
W20260709 13:18:32.169713 12206 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.007s
I20260709 13:18:32.187103  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:32.200325  5524 rpcz_store.cc:276] 0709 13:18:31.153066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.154259 (+  1193us) service_pool.cc:224] Handling call
0709 13:18:31.154598 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.840822 (+686224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.169190 (+328368us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540025c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:32.169458 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573728128}
I20260709 13:18:32.189275  5517 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:32.167030 11828 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.193871  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 109793us
I20260709 13:18:31.869088  5370 rpcz_store.cc:276] 0709 13:18:30.840157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.093027 (+252870us) service_pool.cc:224] Handling call
0709 13:18:31.093407 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.218976 (+125569us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:31.574734 (+355758us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.865617 (+290883us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.865673 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:31.865718 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.865795 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.865922 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55965,"prepare.queue_time_us":96327,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":2275,"thread_start_us":546469,"threads_started":2}
I20260709 13:18:32.161943 12090 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:18:32.211297  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:32.192639 12230 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.194550 12167 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.233034 12167 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:32.216173  5515 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:32.208516 11828 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.238000  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.217979  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.240331  5442 raft_consensus.cc:2368] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21.
I20260709 13:18:32.233340  5522 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:32.241852  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:32.242266  5442 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:18:32.242559  5520 raft_consensus.cc:2376] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25. Re-sending same reply.
I20260709 13:18:32.243186 12118 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.244628 12118 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.236295  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.245085  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:32.245639  5441 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 18: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:32.247032 12209 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.199542 12152 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:32.247561 12206 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:32.248258 12206 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.250810 12206 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.219269  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.255630 12072 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:32.256855  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:32.257545 12136 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.222911 12148 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:32.224462  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:32.229676 12226 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.263012 12148 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.263585 12148 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.268738  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.193099 12099 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.283372  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:32.283812  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59607.1us
I20260709 13:18:32.290275  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.297050  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.268950 12230 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:32.309499  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:32.326912  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:32.328640 12256 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:18:32.281001 12072 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:18:32.333876 12072 consensus_queue.cc:1243] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 22.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:32.334463 12072 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:32.334824 12072 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:32.336086 12072 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:32.337334  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.341688  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.328899  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:32.343981 12167 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.311960 12136 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:32.345914  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.278048 12226 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:18:32.306775 11804 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:18:32.283403 11888 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:18:32.360133 12099 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:32.295883 11755 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:32.367208  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 69035.6us
I20260709 13:18:32.370913 12232 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:32.371560 12232 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:32.372632  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:32.430092  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.373227 11820 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:18:32.376044  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:32.433709  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 57751.5us
I20260709 13:18:32.439443  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:32.447068  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.454206  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.455173  5441 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:32.458634  5448 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:32.459216  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 148584us
I20260709 13:18:32.460556  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:32.464569  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:32.468330  5489 leader_election.cc:400] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21.
I20260709 13:18:32.458487 12261 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:32.458987 12115 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.437175 12231 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:32.484719  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.433635 12099 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.438009 12094 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:32.467864 12090 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.465838 12072 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:32.494643  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:32.474651 12178 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:32.506244  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.467577 12251 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:32.498641 12099 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.513190 12099 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:32.497260 12249 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:32.515172  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.515942  5449 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:32.474510 12092 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
W20260709 13:18:32.533562  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.491047 12231 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.468832 11828 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.490242 12261 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:32.476148 12152 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.548048  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:32.560333  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.514077 12099 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:32.509068 12178 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.514680 12126 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.492973 12263 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:18:32.491740 12115 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:32.546126 12231 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:32.504052 12094 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:32.581632  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111870us
I20260709 13:18:32.517926  5370 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:32.508548 12090 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.569254 12178 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.534688 12148 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.617888  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.621390  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:32.627496  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.628202  5448 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:32.621254 12253 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:18:32.629504 11946 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:32.629916 11946 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:32.630831 11946 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:32.636340 12224 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.925s	user 0.003s	sys 0.000s
I20260709 13:18:32.632797  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.636919  5449 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.642323  5448 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:32.644169  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.645645  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:32.647691  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 99730.3us
I20260709 13:18:32.651037 12087 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:32.651238  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:32.652451  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.645470 12249 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:32.644162  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.656549  5449 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:32.577324 12126 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.569219 12099 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.606747 12167 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:32.669039  5366 raft_consensus.cc:1275] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:32.652455 12087 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.708135 12087 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.710830 12087 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.711670  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:32.715719  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.715893 12094 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:32.717965 12269 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:18:32.660629 12092 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:32.717221  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.721716 12092 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:32.722225 12092 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:32.722654  5519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:32.723518  5519 raft_consensus.cc:606] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:32.723687  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.723944  5519 raft_consensus.cc:614] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:32.727057  5521 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:32.729286  5521 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 13:18:32.726560  5519 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:32.665061  5449 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:18:32.614214 11820 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:32.704772  5374 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
W20260709 13:18:32.733309  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.733774  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:32.734431  5374 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:32.727842  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:32.736294  5522 raft_consensus.cc:606] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:32.736786  5522 raft_consensus.cc:614] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:32.666265 12209 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:32.751236 12249 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.672958 12261 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:32.753147 12216 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.181s	user 0.006s	sys 0.000s
I20260709 13:18:32.756888  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:32.757485 12082 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:32.759761 11946 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:32.764273 12115 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:32.660323 12232 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:32.734683 11936 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:32.767346 12126 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.767568  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3201) took 1120 ms. Trace:
I20260709 13:18:32.767729 11936 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.768124  5447 rpcz_store.cc:276] 0709 13:18:31.648461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.648608 (+   147us) service_pool.cc:224] Handling call
0709 13:18:31.989656 (+341048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.007467 (+ 17811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.767322 (+759855us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540029d6d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:32.767499 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783303552}
I20260709 13:18:32.771253 12090 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:32.771459  5447 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:18:32.771930 11820 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:32.771979 12232 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.774356 12232 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.775986 12210 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.776206 12148 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.776645 12232 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.778270 11828 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:32.781204 12248 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.907s	user 0.003s	sys 0.000s
I20260709 13:18:32.782792  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3338) took 1489 ms. Trace:
I20260709 13:18:32.783403 12152 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.784168  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.784852  5375 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:32.786484 12080 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:32.786954 12080 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:32.724936 12230 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:32.787798  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.788371 12231 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.789692 12230 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.783203  5372 rpcz_store.cc:276] 0709 13:18:31.293295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.293754 (+   459us) service_pool.cc:224] Handling call
0709 13:18:31.294172 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.392805 (+ 98633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.392849 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.421044 (+ 28195us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.867117 (+446073us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:31.867158 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.867228 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.780577 (+913349us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:32.782508 (+  1931us) raft_consensus.cc:1685] finished
0709 13:18:32.782531 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.782731 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36180,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":42800384,"thread_start_us":501789,"threads_started":2,"wal-append.queue_time_us":427368}
W20260709 13:18:32.791743  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.792905  5366 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:32.789872  5370 raft_consensus.cc:2368] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:32.801599  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:32.802994  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.803185  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:32.804221  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.807977  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.812541  5371 raft_consensus.cc:1240] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 13:18:32.821167  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.822046  5366 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:32.817202  5374 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
W20260709 13:18:32.781279 12118 consensus_meta.cc:287] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.002s
I20260709 13:18:32.832058  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:32.835556  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.836314  5517 raft_consensus.cc:2410] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:18:32.837236  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.819764  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:32.840133  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.815141 12132 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.842113  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.738013 12226 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:32.848636  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:32.851444  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:32.840206  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:32.852514  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:32.846671 12152 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:32.855913  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.835039 12263 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:32.836217 12178 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.847074 12206 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:32.851190 12132 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.841328 11728 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:32.841028 12210 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:32.888505 12226 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:32.833521 12130 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:32.917593  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 110874us
I20260709 13:18:32.889323  5447 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.895093  5370 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23. Ops: []
W20260709 13:18:32.939988  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 77664.5us
I20260709 13:18:32.940955  5370 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:32.912900  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.942185  5370 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:32.904388  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:32.942406  5443 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:32.892321 12152 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:32.932660 12231 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.891191 11828 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:32.933703  5441 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:18:32.902241  5368 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:32.923820  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.895779  5375 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:32.943538  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.946976  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:32.950352  5416 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:32.892699 12212 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.956197  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.953636  5368 raft_consensus.cc:1217] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Deduplicated request from leader. Original: 19.12->[20.13-20.13]   Dedup: 20.13->[]
I20260709 13:18:32.958518  5368 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:18:32.954808  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:32.956871  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.953218  5375 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:32.961943  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.893314 11936 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:32.902824 12099 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:32.957832  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:32.981617  5444 raft_consensus.cc:2410] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:18:32.983697  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:32.962700  5523 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:32.985360  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:32.968771  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.925292 12118 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:32.925637 12167 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:32.896178 12092 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.956975 12251 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:18:32.937821 12136 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:32.947096 12230 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:32.935024 12253 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.003170 12132 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.003484 12253 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.989360 12209 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:32.988127 12094 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.012867  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.966904 12072 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:32.978372 12212 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.978452 11828 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:32.947481 12152 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.980706 12226 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:32.986541  5443 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 16: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:32.983007  5447 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:32.981359  5522 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:32.988373  5521 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:32.967656  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:32.988256  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.031304  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:33.033023  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:32.992487  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:32.997016  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:32.999455 12279 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:33.002735 12136 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:32.946877 12130 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.055984  5449 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
W20260709 13:18:33.036398  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 68827.7us
I20260709 13:18:33.043761  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:33.046360  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.058300  5445 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:33.047945  5447 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:33.055480  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.057449  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.017009 12072 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:33.067844  5523 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 25 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:18:33.077348  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:32.992223 12118 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:32.993716 12167 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.080888  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.093691  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.046952 12132 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:33.059298 11728 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:33.111972  5372 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:33.045504 12209 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:33.045965 12251 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:33.078514 12206 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:33.139197  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 181390us
I20260709 13:18:33.067109 12279 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:33.089794 12072 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.088971 11936 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:33.092064 12087 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.129460 12210 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.139328 12289 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.092459 12094 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:33.098759 12178 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.133586 12132 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.158463 11728 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:33.111919 12261 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:33.174886 12268 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.847s	user 0.007s	sys 0.000s
I20260709 13:18:33.092773 12226 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:18:33.140271 12182 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:33.144908 12209 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:33.170511 12136 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.187805 12167 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.163103 11820 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:33.206813  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.145367 12249 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.190671  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:33.211608  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.160694 11936 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.163391 12253 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.162165 12115 consensus_queue.cc:1048] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:33.189982 12285 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.140949 12259 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:18:33.213362  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:33.191730 12132 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:33.176065 12082 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:18:33.220252  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.207904 12261 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:33.143040 11828 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.200390 12182 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.180662 12210 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.256047 12210 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.261516  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.264043  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:33.264834  5450 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.199851 12209 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:33.270005 12212 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.271322  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.272080  5521 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:33.273573  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.198606 12087 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:33.208014 12113 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:33.274513 12087 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.274886 12113 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:33.275604 12294 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:18:33.242458  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.210821 12244 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.212849 12167 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:33.278277 12279 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.279078 12167 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.279897 12261 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.217197 12249 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.229907 11936 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.250488 11728 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.252269 12118 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.238555 12285 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.273612  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:33.183539 12289 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.249040 12130 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.190181 12094 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:33.281566  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:33.283957  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.295249  5444 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.290452  5441 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:33.282861 12182 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.281363 12167 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.299237  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.287585 12212 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:33.290246 12253 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:33.311403  5490 leader_election.cc:400] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:33.311616  5448 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:33.311842  5490 leader_election.cc:403] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.294490 12082 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:33.314227  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:33.317368  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:33.313117 12087 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.300559 12118 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:33.331192 12118 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.320498 12226 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:33.313128 12253 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:33.329492 12130 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.334435 12130 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.334736 12253 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.336370 12118 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.336794 12130 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.329753 12249 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.337452 12226 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.338693 12289 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.340176  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.341042  5368 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:33.342753  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.344633  5450 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:33.345464  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:33.347870  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.348512 12289 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:33.349856 12113 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:33.354103  5371 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:33.349941 12226 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:33.305943 12212 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.354948  5441 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:33.355434  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.356420  5444 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:33.357978  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:33.367318  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 57230.6us
I20260709 13:18:33.360008  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.363511  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.372493  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.373315  5371 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:33.380290  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.381551  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.383374  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.311313 12072 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.394493  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:33.394881  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:33.395428  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.380677  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.381225  5373 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:33.370988 12212 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:33.414444  5367 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23. Ops: [18.10-22.12]
I20260709 13:18:33.402477  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.405133  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.415311  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.376034 12167 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:18:33.430199  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3350) took 1035 ms. Trace:
I20260709 13:18:33.422099  5371 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:33.413590 12072 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.442193 12182 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.444877 12182 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.445600 12285 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.446271 12244 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.446877 12244 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.448963 12244 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.431398  5367 rpcz_store.cc:276] 0709 13:18:32.394807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.395900 (+  1093us) service_pool.cc:224] Handling call
0709 13:18:33.413811 (+1017911us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:33.414029 (+   218us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:33.429754 (+ 15725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.430116 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13525760}
I20260709 13:18:33.451483 11936 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.452219 12113 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.453616 11946 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.454345  5518 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:18:33.452809 12113 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:33.456444 12303 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:33.457850 12113 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:33.458779  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 78228.7us
I20260709 13:18:33.461493 11946 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:33.462752 11946 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:33.463526 11946 consensus_queue.cc:1243] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:33.464061 11946 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:33.464908 11946 consensus_queue.cc:1059] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:33.465647 12288 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:33.469013 12288 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:33.470261 12288 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.472098 12288 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.466215 12285 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:33.473675 12285 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:33.474525 12285 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.476198 12285 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.477782  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.478339  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.480052  5515 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:33.481712 11946 raft_consensus.cc:3055] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:33.482228 11946 raft_consensus.cc:740] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:33.467538  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.481191  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.473281  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.488741  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.493160  5444 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:18:33.490381  5518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:33.494072  5518 raft_consensus.cc:606] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.491346  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.491586  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.399691 12082 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:33.492532  5516 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:33.484450 12251 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:33.510293  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.511078  5516 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:33.506680  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.508057  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.512151  5521 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:33.515367  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.493000 12122 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:33.546561  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:33.519703  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.426940 12230 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:18:33.525002  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:33.527137  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.527711  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.532938  5371 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:33.484723 12209 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.506165 12182 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:33.537009  5515 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:33.549649  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.552078  5516 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:33.555197  5441 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:33.552951 12249 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:33.496168 12132 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.589458  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.594419  5516 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:18:33.520572 12251 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:33.619390  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 2794) took 1132 ms. Trace:
I20260709 13:18:33.619900  5442 rpcz_store.cc:276] 0709 13:18:32.486888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.518679 (+ 31791us) service_pool.cc:224] Handling call
0709 13:18:33.619088 (+1100409us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54003bd654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:33.619291 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343346048}
I20260709 13:18:33.621433  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.622068  5442 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:33.507555 11946 consensus_queue.cc:260] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.626672 11946 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:33.627760 12152 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 13:18:33.628340 12152 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.592687 12122 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:33.630312  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.630683 12122 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.632820  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.633517  5515 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.634474 12167 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:33.634622  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.510362 12082 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.637192 12082 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.638499  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38156 (request call id 565) took 1270 ms. Trace:
I20260709 13:18:33.638967  5369 rpcz_store.cc:276] 0709 13:18:32.368322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.373891 (+  5569us) service_pool.cc:224] Handling call
0709 13:18:33.112849 (+738958us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b5800003698. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:33.113124 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.113627 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.113674 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.132467 (+ 18793us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.374454 (+241987us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:33.374671 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.383413 (+  8742us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.638195 (+254782us) raft_consensus.cc:1685] finished
0709 13:18:33.638220 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.638436 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":685,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":9801,"spinlock_wait_cycles":12896512,"thread_start_us":204323,"threads_started":1,"wal-append.queue_time_us":407264}
I20260709 13:18:33.638495  5520 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:33.532666 12226 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:33.644677  5447 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:18:33.644766 12226 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:33.605059  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:33.606710  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.646204  5516 raft_consensus.cc:606] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.646488  5446 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 11.
I20260709 13:18:33.646678  5516 raft_consensus.cc:614] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.607498 12311 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.607841 12080 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.609549 12182 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:33.643851 12132 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.612748 12251 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.649945 12249 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.553406 12244 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.654739  5367 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:33.556854 12072 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:33.656522  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.657742  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.667927  5516 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.668051  5524 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
W20260709 13:18:33.649330 12248 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:18:33.673218  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:33.659782  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 131530us
W20260709 13:18:33.596223  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46715.2us
I20260709 13:18:33.661406  5521 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:33.694783  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.695914  5515 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:33.696882  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.662158  5441 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:33.647694 12092 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:33.670349 12094 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:33.661456 12099 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.693239  5516 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:33.731515  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.697641  5515 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:33.734001  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.672850 12080 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:33.717396  5521 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:33.671806 12072 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.774344 11936 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.725574  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.775082 12072 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.775959  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:33.697798 12263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.027s	sys 0.025s
W20260709 13:18:33.777621 12263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.027s	sys 0.026s
I20260709 13:18:33.777948 12263 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:33.738574 12118 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.778896 12263 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.734674  5444 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:33.733055  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.782287  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:33.736518  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.783221  5515 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.786067  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.787276 12261 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:33.788333 12261 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:33.750195  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.793972  5521 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:33.777297  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:33.795011  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.795131  5519 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:33.795619  5521 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.796336  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.798600  5339 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.691393  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:33.753341 12308 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:33.762570 12226 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:33.766458 12249 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.723832 12306 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:33.767699 12152 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.803396 11936 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:18:33.806933 11828 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:33.733106 12182 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.769179 12212 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.749269 12209 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.804270  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.805491  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:33.806172  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.806701  5515 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:33.789011 12261 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:33.809373 12231 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:33.810352 12306 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.738384 12310 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:33.806097  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 58409us
I20260709 13:18:33.833545  5519 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.835685 12094 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:33.835795  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 144479us
W20260709 13:18:33.842176  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.851665  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.828763 12249 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.843760  5515 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:18:33.848676  5524 raft_consensus.cc:2410] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 22 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
W20260709 13:18:33.899541  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48095.9us
I20260709 13:18:33.850410  5521 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:33.860069  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:33.902850  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:33.905035  5521 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 11. (term mismatch)
I20260709 13:18:33.905464  5521 pending_rounds.cc:85] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 10
I20260709 13:18:33.905750  5521 pending_rounds.cc:107] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:18:33.906045  5521 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:33.906515  5521 pending_rounds.cc:107] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:18:33.906813  5521 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:33.908079  5519 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:33.901037  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:33.838450 12261 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:33.912040  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:33.910820  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 63633.3us
I20260709 13:18:33.831319 12244 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:33.858527 11828 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.930150  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:33.931591  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.932487  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:33.912009  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.933943  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.846164 12113 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:33.936048  5366 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:33.933668 12120 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:33.933883 12231 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.930624  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.940181  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:33.947492  5522 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
W20260709 13:18:33.940799  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.957690  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:33.961673 12092 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.962715 12261 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.939385 12244 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:33.952299 12285 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:33.932209 12311 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:33.946645 12288 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:33.926497 12317 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:33.896579 12230 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:18:33.858503 12310 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.896116 12152 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:18:33.946946 12099 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:33.997845  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:33.991667  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2804) took 1180 ms. Trace:
I20260709 13:18:33.995787  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:34.024024  5450 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:34.023119  5445 rpcz_store.cc:276] 0709 13:18:32.810945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.059029 (+248084us) service_pool.cc:224] Handling call
0709 13:18:33.112194 (+ 53165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.293971 (+181777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.294005 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.311788 (+ 17783us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.665771 (+353983us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:33.665835 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.665937 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.991440 (+325503us) raft_consensus.cc:1685] finished
0709 13:18:33.991461 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.991605 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1627,"raft.queue_time_us":44029,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":13689,"thread_start_us":465978,"threads_started":2,"wal-append.queue_time_us":480139}
W20260709 13:18:34.005154 12321 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:33.925038 12249 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:33.997450  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:33.994939 12212 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.032270  5448 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:34.032886  5450 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:34.036286  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:33.984889 12298 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.009057 12253 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.006709 12244 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:33.981838 12311 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.037533  5445 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:34.049068  5521 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:34.082407  5521 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:34.083575  5448 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:34.084896  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:33.997743 12261 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.064318  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 538) took 1115 ms. Trace:
I20260709 13:18:34.021579 12288 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.976811 11728 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:34.004804 12306 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:33.981564 12285 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:33.976326 12097 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:18:34.087915  5448 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:34.002859 12113 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:34.094776  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2805) took 1283 ms. Trace:
I20260709 13:18:34.122238  5447 rpcz_store.cc:276] 0709 13:18:32.811360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.059663 (+248303us) service_pool.cc:224] Handling call
0709 13:18:33.059987 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.645293 (+585306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.094428 (+449135us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54002adad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:34.094690 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344031616}
I20260709 13:18:33.986547 12092 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.121482  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:34.093883 12321 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:34.028724 12099 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.091831 12288 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.154042  5450 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:34.152019 12122 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:34.180327 12122 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.183347 12122 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.090631 12311 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.121826 12285 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:34.131549 12113 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.135998 12080 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:18:34.200173  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 78771.7us
I20260709 13:18:34.130584 11728 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.209052  5450 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:34.221436 12120 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:34.302248 12329 log.cc:927] Time spent T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:18:34.212589  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 272487us
I20260709 13:18:34.306319 12080 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:34.225502  5445 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:34.191169 12230 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:34.311069 12230 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:34.201656  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 287821us
W20260709 13:18:34.202579  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 248786us
I20260709 13:18:34.307772 12120 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.307884  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:34.316872 12080 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.305317  5448 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:34.287781  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2819) took 1214 ms. Trace:
W20260709 13:18:34.358002  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50198.7us
I20260709 13:18:34.328289  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:34.329128  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.329190 12310 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.330287 12249 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.254065 12087 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:34.303643 12099 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.326395  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:34.353271  5444 raft_consensus.cc:2410] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:18:34.358880  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:34.358263  5442 rpcz_store.cc:276] 0709 13:18:33.073637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.648940 (+575303us) service_pool.cc:224] Handling call
0709 13:18:33.651137 (+  2197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.651635 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:18:33.843253 (+191618us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.285591 (+442338us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.285908 (+   317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.285979 (+    71us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:34.287289 (+  1310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.287419 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.287593 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273170,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":195,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":55894,"spinlock_wait_cycles":43170560,"thread_start_us":631306,"threads_started":2}
I20260709 13:18:34.212204 12289 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:34.367400  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:34.375618  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49303.1us
I20260709 13:18:34.377758  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:34.374815  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:34.382611 12341 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:34.374157 12289 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.383833 12289 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:34.398865 12314 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.446s	user 0.000s	sys 0.004s
I20260709 13:18:34.401762 12092 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.402611 12249 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:34.403079 12249 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.403427 12249 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.403945 12080 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.404625 12289 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.407125 12289 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.407878 12289 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:34.408298 12289 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.408649 12289 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.409641 12212 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:34.410408 12212 consensus_queue.cc:1243] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 24.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:18:34.410876 12212 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:34.411176 12212 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:34.411947 12288 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:34.413286 12325 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.416s	user 0.000s	sys 0.005s
W20260709 13:18:34.414440  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86256.7us
W20260709 13:18:34.416198  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48896us
I20260709 13:18:34.421622  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:34.422075  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44471.8us
I20260709 13:18:34.424010  5445 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:34.374782 12087 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:34.425803  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.388792 12113 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.432312  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:34.408046 12310 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:34.442936  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:34.420239 12341 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:34.443818  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:34.420172 12209 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:34.424630 11936 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:34.448714  5450 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:34.466547  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.437011 12090 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:34.433984 12122 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:34.473541  5522 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:34.502251  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:34.474421  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:34.498303  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:34.475687  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:34.498337  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:34.478215  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56287.3us
I20260709 13:18:34.503669  5521 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:34.502140  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:34.505028  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:34.505863  5521 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:34.476452  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:34.432803 12182 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:34.436070 12345 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.472349  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:34.469758 12310 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:34.514179  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2638) took 1254 ms. Trace:
I20260709 13:18:34.411989 12212 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.514612  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:34.516316  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:34.524500  5523 raft_consensus.cc:2368] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:34.521163  5517 rpcz_store.cc:276] 0709 13:18:33.259729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.260582 (+   853us) service_pool.cc:224] Handling call
0709 13:18:33.260938 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.593652 (+332714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.593683 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.594186 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.840493 (+246307us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:33.840529 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.840690 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.412694 (+572004us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:34.479264 (+ 66570us) raft_consensus.cc:1685] finished
0709 13:18:34.479288 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.514116 (+ 34828us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27429,"raft.queue_time_us":34027,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8131,"spinlock_wait_cycles":66014464,"thread_start_us":533425,"threads_started":2,"wal-append.queue_time_us":385787}
I20260709 13:18:34.536126  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:34.538235  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:34.511021 12332 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.316s	user 0.002s	sys 0.000s
I20260709 13:18:34.492038 12118 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.544107  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:34.551733  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:34.551884 12099 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.547284 12136 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:34.552536 12136 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:34.552573 12099 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.494247 12092 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:34.553970 12092 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.556046 12092 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.500983 12090 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.498574 11936 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.556382 12099 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.556926 11936 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:34.557627  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.549875  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:34.545449  5517 raft_consensus.cc:2393] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:34.553565 12136 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.561800  5521 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:34.556641 12090 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:34.494303 12279 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:34.498510 12209 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.518249 12259 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:34.531826 12310 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:34.568714 12259 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:34.572350 12348 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:34.516573 12122 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:34.573246 12339 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:18:34.594913 12354 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:34.597354 12343 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:18:34.597738 12353 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:34.572232 12327 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.582s	user 0.002s	sys 0.000s
I20260709 13:18:34.576759  5269 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 21, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 21 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:34.592360  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2823) took 1505 ms. Trace:
I20260709 13:18:34.594374 12122 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.599874  5448 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:34.595590 12354 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:34.589891 12346 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:34.611476  5449 rpcz_store.cc:276] 0709 13:18:33.086770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.695971 (+609201us) service_pool.cc:224] Handling call
0709 13:18:33.731470 (+ 35499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.740197 (+  8727us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:34.049811 (+309614us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.258701 (+208890us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.258978 (+   277us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:34.278843 (+ 19865us) log.cc:844] Serialized 52 byte log entry
0709 13:18:34.279087 (+   244us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:34.279144 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.279278 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.592068 (+312790us) raft_consensus.cc:1685] finished
0709 13:18:34.592098 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.592289 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2936,"prepare.queue_time_us":225144,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":8947,"raft.queue_time_us":15534,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":14091,"spinlock_wait_cycles":3409920,"thread_start_us":387019,"threads_started":2,"wal-append.queue_time_us":345239}
I20260709 13:18:34.518524 12182 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:34.638430  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:34.651858  5523 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:34.569463 12212 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:34.653517  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:34.599452 12259 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:34.665848 12230 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.667068 12209 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:34.670009 12338 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:18:34.534407 12345 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.598505 12353 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.519840 12087 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.683789  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2825) took 1571 ms. Trace:
I20260709 13:18:34.691164  5446 rpcz_store.cc:276] 0709 13:18:33.112813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.777220 (+664407us) service_pool.cc:224] Handling call
0709 13:18:33.777597 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.778009 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:34.231276 (+453267us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.512514 (+281238us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:34.531953 (+ 19439us) log.cc:844] Serialized 52 byte log entry
0709 13:18:34.539018 (+  7065us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:34.539736 (+   718us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.683369 (+143633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.683465 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.683505 (+    40us) raft_consensus.cc:1685] finished
0709 13:18:34.683522 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.683726 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15877,"prepare.queue_time_us":186006,"prepare.run_cpu_time_us":310,"prepare.run_wall_time_us":14147,"raft.queue_time_us":207769,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":6379,"thread_start_us":750430,"threads_started":4,"wal-append.queue_time_us":226444}
I20260709 13:18:34.609938 12340 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 13:18:34.637216 12288 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:34.636533 12253 consensus_meta.cc:287] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:18:34.653517  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:34.684116  5449 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:34.651011  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:34.686131 12072 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:34.637362 12341 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.649538 12355 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:34.566721 12118 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.658524 11728 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.644263  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3131) took 1033 ms. Trace:
W20260709 13:18:34.708317  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 188361us
I20260709 13:18:34.723856  5515 rpcz_store.cc:276] 0709 13:18:33.610871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.900360 (+289489us) service_pool.cc:224] Handling call
0709 13:18:33.979247 (+ 78887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.203049 (+223802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.203080 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.203122 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:34.203163 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.644027 (+440864us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540016bcd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:34.644074 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.644198 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514225920}
W20260709 13:18:34.709100  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.574306 12279 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:34.714808  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 61400.9us
I20260709 13:18:34.694335 12230 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:34.637032 12152 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:18:34.717242 12333 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.352s	user 0.001s	sys 0.001s
I20260709 13:18:34.750707  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:34.752804  5340 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:34.755218  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:34.716854 12288 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:34.775556  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:34.766355  5518 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:34.777563  5516 raft_consensus.cc:606] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:34.778060  5516 raft_consensus.cc:614] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:34.769173  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 222780us
I20260709 13:18:34.789394  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:34.747443 12230 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:34.753726 12152 consensus_queue.cc:1243] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:34.777539 12097 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:34.762068 12355 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:34.778728 12344 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:34.784070 12356 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:34.775712 12340 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:34.817565 12363 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:34.818688 12350 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:18:34.775496 12259 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.822660 12363 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.823398 12259 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.824692 12259 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:34.827332 12363 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.829617 12356 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:34.830745 12356 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.837849 12118 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.842134 12182 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.845781 12355 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.852056 12353 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.853341 12354 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.855608 12152 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:34.856254 12152 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.784933 12360 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:34.858306 12360 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:34.858491 12279 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.858692 12360 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:34.859552 12230 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.861383 12230 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:34.863628 12311 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.000s
I20260709 13:18:34.864032 12311 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.865044  5519 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:34.859551 12360 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.866518 12360 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:34.868520 12261 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.003s
I20260709 13:18:34.873628 12251 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:34.875859 11936 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.878168 11936 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.802505 12359 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.875864 12136 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.880030 12345 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.866778 12310 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.825287 12259 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:34.883348 12285 consensus_meta.cc:287] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
W20260709 13:18:34.893594  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.873155 12249 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.848150 12090 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.889722 12289 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:34.914718 12324 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.927s	user 0.010s	sys 0.008s
I20260709 13:18:34.915138 12289 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.916146  5445 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:34.918552 12345 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.919209 12345 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.917956 12080 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:34.929493 12152 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:34.931406 12310 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.929589  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 3122) took 1449 ms. Trace:
I20260709 13:18:34.889961 12285 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.933995  5518 rpcz_store.cc:276] 0709 13:18:33.480082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.518643 (+ 38561us) service_pool.cc:224] Handling call
0709 13:18:34.929359 (+1410716us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400369054. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:34.929497 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692497152}
I20260709 13:18:34.946641  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:34.948740  5448 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:18:34.949059  5520 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:34.950618  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:34.951798  5445 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:34.954180  5522 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:34.956121  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 156318us
I20260709 13:18:34.957005  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:34.957615  5445 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.958391  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:34.960348  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 172763us
I20260709 13:18:34.943724 12345 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.965994  5414 leader_election.cc:400] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:34.966348  5414 leader_election.cc:403] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.969388  5445 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:34.946880 12365 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.946918 12289 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:34.954380 12152 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.953729 11728 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.971494  5522 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:34.941926 12080 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.971550  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:34.975929  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:34.959653 12363 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:34.981577 12340 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:34.985674  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:34.986271  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:34.986878  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:34.987577  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:34.991024  5371 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:34.989441  5372 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:34.993572  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:34.994254  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:34.994318  5372 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:34.995888  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:34.996847  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:34.998734  5373 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:34.998682  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:34.988371 11728 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:35.002008 12312 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 1.005s	user 0.004s	sys 0.009s
I20260709 13:18:34.945626 12259 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.003806 11728 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.004433 11728 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:35.004910 11728 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:34.976472 12364 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.005790 12364 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.963050 12231 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:18:35.008119 12364 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.008765 12364 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:34.964619 12359 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:34.983565 12152 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.972298 12353 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.011198 12249 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.011580 12152 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.012226  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:35.012733 12363 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.013712  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.014247 12090 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.014341  5374 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:34.970606 12354 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.014984 12363 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.015403  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.015995  5374 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:35.016826  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.018469  5367 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.015102 12354 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.020151  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.022471  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:35.028069  5372 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.972299 12209 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:35.023939  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:34.976576 12212 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:34.980181 12289 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:34.972122 12251 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:18:35.054179  5518 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:18:35.054576  5518 pending_rounds.cc:85] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 10
I20260709 13:18:35.054798  5518 pending_rounds.cc:107] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:18:35.055027  5518 raft_consensus.cc:2889] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.055379 12289 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.056016 12311 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:34.978127 12365 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.059302  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.047044 12285 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:35.049976  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78589.6us
I20260709 13:18:35.050364 11929 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:35.051451  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.062461  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.062889  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.064136  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.067132  5518 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:18:35.071017  5523 raft_consensus.cc:2393] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:35.071307  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:35.009244 12364 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:35.073196  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:34.989998 12356 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:18:35.074688  5448 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:35.082648  5367 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
W20260709 13:18:35.085827  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62022.2us
I20260709 13:18:35.087457  5371 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:35.099838  5369 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:18:35.101150 12364 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:35.102624  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.104027  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.105623  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:35.105356  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.083431 12345 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:35.057341 12209 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:35.085664 11946 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.103955  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.110683  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.110778  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:35.109472  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 133655us
I20260709 13:18:35.106222  5375 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:35.086519 12310 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:35.115832  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:35.090569 11929 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:35.122520  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:35.135001  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.083276 12285 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:18:35.142163  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.143635  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.145813  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.148875  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.151872  5515 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:35.158087  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.143165  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:35.160111  5515 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:35.165726  5368 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:35.161382  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.167083  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.167176  5373 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:35.168254  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.109709 12345 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.222929 12345 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:35.223150  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.226357 12353 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:35.227041 12353 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.227519 12353 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:35.170168  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.229909  5447 raft_consensus.cc:2368] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21.
I20260709 13:18:35.231182  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.162281  5518 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:35.233701  5269 catalog_manager.cc:5697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 21, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 21 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.235646  5269 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.170281  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:35.163313  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.239203  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.240752  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:35.087355 11728 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.172207  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.173002  5373 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:35.174032  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.243672  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.244714  5449 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:35.175577 12182 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:35.176054 11929 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:35.136166 11946 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.177585  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:35.162405 12364 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:35.185504 12261 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:35.185806 11820 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:35.190040 12357 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:35.191226 12212 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:35.194239  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:35.194845 12376 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:35.195305  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52208.8us
I20260709 13:18:35.207885  5372 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:35.278288  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.211331 12209 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:35.212093 12080 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.212903 12285 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:18:35.213534  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76967.5us
I20260709 13:18:35.215083 12354 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.215440 12118 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.306535 12118 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.308861 12118 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.218078 12279 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.309556 12279 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.311749 12279 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.216868 12097 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:35.215169  5490 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:35.222174 12365 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.245844  5515 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:35.247265  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:35.313691  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 98595.4us
I20260709 13:18:35.314216  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.314512  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:35.314992  5518 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:18:35.316215  5490 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:35.316843  5518 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
W20260709 13:18:35.247967  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.248720  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.319382 12285 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:35.320004  5520 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:35.320304 12285 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.321301  5520 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:35.321574 12285 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.322570  5520 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:35.324486 12356 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:35.324601  5520 raft_consensus.cc:1217] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Deduplicated request from leader. Original: 13.7->[14.8-23.11]   Dedup: 16.9->[21.10-23.11]
I20260709 13:18:35.325263 12355 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:35.325120 12356 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.325860 12355 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:35.327430 12356 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.250131  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:35.327845 12355 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:35.328325  5449 raft_consensus.cc:2393] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:35.329200  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:35.329792  5449 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:35.251489  5269 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.252933  5374 raft_consensus.cc:2368] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
W20260709 13:18:35.332127 12381 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:18:35.332757  5269 catalog_manager.cc:5697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 22, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 22 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.272310 12261 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:35.334283  5269 catalog_manager.cc:5697] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 17, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 17 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:35.325109  5520 pending_rounds.cc:85] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:18:35.335398  5520 pending_rounds.cc:107] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:18:35.335706 12261 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:35.336092 11820 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:35.335958  5269 catalog_manager.cc:5697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.259383 11936 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:35.336697 11820 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:35.337100 12376 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.259141  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.338812 11820 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:35.339452  5520 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.263808 12122 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.340636 12072 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.259171  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:35.248338 12182 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:35.378017 12182 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:35.161931 12289 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.381960 12289 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.384725 12289 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:35.280578  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86433.1us
I20260709 13:18:35.388840  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:35.286582  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51720 (request call id 104) took 1552 ms. Trace:
I20260709 13:18:34.087543  5443 rpcz_store.cc:276] 0709 13:18:32.948846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.450250 (+501404us) service_pool.cc:224] Handling call
0709 13:18:33.450515 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.450714 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:18:33.674208 (+223494us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.063457 (+389249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.063571 (+   114us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:34.063645 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.063764 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.063988 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58890,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":176,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2079,"thread_start_us":593882,"threads_started":2}
I20260709 13:18:35.293689 12345 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.398423  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:35.390466  5516 rpcz_store.cc:276] 0709 13:18:33.734501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.782160 (+ 47659us) service_pool.cc:224] Handling call
0709 13:18:35.286367 (+1504207us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400369054. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d86853 00007fc1d8d5460a 00007fc1d22da7d4 00007fc1d22da762 00007fc1d22da691 00007fc1d22da60c 00007fc1d22d98c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:35.286496 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2287481728}
I20260709 13:18:35.402117  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:35.247606  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:35.412191  5450 raft_consensus.cc:2368] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:35.413321  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:35.414018  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.331491  5518 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:18:35.253880  5270 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 158) took 57715 ms (client timeout 15000 ms). Trace:
I20260709 13:18:35.415097  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:35.300491  5375 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:35.340230 12122 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.158886 12310 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:35.267479  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:35.344661  5269 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 21, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 21 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.268713  5446 raft_consensus.cc:2368] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20.
I20260709 13:18:35.353547 12365 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.354136 11936 consensus_queue.cc:1059] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:35.356283 12354 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:35.356897 12209 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.357448 12363 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.429544  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:35.412544 12080 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:35.358865 11946 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.359150  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:35.269558 11929 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:35.271791 12364 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.372208  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.387823 11820 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:18:35.376478  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.281708 12379 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.391852  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.409938 11828 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:18:35.415701  5516 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.283146 12212 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.478681 12344 raft_consensus.cc:993] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:35.479657 12212 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.480569 12212 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:35.418172  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.416489  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:35.427600  5449 raft_consensus.cc:2410] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:18:35.481410 12379 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.482051  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:35.482658  5367 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.483676 12379 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.419097  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:35.428086  5523 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:35.433766 11936 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:35.484663  5447 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:35.434868  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.341187 12072 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.357987 12249 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:35.409300 12090 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:35.420048 12289 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:35.411463 12288 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:35.440019  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:35.283318 12306 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:35.418908 12311 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.420215 12261 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:18:35.454595 12364 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.454224 12310 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.455339  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:35.439779 12354 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.446923 12357 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:35.422519 12375 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:35.406822  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 90666.8us
I20260709 13:18:35.622773  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:35.415377  5270 rpcz_store.cc:269] 0709 13:17:37.538547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.561463 (+ 22916us) service_pool.cc:224] Handling call
0709 13:18:35.253773 (+57692310us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:28.321598 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:28.322357 (+   759us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:28.322413 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:18:28.322432 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:28.323091 (+   659us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:28.323181 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:28.323215 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:28.323707 (+   492us) tablet.cc:701] Row locks acquired
0709 13:18:28.323755 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:18:28.323944 (+   189us) write_op.cc:270] Start()
0709 13:18:28.324097 (+   153us) write_op.cc:276] Timestamp: P: 1783603108323871 usec, L: 0
0709 13:18:28.324137 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:18:28.339708 (+ 15571us) log.cc:844] Serialized 1307 byte log entry
0709 13:18:29.086815 (+747107us) op_driver.cc:464] REPLICATION: finished
0709 13:18:29.281083 (+194268us) write_op.cc:301] APPLY: starting
0709 13:18:29.295186 (+ 14103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:29.460745 (+165559us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:29.460869 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:29.560275 (+ 99406us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:29.560517 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:18:29.560577 (+    60us) write_op.cc:312] APPLY: finished
0709 13:18:29.560883 (+   306us) log.cc:844] Serialized 40 byte log entry
0709 13:18:29.561082 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:29.561187 (+   105us) write_op.cc:454] Released schema lock
0709 13:18:29.561250 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:29.597409 (+ 36159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:29.613496 (+ 16087us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1323772,"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":159545,"apply.run_cpu_time_us":8293,"apply.run_wall_time_us":308735,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":297868,"prepare.run_cpu_time_us":11683,"prepare.run_wall_time_us":130786,"raft.queue_time_us":176668,"raft.run_cpu_time_us":88759,"raft.run_wall_time_us":103678,"replication_time_us":762487,"spinlock_wait_cycles":32512,"thread_start_us":436355,"threads_started":4,"wal-append.queue_time_us":214464,"wal-append.run_cpu_time_us":33411,"wal-append.run_wall_time_us":2059083}]]}
I20260709 13:18:35.471993 11929 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:35.476233 12376 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.480463  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.512733 12289 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.485822  5371 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:35.485987  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.488647  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3259) took 1056 ms. Trace:
W20260709 13:18:35.489106  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 87260.5us
I20260709 13:18:35.496495  5367 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:35.501896  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:35.481153 12212 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:35.637331  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:35.636298  5441 rpcz_store.cc:276] 0709 13:18:34.432282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.432859 (+   577us) service_pool.cc:224] Handling call
0709 13:18:34.641493 (+208634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.641703 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:34.663627 (+ 21924us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.807472 (+143845us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.928481 (+121009us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b180032bea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f522 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:34.932508 (+  4027us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b180032bea0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:18:34.932694 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:34.932750 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:34.932802 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.932877 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.488454 (+555577us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540019d050. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:35.488576 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117620,"prepare.queue_time_us":24355,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":128144,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":10868,"spinlock_wait_cycles":487316992,"thread_start_us":142902,"threads_started":1,"wal-append.queue_time_us":260317}
I20260709 13:18:35.640298  5441 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:35.511587  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:35.544365  5516 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:35.642428  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.513455 12249 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:35.436232 12365 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.437644 12363 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.443145 12209 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.514966 12344 raft_consensus.cc:1081] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:35.629637  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:35.422554  5269 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 14 to 19, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 19 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.556564 11728 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.654522  5269 catalog_manager.cc:5697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.547015 12253 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:35.630909  5517 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
W20260709 13:18:35.504194  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 85160.3us
I20260709 13:18:35.643553  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.621287 12357 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:35.659489  5269 catalog_manager.cc:5697] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 23, leader changed from <none> to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 23 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:35.647755  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.652592  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:35.590732 12311 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.636760 12289 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:35.662169  5269 catalog_manager.cc:5697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.663821  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:35.657815  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.666667  5516 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:35.667574  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:35.660055  5489 leader_election.cc:400] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:35.668332  5489 leader_election.cc:403] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:18:35.659976  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:35.661074  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:35.664001  5269 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 17, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 17 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.671043  5442 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:35.671437  5269 catalog_manager.cc:5697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.674396  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:35.673755  5269 catalog_manager.cc:5697] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 12 to 21, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 21 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:18:35.677942  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 319341us
I20260709 13:18:35.679216  5269 catalog_manager.cc:5697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 21, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 21 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.650933 11929 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.687106  5269 catalog_manager.cc:5697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.659386 12253 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.665752 12357 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.695072  5269 catalog_manager.cc:5697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.698962  5269 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 16, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 16 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.665047 12389 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:35.700695  5269 catalog_manager.cc:5697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.677299 12358 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.677600 12306 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:35.695619  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:35.707583  5269 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 12 to 15, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 15 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.709408  5269 catalog_manager.cc:5697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 11, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 11 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:35.706602 12118 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:35.711838  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:35.714731  5269 catalog_manager.cc:5697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.686365 12090 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:35.687552 12345 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.693372 12253 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:35.716349  5442 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 12.
W20260709 13:18:35.711704 12386 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:18:35.699802 12376 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.684204 12379 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:18:35.666092 11728 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.707890 12364 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:35.708791 12344 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:35.705839 12389 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:35.713760 12118 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.712630 12306 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:35.753058  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.689998 11929 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.736791  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:35.722138 12122 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.728658  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:35.704032 12212 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:35.757826 12353 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.000s
W20260709 13:18:35.801461  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 140439us
I20260709 13:18:35.753079 12072 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.803400  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:35.806095  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 126352us
I20260709 13:18:35.753194 12394 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:35.768966 12118 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:35.769122 12306 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:35.769938 12389 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:35.748839 12376 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:35.828387  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 116608us
I20260709 13:18:35.813935  5414 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:35.776610 12345 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.844238  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.811018 12072 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:35.825845 12354 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.808384 12399 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:35.846745 12365 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:35.853194 12388 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
I20260709 13:18:35.858587 11929 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.949756 12118 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.952535 12118 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.847885 12345 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.959326 12405 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:35.959758 12345 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.960038 12405 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:35.962904 12405 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:35.968137 12289 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.882614 12249 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:35.846653 12379 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:35.971765 12113 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.973755 12376 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:35.975188 12182 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.001s
I20260709 13:18:35.975626 12182 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.980074  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.980870  5447 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:35.808439 12353 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:35.983951  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.985620  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.991704  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:35.994665 12398 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:18:35.992475  5447 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 11.
I20260709 13:18:35.996124  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:35.875540 12311 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:35.875193 12363 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:35.998960 12406 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:18:35.961349 12364 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:36.005247  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:36.005358  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 202056us
I20260709 13:18:36.005959  5448 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:36.006870  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.007431  5448 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
W20260709 13:18:36.009069 12393 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:18:35.998970  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.906519 12354 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:36.009274  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.014235 12391 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:36.028107  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.019102 12090 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:36.015137 12401 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.029770 12090 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:36.029984 12401 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.030194  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.030248  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:36.030925  5448 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:36.031512  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:36.026859 12289 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.013473  5441 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:36.032140 12401 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:36.014771  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.032965  5441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:18:36.034128  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.034798  5524 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:36.035627  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.036656  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.032060 12090 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:36.039196 12285 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.000s
I20260709 13:18:35.997596 11728 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.040336  5516 raft_consensus.cc:2410] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:36.041677 12353 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.025876 12311 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.042737 12311 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.043062  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.036674 12389 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.044751  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.045015 12311 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:36.045409  5516 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:36.057173 12182 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.087504 12357 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:36.012451 12209 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:35.879585 12072 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:36.091017 12396 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.244s	user 0.003s	sys 0.000s
I20260709 13:18:36.092908  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.093614  5446 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:36.094521  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.095064  5446 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:36.095906  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:35.985762 12399 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:36.098471 12399 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.091001 12072 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.104765 12306 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.122068  5447 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:36.122879  5441 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:36.123323  5441 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:36.077200 12253 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.124055  5448 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:36.048134 12389 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.082938  5524 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:36.084113 12087 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:36.045614 12354 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.053759  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.153394  5521 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:36.130354  5340 leader_election.cc:400] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21.
I20260709 13:18:36.156437  5340 leader_election.cc:403] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.160477  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:36.169322  5490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 1.621s (SENT) [suppressed 7 similar messages]
I20260709 13:18:36.170490  5524 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:36.170897  5517 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:36.148725 12118 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:36.164798  5441 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:36.196939  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:36.200263  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:36.201683  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3155) took 1060 ms. Trace:
I20260709 13:18:36.202069  5523 rpcz_store.cc:276] 0709 13:18:35.141508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.145487 (+  3979us) service_pool.cc:224] Handling call
0709 13:18:35.172263 (+ 26776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.485123 (+312860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.201380 (+716257us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540018f6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:36.201603 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587834112}
I20260709 13:18:36.205165  5523 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:18:36.206328  5444 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:36.211747  5340 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:36.336501 12090 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.372611 12285 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.373498 12285 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.171978 12152 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21.
W20260709 13:18:36.410735  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 199066us
W20260709 13:18:36.417032  5522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2651) took 1871 ms (client timeout 1690 ms). Trace:
I20260709 13:18:36.199070 12361 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:36.195629 12389 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:36.425355  5340 leader_election.cc:400] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20.
I20260709 13:18:36.425899  5340 leader_election.cc:403] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.427294  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3143) took 2752 ms. Trace:
I20260709 13:18:36.427778  5519 rpcz_store.cc:276] 0709 13:18:33.667096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.994798 (+327702us) service_pool.cc:224] Handling call
0709 13:18:33.995102 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:34.865410 (+870308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.419054 (+1553644us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b540016c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:36.419253 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000257792}
I20260709 13:18:36.208217 11936 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:36.209758 11929 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:36.417759  5522 rpcz_store.cc:269] 0709 13:18:34.546509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.546935 (+   426us) service_pool.cc:224] Handling call
0709 13:18:36.416833 (+1869898us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400369a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:36.416957 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906782976}
W20260709 13:18:36.439054  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 286599us
I20260709 13:18:36.199335 12118 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:36.419922 12072 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.466274 12118 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:36.423399 12340 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:36.479029 12357 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:36.429066 12209 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:36.432075 12080 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:36.442301 12231 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20.
I20260709 13:18:36.420164 12090 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.435603 12389 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.485875 12285 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:36.499958  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 178205us
W20260709 13:18:36.481760 12226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.300s	user 0.027s	sys 0.068s
W20260709 13:18:36.501760 12226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.027s	sys 0.068s
I20260709 13:18:36.483341 12072 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.489147 12209 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:36.522521  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 353237us
I20260709 13:18:36.511755 12306 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.535913  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3173) took 1366 ms. Trace:
I20260709 13:18:36.537838  5520 rpcz_store.cc:276] 0709 13:18:35.169486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.324062 (+154576us) service_pool.cc:224] Handling call
0709 13:18:35.324373 (+   311us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:18:35.404133 (+ 79760us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:35.656848 (+252715us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.007328 (+350480us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b180028b940. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a
0709 13:18:36.426416 (+419088us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.427624 (+  1208us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:36.428179 (+   555us) log.cc:844] Serialized 52 byte log entry
0709 13:18:36.429971 (+  1792us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:36.430027 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.432203 (+  2176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.535682 (+103479us) raft_consensus.cc:1685] finished
0709 13:18:36.535709 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.535847 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65101,"prepare.queue_time_us":312089,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3910,"raft.queue_time_us":79354,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":9629,"spinlock_wait_cycles":132760832,"thread_start_us":715938,"threads_started":3,"wal-append.queue_time_us":188690}
W20260709 13:18:36.543798  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.549093  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 103773us
I20260709 13:18:36.551623  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:36.544180 12253 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:36.575654  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.579154  5446 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:36.584843  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.554992 12354 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:36.603085  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 178272us
I20260709 13:18:36.603978  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:36.604885  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:36.608861  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58686.6us
I20260709 13:18:36.612730  5446 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:36.615468 12118 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.616086 12118 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.617745  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3182) took 1314 ms. Trace:
I20260709 13:18:36.618003 12279 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.618573 12279 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.618208  5516 rpcz_store.cc:276] 0709 13:18:35.303018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.089410 (+786392us) service_pool.cc:224] Handling call
0709 13:18:36.089820 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.090193 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.090225 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.090790 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.533594 (+442804us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:36.533696 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.533798 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.617501 (+ 83703us) raft_consensus.cc:1685] finished
0709 13:18:36.617524 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.617684 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":442116,"threads_started":1,"wal-append.queue_time_us":524198}
I20260709 13:18:36.621591 12118 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:36.624439  5415 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:36.626719  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:36.626922  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:36.627962 12279 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:36.628309  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:36.631531  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2855) took 1456 ms. Trace:
I20260709 13:18:36.632561  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:36.632040  5443 rpcz_store.cc:276] 0709 13:18:35.174785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.466666 (+291881us) service_pool.cc:224] Handling call
0709 13:18:35.467158 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.666651 (+199493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.666698 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.676519 (+  9821us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.812561 (+136042us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:35.812604 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.631050 (+818446us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400238f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:36.631109 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.631164 (+    55us) raft_consensus.cc:1685] finished
0709 13:18:36.631178 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.631461 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9138,"raft.queue_time_us":3623,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":10682,"spinlock_wait_cycles":457681792,"thread_start_us":135713,"threads_started":1,"wal-append.queue_time_us":274040}
I20260709 13:18:36.634464  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3186) took 1283 ms. Trace:
I20260709 13:18:36.634851  5524 rpcz_store.cc:276] 0709 13:18:35.351528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.201891 (+850363us) service_pool.cc:224] Handling call
0709 13:18:36.202234 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.202573 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.202601 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.203365 (+   764us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.537168 (+333803us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:36.537301 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.537551 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.634251 (+ 96700us) raft_consensus.cc:1685] finished
0709 13:18:36.634273 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.634408 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":332867,"threads_started":1,"wal-append.queue_time_us":403489}
I20260709 13:18:36.637416  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 3278) took 1450 ms. Trace:
I20260709 13:18:36.637863  5442 rpcz_store.cc:276] 0709 13:18:35.186951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.398164 (+211213us) service_pool.cc:224] Handling call
0709 13:18:36.637084 (+1238920us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540029d1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:36.637346 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625302912}
I20260709 13:18:36.639225  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.595419 12253 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.653276  5490 leader_election.cc:400] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24.
I20260709 13:18:36.656255 12375 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:36.656749 12375 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.654417  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:36.664062  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:36.665753  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.665745  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:36.667497  5490 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:36.670030  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.670575  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.670717  5369 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:36.671698  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.672886 12357 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:36.674649  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2849) took 1501 ms. Trace:
I20260709 13:18:36.675071  5450 rpcz_store.cc:276] 0709 13:18:35.173016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.414561 (+241545us) service_pool.cc:224] Handling call
0709 13:18:35.414934 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.555658 (+140724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.555688 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:35.555738 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:35.555767 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.674374 (+1118607us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400239454. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:36.674420 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.674576 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323188992}
I20260709 13:18:36.676954 12288 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:36.677452 12288 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.677867 12288 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:36.677654  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.681730 12230 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.681843  5374 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:36.671185  5368 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
W20260709 13:18:36.683585  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 79681.4us
I20260709 13:18:36.647171 12354 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:36.684744  5446 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 27 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:18:36.685360 12231 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:36.686774  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.689961  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2673) took 1282 ms. Trace:
I20260709 13:18:36.687546  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.690442  5370 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:36.690714  5374 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:36.691242  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 553) took 1387 ms. Trace:
I20260709 13:18:36.692059  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.692543  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3394) took 1588 ms. Trace:
I20260709 13:18:36.694538  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.696693  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.688581  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.698567  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.690469  5517 rpcz_store.cc:276] 0709 13:18:35.408436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.656775 (+248339us) service_pool.cc:224] Handling call
0709 13:18:36.689753 (+1032978us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54002788d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:36.689897 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153453824}
I20260709 13:18:36.701359  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.702615  5369 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:36.703492  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.687973  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.705569  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.705731  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.699755  5367 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:18:36.692950  5371 rpcz_store.cc:276] 0709 13:18:35.103845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.105649 (+  1804us) service_pool.cc:224] Handling call
0709 13:18:35.485662 (+380013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.641926 (+156264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.692366 (+1050440us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400331650. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:36.692489 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873200896}
I20260709 13:18:36.715512  5518 raft_consensus.cc:1240] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:18:36.693128  5450 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:36.717979  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:36.718094  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.719528  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.719911  5444 raft_consensus.cc:2410] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:18:36.720399  5450 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:36.691638  5521 rpcz_store.cc:276] 0709 13:18:35.304287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.155925 (+851638us) service_pool.cc:224] Handling call
0709 13:18:36.156167 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.464972 (+308805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.465008 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.465054 (+    46us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:36.465088 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.691037 (+225949us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b540025c6d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:36.691078 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.691191 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709618048}
I20260709 13:18:36.726519  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.727646  5521 raft_consensus.cc:2410] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:36.728753  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:36.702250  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.723029  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.724740  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:36.730542  5447 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:36.723524  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:36.732110  5447 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:36.733771  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.734659  5366 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:36.735908  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.737393 12226 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.666711 12253 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.742293 12253 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:36.701665 12357 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:36.745265 12357 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.755400  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.756587  5373 raft_consensus.cc:2393] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:36.732152  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.759449  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.762360 12209 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:36.652537 12090 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:36.760878 12226 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.687009 12279 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:18:36.770678 12226 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.686949 12285 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:36.774066  5524 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 13:18:36.737387  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.774843  5520 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:36.775584  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.773020  5446 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:36.682446 12230 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.779381  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.780632  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.781976  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.789060  5521 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:36.790947  5521 raft_consensus.cc:1240] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:18:36.792937  5450 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:36.800144  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.803117  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.804704  5520 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:36.806476  5374 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:36.809576  5447 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 15. (term mismatch)
I20260709 13:18:36.810055  5447 pending_rounds.cc:85] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 14
I20260709 13:18:36.810366  5447 pending_rounds.cc:107] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 13:18:36.810670  5447 raft_consensus.cc:2889] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.810811  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:36.813457  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 89967.5us
I20260709 13:18:36.814496  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:36.815413  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.808406  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.817322  5373 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:36.823477  5444 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:36.778163  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:36.809329  5450 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 13:18:36.844513  5369 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:36.845770  5375 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:18:36.848881 12230 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.850521  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.852603  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.853122  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.853381  5369 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:36.859545  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.860422  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.881919  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.884455  5366 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 13:18:36.885289  5366 pending_rounds.cc:85] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 11
I20260709 13:18:36.885645  5366 pending_rounds.cc:107] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:18:36.885948  5366 raft_consensus.cc:2889] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.802058 12389 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.851414 12152 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:36.851748 11936 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:36.892581  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.900199  5372 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:36.898294  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:36.872838 12359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.693s	user 0.040s	sys 0.113s
I20260709 13:18:36.772028 12231 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 13:18:36.863570 12285 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.889540 12072 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:36.911306  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:36.911348  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:36.908181 12359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.729s	user 0.040s	sys 0.114s
I20260709 13:18:36.911134  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:36.895051 12152 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:36.907301  5374 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:36.899569 11936 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:18:36.963840  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 148375us
W20260709 13:18:36.972424  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 306748us
I20260709 13:18:36.912385 12279 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:36.978535  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:36.936620 12413 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 13:18:36.981730  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:36.982034  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:36.985564  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 357908us
I20260709 13:18:36.940791 12152 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:36.981053 12310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.027s	sys 0.026s
I20260709 13:18:36.988107  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:36.980795  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:36.916944 12401 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:18:36.974320 11936 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:36.915246 12285 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:36.979331 12279 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.973673 12118 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:36.985098 12311 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:37.000857  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:36.991539 12410 log.cc:927] Time spent T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.348s	user 0.001s	sys 0.001s
W20260709 13:18:36.990628 12310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.027s	sys 0.026s
I20260709 13:18:36.979475 11946 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 13:18:36.998229 12087 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.840s	user 0.014s	sys 0.000s
I20260709 13:18:37.007459  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.001368  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:37.012679 12118 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.005623 12279 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:37.000344 12340 raft_consensus.cc:3055] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:37.002111 12253 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:37.014894 12311 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.030560  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:37.038316  5445 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:37.012614 12231 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:37.001514 12357 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:37.034538 12306 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:37.043408 12357 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.033062 12288 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.033484 12118 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.045868 12357 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:37.047569 12288 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.003705 12072 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:18:37.032974 12389 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:37.048626 12087 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:37.057741 12087 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:37.058650 12087 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.061201  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3289) took 1235 ms. Trace:
I20260709 13:18:37.061683  5448 rpcz_store.cc:276] 0709 13:18:35.826145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.031537 (+205392us) service_pool.cc:224] Handling call
0709 13:18:36.031852 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.124621 (+ 92769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.060972 (+936351us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b540019bc54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:37.061144 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211475840}
I20260709 13:18:37.076115  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.078217  5374 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:37.078663  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3180) took 1863 ms. Trace:
I20260709 13:18:37.079203  5518 rpcz_store.cc:276] 0709 13:18:35.215206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.709994 (+494788us) service_pool.cc:224] Handling call
0709 13:18:36.690625 (+980631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.773143 (+ 82518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.078411 (+305268us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54002788d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:37.078588 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210512128}
I20260709 13:18:37.079788  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.080757  5372 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:37.084247  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:37.085183  5446 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.090996  5442 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
W20260709 13:18:37.092098  5445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 3275) took 1950 ms (client timeout 2148 ms). Trace:
W20260709 13:18:37.084345 12397 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.099s	user 0.000s	sys 0.010s
I20260709 13:18:37.095323  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2857) took 1920 ms. Trace:
W20260709 13:18:37.092681  5445 rpcz_store.cc:269] 0709 13:18:35.142061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.143370 (+  1309us) service_pool.cc:224] Handling call
0709 13:18:37.091864 (+1948494us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b5400309dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:37.092020 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4355474304}
I20260709 13:18:37.034816 12340 raft_consensus.cc:740] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:37.042603 12399 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.044148 12311 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:37.114178  5441 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:37.092988  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:37.131919  5375 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:37.122920  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:37.135340  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.095841  5449 rpcz_store.cc:276] 0709 13:18:35.175343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.482937 (+307594us) service_pool.cc:224] Handling call
0709 13:18:35.483226 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.483521 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.483547 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.484000 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.663240 (+179240us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:35.663282 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.663350 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.083606 (+1420256us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:37.094884 (+ 11278us) raft_consensus.cc:1685] finished
0709 13:18:37.094918 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.095237 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17812,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7848,"spinlock_wait_cycles":8168704,"thread_start_us":178869,"threads_started":1,"wal-append.queue_time_us":341925}
I20260709 13:18:37.143666  5446 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:37.130705  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:37.199393  5448 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:37.056704 12389 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.108592 12288 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:37.154052  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58818 (request call id 3292) took 1301 ms. Trace:
W20260709 13:18:37.150354 12428 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.162s	user 0.004s	sys 0.000s
I20260709 13:18:37.146651 12399 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.205789 12389 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:37.209158 12072 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:37.210670 12306 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 13:18:37.182374 12422 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:18:37.223374 12375 consensus_meta.cc:287] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.563s	user 0.004s	sys 0.008s
I20260709 13:18:37.241712 12288 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:37.193011 12340 consensus_queue.cc:260] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:37.253984 12423 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:18:37.263098 12442 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:37.305013 12442 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:37.306411 12442 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.308077 12442 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:37.247942 12375 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.273242 12444 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:37.311815 12375 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:37.246515 12285 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.312207 12444 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.312996 12285 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.313730 12285 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.315218 12444 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.316520 12285 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.295825 12445 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.318951 12445 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.322084 12445 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.297497 12340 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:37.247908 12401 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:37.151854  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:37.382512  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 362811us
W20260709 13:18:37.195698  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 194873us
I20260709 13:18:37.145220  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:37.202521  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 67281.1us
I20260709 13:18:37.204257  5441 rpcz_store.cc:276] 0709 13:18:35.842732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.032818 (+190086us) service_pool.cc:224] Handling call
0709 13:18:36.625138 (+592320us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b540007dad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d83a3d 00007fc1d8d53cd0 00007fc1d22d8254 00007fc1d22d81e2 00007fc1d22d8111 00007fc1d22d808c 00007fc1d22d7342 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:37.069247 (+444109us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4c001f2dc0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d2058a20 00007fc1d2069a29 00007fc1d206a13f 00007fc1d202e2ab 00007fc1d205bf3c 00007fc1d205c3fe 00007fc1d22e988b 00007fc1d3ce8495 00007fc1d3d3930f 00007fc1d3d83a55 00007fc1d8d53cd0
0709 13:18:37.131437 (+ 62190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249552000}
I20260709 13:18:37.394457  5367 raft_consensus.cc:2376] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19. Re-sending same reply.
I20260709 13:18:37.395428  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:37.195961  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75009.4us
I20260709 13:18:37.404489  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:37.268631 11936 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:37.421994 12072 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:18:37.430004 11946 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.431424 11946 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.435492 12399 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:37.424485 12072 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:37.424458  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:37.437933 12072 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:37.439898 12072 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.423509 12087 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:37.475517 12430 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:18:37.476994 12087 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.478955 12087 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.480031 12431 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:37.324416 12401 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:37.446045 12090 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:37.474368  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:37.474637 12360 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:18:37.463407  5515 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 3170) took 2294 ms (client timeout 2234 ms). Trace:
W20260709 13:18:37.443243 12446 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:18:37.324002 12253 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:37.422964 11936 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:37.471163 12288 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.494663  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.488653 12090 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:37.505970 12360 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:37.507648  5367 raft_consensus.cc:3060] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.488366 12401 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:37.494900  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 100012us
W20260709 13:18:37.495633  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 91541.6us
I20260709 13:18:37.496330 12399 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:37.511101 12401 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:37.321076 12389 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:37.490484  5515 rpcz_store.cc:269] 0709 13:18:35.168377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.313969 (+145592us) service_pool.cc:224] Handling call
0709 13:18:37.462873 (+2148904us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54002b9654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:37.463095 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4919277440}
I20260709 13:18:37.539690 12429 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:37.540817 12429 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.544436 12429 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:37.504586 12090 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.546528 12090 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:37.547374 12253 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.529990 12399 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:37.564096  5367 raft_consensus.cc:2468] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:37.533922 12360 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:37.541186 12389 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:37.571622 12152 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.573s	user 0.017s	sys 0.003s
I20260709 13:18:37.572810  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.573644  5375 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
W20260709 13:18:37.585686  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 160608us
I20260709 13:18:37.586740 12152 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:37.589859 12440 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.590595 12440 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.591037  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.591841  5372 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:37.592979  5366 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:37.594846  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:37.578761 12399 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:37.598382 12429 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.599112 12429 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.601604 12310 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.602255 12310 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.605345  5369 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 19. Current term is 21. Ops: []
I20260709 13:18:37.606062  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:37.592790 12087 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.611325  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:37.612967  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.614312 12306 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:37.614604 12087 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:37.615275  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.616268  5374 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:37.616405 12087 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:37.601343 12429 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:37.617758 12087 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.618435 12087 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:37.622663 12447 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.623073 12288 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.596032 12072 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:37.629673 12288 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.606088 11936 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:37.605289 12310 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.635635 11936 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:37.640790 12357 consensus_meta.cc:287] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.551s	user 0.016s	sys 0.002s
I20260709 13:18:37.641340 12357 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.641214 11936 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.643206 11936 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:37.644225 12357 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:37.645627  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.645845  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:37.646543  5441 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
W20260709 13:18:37.647537  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 119855us
W20260709 13:18:37.666716 12118 consensus_meta.cc:287] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.011s
I20260709 13:18:37.667452 12118 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.673671 12288 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.674149 11946 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.674945 12152 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:37.663697 12447 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.677765  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:37.678853 12447 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.684137  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.684798  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:37.685456  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.686240  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:37.687407  5370 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.688791  5490 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:37.689937  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.690167  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.691180  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.691665  5372 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:37.692298 12429 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:37.692860 12429 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:37.693034 12279 consensus_meta.cc:287] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.010s
I20260709 13:18:37.693768  5374 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:37.698088 12375 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:37.700407  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.701397 12389 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:37.702203 12459 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:37.703387 12431 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:37.704452  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:37.635506  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:37.705212  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:37.694131 12429 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.695731 12440 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.703608 12459 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:37.693681 12279 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.706034 12437 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:37.710347 12311 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.015s
I20260709 13:18:37.710929  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.710398  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:37.714030 12118 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.714452  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.710947 12090 raft_consensus.cc:2804] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:37.716362  5369 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:37.723078  5372 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:37.716476 12459 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:37.725507 12437 consensus_queue.cc:1243] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:37.725401 12311 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:37.728374  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 93167.7us
I20260709 13:18:37.733196  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.733754  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:37.734333 12090 raft_consensus.cc:697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:37.735033  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.735828  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:37.737128 12440 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:37.738459 12459 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.747795 12459 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.749732  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.750911 12389 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:37.752738  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.738510  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:37.731027 12431 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:18:37.742336  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:37.753760 12375 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:37.745745 12440 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.754328 12090 consensus_queue.cc:237] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.755816  5371 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:37.715514 12152 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:18:37.768647  5375 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:37.792112  5370 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:37.779784  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:37.775040 12431 consensus_queue.cc:1243] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:37.793488 12118 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:37.771575 12375 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.794881 12375 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.795732  5446 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:37.779119  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:37.798906  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.799437  5446 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:37.774958 12389 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:37.772655 12440 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.802490 12389 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:37.803794 12389 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:37.818805  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:37.788993 12311 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.827181  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:37.831293 12421 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
W20260709 13:18:37.831698  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 94417.9us
I20260709 13:18:37.831599 12273 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:37.833000 12273 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:37.833067  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.833467 12273 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:37.833720 12414 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:37.842454 12273 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:37.844599 12273 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:37.853835  5370 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:37.834285 12306 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:37.835567 12414 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:37.859440  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:37.859552  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:37.860786 12459 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:37.860822  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:37.862061  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 109496us
I20260709 13:18:37.863078 12361 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:37.864149 12361 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:37.863104  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.865542  5441 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.866833  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:37.865067  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.868227 12357 raft_consensus.cc:2764] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:18:37.869551 12311 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:37.870199  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.870045 12414 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:37.870853  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.871907 12414 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:37.872004 12306 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:37.872658 12306 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.873104 12306 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.870045 12311 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:37.873988 12311 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.853258  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:37.886204  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53270us
I20260709 13:18:37.887379  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:37.887550 12253 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:37.888105 12253 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:37.889382 12253 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:37.890605 12118 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:37.890923 12253 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:37.893754  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:37.895380 12430 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:37.895825 12430 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.896193 12430 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.897859 12279 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:37.890385 12462 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:37.900911 12462 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:37.902099 12462 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.903101 12459 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:37.904073 12462 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:37.904789  5446 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:37.906287  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 78669us
I20260709 13:18:37.906615 12431 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:37.908548  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:37.837769 12399 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:37.918896 12431 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:37.926819 12340 consensus_meta.cc:287] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.603s	user 0.015s	sys 0.000s
I20260709 13:18:37.933914  5449 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:37.935158 12399 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:37.940680  5366 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 15.
I20260709 13:18:37.942517  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:18:37.952998  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 68104.7us
I20260709 13:18:37.956550  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.958390  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:37.959424 12399 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:37.960027 12399 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:37.946597 12087 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.961088 12399 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.961362  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:37.963294 12087 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:37.958380  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:37.922726 12375 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:37.975591  5450 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:37.980353  5441 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:37.979980  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:37.981447  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 72373.8us
I20260709 13:18:38.016378  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:37.974946 12466 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 13:18:37.979915 12279 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:38.017385 12357 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:38.045022  5372 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.048664 12090 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:38.018937 12375 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:38.054080  5370 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:38.055114  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:38.063503 12424 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:18:38.064850 12424 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:38.065243 12424 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:38.066031 12389 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:38.066671 12253 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:38.067312  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 109057us
I20260709 13:18:38.067221 12253 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.070032  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:38.071525 12310 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:38.066448 12389 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.075754 12389 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:38.042843 12440 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.087771 12440 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:38.089655  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:38.089792  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:38.090440  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:38.090998  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 132757us
I20260709 13:18:38.091122  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:38.066437 12424 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:38.034590 12447 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:38.095376 12447 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.095829  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:38.096072 12341 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:38.096472  5371 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.098279 12424 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:38.091382  5366 raft_consensus.cc:2410] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:38.099545 12253 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:38.069085  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:38.107690  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:38.110144 12447 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:38.111020 12447 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:38.111481 12447 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.111871 12447 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:38.049332 12090 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.113592 12072 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:38.114082 12090 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:38.116508 12362 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:18:38.053656 12279 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:38.106197  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:38.137658  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:38.139218  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:38.135597 12357 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:38.149538  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:38.167941  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 98961.2us
W20260709 13:18:38.172472  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 97474.3us
W20260709 13:18:38.173919  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.177214 12429 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:38.177412 12341 consensus_queue.cc:1059] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:18:38.180276 12341 raft_consensus.cc:3055] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:38.180697 12341 raft_consensus.cc:740] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:38.181699 12341 consensus_queue.cc:260] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.183096 12341 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:38.187211 12359 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:18:38.188529 12359 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:38.188944 12359 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:38.137018 12072 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:18:38.190478  5518 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:38.192170  5516 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:38.193789  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:38.194525  5515 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:38.196066  5373 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:18:38.178606 12340 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:38.202003 12279 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.206148 12306 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.207293 12118 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:38.208559  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:38.215925  5370 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:38.217063  5367 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:38.221552  5371 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:38.220824  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:38.237154  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:38.208556 12306 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:38.243650  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:38.242100  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:38.262612  5371 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:38.243769 12440 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:38.264331 12437 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:38.274710  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:38.220059 12311 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:38.285079  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52046.2us
I20260709 13:18:38.286940  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:18:38.287501 12311 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:38.288225 12311 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:38.288673 12311 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:38.289057 12311 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.279778 12401 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:38.255441 12340 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:18:38.280377 12090 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:38.280704 12437 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:38.284204 12442 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:38.288461  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:38.289623 12470 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:38.297838  5372 raft_consensus.cc:2468] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:38.315321  5369 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:38.317338  5449 raft_consensus.cc:1217] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Deduplicated request from leader. Original: 21.12->[22.13-26.15]   Dedup: 22.13->[24.14-26.15]
I20260709 13:18:38.326179  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:38.317971  5449 pending_rounds.cc:85] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 13
I20260709 13:18:38.307632 12437 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:38.298583 12118 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:38.308708 12440 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:38.351193  5444 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:38.313871 12306 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.342259  5449 pending_rounds.cc:107] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:18:38.360615  5449 raft_consensus.cc:2889] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.367316 12362 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.368023 12362 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.338066 11946 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:38.350687 12310 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:38.328423 12359 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.328646 12401 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.406512 12310 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:38.415699  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 127343us
W20260709 13:18:38.419938 12182 consensus_queue.cc:1175] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 12 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:38.421142  5442 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:38.433724 12440 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.440779 12442 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:38.442106 12442 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:38.443622 12442 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:38.444075 12442 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:38.410215 12359 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:38.455359  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:38.398840 12118 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.413610 12310 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:38.407903 12306 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.413798 11946 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:38.487093 12430 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.001s
I20260709 13:18:38.545666  5371 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:38.445237 12442 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.510932 12357 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:38.596748  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 179070us
I20260709 13:18:38.560353 12429 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:38.572983 12375 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:38.534796 12389 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:38.612826  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 433384us
W20260709 13:18:38.615499  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.566758 12430 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.600649 12362 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:38.585131 12447 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:38.647784 12477 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
I20260709 13:18:38.654335 12429 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:38.656307 12479 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:18:38.656934  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:38.647051 12480 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:18:38.601542 12090 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:38.604727 12375 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:38.669831  5367 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:38.635725 12442 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:38.688469  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:38.687673  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 331453us
I20260709 13:18:38.707078  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:38.692183  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:38.711287  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:38.677250 12288 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:38.721592  5517 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:18:38.717020 12399 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:38.722349  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:38.726379 12489 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:38.726159 12090 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.724543 12152 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:18:38.741670  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:38.724908 12389 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:38.782325  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:38.786492  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:38.787511  5372 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:38.794356 12501 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.795051 12501 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.795631 12490 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:38.796263 12490 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.750875 12399 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.797711 11946 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:38.798450 12482 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:18:38.799625 12399 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:38.799885 12483 log.cc:927] Time spent T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:18:38.718524 12357 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.781813 12375 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.772284 12306 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:38.803911  5447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.017s	sys 0.025s
W20260709 13:18:38.804266  5447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.017s	sys 0.025s
I20260709 13:18:38.805101 12152 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:38.781899 12118 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:38.809118 12311 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.001s
I20260709 13:18:38.809017  5445 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:38.786953  5490 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:38.812837  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 190767us
I20260709 13:18:38.797281 12501 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:38.822567 12341 consensus_meta.cc:287] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.008s
I20260709 13:18:38.797731 12505 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:38.839344 12399 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.838575 12362 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:38.817813 12311 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:38.860836  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 138786us
I20260709 13:18:38.879522  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:38.973866  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 281784us
I20260709 13:18:39.050427  5520 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:39.052305  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65177us
I20260709 13:18:38.860818 12505 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:39.054613 12505 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:39.057931  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 74514.4us
I20260709 13:18:38.859306 12362 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:38.928172 12340 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.863190 12502 raft_consensus.cc:2804] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:38.879696 12447 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:38.976584 12501 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.878216 12430 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:38.869575 12499 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:38.881250 12490 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:38.888913 12311 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:39.104243  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.859465 12399 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:38.877977 12503 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.234s
I20260709 13:18:39.091394 12500 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.102718 12087 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:39.108510 12501 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.127810 12501 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:39.128041 12431 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:39.129045 12437 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.758s	user 0.006s	sys 0.006s
I20260709 13:18:39.129621 12459 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:39.129468 12437 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:39.122982  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 243549us
I20260709 13:18:39.130064 12459 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:39.130769  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:18:39.131103 12459 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.132477 12459 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:39.134146  5367 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: []
W20260709 13:18:39.136667 12359 consensus_meta.cc:287] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.670s	user 0.013s	sys 0.000s
I20260709 13:18:39.137394  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 2892) took 1262 ms. Trace:
I20260709 13:18:39.137862  5443 rpcz_store.cc:276] 0709 13:18:37.846234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.846473 (+   239us) service_pool.cc:224] Handling call
0709 13:18:37.898206 (+ 51733us) spinlock_profiling.cc:243] Waited 966 us on lock 0x7b5800018998. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:37.898504 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:37.898881 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:38.043861 (+144980us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.488351 (+444490us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.709033 (+220682us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.096853 (+387820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.096908 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:39.096957 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.097038 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.108978 (+ 11940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68980,"prepare.queue_time_us":95506,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":8699,"raft.queue_time_us":417523,"raft.run_cpu_time_us":507,"raft.run_wall_time_us":20215,"spinlock_wait_cycles":2222336,"thread_start_us":976137,"threads_started":4,"wal-append.queue_time_us":646965}
I20260709 13:18:39.140178 12087 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:39.141593 12437 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.104427 12340 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.156198 12182 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:39.163955 12517 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:18:39.164112 12182 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.165251 12517 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:39.165663 12517 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:39.166494 12517 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.167752 12517 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:39.182829 12310 consensus_meta.cc:287] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.613s	user 0.001s	sys 0.011s
W20260709 13:18:39.182566 12518 log.cc:927] Time spent T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:18:39.141651 12500 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.206225 12489 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:39.207031 12489 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.209648 12489 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.197849 12462 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.211417 12462 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.214143 12401 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:39.190147 12310 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.240442 12310 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:39.243289 12399 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.222637 12182 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.250483 12152 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.249967 12502 raft_consensus.cc:697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:39.258737 12533 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:39.267860 12070 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.268386 12070 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:39.269220 12311 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:39.269690 12311 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:18:39.269539  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 138870us
I20260709 13:18:39.270323 12311 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:39.270958  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:39.272122  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.272830  5374 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 19.
I20260709 13:18:39.252170 12279 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:39.272675  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:39.262231 12462 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:39.293092  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.267472 12152 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:39.308926  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.321907  5371 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:18:39.322692 12152 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:39.311791  5374 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:18:39.297323 12375 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:39.299667 12399 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:39.305675  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:39.317045  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.305909  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.306063  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:39.315068 12437 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.303272  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.326859  5368 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:39.360783 12487 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:39.361332 12487 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.363533 12487 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.365686  5369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2549) took 1387 ms. Trace:
I20260709 13:18:39.366313  5369 rpcz_store.cc:276] 0709 13:18:37.978405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.979564 (+  1159us) service_pool.cc:224] Handling call
0709 13:18:38.308838 (+329274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.321995 (+ 13157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.365343 (+1043348us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540015bdd0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:39.365564 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628323712}
I20260709 13:18:39.371002 12340 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.404440  5520 raft_consensus.cc:1240] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:18:39.318739 12070 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:39.407967  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.316728 12489 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:18:39.408933  5524 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:39.409518 12494 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:39.410140 12494 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.330057 12500 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.413444  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3220) took 1021 ms. Trace:
I20260709 13:18:39.300237 12502 consensus_queue.cc:237] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.413879  5522 rpcz_store.cc:276] 0709 13:18:38.307963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.810361 (+502398us) service_pool.cc:224] Handling call
0709 13:18:38.824686 (+ 14325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.840854 (+ 16168us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:38.854806 (+ 13952us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.094792 (+239986us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.326246 (+231454us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.326299 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:39.326360 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.328682 (+  2322us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.328793 (+   111us) inbound_call.cc:177] Queueing success response
0709 13:18:39.369926 (+ 41133us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b48001f2858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
Metrics: {"mutex_wait_us":266635,"prepare.queue_time_us":16247,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":3871,"raft.queue_time_us":430060,"raft.run_cpu_time_us":2538,"raft.run_wall_time_us":113563,"spinlock_wait_cycles":4661504,"thread_start_us":197347,"threads_started":2,"wal-append.queue_time_us":300198}
I20260709 13:18:39.416496  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.418210  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.418444  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.420877  5367 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:39.420799  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.325702 12311 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:39.403410 12505 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.329628 12437 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.422587 12505 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:39.423357  5369 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:39.428849  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.429100  5368 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:39.428082  5524 raft_consensus.cc:1240] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:39.429638  5449 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:39.431306  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.326754 12399 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.432085  5366 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
W20260709 13:18:39.359635 12440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.015s	sys 0.001s
I20260709 13:18:39.330893 12531 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:39.441958  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:39.424170 12530 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:18:39.442337  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 169795us
I20260709 13:18:39.451862  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.425660 12505 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:39.423738 12508 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.423305 12311 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:39.424250 12437 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.430251 12494 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.432175 12087 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:39.461695  5449 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:39.442884 12440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.016s	sys 0.001s
I20260709 13:18:39.476815  5520 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:39.476727 11936 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.483108 11936 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.480504 12087 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:39.486029  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:39.486749  5518 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:39.487274 12087 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:39.489049  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:39.489749  6076 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:18:39.491292  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:39.493320 11936 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.493621  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:39.494100 12087 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:39.494645 12087 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:39.494966  5518 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:39.495208 12087 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:39.501072 12399 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:39.502319  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.527849  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3209) took 1304 ms. Trace:
I20260709 13:18:39.537015  5443 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:39.468032 12489 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
W20260709 13:18:39.537703  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.529335  5515 rpcz_store.cc:276] 0709 13:18:38.202694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.215364 (+ 12670us) service_pool.cc:224] Handling call
0709 13:18:38.295108 (+ 79744us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:38.295372 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.323250 (+ 27878us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:18:38.608470 (+285220us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.015456 (+406986us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.241990 (+226534us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b180039b0e0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:18:39.395238 (+153248us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b180039b0e0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d3d84060 00007fc1d3d96716 00007fc1d3da7287 00007fc1d3da7208
0709 13:18:39.504735 (+109497us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.504790 (+    55us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:39.506589 (+  1799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.506667 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.506798 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233385,"prepare.queue_time_us":366620,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":120,"raft.queue_time_us":364889,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":12941,"spinlock_wait_cycles":37981440,"thread_start_us":611211,"threads_started":3,"wal-append.queue_time_us":467212}
I20260709 13:18:39.506511 12437 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.468402 12508 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.546252  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.543118  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.541311  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.538383  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3221) took 1209 ms. Trace:
I20260709 13:18:39.557864  5442 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:39.569684  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:39.566856  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.573395  5515 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:39.540292 12311 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:39.571116  5447 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:39.583093  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 143966us
I20260709 13:18:39.583379  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:39.586032  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 121113us
I20260709 13:18:39.584311  5450 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:39.591960  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3222) took 1238 ms. Trace:
I20260709 13:18:39.548853  5517 rpcz_store.cc:276] 0709 13:18:38.329206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.798818 (+469612us) service_pool.cc:224] Handling call
0709 13:18:39.391878 (+593060us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:39.392178 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.392564 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:39.426465 (+ 33901us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.538050 (+111585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.538097 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:39.538137 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.538215 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.538329 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13082,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":98,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9018,"spinlock_wait_cycles":27934080,"thread_start_us":84710,"threads_started":1}
I20260709 13:18:39.549073 12437 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.594880  5516 rpcz_store.cc:276] 0709 13:18:38.354066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.799995 (+445929us) service_pool.cc:224] Handling call
0709 13:18:39.433387 (+633392us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:39.433695 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:39.444650 (+ 10955us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:18:39.479668 (+ 35018us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.576822 (+ 97154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.576888 (+    66us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:39.576940 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.577012 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.591898 (+ 14886us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21794,"raft.queue_time_us":86,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":10869,"spinlock_wait_cycles":25041664,"thread_start_us":96698,"threads_started":1}
I20260709 13:18:39.598990  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:39.599565 12440 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:39.600767 12440 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:39.601147 12440 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:39.601562 12440 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:39.602631 12502 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:39.603137 12502 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:39.604312 12502 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.602061  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:39.589507 12508 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.611797  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.613679  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.616429 12543 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:39.617516  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.618083 12437 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:39.618160  5450 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:39.620321 12531 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:39.620820 12531 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:39.623009  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.623629  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.624221  5518 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:39.624256 12152 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:39.624787 12152 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:39.625535  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.625847  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.626518  5520 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:39.627251 12399 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:39.627504  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.622741  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:39.625301  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:39.655213  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55415us
I20260709 13:18:39.635895  5447 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:39.661355  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:39.666235  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.670552  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.671463  5367 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:18:39.672330 12542 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:39.673120 12311 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:39.673589 12311 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:39.673887 12541 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:18:39.674001 12311 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:39.677248 12539 log.cc:927] Time spent T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:18:39.677618 12362 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.678819 12362 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.679416  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:39.679893  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:39.680251  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50101.1us
I20260709 13:18:39.680572  5442 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:39.625798 12152 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.683123 12152 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:39.685979 12536 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:18:39.687178 12181 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:39.687579 12181 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.687943 12181 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:39.695001  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3214) took 1488 ms. Trace:
I20260709 13:18:39.695407  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:39.695633 12253 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:39.696791  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:39.699564 12437 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:39.699993 12437 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:39.700377 12437 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:39.701498 12535 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:39.701647 12340 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:39.702183 12340 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:39.702620 12340 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:39.704860  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43593.4us
W20260709 13:18:39.679888 12547 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:39.708014  5446 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:39.702018 12535 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:39.710187  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:39.711294 12535 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.711951  5517 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:18:39.712600 12535 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:39.712663  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.713137  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.710505  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.710194  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.713785  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.714080  5523 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:39.714257  5524 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:39.714370  5520 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:39.715113  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.719929  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.722956  5515 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:39.722345  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:39.747474  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.750896  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:39.755121  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96042.4us
I20260709 13:18:39.747731  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:39.759251  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.760659  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.664287 12502 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:39.768185  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.766199  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.695454  5519 rpcz_store.cc:276] 0709 13:18:38.206608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.243245 (+ 36637us) service_pool.cc:224] Handling call
0709 13:18:38.785276 (+542031us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67e9c 00007fc1d0c67a5b 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:38.793573 (+  8297us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:38.974322 (+180749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.974370 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:39.055665 (+ 81295us) log.cc:844] Serialized 78 byte log entry
0709 13:18:39.141475 (+ 85810us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b48001f2858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:18:39.439969 (+298494us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:39.466694 (+ 26725us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.683542 (+216848us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18000b5900. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:39.694343 (+ 10801us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.694557 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.694637 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.694680 (+    43us) raft_consensus.cc:1685] finished
0709 13:18:39.694694 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.694831 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":394699,"prepare.queue_time_us":284658,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":17883,"raft.run_cpu_time_us":7182,"raft.run_wall_time_us":343492,"spinlock_wait_cycles":74232576,"thread_start_us":563863,"threads_started":2,"wal-append.queue_time_us":478671}
I20260709 13:18:39.771883  5449 raft_consensus.cc:2368] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:18:39.773330  5339 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:39.773705  5447 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:39.773284  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:39.782616  5450 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:39.773576  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:39.742959 12501 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:39.786144  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.743036 12543 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:39.786814  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 105864us
I20260709 13:18:39.755829 12431 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.786530  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.815639  5442 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:39.815133  5446 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:39.814064  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.793857  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:39.819242  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46011.3us
I20260709 13:18:39.819268  5448 raft_consensus.cc:2410] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:18:39.767969 11946 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:39.823253  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.709786 12440 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.716831 12531 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.829852 12182 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:39.833087  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.868109 12182 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.868471  5449 raft_consensus.cc:2410] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:39.870074  5449 raft_consensus.cc:1275] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:18:39.785686 12489 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:39.863307  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 278915us
I20260709 13:18:39.865085  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.865214  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.763759 12494 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:18:39.813482 12462 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:39.826102 11946 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.786120 12399 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:18:39.893188  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.901129  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:39.893819  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 68796.9us
I20260709 13:18:39.830024 12459 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:39.895378  5522 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:39.868693 12182 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:39.902155  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.904630  5521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3217) took 1481 ms. Trace:
I20260709 13:18:39.877986 12489 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.905707 12523 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:18:39.906384  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.901758  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.928393  5443 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:39.928225  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:39.928390  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 95135.7us
I20260709 13:18:39.894455 12462 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.903690 11946 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:39.935642  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:39.935992  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 117159us
I20260709 13:18:39.902060 12494 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:39.939507  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.823421 12431 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:39.944340  5368 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:39.921370  5521 rpcz_store.cc:276] 0709 13:18:38.234182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.273891 (+ 39709us) service_pool.cc:224] Handling call
0709 13:18:38.405502 (+131611us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:38.407044 (+  1542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.407351 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:18:38.683875 (+276524us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.363245 (+679370us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b180005da60. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:18:39.692985 (+329740us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b180005da60. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d77843c7 00007fc1d3d969a7 00007fc1d3da60bf 00007fc1d3da6038
0709 13:18:39.693204 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.715232 (+ 22028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:39.715290 (+    58us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:39.715330 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.715403 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.715506 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38908,"prepare.queue_time_us":540005,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":7578,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":10052,"spinlock_wait_cycles":49673088,"thread_start_us":367443,"threads_started":2,"wal-append.queue_time_us":883262}
I20260709 13:18:39.940280  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.947832  5449 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:18:39.936542  5519 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:39.924482 12523 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.925047 12489 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:39.953861  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.962030  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:39.937947 12462 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:39.965143  5370 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:39.967746  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:39.969000  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:39.770478 12508 consensus_queue.cc:1059] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:18:39.770869 12429 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:18:39.905036 12528 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.119s
W20260709 13:18:39.992542  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.943284 12494 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:39.959338 12523 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:40.022136  5521 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:40.023797 12564 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.024379 12564 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:39.950047 12087 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.039456  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.012069 12499 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:40.020788 12341 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.030951 12527 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:40.051220  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.016081 12563 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.081808  5368 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:40.045562 12565 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.050911 12459 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:40.098104  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 269845us
W20260709 13:18:40.099799  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 223796us
I20260709 13:18:40.076116 12487 raft_consensus.cc:3055] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:40.102345  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.078506 12508 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 13:18:40.112319  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 172022us
I20260709 13:18:40.077996 12558 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:18:40.056461 12341 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.117579  5515 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.133493  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.048728 12499 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.089488 12531 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:40.151935  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 50166.8us
I20260709 13:18:40.090552 12440 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:40.125555 12553 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:18:40.100528 12565 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.109391 12487 raft_consensus.cc:740] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:40.135118 12375 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.179891  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.180913  5522 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:40.080175 12563 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.116052 12459 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.194190  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:40.197368  5372 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 12: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:40.127878 12399 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:40.166225 12430 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.163604 12569 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.210908  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 105023us
I20260709 13:18:40.185681 12574 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.188891 12564 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:40.194526 12431 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.163619 12570 consensus_queue.cc:1059] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:18:40.221648  5372 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:18:40.192389 12375 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.234068  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.238847  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.214839 12430 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.270344  5447 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:40.270668  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.272961  5442 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:40.218289 12569 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.251123 12087 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:40.277200  5515 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
W20260709 13:18:40.285946 12561 log.cc:927] Time spent T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:18:40.286755 12559 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:18:40.220376 12487 consensus_queue.cc:260] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.289001 12487 raft_consensus.cc:3060] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:40.300654 12152 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.000s
I20260709 13:18:40.303143 12341 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.308657 12459 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.309365 12499 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.310541 12565 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.227937 12574 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.316367 12523 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:40.277055 12442 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:40.301522 12528 consensus_queue.cc:1175] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "86b410d62f4040c39d33dc0698998562" responder_term: 19 status { last_received { term: 17 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: [18.13-18.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:40.347059  5522 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:40.323547  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:40.325678  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.342952  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:40.331362  5519 raft_consensus.cc:2368] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 22.
I20260709 13:18:40.343621  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:40.352240  5372 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:40.356678  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:40.326177 12340 consensus_meta.cc:287] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 13:18:40.327100 12563 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.358369  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.335873 12375 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.337272 12569 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.359378  5524 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 15.
I20260709 13:18:40.337998 12442 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.367789 12442 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:40.361902  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.340701 12311 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
W20260709 13:18:40.338702 12181 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.000s
I20260709 13:18:40.393697 12181 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.396672 12181 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:40.374655  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.398988  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.399261  5441 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:18:40.378578  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.401101  5450 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:40.379451  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.402210 12497 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.402443  5447 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:40.383544  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:40.364168 12437 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.000s
I20260709 13:18:40.404466 12437 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.407331 12437 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.363104 11946 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:40.410292 12362 consensus_meta.cc:287] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.000s
I20260709 13:18:40.413201  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.414453  5520 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.415511  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.415938  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.416852  5523 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:40.418174  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.358388 12340 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.419719  5523 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.332024 12462 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.385370  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:40.384354 12311 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:40.321368 12502 consensus_meta.cc:287] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.000s
I20260709 13:18:40.402762 12497 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.410219 11946 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:40.354024 12574 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:40.418967  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.391415  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.417058  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.390734 12523 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:40.325062 12182 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.322933 12430 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.423346  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.429247  5371 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:40.429742  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:40.463378  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.467934  5521 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.435786  5523 raft_consensus.cc:1240] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:40.441016  5522 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:40.418411  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.452551  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:40.399711  5446 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:18:40.453758  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:40.482925  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.454825  5516 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:40.484344  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:40.453251 12535 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.006s
I20260709 13:18:40.488646  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.494412  5447 raft_consensus.cc:2410] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:40.490756 12494 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.492493  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.464517  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:40.492975  5524 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:40.421900 12462 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.492359  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.421377 12340 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.501701  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:40.491784 12538 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:18:40.514036  5523 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:40.503007 12182 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.507575 12311 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:40.468586 12528 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.508201 12442 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:40.508265  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.509542  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.449225 12489 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.497684  5449 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:40.515801  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:40.560036  5521 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.502360  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.560561  5524 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.560987  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:40.553258  5371 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:40.535240  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.558243  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.567508  5523 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:40.575004 12523 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:40.575711 12523 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.586056 12497 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.586165 12182 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:40.587082 12182 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.587579 12182 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:40.577373  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61714.5us
I20260709 13:18:40.592916  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:40.596503  5523 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:40.597272  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:40.602422  5369 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:40.604283  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:40.554502 12442 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.582168 12494 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:40.553838 12279 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:18:40.602420 12523 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:40.621532  5523 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:18:40.619038  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 405798us
I20260709 13:18:40.624795  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:40.630119  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:40.630640  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.630785  5367 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.633653  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:40.610965 12535 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:40.634119  5372 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:40.578009 12528 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.615726 12442 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.640601  5523 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:40.600931 12311 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:18:40.643784  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.656704  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:40.658268  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:40.658932  5445 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:18:40.644586  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 420847us
I20260709 13:18:40.619145 12497 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:40.663522 12501 raft_consensus.cc:3055] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:40.666978  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.691982  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.690133  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:40.704329  5371 raft_consensus.cc:1240] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
W20260709 13:18:40.706051 12588 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:40.668231  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c2527a380a499db649c9aa30957175"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:40.707021 12523 consensus_queue.cc:1059] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:40.707748  5522 raft_consensus.cc:606] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.639128 12535 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:40.666653  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:18:40.672220  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.709515  5522 raft_consensus.cc:614] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:40.700642  5449 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 19.
I20260709 13:18:40.714946  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.697638  5367 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 20.
I20260709 13:18:40.666433  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:40.698388  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:40.667630 12583 raft_consensus.cc:3055] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:40.666704 12564 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:40.725842  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:40.728870  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:40.691448 12497 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.735486  5446 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:40.740578  5519 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:40.735522  5450 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:40.660692 12362 consensus_queue.cc:1059] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:18:40.741314  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:40.700408 12501 raft_consensus.cc:740] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:40.715823 12558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.016s	sys 0.028s
W20260709 13:18:40.749701  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 109843us
I20260709 13:18:40.750555  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.716706 12535 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:40.745816  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:40.746766  5447 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:40.719448 12430 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:40.751618  5448 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:40.669724  5271 catalog_manager.cc:5697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 11 to 18, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 18 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:40.721768 12580 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:40.755487  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.756119  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.738158 12564 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.732281 12583 raft_consensus.cc:740] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:40.742709 12497 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:40.765556  5517 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.766297  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:40.755035 12558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.017s	sys 0.029s
I20260709 13:18:40.774245  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:40.776151  5443 raft_consensus.cc:2410] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:40.774899  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.756088 12430 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.782925 12583 consensus_queue.cc:260] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.784301 12583 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.762494 12584 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:40.794888  5521 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:40.790019  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:40.797734  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76677.7us
I20260709 13:18:40.768658 12564 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:40.799244  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.805910 11936 raft_consensus.cc:3055] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:40.805653 12501 consensus_queue.cc:260] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.794682 12584 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.826085 12584 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.810297  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.810427  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.827286  5450 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:40.773111 12489 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.811331  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.829916  5446 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:40.820973  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.822173  5448 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:40.824680  5519 raft_consensus.cc:2368] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22.
I20260709 13:18:40.835304  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.825116  5447 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:40.815083  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.773331 12580 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:40.841790  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.842444  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.788535 12430 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:40.843338  5521 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.842415  5523 raft_consensus.cc:2393] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 15: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.844430  6076 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 12.
I20260709 13:18:40.846210  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.847036  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.845742  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:40.848942  6077 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 12.
I20260709 13:18:40.824295 11936 raft_consensus.cc:740] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:40.850378  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.850884 11936 consensus_queue.cc:260] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.852425 11936 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:40.855587  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.853865  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.857051  5521 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 15.
I20260709 13:18:40.857790  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.860044  5520 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:40.860258  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.860919  5516 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:40.861279  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:40.853693 12501 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:40.862787 12375 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:40.863375 12375 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:40.863637  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.863941 12528 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:40.864354 12375 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.865971 12182 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.859874 12586 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.874051 12586 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.876261 12586 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.875792 12580 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:40.883165 12601 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:18:40.884450 12589 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:18:40.885788 12598 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.074s	user 0.004s	sys 0.000s
W20260709 13:18:40.886377  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 71369us
I20260709 13:18:40.887070 12437 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:40.887660 12437 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:40.888055 12437 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:40.888690 12581 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.889194 12581 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.891311 12581 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.891819 12581 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.892230 12581 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.894601 12555 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:40.895089 12555 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:40.899319  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.900419  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:40.901146  5366 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:40.882663 12182 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:40.903455 12586 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:40.904086 12586 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:40.829375 12574 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:40.904683 12586 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:40.906572  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.907570  5521 raft_consensus.cc:2376] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22. Re-sending same reply.
I20260709 13:18:40.910809  5515 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:40.913251  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:40.913383  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:18:40.914734  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.921000  5520 raft_consensus.cc:606] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.921548  5520 raft_consensus.cc:614] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:40.920804  5524 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:40.933897  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.942555  5445 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 20.
I20260709 13:18:40.944345 12584 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:40.945948  6076 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:40.947062 12584 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:40.949177  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:40.949975  5520 raft_consensus.cc:606] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.950537  5520 raft_consensus.cc:614] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:40.952649  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.952944  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.953179 12581 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:40.953297  5522 raft_consensus.cc:2376] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23. Re-sending same reply.
I20260709 13:18:40.955505  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.960027  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.962836  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.954334  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:18:40.965855  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.967473  5521 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:40.961517  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1289dc7debf403aa87416568de586e6"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:40.970408  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.970589  5522 raft_consensus.cc:606] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.972429  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.964289  5516 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:40.971798  5522 raft_consensus.cc:614] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:40.955904  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:40.960556  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:40.975970 12497 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.976702  5515 raft_consensus.cc:2368] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 22.
I20260709 13:18:40.979455 12442 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:40.979022  5520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:40.960695  5271 catalog_manager.cc:5697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 12 to 16, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 16 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.995885  5520 raft_consensus.cc:606] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:40.996315  5520 raft_consensus.cc:614] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:40.971323  5524 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:40.905489 12574 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:40.896176 12555 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:41.004585  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:41.009538  5368 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.005921  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.011257  5340 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.009333  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:41.012782  5520 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:18:41.013279  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.017166  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 83387.5us
I20260709 13:18:41.020807  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.022379  5340 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.018328  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:41.019888  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:41.039348 12576 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:41.043890  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:41.044711  6076 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:41.051044 12555 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:41.019510 12340 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:41.026883 12462 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:41.053874 12462 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:41.054831 12462 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.037834  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:41.061674  6076 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:18:41.063723  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:41.068312 12442 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.035012 12500 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:41.035225 12362 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:41.068801 12497 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.069916 12362 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:41.070360 12362 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:41.065129 12489 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:41.073899  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.075506  5445 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:41.076030  5446 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:41.017277 12585 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.078562  5448 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:18:41.079063  5448 pending_rounds.cc:85] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 10
I20260709 13:18:41.079329  5448 pending_rounds.cc:107] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:18:41.079623  5448 raft_consensus.cc:2889] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.081596  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.085681  5368 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 20.
I20260709 13:18:41.086959  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.106967  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.107753  5515 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:41.117759  5450 raft_consensus.cc:1275] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:18:41.122938  5450 pending_rounds.cc:85] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 12
I20260709 13:18:41.123220  5450 pending_rounds.cc:107] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:18:41.123489  5450 raft_consensus.cc:2889] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:41.118141  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.110157  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.110276 12442 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:41.129627 12442 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.130038 12442 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.130985 12564 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.132217  5374 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:41.116662 12311 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.133883 12311 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.134099 12535 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.136183 12311 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:41.137213  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:41.138087  5373 raft_consensus.cc:2410] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:18:41.090519 12585 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.118811  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.109890 12596 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:41.143296 12596 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:41.146286 12442 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:41.148515 12442 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:41.149003  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:41.149880  5447 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:41.141147 12585 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.136201 12535 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.145051 12596 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:41.073940 12489 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:41.133189 12564 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.163753  5373 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:41.170003 12489 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.068123 12574 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:41.149050 12442 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:41.178975  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:41.185606  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:41.186667 12311 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:41.186595 11946 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:41.187422 12311 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.190912  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:41.192785 12311 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:41.202211  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:41.178223 12501 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:41.228482 12501 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.231550 12501 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:41.232414 11946 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:41.235062  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:41.197062 12442 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.234979  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:41.269901 11946 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:41.274645  5269 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 159) took 12334 ms (client timeout 15000 ms). Trace:
I20260709 13:18:41.164551 12430 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.211602  5367 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24. Ops: []
W20260709 13:18:41.220767 12602 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:18:41.221836  6043 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:41.223855 12503 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:41.281582 11946 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:41.284107  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:18:41.286675  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.209241 12311 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:41.295100  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:41.179246 12523 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.301713  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 80011.1us
I20260709 13:18:41.269291 12442 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.245155 12586 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.313402 12544 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:41.305111 12501 consensus_queue.cc:1059] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:18:41.343613 12437 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:18:41.373236  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.386659  5366 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:41.363618 12544 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 20 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:41.377612 12311 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:41.345230 12523 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:41.386107  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 2.121s (SENT) [suppressed 32 similar messages]
I20260709 13:18:41.383384 12362 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:41.537570  5416 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.012s
W20260709 13:18:41.538182  5416 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.012s
W20260709 13:18:41.538921  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 586002us
W20260709 13:18:41.443936 12399 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.012s	sys 0.014s
I20260709 13:18:41.556404  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.557405  5449 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:41.548851 12500 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:41.292649  5269 rpcz_store.cc:269] 0709 13:18:28.939776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.939959 (+   183us) service_pool.cc:224] Handling call
0709 13:18:41.274403 (+12334444us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:36.473871 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:36.474585 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:36.474622 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:18:36.474640 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:36.894837 (+420197us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:36.900542 (+  5705us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:36.904083 (+  3541us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:18:37.249327 (+345244us) tablet.cc:701] Row locks acquired
0709 13:18:37.249350 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:18:37.249551 (+   201us) write_op.cc:270] Start()
0709 13:18:37.249708 (+   157us) write_op.cc:276] Timestamp: P: 1783603117249501 usec, L: 0
0709 13:18:37.249731 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:18:37.250716 (+   985us) log.cc:844] Serialized 9046 byte log entry
0709 13:18:37.722430 (+471714us) op_driver.cc:464] REPLICATION: finished
0709 13:18:37.870348 (+147918us) write_op.cc:301] APPLY: starting
0709 13:18:37.870479 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.282745 (+412266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.282879 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.727290 (+444411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.794439 (+ 67149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:18:38.794511 (+    72us) write_op.cc:312] APPLY: finished
0709 13:18:38.795128 (+   617us) log.cc:844] Serialized 203 byte log entry
0709 13:18:39.082352 (+287224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.131328 (+ 48976us) write_op.cc:454] Released schema lock
0709 13:18:39.131440 (+   112us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:39.131986 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.132029 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1564363,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":147511,"apply.run_cpu_time_us":50414,"apply.run_wall_time_us":1261624,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100267,"num_ops":23,"prepare.queue_time_us":625086,"prepare.run_cpu_time_us":56075,"prepare.run_wall_time_us":1057448,"raft.queue_time_us":115252,"raft.run_cpu_time_us":28222,"raft.run_wall_time_us":49519,"replication_time_us":472222,"spinlock_wait_cycles":3456,"thread_start_us":770616,"threads_started":5,"wal-append.queue_time_us":527521,"wal-append.run_cpu_time_us":15780,"wal-append.run_wall_time_us":2396548}]]}
I20260709 13:18:41.549336 12340 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:41.583160  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.017s	sys 0.008s
W20260709 13:18:41.583753  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.017s	sys 0.009s
W20260709 13:18:41.584187  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 542922us
I20260709 13:18:41.587568 12500 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.597816  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:41.599321  5446 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:41.606706  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.608237  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:41.609022  5445 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:18:41.569001 12430 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.586499  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:41.632344  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.633019  5446 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:41.633380  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47007.5us
I20260709 13:18:41.635136  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:41.635807  5447 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:41.552153 12544 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:41.628132 12375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.017s	sys 0.026s
I20260709 13:18:41.628012 12487 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:41.638105 12576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.015s	sys 0.023s
I20260709 13:18:41.588783 11936 consensus_queue.cc:1059] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 23.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:18:41.638928 12182 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:18:41.643383 12375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.018s	sys 0.026s
I20260709 13:18:41.654800  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.660022  5447 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:41.660136  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.669445  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.670346  5443 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.674045  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:41.655620 12576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.016s	sys 0.023s
I20260709 13:18:41.655563 12523 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:41.675303  5444 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:41.659619 12182 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:41.695638  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.696473  5444 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:41.698057  5447 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:18:41.698122  5446 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
W20260709 13:18:41.683053 12605 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:18:41.682906 12462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.023s
I20260709 13:18:41.714529  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.649142 12487 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.699517 12362 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.713896  5446 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:41.681540 12576 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:41.680737 12611 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:41.699693 12182 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:41.732172  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:41.732995  5447 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:41.733121  5449 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
W20260709 13:18:41.721807 12462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.013s	sys 0.023s
W20260709 13:18:41.745952  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 472537us
I20260709 13:18:41.749348  5489 leader_election.cc:400] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:18:41.749989  5489 leader_election.cc:403] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:41.671316 12340 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:41.762620  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 376526us
I20260709 13:18:41.777230  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3501) took 1018 ms. Trace:
I20260709 13:18:41.777720  5370 rpcz_store.cc:276] 0709 13:18:40.758580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.758754 (+   174us) service_pool.cc:224] Handling call
0709 13:18:40.771570 (+ 12816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.779067 (+  7497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.779104 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.796843 (+ 17739us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.290340 (+493497us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:41.290384 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.290475 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.776971 (+486496us) raft_consensus.cc:1685] finished
0709 13:18:41.776993 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.777156 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7205,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":440914,"threads_started":1,"wal-append.queue_time_us":622081}
I20260709 13:18:41.731235 12611 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:41.790647 12613 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:41.801107  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.790987 12569 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.808743  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.813832  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.829737 12618 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:41.830354 12618 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.830760 12618 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:41.833240  5444 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:41.797286 11946 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.850782  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.851910 11936 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:41.798172 12523 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:41.852342 11936 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.852057  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.790987 12576 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.854324 11936 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:41.859417  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.835494 12612 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:41.858680  5340 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.871482  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:41.857035  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.863770  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.870376  5523 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:41.860677  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.876842  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.848212 12614 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:41.850044 12375 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:41.884690  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:41.873479  5520 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:41.885282  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.853961 12613 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:41.860363 12623 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.853470 12629 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:18:41.871779 12612 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.891556  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:41.906098  5520 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:41.893337  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.895435 12613 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:41.895236  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:41.855664 12615 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.870468 12430 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:41.879546  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.939000  5516 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:41.884024  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:41.884631 12489 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:41.922609  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:41.901479  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.894271 11936 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.926119  5521 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:41.889716 12614 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.937529  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.940764  5524 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:41.845547 12569 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.942894  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:41.854511 11946 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.881110 12442 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:18:41.927651 12612 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:41.873823 12523 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.884214 12528 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:18:41.947980  5519 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:41.960602 11936 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.887043 12087 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:18:41.888489 12494 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 13:18:41.962692  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 213575us
I20260709 13:18:41.972131  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:41.898622 12375 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.896461 12609 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:18:41.974367  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.978955  5519 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 17.
I20260709 13:18:41.956938 12489 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:41.976528 11936 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:41.953811 12614 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:41.953297 12430 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:41.963205 12500 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:41.985478  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:41.975054  5443 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:41.966536 12594 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:41.972981 12494 consensus_queue.cc:1243] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:41.944518 12362 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:18:41.961694 12487 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.986485  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:41.985898 12632 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:41.984295  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:42.011101  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.012301  5515 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:41.992559  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 107957us
I20260709 13:18:42.018371  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:42.011258 12500 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:41.994393  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:41.979764  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:41.950248 12615 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.922374 12623 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.976181 12528 consensus_queue.cc:1243] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:41.997946  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.023614  5519 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:41.982072 11946 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:42.007485  5517 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:41.988301 11936 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:42.027345 11936 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.029209 12523 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:42.029840 12623 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:41.985126 12087 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.031162 12569 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.031009 12087 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:41.990976  5524 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:42.033154 12087 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.038123  5523 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:42.035755  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:42.040649  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61012.6us
I20260709 13:18:42.041708  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.048875  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.049346  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:41.981441 12489 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.055213  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.055351  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.052935 12569 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:42.056143  5515 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:42.057526 12635 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:42.057932 12637 log.cc:927] Time spent T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:18:42.058071 12375 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.057569 12569 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:42.023862 12611 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:42.056519  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.056221  5523 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:42.051442 11946 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:42.057324 12636 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:18:42.051681 12523 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:42.079887  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:42.052688 12528 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:42.084795  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.088932  5523 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:42.090807  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.091643 12635 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:42.094331  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.052845 12632 consensus_queue.cc:1048] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:42.095338  5373 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:42.091933 12629 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:42.100644  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.103026  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.081863 12646 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:42.100122 12523 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:42.105675 12629 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:42.105983 12615 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.107522  5523 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:42.107897  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.108695 12629 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:42.109582 12618 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.100123 12494 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:42.110271  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.054190 12430 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.110875 12586 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.111478 12629 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:42.113111 12618 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.114390  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:42.113252  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.115772 11946 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:42.119427  5521 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:42.119308  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:42.125471 12611 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:18:42.120616 12501 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:42.128494  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:42.128840  6077 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:42.129206  6072 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
W20260709 13:18:42.125854 12642 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:18:42.139150  5515 raft_consensus.cc:1240] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:42.144546 12399 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:42.147389  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:42.148108  5517 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:42.138870  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:42.150693  5516 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:42.139607  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.151080  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.151969  5517 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:42.147715  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.157032  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.157976  5518 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:42.121063 12087 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:42.125849 12523 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:18:42.160673  5521 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:42.122449 11946 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:18:42.093861 12569 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.172257 12629 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:42.188993  5516 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:42.100481 12500 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.185156  5518 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:42.189798 12182 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.165985 12639 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:18:42.208868 12182 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.229404  5520 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:42.238188  5517 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
W20260709 13:18:42.258289  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 98586.8us
I20260709 13:18:42.235222 12628 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:42.234844 12629 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:42.260255  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:42.260370 12651 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:18:42.210546 12632 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:42.260437 12627 consensus_queue.cc:1048] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:42.261875 12614 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.263562 11946 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:42.274370  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.276996  5489 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.264047 12629 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:42.279886 12660 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:18:42.276829 12627 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:42.283259 12614 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.285356 12612 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.278123 12523 consensus_queue.cc:1243] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:42.288158  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:42.287536 12580 raft_consensus.cc:3055] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:42.290007 12629 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.291427 12629 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:42.321197  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.321564  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:42.376698 12523 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:42.378852  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:42.379566  5521 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:42.290035 12580 raft_consensus.cc:740] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:42.380082 12612 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.380756 12580 consensus_queue.cc:260] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.381981 12580 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:42.383211  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 61736us
I20260709 13:18:42.390810 12523 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:42.392612 12640 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.393195 12640 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:42.400547  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:42.401219  5521 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 20.
I20260709 13:18:42.393539 12501 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:42.403029  5523 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:42.403000  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:42.409977 12590 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:42.410451 12590 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.410777 12590 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:42.399389 12640 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.419020  5370 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:42.420598  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.434494  5370 raft_consensus.cc:2410] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:42.435797  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.439503  5524 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:42.443329  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.444542  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.451088  5370 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:42.450937 12590 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:42.452313  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.453799  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.454095 12590 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:42.450883  5523 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
W20260709 13:18:42.455746  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 336483us
I20260709 13:18:42.457273  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:42.473979  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:42.474962  5524 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:42.567570 12437 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:42.579093 12587 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:42.582120 12587 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:42.580256 11946 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.583249 11946 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.586035 11946 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:42.604926  5524 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 21.
I20260709 13:18:42.606724  6041 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:42.608215 12555 raft_consensus.cc:2804] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:42.618276 12311 raft_consensus.cc:3055] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:42.620424 12311 raft_consensus.cc:740] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:42.614337 12555 raft_consensus.cc:697] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:42.624536  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.625468  5370 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:42.631734 12587 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:42.633400 12555 consensus_queue.cc:237] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:42.621464 12311 consensus_queue.cc:260] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.642546 12311 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:42.655442 12497 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:42.656445 12497 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.660058 12587 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:42.661265  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.661363 12587 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.665258 12437 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:42.666218 12437 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.689788  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44090 (request call id 3508) took 1521 ms. Trace:
I20260709 13:18:42.690400  5373 rpcz_store.cc:276] 0709 13:18:41.168534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.168700 (+   166us) service_pool.cc:224] Handling call
0709 13:18:41.169169 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.098655 (+929486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.689384 (+590729us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400034dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:42.689686 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129486208}
I20260709 13:18:42.691856  5370 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:42.695866  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:42.696497  5370 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:42.697010  5367 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:42.700317  5370 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:42.719094  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.713086  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:42.853771 12670 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.854417 12670 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:42.859840 12487 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:42.860633 12487 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:42.856758 12670 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:42.864056  5372 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:42.863184 12487 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.874606 12487 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:42.884678  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:42.885658  5445 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:42.893764  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:42.894563  5447 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:42.896333  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:42.896570  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:42.897114  5450 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:42.897254  5447 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:18:42.898640 12503 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:42.899112 12503 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:42.900044 12503 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:42.901113 12503 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:42.912519  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:42.913266  5448 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:42.918037  5368 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:42.920423  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:42.921931  5448 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:42.926868  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:42.939850  5441 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:18:42.940995  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:42.941663  5441 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
W20260709 13:18:42.953778  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.954387  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.980141  5447 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:42.981972  5444 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:18:43.012667  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:42.986516  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.014847  5441 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:43.016027  5441 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:42.987917  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.988618  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 531402us
I20260709 13:18:43.018033  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.018111  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:42.998553  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:43.018687  5446 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:42.993095 12587 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.013381  5444 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:43.021551  5441 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:43.023412  5444 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:18:43.024763  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.022485  5441 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:43.008366 12639 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:43.026824  5441 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:43.027100 12639 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:43.028079 12639 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.029078 12639 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.032318  5446 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:43.047552  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:43.064817  5518 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:43.066461 12544 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:43.064815  5441 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:18:43.067646  5441 pending_rounds.cc:85] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 10
I20260709 13:18:43.067871  5441 pending_rounds.cc:107] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:18:43.068091  5441 raft_consensus.cc:2889] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:43.076857  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.098284  5449 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:18:43.100898  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.102221  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:43.108140 12503 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:43.108639 12503 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.108992 12503 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:43.117993 12087 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:43.122045 12639 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:43.123677 12639 consensus_queue.cc:1243] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer 86b410d62f4040c39d33dc0698998562 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:18:43.124310 12629 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:43.124951 12629 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:43.129660  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:43.133123 12629 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.135499 12629 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:43.147284 12613 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:43.148895 12613 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:43.196537  5442 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:43.250855 12628 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:43.295637 12628 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.368292 12628 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.372454  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:43.377131 12503 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.402770  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:43.403414  5371 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:43.411685  5371 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:43.420135 12437 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.422158 12503 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.424499  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:43.425758 12503 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:43.427532 12503 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:43.430106 12503 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:43.441711  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 458288us
I20260709 13:18:43.443465  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:43.450671  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.451885  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.452567 12629 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.453332  5446 pending_rounds.cc:85] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 12
I20260709 13:18:43.453804  5446 pending_rounds.cc:107] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 20.13
W20260709 13:18:43.453729  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 435720us
I20260709 13:18:43.453291 12629 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.454166  5446 raft_consensus.cc:2889] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.454599  5414 leader_election.cc:400] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22.
I20260709 13:18:43.455430  5414 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.455724 12628 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.456001 12629 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.461187  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.462378  5444 raft_consensus.cc:2410] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 26 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:18:43.463896 12629 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.464512 12629 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.465093 12087 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:43.466338 12087 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:43.466781 12087 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.467177 12087 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:43.467975  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:43.468549 12629 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.469769 12617 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:43.470505 12617 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:43.475274 12375 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:43.476128 12375 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:43.477092 12375 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:43.457242 12442 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.486619 12442 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.489467  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:43.457644  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:43.492523  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.456235 12628 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.458448  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:43.494021 11946 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.489089 12442 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.494594 11946 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.459197  5449 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22. Ops: [19.13-21.14]
I20260709 13:18:43.460500  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.496657  5449 raft_consensus.cc:1240] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:18:43.456664  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.458285  5450 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:43.498800  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:43.499841 12623 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:43.459738  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.498492  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.501986  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.502254  5371 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:43.503105 12497 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.503273  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.503611 12487 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:43.504326 12487 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:43.504990 12487 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:43.510857  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:43.511577 12375 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:43.511961  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:43.512557  5517 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:43.512909  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:43.513494  5524 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.513612 12590 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:43.514335  5515 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:18:43.514014 12375 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.514680  5515 pending_rounds.cc:85] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 7
I20260709 13:18:43.514932  5515 pending_rounds.cc:107] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:18:43.515169  5515 raft_consensus.cc:2889] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.515344 12375 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:43.515445 12590 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:43.511620  5521 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:43.510885  5516 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:18:43.518114  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:43.518728  5518 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:43.504691 11946 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.517822  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:43.522639  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:43.523236  5517 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:43.524574  5515 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:18:43.494935 12628 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:43.527269  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.436769  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:43.527944  5448 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.510960 12487 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.528522 12487 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:43.512599  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3285) took 1383 ms. Trace:
I20260709 13:18:43.529742  5519 rpcz_store.cc:276] 0709 13:18:42.129149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.132920 (+  3771us) service_pool.cc:224] Handling call
0709 13:18:43.488680 (+1355760us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:43.488932 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.489145 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.489172 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.489222 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:43.489256 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.489313 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.512537 (+ 23224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643200}
I20260709 13:18:43.509615 12612 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.531162  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.530090  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.534881 12442 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:43.531193 12612 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.536175  5518 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:43.537371  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.539067  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:43.539438  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.539999  5516 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:43.540232 12497 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:43.541252  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:43.541358 12580 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:43.542645 12580 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:18:43.542654  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 97318.3us
I20260709 13:18:43.543299 12580 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:43.544420 12623 consensus_queue.cc:1059] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:43.544209 12580 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.545454 12619 raft_consensus.cc:3055] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:43.543984 12442 raft_consensus.cc:2764] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 13:18:43.545693 12580 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:43.545830 12619 raft_consensus.cc:740] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:43.547139  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.546869 12619 consensus_queue.cc:260] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.549646 12487 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.549906 12619 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:43.552361 12613 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:43.552502 12487 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.552968 12613 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:43.553256  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.554484  5414 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.553933 12613 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.561074 12623 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:43.562083 12494 raft_consensus.cc:2764] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
I20260709 13:18:43.563539  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.566102  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.566669  5524 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:43.569401 12497 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:43.569984 12497 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:43.570276  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.570418 12497 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:43.572057  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.572914 12437 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:43.574743  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.473178 12617 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:43.575560 12430 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:43.579002  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.579445  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.581396  5442 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 13:18:43.584983  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.586776 12487 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:43.587270  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:43.587256 12487 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.588739 12487 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:43.592361 12612 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.581136  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:43.599435  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.591542 12497 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.599809 12617 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:43.600196  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.603377  5414 leader_election.cc:400] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 22.
I20260709 13:18:43.605723 12617 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:43.597203 12487 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.620239  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.646977  5441 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:43.649819  5340 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:43.692413  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.693639  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.694262  5441 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:43.647037  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.653101 12497 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.663164 12087 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.666283 11946 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.667553  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:43.710744  5415 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.712823  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:43.680141  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee980 after lost signal to thread 4249
I20260709 13:18:43.690421  5414 leader_election.cc:403] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:18:43.690734  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 93585us
W20260709 13:18:43.714403  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08002f70a0 after lost signal to thread 5307
W20260709 13:18:43.715708  5471 debug-util.cc:398] Leaking SignalData structure 0x7b080012e4a0 after lost signal to thread 5399
I20260709 13:18:43.696173  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:43.716032  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08000e1c60 after lost signal to thread 5400
I20260709 13:18:43.695230  5450 raft_consensus.cc:2468] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 19.
I20260709 13:18:43.716897  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.717667  5450 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:43.718609  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:43.698240  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.717157  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7b40 after lost signal to thread 5474
I20260709 13:18:43.720681  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:43.721046  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:43.706405  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56662.7us
I20260709 13:18:43.722821  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:43.724205  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.676782  5448 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
W20260709 13:18:43.721905  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd320 after lost signal to thread 5548
W20260709 13:18:43.727347  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08000eae00 after lost signal to thread 6101
W20260709 13:18:43.727659  5471 debug-util.cc:398] Leaking SignalData structure 0x7b0800206940 after lost signal to thread 6102
W20260709 13:18:43.728412  5471 debug-util.cc:398] Leaking SignalData structure 0x7b08000fad80 after lost signal to thread 12626
I20260709 13:18:43.722764  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:43.735431  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.737958  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:43.738343  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.748189  5443 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:43.700896 12501 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.700662 12628 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.754660  5442 raft_consensus.cc:3060] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:43.758818 12087 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.764909  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:43.730017 12623 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:43.730294 12442 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:43.725585 12613 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:43.732708 12629 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:43.732456 12580 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:43.772847  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:43.745023 12503 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:18:43.791572  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 188342us
I20260709 13:18:43.792616  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:43.791538  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 56205.8us
I20260709 13:18:43.778112  5441 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:18:43.795212  5441 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:43.731134 12555 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:18:43.746071 12437 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:43.800402  5443 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:43.804946 12503 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:43.806277  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.769557 12494 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:43.730692 11946 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.780643 12087 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.816035  5442 raft_consensus.cc:1275] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:18:43.817400  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.784093 12619 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 22.
I20260709 13:18:43.777001 12442 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:18:43.808737  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43886.2us
I20260709 13:18:43.785648 12580 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.858196 12580 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:43.804296 12437 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.860467 12437 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:43.845733 12503 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.867069 12503 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.875387 12503 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.876055 12503 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.878088 12688 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:43.882903 12487 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.876670 12503 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.886283 12693 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:43.886950 12693 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:43.887430 12503 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.887885 12693 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:43.888950  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.891000  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:43.841269  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48758.1us
I20260709 13:18:43.846336 12442 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:43.846884 12619 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:43.844408 12570 consensus_queue.cc:1048] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:18:43.855628 11946 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.780064 12628 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.844688 12629 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:43.793267 12613 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:43.844892 12087 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.768406 12501 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.837144 12497 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:18:43.894160  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49081.5us
I20260709 13:18:43.910260  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:43.910959  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 172682us
W20260709 13:18:43.905821 12678 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.419s	user 0.005s	sys 0.002s
I20260709 13:18:43.911011  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:43.917763  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.925410  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:43.926124  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 111044us
I20260709 13:18:43.927580  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.895795 12619 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.908494 11946 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.937239  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.942571  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:43.928871 12487 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:43.947312  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:18:43.950239  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:43.924911 12497 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:43.943199 12692 raft_consensus.cc:2764] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:18:43.930404 12698 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:43.937318 12629 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:43.934988 12619 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.940562 11946 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:43.916806 12430 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:18:43.955955 12375 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:43.976050 12375 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:43.976511 12375 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:43.977164 12437 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.977567  5267 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 14 to 18, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 18 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.979444 12437 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.980048  5267 catalog_manager.cc:5697] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 10 to 15, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 15 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.981822 12704 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.982546 12704 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:43.958019 12696 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:43.958663 12694 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:43.963040 12699 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:18:43.953709 12617 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:43.986020  5271 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 155) took 37315 ms (client timeout 15000 ms). Trace:
I20260709 13:18:43.998737  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.001279  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:44.007422  5366 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:44.004642  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.007949  5340 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:44.018899  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 104966us
I20260709 13:18:43.993592 12612 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:43.985409 12704 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.996032 12087 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:43.992887 12501 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.988564 12628 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:43.997687 11946 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:44.082456  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.083582  5374 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:18:43.987358 12697 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:44.054405  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:43.993302 12696 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:43.999344 12613 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:44.055440 12612 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:44.059892  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.060593  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.063000  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.059262  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:44.006685  5271 rpcz_store.cc:269] 0709 13:18:06.670210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.670567 (+   357us) service_pool.cc:224] Handling call
0709 13:18:43.985738 (+37315171us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:41.853945 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:41.982491 (+128546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:41.982542 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:18:41.982560 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:41.982995 (+   435us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:41.983077 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:41.983117 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:41.983540 (+   423us) tablet.cc:701] Row locks acquired
0709 13:18:41.983586 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:18:41.993615 (+ 10029us) write_op.cc:270] Start()
0709 13:18:42.025658 (+ 32043us) write_op.cc:276] Timestamp: P: 1783603121983709 usec, L: 0
0709 13:18:42.025705 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:18:42.039854 (+ 14149us) log.cc:844] Serialized 922 byte log entry
0709 13:18:42.264900 (+225046us) op_driver.cc:464] REPLICATION: finished
0709 13:18:42.313575 (+ 48675us) write_op.cc:301] APPLY: starting
0709 13:18:42.313691 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:42.315564 (+  1873us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:42.315696 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:42.317049 (+  1353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:42.317209 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:18:42.317253 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:42.378310 (+ 61057us) log.cc:844] Serialized 32 byte log entry
0709 13:18:42.381981 (+  3671us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.382084 (+   103us) write_op.cc:454] Released schema lock
0709 13:18:42.382129 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:42.382598 (+   469us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.382625 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":375108,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":48339,"apply.run_cpu_time_us":4740,"apply.run_wall_time_us":69017,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":519023,"prepare.run_cpu_time_us":23157,"prepare.run_wall_time_us":357014,"raft.queue_time_us":92557,"raft.run_cpu_time_us":8715,"raft.run_wall_time_us":15850,"replication_time_us":235679,"thread_start_us":556282,"threads_started":4,"wal-append.queue_time_us":129097,"wal-append.run_cpu_time_us":25258,"wal-append.run_wall_time_us":1218141}]]}
I20260709 13:18:44.033327 12437 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:43.998154 12497 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.034691 12576 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:18:44.076304 12442 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:44.018326 12632 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:44.031462 12699 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:44.088274  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.001611 12500 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
W20260709 13:18:44.094137  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 147222us
I20260709 13:18:44.102326  5267 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:44.101516 12612 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:44.104539 12690 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.153192 12690 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.074868 12619 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.033823 12430 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:18:44.077483 12580 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.093616 12087 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:44.101754 12437 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:44.130820 12632 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.093436 12696 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:44.133596 12701 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:44.134199  5369 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:44.111091 11946 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.094751 12709 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:18:44.146085 12375 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:44.163519  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 224897us
I20260709 13:18:44.092823 12503 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:44.168536  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 133776us
W20260709 13:18:44.173323  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 223154us
I20260709 13:18:44.182467  5371 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:44.157786 12617 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.181540 11946 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:44.191761 11946 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.192983 12580 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.193195  5339 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:44.194389 12711 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:44.194800 12632 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.194892 12711 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:44.195703  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:44.195884 12437 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.197173 12698 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:44.192806 12709 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:44.198024 12613 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:44.198426 12613 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:44.196455 12580 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:44.199086 12709 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:44.195969 12711 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.197722  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:44.168910 12087 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:44.202575  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.203325  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.199266 12613 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.209547  5267 catalog_manager.cc:5697] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 10 to 17, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 17 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.206115 12619 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.206705 12500 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:44.208268  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:44.208297  5368 raft_consensus.cc:2410] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:44.224179  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:44.181221  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 110761us
I20260709 13:18:44.225678  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:44.229272  5340 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:44.229406 12699 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:44.229753 12716 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:44.230342 12716 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:44.230526 12699 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.232584 12716 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:44.230521 12497 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:44.233408  5489 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:44.234541  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:44.236496  5415 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:44.207607 12704 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.209765 12087 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:44.214109 12709 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:44.214702 12500 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:44.228379 12570 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.201094 12503 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.237385 12619 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:44.237593 12716 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:44.255014 12629 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:44.258965  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:44.254511  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:44.208086 12617 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.199184 12612 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:44.250600 12613 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:44.251377 12693 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:44.238063 12713 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.265661  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58770us
I20260709 13:18:44.281755  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:44.282663  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.224591 12580 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:44.182156 12701 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.285413 12701 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.285548 12580 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:44.259091 12709 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:44.286612 12709 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:44.287021 12713 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.288375 12693 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:44.254710 12497 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:44.289363 12693 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.290350 12497 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:44.228152 12694 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:44.254401 12704 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.262609 12576 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:18:44.266288 12716 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.279526  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.223874 12710 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:18:44.271085  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:44.273443 12628 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.274706 12632 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:44.315944  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44990.9us
I20260709 13:18:44.326273  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:44.309322 12712 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:18:44.319555  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.320478  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70870.5us
I20260709 13:18:44.324308  5371 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:44.275493 12442 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:44.330588  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:44.331048  5489 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:44.333182  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 75813us
I20260709 13:18:44.336386  5267 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 11 to 16, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 16 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:44.339598  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:44.340248  5450 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:44.341513  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:44.324952 12710 consensus_queue.cc:1243] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:44.342509  5442 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:44.332616  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49683.2us
I20260709 13:18:44.315433 12716 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:44.309234 12375 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.346031  5441 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:44.325287 12701 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:44.328014 12632 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.265055 12570 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:44.334085 12697 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:44.331669 12580 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:18:44.327425 12430 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:18:44.341703 11946 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:44.365145 12612 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:44.327430 12628 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.343214 12698 consensus_queue.cc:1059] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:18:44.378924  5450 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:44.349524 12690 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.308172 12500 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.362818 12632 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:44.374190 12715 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:18:44.378753 12693 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:18:44.437408 12704 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:44.441563  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 87581.8us
I20260709 13:18:44.441985  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.443306  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.441576  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.436347 12500 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:44.444720 12503 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.453205 12692 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.445941 12617 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.511683 12702 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:44.488814 12713 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.471176 12692 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:44.516707  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 180775us
I20260709 13:18:44.557519  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.566740  5372 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:44.543008  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:44.598842  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:44.585925  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 69615.5us
I20260709 13:18:44.601336  5443 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:44.603078  5442 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:44.605330  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 162847us
I20260709 13:18:44.606107  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.606740  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.607082  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:44.608641  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.611789  5441 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 15. (term mismatch)
I20260709 13:18:44.612383  5441 pending_rounds.cc:85] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 14
I20260709 13:18:44.612687  5441 pending_rounds.cc:107] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 24.15
I20260709 13:18:44.612988  5441 raft_consensus.cc:2889] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.613427  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.614269  5447 raft_consensus.cc:2410] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:18:44.614487  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.615154  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:44.525635 12728 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:44.622378  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:44.626353  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:44.626847  5518 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:18:44.627118  5516 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:44.625995  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.628611  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.629223  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:44.562896 12442 raft_consensus.cc:3055] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:44.623684  5449 raft_consensus.cc:2410] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:44.624528  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.626005  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:44.638955  5443 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:44.620815  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:44.639778  5524 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:44.634207  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:44.640776  5523 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:44.520949 11946 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:44.519515 12628 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.639822  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.635195  5518 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:44.651445  5443 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:44.651733  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.651968  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.652340  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.652742  5449 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:44.652947  5443 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:18:44.653607  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.641902  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:44.529789 12617 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:44.654608 12617 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.638477 12442 raft_consensus.cc:740] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:44.646867 12720 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:44.657171 12442 consensus_queue.cc:260] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.658543 12442 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:44.561795 12698 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:44.644465  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.636986  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:44.647465  5519 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:18:44.671403  5519 pending_rounds.cc:85] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 13
I20260709 13:18:44.671705  5519 pending_rounds.cc:107] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:18:44.671928  5519 raft_consensus.cc:2889] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.622920 12503 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.660195  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.662942  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:44.676512  5441 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:44.677089  5516 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:44.562438 12570 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.668279  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:44.673954  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:44.556511 12692 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.676177  5445 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 18.
I20260709 13:18:44.637204 12695 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:18:44.544804 12696 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.690680  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:44.519064 12087 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.703058  5519 pending_rounds.cc:85] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 12
I20260709 13:18:44.708328  5519 pending_rounds.cc:107] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:18:44.708719  5519 raft_consensus.cc:2889] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.629876 12437 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:18:44.662261 12726 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:44.517685 12702 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.714960  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:44.716287 12704 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.716384  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:44.716753 11946 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.716948 12704 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:44.715013  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.717344 11946 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.719316 12704 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.719439  5515 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:44.719621 11946 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:44.719455 12736 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.721101 12736 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.727926  5368 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:44.702422 12742 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.734563  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:44.734915  5523 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
W20260709 13:18:44.735222  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92114.7us
I20260709 13:18:44.738183 12629 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.739879  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:44.748457  5523 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:44.744271  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:44.748328  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:44.737531  5449 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:44.738193  5515 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:44.751297  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:44.752010  5522 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:44.751919  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.753588  5447 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:44.686285 12698 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.756079 12692 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:44.760823  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:44.762058  5447 raft_consensus.cc:2410] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:44.735671 12726 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:44.691406 12503 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.758311 12613 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:44.792163  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:44.794250  6072 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:18:44.796319  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:44.755263 12629 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.739739 12742 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.814507 12692 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:44.832917  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:44.822657 12709 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.000s
W20260709 13:18:44.874325 12746 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:18:44.886580  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:44.900032 12750 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.901171  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:44.832540 12612 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:18:44.796105 12716 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.889956 12702 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.892769  5516 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 16.
I20260709 13:18:44.895534 12698 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.821669 12741 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:44.896822 12754 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:44.899119 12696 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.887696 12087 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.992645  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.006973  5516 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:45.002007 12747 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.900854 12750 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.009645  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:45.009819 12747 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.010394  5522 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:45.011633 12742 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.012004 12747 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:45.014390 12500 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
W20260709 13:18:45.020733 12745 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:18:45.021277  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.022714  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:44.999274 12613 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.025470 12716 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:45.026003 12613 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:44.836515 12726 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.028311 12613 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.954350 12709 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.029960  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:45.030788  5521 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 18: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:45.031492 12629 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.031579  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.032166 12709 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:44.834132 12738 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.180s
I20260709 13:18:45.033288  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.021277  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.034511  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.035382 12501 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.035848 12501 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.037753  5375 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:45.037920 12501 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.038482 12501 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:45.039628 12503 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.040063 12501 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:45.038913 12704 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:45.040705 12612 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:45.040865  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.041136 12612 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:45.041791  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.042497  5369 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:44.998338 12692 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:45.044343 12692 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:45.044866  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.046013  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.046705  5517 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:45.048509  5517 raft_consensus.cc:1240] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 13:18:45.049234  5372 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:45.039060 12739 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:45.035382  5371 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:45.034552  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.036070  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:45.000313  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.055483  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.059576  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.032770  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.000527  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:45.061707  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.063078  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.070894  5516 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:45.063264  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.063720  5522 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:45.066253  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.072566  5522 pending_rounds.cc:85] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 9
I20260709 13:18:45.072921  5522 pending_rounds.cc:107] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:18:45.073172  5522 raft_consensus.cc:2889] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.066246  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.068603  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.069543  5521 raft_consensus.cc:2410] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:18:45.083673  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.087622  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:45.122963  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59838.4us
I20260709 13:18:45.123167  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.124006  5369 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:45.124116  5489 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.062544 12739 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:45.125119  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:45.069713 12613 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:45.131544  5517 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: [21.13-22.14]
I20260709 13:18:45.088783 12749 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:45.137997  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 71854.4us
I20260709 13:18:45.178440 12580 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:45.179713 12761 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.179275 12739 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.180239 12761 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.181082 12739 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:45.181380  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43488us
I20260709 13:18:45.184831  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:45.185192  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:45.186267  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.186009 12713 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:45.181547 12731 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:18:45.188510 12713 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:45.188979 12713 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.186053  5518 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 20: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:45.190444  5369 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:45.183104 11946 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:45.192356 11946 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.193487  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:45.194355 11946 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.191816  5518 raft_consensus.cc:1240] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:45.126652 12628 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:45.216219  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 92223.6us
I20260709 13:18:45.216931 11946 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:45.217651  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.221382  5518 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:45.221588  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.190470 12750 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.223187 12718 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
W20260709 13:18:45.235657 12632 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.823s	user 0.004s	sys 0.021s
I20260709 13:18:45.236804  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.237636  5516 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:45.235471 12741 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.135190 12736 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.239392  5517 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:45.252476  5516 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:45.258268 11946 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:45.258823  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.261016  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:18:45.262706  5521 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:45.211364 12713 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:18:45.265220  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48963.3us
I20260709 13:18:45.266088  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.142028 12613 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.268499 12736 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:45.272182  5521 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:45.254572 12741 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:45.276044  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:45.278656  5521 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 13:18:45.182607 12761 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.286592  5521 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:45.296217  5521 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:45.260861 12742 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:45.274719 12730 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:45.255270 12632 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.254980 12699 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:18:45.275066 12629 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:45.294025 12501 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:45.334360  5519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.015s	sys 0.008s
W20260709 13:18:45.334892  5519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.015s	sys 0.008s
I20260709 13:18:45.307574 12701 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:45.305506 12442 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:45.379232  5520 raft_consensus.cc:2393] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 23: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:45.319475 12629 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.316790 12613 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:45.387326 12629 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:45.364948 12731 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:45.371068 12701 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:45.435804  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.453356  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 187282us
W20260709 13:18:45.424532  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 136041us
I20260709 13:18:45.456431  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.269477 12764 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:18:45.454970 12752 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:18:45.456431  5339 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.482717  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:45.368578  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 183810us
I20260709 13:18:45.384557 12442 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.452917 12701 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:45.526533  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 70188.8us
I20260709 13:18:45.486661  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:45.569545  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.571316  5339 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.485890 12761 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:45.592862 12613 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.485528 12742 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.567361  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:45.593513 12613 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.596154 12613 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:45.600659 12708 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:45.487426 12736 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:45.601404 12708 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:45.611688  5517 raft_consensus.cc:1240] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:18:45.612243 12708 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:45.613970 12613 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.614594 12750 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:45.615020 12750 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.614732 12613 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.615089 12708 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:45.593737 12742 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:45.620738  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 158610us
I20260709 13:18:45.452443 12731 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:45.529143 12763 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:45.620172 12613 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:45.620244 12699 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:18:45.626255  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55049.5us
W20260709 13:18:45.572649  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 86061.3us
I20260709 13:18:45.631719 12726 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:45.632690 12699 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:45.632897 12731 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:45.638316  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 151388us
I20260709 13:18:45.615428 12750 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:45.630509  5369 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:45.567317 12749 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:45.662304 12736 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:18:45.702549  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43973.3us
I20260709 13:18:45.712604 12442 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:45.701964 12613 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:45.713618 12613 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.715685 12613 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:45.718286 12699 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.723631 12617 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:45.680008 12749 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.734628  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:45.737078  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.739063 12692 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:45.744341 12742 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.718679  5371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2621) took 1172 ms. Trace:
I20260709 13:18:45.745627  5371 rpcz_store.cc:276] 0709 13:18:44.545914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.546106 (+   192us) service_pool.cc:224] Handling call
0709 13:18:44.546426 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.062094 (+515668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.718414 (+656320us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54000fafd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:45.718618 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124059392}
I20260709 13:18:45.746899  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:45.704066  5490 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:45.749785  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:45.751514  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.752276  5371 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:45.752735  5414 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:45.752760  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.753505  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.755470  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.757187  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.757521  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.757973  5372 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:45.763478  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:45.764179  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 103861us
I20260709 13:18:45.765360  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:45.766438  5370 raft_consensus.cc:2410] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:45.768904  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.769402  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.770418  5449 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:45.769721  5366 raft_consensus.cc:2368] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25.
I20260709 13:18:45.769737  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.772370  5442 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:45.776852  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.777817  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.780164  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.706821 12736 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:45.762207 12769 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:18:45.790915  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 86906.6us
I20260709 13:18:45.800384 12742 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.801201 12742 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.803893 12742 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.806993  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:45.810482 12739 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:45.774993 12726 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:45.811398 12757 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:45.811878 12726 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.812497 12757 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:45.812889 12501 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:45.814007 12758 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:45.814405 12758 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:45.814778 12716 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:45.815295 12758 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.816994  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:45.818244  5523 raft_consensus.cc:2393] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:45.818113 12580 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:45.819415 12497 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:45.820827 12500 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:45.824482 12430 consensus_queue.cc:1059] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:45.825611 12430 raft_consensus.cc:3055] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:45.825924  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.826126 12430 raft_consensus.cc:740] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:45.827210 12430 consensus_queue.cc:260] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.828639  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.797765 12704 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:45.829254 12430 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:45.781139  5441 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:45.830881  5522 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:18:45.833055  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3327) took 1131 ms. Trace:
W20260709 13:18:45.834990 12741 consensus_meta.cc:287] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:18:45.835664  5522 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:45.766399 12442 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:45.838804 12442 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.839387 12442 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.843333  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.844254  5450 raft_consensus.cc:2410] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 13:18:45.707886 12632 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.798558  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.810947 12739 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.764343 12617 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:45.833619  5524 rpcz_store.cc:276] 0709 13:18:44.703583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.706121 (+  2538us) service_pool.cc:224] Handling call
0709 13:18:44.706610 (+   489us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.000958 (+294348us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:45.254885 (+253927us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.656180 (+401295us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.661222 (+  5042us) log.cc:844] Serialized 52 byte log entry
0709 13:18:45.661391 (+   169us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:45.661443 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.661510 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.832796 (+171286us) raft_consensus.cc:1685] finished
0709 13:18:45.832816 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.832986 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38831,"prepare.queue_time_us":267075,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":16261,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":6743,"thread_start_us":792717,"threads_started":3,"wal-append.queue_time_us":489230}
I20260709 13:18:45.847882  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.855156  5523 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:45.855373  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.856185  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.856352  5524 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:45.858319  5443 raft_consensus.cc:2393] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:45.673137 12713 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.795508  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:45.799407 12736 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:45.734639 12749 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:45.764146 12613 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.835392 12741 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:45.848182  5490 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:45.850975  5445 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:45.862687  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:45.868085  5522 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:45.873694  6072 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:45.874994  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.858211 12758 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:45.852775 12739 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:45.875157  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:45.849730  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 84419.1us
I20260709 13:18:45.880314  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:45.884331  5414 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:45.885701  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.886749  5449 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
W20260709 13:18:45.863436  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.815305 12716 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.907563  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:45.889088  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:45.926323  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.927008  5445 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:45.927803  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:45.928607  5450 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 19.
I20260709 13:18:45.882629 12749 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:45.865741 12629 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:46.018447  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 75477.9us
I20260709 13:18:45.877010 12613 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.951432  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:46.056576  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.937469 12756 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:45.926231 12442 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.052457  5370 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:45.889060 12750 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:45.938673 12749 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.084676  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:46.106171  5446 raft_consensus.cc:2410] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 26 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:18:45.937604 12580 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.152s
I20260709 13:18:45.937281 12437 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.157s
I20260709 13:18:46.140074  5519 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:18:46.091046 12722 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.156420 11946 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:46.165927  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:46.168828 11946 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:46.151701 12701 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.001s
I20260709 13:18:46.106377 12711 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:46.098052 12442 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.160929 12617 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:46.170019 12722 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:46.100579 12749 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:46.137161  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 248135us
I20260709 13:18:46.183162 12761 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.138255 12778 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:18:46.194416  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:46.161530 12782 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:46.201269  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.203276 11946 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:46.189719 12711 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:46.189311 12781 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:46.232897  5368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2622) took 1665 ms (client timeout 1870 ms). Trace:
W20260709 13:18:46.233981  5368 rpcz_store.cc:269] 0709 13:18:44.556949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.557143 (+   194us) service_pool.cc:224] Handling call
0709 13:18:46.221702 (+1664559us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400331654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:46.221865 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300712832}
I20260709 13:18:46.210091 12741 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.188922 12701 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.193337 12442 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.232461 12711 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:46.265000  5369 consensus_meta.cc:287] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.002s
I20260709 13:18:46.236994 12781 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:46.268744 12783 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:18:46.269042 12780 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:18:46.269778 12790 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.271733  5369 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:46.216204 12761 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.276587 12782 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:46.315953  6102 heartbeater.cc:646] Failed to heartbeat to 127.4.37.190:41135 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.37.190:41135 timed out after 15.000s (SENT)
W20260709 13:18:46.316506 12784 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:46.257252 12713 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.266716 12788 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.331532 12791 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:46.332369 12791 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:46.332864 12791 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:46.336061 12791 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:46.336678 12791 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.337847 12793 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:46.338407 12793 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:46.340806 12793 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:46.342041 12785 log.cc:927] Time spent T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:46.272670 12629 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:46.355145 12701 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.357888 12613 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.317272 12716 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.359376  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:46.360213  5518 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
W20260709 13:18:46.372435  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 171218us
I20260709 13:18:46.374508  5414 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:46.337029  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:46.382232  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:46.388886  5518 raft_consensus.cc:2410] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:46.390134  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:46.391196  5522 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:46.394143  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.397989  5522 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:46.402403  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.341356 12793 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:46.403502 12613 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:46.403906 12792 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:46.403738 12793 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.404443 12613 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:46.405205 12612 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.406425 12793 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.406787 12612 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:46.407873 12761 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.327256 12790 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:46.412956  5516 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36792 (request call id 3337) took 1328 ms (client timeout 1709 ms). Trace:
I20260709 13:18:46.413703 12790 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.413966 12750 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.365214 12782 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.416857 12782 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.418079 12722 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.418612 12713 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.419188 12713 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.337163 12791 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.423578 12791 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.385399 12788 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:46.425760 12430 consensus_meta.cc:287] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.596s	user 0.012s	sys 0.000s
I20260709 13:18:46.426829 12788 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.427049  5367 raft_consensus.cc:2410] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
W20260709 13:18:46.413452  5516 rpcz_store.cc:269] 0709 13:18:45.084140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.085721 (+  1581us) service_pool.cc:224] Handling call
0709 13:18:46.412745 (+1327024us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003a3754. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:46.412859 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342864256}
I20260709 13:18:46.440402  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.445873  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:46.282500 12708 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.000s
I20260709 13:18:46.434322  5518 raft_consensus.cc:1240] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:46.450968 12791 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:46.454885  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.441807 12788 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:46.432492 12713 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.459985  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:46.478682  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.480880 12613 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:46.439370 12632 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.481788  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:46.484086 12790 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.484774 12782 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.485487 12782 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.487794 12782 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.481818 12632 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.488415 12782 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.457067  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:46.489715 12791 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:46.490295 12791 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.490767 12793 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:46.491076 12761 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:46.491312 12793 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:46.492540 12791 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.470448  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:46.280673 12781 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:46.493827  5518 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:46.495726 12632 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.497797  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:46.471319  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:46.498432  5369 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:46.498576  5516 raft_consensus.cc:606] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:46.499065  5516 raft_consensus.cc:614] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:46.500998 12736 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.617s	user 0.005s	sys 0.000s
I20260709 13:18:46.404522 12792 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:46.474089 12701 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:46.502032 12701 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.488983 12782 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.459245  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:46.503012  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:46.470829 12692 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.001s
W20260709 13:18:46.503068  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43912us
I20260709 13:18:46.504122 12692 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:46.484616 12790 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:46.506413 12790 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:46.502429 12701 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:46.490489  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.508747  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:46.441397 12750 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.449707 12442 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.448428 12617 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:46.503444 12792 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:46.509802 12697 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:46.510147 12617 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:46.510324 12697 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.510656 12793 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:46.510774 12697 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:46.511096 12617 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.511982 12632 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:46.503492 12761 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:46.513718 12761 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.514142 12761 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:46.509851  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:46.520097  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:46.509029 12758 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.000s
I20260709 13:18:46.530224  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.547130  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.537776  5369 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:46.561439 12632 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:46.562126 12632 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:46.562624 12632 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:46.519091 12739 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.000s
I20260709 13:18:46.567727  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:46.569221 11946 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:46.568457  5489 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:46.579135 11946 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.579703 11946 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:46.480296 12749 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.583693  5442 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:46.589119  5442 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:46.590741  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:46.592098  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:46.592821  5444 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:46.603093  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:46.603843  5369 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:46.565543 12629 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:46.529160 12750 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.624215  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:46.610163  5520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.017s	sys 0.051s
I20260709 13:18:46.519354 12736 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:46.625113  5520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.017s	sys 0.051s
I20260709 13:18:46.600401  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:46.624419  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:46.628297  5441 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:46.628940  5447 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 25
W20260709 13:18:46.633880  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.557s (SENT) [suppressed 5 similar messages]
I20260709 13:18:46.653759 11946 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.581801 12612 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:46.656739  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:46.658265  5449 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:18:46.659789  5449 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 13:18:46.664225 11946 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.605333 12713 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:46.675113  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:46.655858 12793 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.679816  5517 raft_consensus.cc:2368] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22.
I20260709 13:18:46.621631 12629 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.585268 12739 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.695364 11946 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:46.716961 11946 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.667219 12788 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.662969 12612 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.745468  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:46.714761 12629 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:46.755367  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:46.756525  5521 raft_consensus.cc:2368] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25.
I20260709 13:18:46.736482 12788 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.758059  5447 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
W20260709 13:18:46.758205 12795 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:18:46.759181  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:46.759806  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:18:46.769073  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 127177us
I20260709 13:18:46.771291 11946 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.715415 12793 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:46.777303 11946 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:46.777971 11946 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:46.763984 12777 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 1.053s	user 0.017s	sys 0.000s
I20260709 13:18:46.760061  5447 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 19: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:46.801961  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:46.805747  5523 raft_consensus.cc:1240] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 13:18:46.810842  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 226131us
I20260709 13:18:46.816989  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:46.815611  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:46.818660 11946 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.820433  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:46.826002  5414 leader_election.cc:400] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25.
I20260709 13:18:46.826372  5414 leader_election.cc:403] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:46.829598  6077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:46.830652  6077 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:46.829622  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:46.835882  5414 leader_election.cc:400] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22.
I20260709 13:18:46.836313  5414 leader_election.cc:403] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:46.836898 12790 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25.
I20260709 13:18:46.837690 12790 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:46.842173  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:46.843272  5515 raft_consensus.cc:2393] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:46.844501  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:46.846740 12790 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22.
I20260709 13:18:46.849551  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:46.850431  5450 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:46.851702  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:46.852398  5450 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:46.866084  6072 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59492 (request call id 264) took 1231 ms. Trace:
I20260709 13:18:46.866637  6072 rpcz_store.cc:276] 0709 13:18:45.634766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.634994 (+   228us) service_pool.cc:224] Handling call
0709 13:18:45.635386 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.874336 (+238950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.865713 (+991377us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400409f54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:46.865972 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547510528}
I20260709 13:18:46.876083  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:46.876472  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.886621  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3346) took 1051 ms. Trace:
I20260709 13:18:46.887292  5519 rpcz_store.cc:276] 0709 13:18:45.834914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.837451 (+  2537us) service_pool.cc:224] Handling call
0709 13:18:45.838105 (+   654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.150844 (+312739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.886323 (+735479us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540025d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:46.886550 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693794560}
I20260709 13:18:46.894125  6069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:46.892079  5415 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:46.830189 12788 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.830367 12797 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:46.918488  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:46.908655 12790 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:46.943786  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 165049us
I20260709 13:18:46.920204 12793 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.920928 12750 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.878039 12794 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:18:46.921603 12792 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:46.895521 12749 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:46.894822 12694 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.874877 12798 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:46.930063  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:46.978148  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3032) took 2625 ms. Trace:
I20260709 13:18:46.948346  5489 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:46.978490  5367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 3582) took 1071 ms. Trace:
I20260709 13:18:46.890664 12782 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:46.925364 12613 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:46.996645  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 48427.4us
I20260709 13:18:46.977864  5519 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:46.907295  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:46.966843 12796 log.cc:927] Time spent T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:18:46.967880 12800 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:18:46.968752 12801 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:46.970139 12750 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:46.898692  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.977458 12798 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.978947  5367 rpcz_store.cc:276] 0709 13:18:45.907174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.907313 (+   139us) service_pool.cc:224] Handling call
0709 13:18:46.978296 (+1070983us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b5400034dd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:46.978435 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1192116608}
I20260709 13:18:46.943137 12790 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:46.978600  5448 rpcz_store.cc:276] 0709 13:18:44.338901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.339041 (+   140us) service_pool.cc:224] Handling call
0709 13:18:44.357916 (+ 18875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.363130 (+  5214us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:44.377453 (+ 14323us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.274567 (+897114us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18002cb3c0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c23a 00007fc1d3d96a2a
0709 13:18:45.582212 (+307645us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.582765 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.582905 (+   140us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:45.582940 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.583022 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.592450 (+1009428us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:46.964101 (+371651us) raft_consensus.cc:1685] finished
0709 13:18:46.964138 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.964328 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22070,"prepare.queue_time_us":15405,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":22103,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":12567,"spinlock_wait_cycles":39864448,"thread_start_us":216053,"threads_started":1,"wal-append.queue_time_us":1228464}
I20260709 13:18:46.950269 12736 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.035302  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.007972  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:18:47.008672 12711 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.000s
I20260709 13:18:47.014889  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.017463  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.018671  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:46.927361 12701 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:47.027146 12761 consensus_meta.cc:287] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 13:18:47.017494  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:46.936632 12797 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.025110  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.023531  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.027815  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:47.030061 12805 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:46.993853 12739 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.033306  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3361) took 1105 ms. Trace:
I20260709 13:18:47.033973 12750 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.039546  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.032524  5339 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:47.067617  5448 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:47.040067  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.040865  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:47.026252 12781 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.003s
W20260709 13:18:47.046090  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.020756  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3358) took 1140 ms. Trace:
I20260709 13:18:47.073956  5524 rpcz_store.cc:276] 0709 13:18:45.880485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.514896 (+634411us) service_pool.cc:224] Handling call
0709 13:18:46.515234 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.515429 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:18:46.515678 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.020383 (+504705us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.020459 (+    76us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:47.020502 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.020569 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.020699 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4184,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":145005,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":21707,"thread_start_us":504268,"threads_started":2,"wal-append.queue_time_us":492994}
I20260709 13:18:47.076545  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.046877  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:46.975617 12697 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:47.048975  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 104480us
I20260709 13:18:46.993199 12694 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.022078 12612 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.026052 12810 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:46.997008 12617 consensus_queue.cc:1059] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:18:47.041857 12790 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:47.067368  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.040123  6073 raft_consensus.cc:2393] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 19: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:18:47.068544  5521 raft_consensus.cc:606] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.034713 12798 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.068903  5450 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:47.079224  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.080673  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.135428  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.136315  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3355) took 1274 ms. Trace:
I20260709 13:18:47.136740  5522 rpcz_store.cc:276] 0709 13:18:45.865003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.429778 (+564775us) service_pool.cc:224] Handling call
0709 13:18:46.430208 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:46.430777 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.430826 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:46.441521 (+ 10695us) log.cc:844] Serialized 52 byte log entry
0709 13:18:46.688746 (+247225us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:46.688808 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.688892 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.136081 (+447189us) raft_consensus.cc:1685] finished
0709 13:18:47.136101 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.136260 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9786,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5843,"thread_start_us":241613,"threads_started":1,"wal-append.queue_time_us":366031}
I20260709 13:18:47.138425  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.139047  5522 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:47.139954  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.140229  5448 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:47.140784  5522 raft_consensus.cc:2368] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 18. Current term is 19.
I20260709 13:18:47.080971  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.081241  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.082448  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.082808  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.083276  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.042443 12730 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:18:47.063463 12613 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:47.096165  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.119884  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:47.127696  5521 raft_consensus.cc:614] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:47.066766 12782 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.048328 12711 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.145390  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.151749  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.053766 12797 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:47.053542 12761 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.183890 12761 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.148209  5518 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: [24.11-24.11]
I20260709 13:18:47.149060  5373 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:47.125991 12739 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:18:47.186233 12739 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:47.186733 12739 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:47.188001 12739 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.190770 12701 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.193148 12750 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:47.199944 12813 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:18:47.201715  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.202924  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.203974  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.204458  5444 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:47.207821  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.208469  5521 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:47.088344 12726 consensus_queue.cc:1059] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.125s
I20260709 13:18:47.149820  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.214088  5448 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 13.
I20260709 13:18:47.214322 12726 raft_consensus.cc:3055] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:47.214687 12792 raft_consensus.cc:3055] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:47.214917 12726 raft_consensus.cc:740] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:47.215153 12792 raft_consensus.cc:740] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:47.215245  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.216123  5448 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 20: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:47.216694 12697 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.216171 12792 consensus_queue.cc:260] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:47.218350 12792 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.217980  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.219385  5448 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:47.219792 12711 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.223285  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.153898  5489 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:47.224390  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70575.5us
W20260709 13:18:47.224697  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 104904us
I20260709 13:18:47.090281 12781 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:47.225899  5449 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.026s	sys 0.054s
W20260709 13:18:47.226330  5449 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.026s	sys 0.054s
I20260709 13:18:47.226418  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.153316  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3347) took 1314 ms. Trace:
I20260709 13:18:47.157696  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.157546 12782 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:47.159140 12807 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:18:47.084981 12758 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:47.227360  5520 rpcz_store.cc:276] 0709 13:18:45.838693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.840282 (+  1589us) service_pool.cc:224] Handling call
0709 13:18:45.840757 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.841206 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:45.841952 (+   746us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.787801 (+945849us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.807996 (+ 20195us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.808222 (+   226us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:47.073466 (+265244us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.092414 (+ 18948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.092495 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.153073 (+ 60578us) raft_consensus.cc:1685] finished
0709 13:18:47.153095 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.153253 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35805,"prepare.queue_time_us":78408,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":7363,"raft.queue_time_us":88546,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":17323,"thread_start_us":1210050,"threads_started":3,"wal-append.queue_time_us":922884}
I20260709 13:18:47.162915 12694 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.065109  5523 rpcz_store.cc:276] 0709 13:18:45.927519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.807073 (+879554us) service_pool.cc:224] Handling call
0709 13:18:46.807474 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.807760 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:46.808102 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.029610 (+221508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.030116 (+   506us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:47.030561 (+   445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.033116 (+  2555us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.033250 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50937,"prepare.queue_time_us":139,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":3680,"raft.queue_time_us":16513,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":16245,"thread_start_us":219613,"threads_started":1}
I20260709 13:18:47.253149  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.165932  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.254151  5524 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
W20260709 13:18:47.167333 12811 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:18:47.172494  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.256712  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.180452  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 3411) took 1404 ms. Trace:
I20260709 13:18:47.257687  5446 rpcz_store.cc:276] 0709 13:18:45.776428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.776563 (+   135us) service_pool.cc:224] Handling call
0709 13:18:47.180183 (+1403620us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54003ccb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:47.180352 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754646400}
I20260709 13:18:47.181191 12793 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:47.153934 12806 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:47.259382 12806 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:47.260241 12806 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.152488  5450 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:18:47.262404  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.262962  5450 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:47.151829 12803 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:18:47.155452 12804 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:18:47.214437  5444 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:47.266532  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3357) took 1400 ms. Trace:
I20260709 13:18:47.254997  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.266930 12742 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.267562 12742 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.267966  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.268829  5522 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:47.269955  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:47.270695 12742 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.270924  5522 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:47.272195  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.273300  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:47.201107 12713 consensus_meta.cc:287] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:18:47.227852  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:47.254997  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.278517 12713 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:47.279063  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51272.6us
I20260709 13:18:47.280124 12713 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:47.280462  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3356) took 1415 ms. Trace:
I20260709 13:18:47.280639 12713 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.282339  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:47.243305 12721 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.297911  5524 raft_consensus.cc:606] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.298426  5524 raft_consensus.cc:614] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:47.247344 12782 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.247826 12501 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:47.248790  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.252022 12805 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:47.277707  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.281093 12713 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.273481 12694 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:47.280939  5518 rpcz_store.cc:276] 0709 13:18:45.865379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.494547 (+629168us) service_pool.cc:224] Handling call
0709 13:18:46.494905 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.184556 (+689651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.280080 (+ 95524us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400378cd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:47.280312 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501477760}
I20260709 13:18:47.286561  5272 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 8 to 10, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 10 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.335029  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.335258  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.267057  5516 rpcz_store.cc:276] 0709 13:18:45.865681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.499864 (+634183us) service_pool.cc:224] Handling call
0709 13:18:46.500220 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:46.500638 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:46.500673 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:46.501171 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:18:46.766730 (+265559us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:46.766781 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.766860 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.266229 (+499369us) raft_consensus.cc:1685] finished
0709 13:18:47.266263 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.266453 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2649,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"thread_start_us":264537,"threads_started":1,"wal-append.queue_time_us":376245}
I20260709 13:18:47.336788 12805 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:47.339183 12805 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:47.294154 12726 consensus_queue.cc:260] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.150669 12613 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.341339 12726 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:47.341902 12613 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:47.239745 12814 raft_consensus.cc:2804] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:47.351337  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:47.329237 12758 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:47.324008  5522 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:18:47.325999  5442 raft_consensus.cc:2368] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21.
I20260709 13:18:47.327790  5519 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 10.
I20260709 13:18:47.361999  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3364) took 1130 ms. Trace:
I20260709 13:18:47.362875  5522 rpcz_store.cc:276] 0709 13:18:46.232107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.323273 (+1091166us) service_pool.cc:224] Handling call
0709 13:18:47.323693 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.361734 (+ 38041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.361943 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:47.353315 12629 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.001s
I20260709 13:18:47.269764 12739 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:47.335667  5444 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:47.336637  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.209261  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.347234  5443 raft_consensus.cc:2410] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:47.354127  5450 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:47.366329  5445 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
W20260709 13:18:47.326774  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 259487us
W20260709 13:18:47.369688  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 47929.3us
I20260709 13:18:47.370667  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:47.321098  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 427834us
I20260709 13:18:47.373785  5521 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:47.374327  5444 raft_consensus.cc:2468] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:47.379129  5521 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:47.359162 12792 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:47.385711  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.386649  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3363) took 1216 ms. Trace:
I20260709 13:18:47.393497  5524 rpcz_store.cc:276] 0709 13:18:46.170639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.328066 (+1157427us) service_pool.cc:224] Handling call
0709 13:18:47.328501 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.386322 (+ 57821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.386348 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.386391 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:47.386420 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.386474 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.386578 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:47.377381  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:47.390858  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.395889  5521 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:47.394699 11946 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.395910  5441 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:47.310411  5448 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:47.396905 11946 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.400132  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.329926 12721 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:47.407061  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.407994  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:47.408643  5366 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.409488  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:47.410737  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.411875  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.413962  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.414814  5517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3359) took 1534 ms. Trace:
I20260709 13:18:47.415235  5517 rpcz_store.cc:276] 0709 13:18:45.880807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.788238 (+907431us) service_pool.cc:224] Handling call
0709 13:18:46.815078 (+ 26840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:46.815351 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:47.053999 (+238648us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.414447 (+360448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.414505 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:47.414553 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.414626 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.414758 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8498,"prepare.queue_time_us":106380,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"thread_start_us":515107,"threads_started":2}
I20260709 13:18:47.350422 12694 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.404021  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.423542  5368 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:47.404775  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:47.405257  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:47.424628  5373 raft_consensus.cc:3060] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:47.406245  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:47.406299  5519 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:18:47.425099  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 297905us
I20260709 13:18:47.419596  5450 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:47.428120  5450 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:47.401979  5416 leader_election.cc:400] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25.
I20260709 13:18:47.420420  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:47.374779 12750 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:47.429808  5445 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:47.431037 11946 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.434217  5374 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:47.439431  5441 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:47.392769 12792 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.442485  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:47.456700 11946 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:47.391166 12697 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.448532  5448 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:47.457239 11946 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.471810 11946 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:47.445188  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34858 (request call id 625) took 1028 ms. Trace:
I20260709 13:18:47.472947  5518 rpcz_store.cc:276] 0709 13:18:46.417250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.334561 (+917311us) service_pool.cc:224] Handling call
0709 13:18:47.360889 (+ 26328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.361140 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.361178 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.361243 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:47.361290 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.361370 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.445012 (+ 83642us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b540016c1d0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8b8ad 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:47.445128 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59816192}
I20260709 13:18:47.469697 12792 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:47.474530  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:47.475405  5518 raft_consensus.cc:2368] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20.
I20260709 13:18:47.477898 12738 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:47.479877 12775 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:47.413892 12501 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:47.482198 12501 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.452698  5441 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:47.399392 12814 raft_consensus.cc:697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:47.487747 12814 consensus_queue.cc:237] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 23.10, Last appended by leader: 10, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.412201 12727 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.489791 12727 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.491971 12727 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:47.422402 12632 consensus_meta.cc:287] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.859s	user 0.012s	sys 0.003s
I20260709 13:18:47.493036 12632 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.368484 12629 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.445894  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.384574 12782 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:18:47.413398 12794 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:47.498024  5371 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:47.404083 12823 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:47.500718  5517 raft_consensus.cc:1240] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:47.459088  5367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:59536
I20260709 13:18:47.472569  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:47.421737 12701 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:47.502596 12727 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.506348 12727 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.504522  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.508002  5367 raft_consensus.cc:606] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.517838  5367 raft_consensus.cc:614] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:47.498045 11946 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.444278 12805 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.510557  5521 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:47.526382  5524 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:47.504041  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48107.3us
I20260709 13:18:47.501917  5366 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:47.531164  5519 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
W20260709 13:18:47.522071  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 76335.1us
I20260709 13:18:47.533934  5416 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:47.502624 12810 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.539882 11946 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.502712 12794 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:47.458019 12750 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:47.563833  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.565498 12829 raft_consensus.cc:2764] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 13:18:47.535995 12442 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:47.536428 12826 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.543900 12810 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:47.499831 12697 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.507181 12757 consensus_queue.cc:1059] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:18:47.570554  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.546240 12793 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:47.540969 12430 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:47.518080 12612 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:18:47.520569 12738 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:18:47.543092 12781 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.578656  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.493920 12758 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.549314 12794 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:47.583870  5373 raft_consensus.cc:2468] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:47.616482  5416 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.539041 12805 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.542162 12798 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.621811  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:47.619292  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 220766us
I20260709 13:18:47.626327  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.581503 12829 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:47.572118 12828 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:47.632134  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.641896  5449 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:47.634316  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.638808  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:47.643209  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.643613  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.639031  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.644351  5442 raft_consensus.cc:2376] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25. Re-sending same reply.
I20260709 13:18:47.644758  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.645258  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:47.646010  5442 raft_consensus.cc:2368] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20.
I20260709 13:18:47.581249 12793 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:47.651542 12750 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:47.654090 12632 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.654222 12721 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:47.617655 12442 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:47.655377 12629 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.656700 12694 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.659910 12727 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.623226 12782 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:47.663501 12805 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.639426 12781 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:47.672763 12697 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:47.640967 12617 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.641188 12788 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:47.582645 12826 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.674454 12701 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:47.682148 12825 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:47.682849 12730 raft_consensus.cc:3055] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:18:47.695127 12790 consensus_meta.cc:287] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.008s
I20260709 13:18:47.689338  5449 raft_consensus.cc:1240] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: [19.13-22.15]
I20260709 13:18:47.692394  5444 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:47.572010 12613 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.694634  5442 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:18:47.709646  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:47.698416 12701 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:47.701766  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 281462us
I20260709 13:18:47.704011  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.686045  5524 raft_consensus.cc:606] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.724362  5524 raft_consensus.cc:614] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:47.724939  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.725214  6042 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:47.726475  5520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3362) took 1798 ms. Trace:
I20260709 13:18:47.726953  5520 rpcz_store.cc:276] 0709 13:18:45.927919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.293372 (+1365453us) service_pool.cc:224] Handling call
0709 13:18:47.293783 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.294136 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:47.295511 (+  1375us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.726035 (+430524us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:47.726088 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:47.726126 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.726196 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.726418 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":192,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":430148,"threads_started":1}
I20260709 13:18:47.705674 12730 raft_consensus.cc:740] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:47.694780 12797 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.698989 12617 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.727298 12555 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:47.714284 12790 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:47.772524 12790 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:47.757715 12833 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:47.773483 12833 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.778865 12833 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:47.743083 12793 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:47.793215 12830 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:18:47.789834 12794 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:47.789482 12831 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:47.793274 12798 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.802702 12826 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.785030 12730 consensus_queue.cc:260] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.806907 12730 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:47.808894 12792 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.813097 12793 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:47.856809  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.859376  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 327458us
W20260709 13:18:47.956203  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.958083 12815 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:47.959209 12815 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:47.960114 12815 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.868084  5446 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:47.869815  5450 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:47.870572  5443 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:47.872016  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3366) took 1025 ms. Trace:
I20260709 13:18:47.963622  5515 rpcz_store.cc:276] 0709 13:18:46.846225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.357277 (+511052us) service_pool.cc:224] Handling call
0709 13:18:47.357847 (+   570us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:47.395660 (+ 37813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.395711 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:47.414314 (+ 18603us) log.cc:844] Serialized 52 byte log entry
0709 13:18:47.486089 (+ 71775us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b48001f2858. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:18:47.697620 (+211531us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:47.697667 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.697740 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.871111 (+173371us) raft_consensus.cc:1685] finished
0709 13:18:47.871158 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.871643 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37083,"raft.queue_time_us":44097,"raft.run_cpu_time_us":990,"raft.run_wall_time_us":73233,"spinlock_wait_cycles":12489984,"thread_start_us":210807,"threads_started":1,"wal-append.queue_time_us":296401}
I20260709 13:18:47.874164  5445 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:47.875408  5522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3368) took 1028 ms. Trace:
I20260709 13:18:47.747229  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:47.878799  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 153834us
I20260709 13:18:47.870455  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3073) took 1196 ms. Trace:
I20260709 13:18:47.894877  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:47.900333  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:47.907147  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:47.940649 12617 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.942550 12613 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:47.823387 12833 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:48.002759 12694 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:48.004604 12833 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:48.006362 12719 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:47.992065 12815 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:48.014125  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:47.993780 12701 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:47.993780  5516 raft_consensus.cc:606] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.999675  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.018695  5516 raft_consensus.cc:614] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:48.020238  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:18:48.008912  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51992.1us
I20260709 13:18:47.984872 12810 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.011294  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:47.971619  5447 rpcz_store.cc:276] 0709 13:18:46.673588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.407903 (+734315us) service_pool.cc:224] Handling call
0709 13:18:47.442020 (+ 34117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.457324 (+ 15304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.457374 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.457994 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.712512 (+254518us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:47.712571 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.715068 (+  2497us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.869780 (+154712us) raft_consensus.cc:1685] finished
0709 13:18:47.869828 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.870182 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36067,"raft.queue_time_us":27665,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":183877,"threads_started":1,"wal-append.queue_time_us":295572}
I20260709 13:18:48.019565 12701 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:48.038390  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 291115us
I20260709 13:18:48.038655 12817 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:48.039887 12497 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:48.040819 12497 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.044301 12497 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.047693 12612 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:48.049640 12612 consensus_queue.cc:1059] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:48.050755  5490 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:48.051142 12727 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:48.051710 12727 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:47.970623  5522 rpcz_store.cc:276] 0709 13:18:46.846823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.363790 (+516967us) service_pool.cc:224] Handling call
0709 13:18:47.364168 (+   378us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:47.404875 (+ 40707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.404924 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:47.419121 (+ 14197us) log.cc:844] Serialized 78 byte log entry
0709 13:18:47.756167 (+337046us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:47.873635 (+117468us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.874428 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.874677 (+   249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:47.874775 (+    98us) raft_consensus.cc:1685] finished
0709 13:18:47.874786 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.875198 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46810,"prepare.queue_time_us":80535,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":116732,"raft.run_cpu_time_us":487,"raft.run_wall_time_us":16417,"thread_start_us":262090,"threads_started":1,"wal-append.queue_time_us":342028}
I20260709 13:18:48.053333 12727 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.11, Last appended by leader: 11, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.054355 12810 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:48.055415 12727 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:48.053004 12739 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.010s
I20260709 13:18:48.060316  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:48.062372  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3079) took 1320 ms. Trace:
I20260709 13:18:48.069705  5450 rpcz_store.cc:276] 0709 13:18:46.742282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.434939 (+692657us) service_pool.cc:224] Handling call
0709 13:18:47.435443 (+   504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.962733 (+527290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.061885 (+ 99152us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540033ccd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:48.062232 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996859264}
I20260709 13:18:48.070281  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:48.065593 12629 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:48.072926 12629 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:48.066745  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3078) took 1335 ms. Trace:
I20260709 13:18:48.067461 12792 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.068068 12810 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:48.068877 12713 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.715s	user 0.019s	sys 0.005s
I20260709 13:18:48.056859 12739 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:48.073024 12758 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:48.073457 12629 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:48.081516 12834 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:48.073974  5445 rpcz_store.cc:276] 0709 13:18:46.732155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.431482 (+699327us) service_pool.cc:224] Handling call
0709 13:18:47.431777 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.967530 (+535753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.066437 (+ 98907us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54003ccb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:48.066685 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015735168}
I20260709 13:18:48.087064  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3437) took 1086 ms. Trace:
I20260709 13:18:48.086702  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:48.089633  5446 rpcz_store.cc:276] 0709 13:18:47.001044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.485094 (+484050us) service_pool.cc:224] Handling call
0709 13:18:47.485333 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.961848 (+476515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.077270 (+115422us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400239954. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:48.086985 (+  9715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878174080}
W20260709 13:18:48.091593  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 80603us
I20260709 13:18:48.102355  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.091486  6076 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:48.097388 12794 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.107620  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.108501  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:48.109895  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.090715 12613 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:48.093852 12713 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:48.110126  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 163125us
I20260709 13:18:48.114522 12613 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.115430 12806 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:48.115841 12806 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:48.116231 12806 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:48.117084 12613 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.112576 12834 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:48.131544 12834 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.119352 12797 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.119267 12827 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:48.135011 12827 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:48.135418 12827 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:48.135548 12713 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:48.136616 12827 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.120711  5339 leader_election.cc:400] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20.
I20260709 13:18:48.140086  5339 leader_election.cc:403] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:48.121201 12612 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:48.112182  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 110339us
I20260709 13:18:48.127300 12721 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:48.128767  5414 leader_election.cc:336] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.647s (SENT)
I20260709 13:18:48.129951  5489 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:48.148487  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78513.9us
I20260709 13:18:48.152702  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.156759  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.157143 12750 raft_consensus.cc:2804] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:48.157938 12750 raft_consensus.cc:697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:48.159833 12845 raft_consensus.cc:3055] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:48.160497 12845 raft_consensus.cc:740] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:48.161996 12738 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20.
I20260709 13:18:48.164680  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:48.167532  5415 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:48.143846 12797 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:48.168859 12613 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:48.172494  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 43874.5us
W20260709 13:18:48.173251  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43507.3us
I20260709 13:18:48.174288  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:48.175534 12742 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:48.176198 12742 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:48.177484 12613 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:48.178535  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:48.177536 12742 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.181950 12827 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.169499 12797 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.186098 12797 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.187152  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.187503  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.159472 12750 consensus_queue.cc:237] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.165757 12845 consensus_queue.cc:260] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.189771  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.185310 12613 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:48.193307  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.214677  5371 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:48.193395  5366 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 25 index: 11. (index mismatch)
I20260709 13:18:48.199781  5269 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 23, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 23 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.206516 12738 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:48.221979 12738 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.208786 12694 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:48.207726 12721 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:18:48.243193 12694 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:48.222371 12738 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.244005 12694 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:48.213629  6076 raft_consensus.cc:1240] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:48.232339 12713 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.195708  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.192003 12845 raft_consensus.cc:3060] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:48.246304  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67920.9us
I20260709 13:18:48.246487 12721 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:48.192049  5373 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:18:48.242166  5272 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 43) took 77237 ms (client timeout 15000 ms). Trace:
I20260709 13:18:48.220935  5269 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 26, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 26 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.222306 12817 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.248123 12721 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:48.279100 12694 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.290850 12797 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:48.291332  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.291810 12797 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.227798 12697 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:18:48.245808 12713 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.304520  5371 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:48.305766  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:48.310392  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:48.314913 12694 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:48.315461 12721 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.318130 12792 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.318924 12797 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.318851 12792 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.319617 12797 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:48.320227 12797 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.314863  5340 leader_election.cc:400] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 19. Current term is 20.
I20260709 13:18:48.325780 12792 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.342343  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:48.335289 12612 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.329145 12845 consensus_queue.cc:1059] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:18:48.366941  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.354188 12697 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:48.355041  5269 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 22, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 22 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:48.372622  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67012.4us
I20260709 13:18:48.374457  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:48.352756 12834 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:48.376377 12834 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.377089 12814 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:48.378590 12713 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:48.358336 12727 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:48.254401  5272 rpcz_store.cc:269] 0709 13:17:31.003596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.003907 (+   311us) service_pool.cc:224] Handling call
0709 13:18:48.208141 (+77204234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:47.793667 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:47.794469 (+   802us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:47.794507 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:47.794525 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:47.794976 (+   451us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:47.795055 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:47.795097 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:47.795326 (+   229us) tablet.cc:701] Row locks acquired
0709 13:18:47.795353 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:18:47.795552 (+   199us) write_op.cc:270] Start()
0709 13:18:47.795710 (+   158us) write_op.cc:276] Timestamp: P: 1783603127795495 usec, L: 0
0709 13:18:47.795740 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:18:47.796713 (+   973us) log.cc:844] Serialized 532 byte log entry
0709 13:18:47.824644 (+ 27931us) op_driver.cc:464] REPLICATION: finished
0709 13:18:47.949701 (+125057us) write_op.cc:301] APPLY: starting
0709 13:18:47.950068 (+   367us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:47.953914 (+  3846us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:47.954136 (+   222us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:47.955442 (+  1306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:47.961604 (+  6162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:47.961682 (+    78us) write_op.cc:312] APPLY: finished
0709 13:18:47.962219 (+   537us) log.cc:844] Serialized 24 byte log entry
0709 13:18:47.969745 (+  7526us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.969932 (+   187us) write_op.cc:454] Released schema lock
0709 13:18:47.970005 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:47.994505 (+ 24500us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:47.994548 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":867175,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":1218,"apply.run_cpu_time_us":8100,"apply.run_wall_time_us":168296,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":243471,"prepare.run_cpu_time_us":7127,"prepare.run_wall_time_us":28532,"raft.queue_time_us":5591,"raft.run_cpu_time_us":1457,"raft.run_wall_time_us":1456,"replication_time_us":28709,"thread_start_us":322498,"threads_started":4,"wal-append.queue_time_us":19863}]]}
W20260709 13:18:48.399892  5267 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 159) took 41910 ms (client timeout 15000 ms). Trace:
I20260709 13:18:48.349763 12629 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.389979 12697 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:48.407660  5269 catalog_manager.cc:5697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 20, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 20 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.413681 12727 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:48.414857 12727 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:48.415752 12727 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:48.421654 12719 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:48.422724 12719 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:48.427309 12719 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:48.427702 12719 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:48.427753 12792 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:48.397318 12711 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:18:48.428510 12792 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.429839  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:48.438437 12860 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.065s	user 0.002s	sys 0.001s
I20260709 13:18:48.438728 12792 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.417327 12727 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.425915 12739 raft_consensus.cc:3055] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:48.440752 12727 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.440806 12739 raft_consensus.cc:740] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:48.442279 12739 consensus_queue.cc:260] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:48.443809 12739 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:48.445072 12814 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:48.450269 12721 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:48.408643 12797 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.431788 12719 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.485055 12835 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:48.486382  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:48.477478 12713 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:48.496978  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.498272  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.499387 12846 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.499980  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:48.501062  5373 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:18:48.506744  5373 pending_rounds.cc:85] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 12
I20260709 13:18:48.514213  5369 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:48.516511  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.507017  5373 pending_rounds.cc:107] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:18:48.530282  5373 raft_consensus.cc:2889] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:48.531265  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:48.535244  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:48.537218  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.412142 12806 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.537593  5447 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:48.547063  5366 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
W20260709 13:18:48.400483  5267 rpcz_store.cc:269] 0709 13:18:06.461951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.471005 (+  9054us) service_pool.cc:224] Handling call
0709 13:18:48.368431 (+41897426us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:44.484534 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:44.485087 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:44.485121 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:44.485144 (+    23us) tablet.cc:662] Decoding operations
0709 13:18:44.521513 (+ 36369us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:44.521589 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:44.521627 (+    38us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:44.522270 (+   643us) tablet.cc:701] Row locks acquired
0709 13:18:44.522304 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:18:44.522484 (+   180us) write_op.cc:270] Start()
0709 13:18:44.522654 (+   170us) write_op.cc:276] Timestamp: P: 1783603124522429 usec, L: 0
0709 13:18:44.522694 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:18:44.523507 (+   813us) log.cc:844] Serialized 2074 byte log entry
0709 13:18:45.186554 (+663047us) op_driver.cc:464] REPLICATION: finished
0709 13:18:45.447338 (+260784us) write_op.cc:301] APPLY: starting
0709 13:18:45.447451 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:45.592614 (+145163us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:45.592763 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:45.804251 (+211488us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:45.804472 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:18:45.804523 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:45.804790 (+   267us) log.cc:844] Serialized 56 byte log entry
0709 13:18:45.804989 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:45.805097 (+   108us) write_op.cc:454] Released schema lock
0709 13:18:45.805149 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:45.810463 (+  5314us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:45.810499 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":105521,"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":260496,"apply.run_cpu_time_us":11193,"apply.run_wall_time_us":363098,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":109416,"prepare.run_cpu_time_us":33242,"prepare.run_wall_time_us":193121,"raft.queue_time_us":344040,"raft.run_cpu_time_us":15433,"raft.run_wall_time_us":193838,"replication_time_us":644408,"thread_start_us":570866,"threads_started":4,"wal-append.queue_time_us":210107,"wal-append.run_cpu_time_us":14697,"wal-append.run_wall_time_us":2077117}]]}
I20260709 13:18:48.556738  5445 raft_consensus.cc:2368] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21.
I20260709 13:18:48.559646  5367 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 21: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:48.540580 12719 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:48.562680  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.577529 12697 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.579134 12834 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:48.581514 12742 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:48.582252 12742 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:48.563409 12613 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.568591 12738 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.570153  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:48.571053 12806 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:48.560329 12846 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:48.598399  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 174416us
I20260709 13:18:48.603345  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.607824  5368 raft_consensus.cc:2393] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 20: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:48.609138  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:48.614151  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.615756  5515 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:48.616267  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.619484  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:48.621536  5414 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.557s (SENT)
I20260709 13:18:48.622052  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:48.622880 12792 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:48.625000  5441 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: [24.11-24.11]
I20260709 13:18:48.599673 12613 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:48.640347 12613 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:48.609624  5522 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
W20260709 13:18:48.644043  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.644986  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:48.607335 12742 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.646078  6076 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:48.647001 12742 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:48.644932 12750 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:18:48.647543  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:48.648962 12629 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:48.650383  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:48.651108  5520 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:48.653026  5269 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 23, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 23 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.654011  5518 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:48.654657  5269 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.656448  5269 catalog_manager.cc:5697] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:48.665351  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.666411  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.669390  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.669855  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.676164  5442 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 26. Current term is 27. Ops: []
I20260709 13:18:48.678340 12612 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:48.679072 12612 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.687019  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:48.690953  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.693204  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:48.694073  5375 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:48.668084  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:48.714246  5374 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:48.691515 12612 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.729074  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.724480  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.697187 12845 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:48.730134  5368 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
W20260709 13:18:48.741465  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.752707  5372 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:18:48.751667  6042 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:48.755013  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.757386 12555 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:48.757099  5269 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:18:48.758323 12863 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:18:48.758939  5269 catalog_manager.cc:5697] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.761058  5269 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 19, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 19 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.755293  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:48.776172  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:48.777876  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:48.741200 12845 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:48.786820  5269 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 20, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 20 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.783520  5522 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:48.754354 12738 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.795701  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:48.820765  5370 raft_consensus.cc:2410] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:18:48.820675  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:48.827183  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 72215.8us
I20260709 13:18:48.841557  5340 leader_election.cc:400] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21.
I20260709 13:18:48.842116  5340 leader_election.cc:403] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:48.831386 12778 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.854385 12694 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21.
I20260709 13:18:48.859287  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:48.860289 12871 log.cc:927] Time spent T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:18:48.863102  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 82196.6us
I20260709 13:18:48.864363  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:48.864611 12797 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.870095  5269 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 21, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 21 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.878338 12730 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:48.865293 12797 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.891986 12797 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.894448  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:48.896071  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:48.896858 12792 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.905951 12778 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.908411  5444 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:18:48.908537 12778 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:48.909256  5374 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
W20260709 13:18:48.909461  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54536.5us
I20260709 13:18:48.910259  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:48.872154 12846 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:48.851709 12867 log.cc:927] Time spent T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260709 13:18:48.911248  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:48.876943 12845 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:48.913695 12845 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:48.914911  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:48.924885  5269 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.937821  5370 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:48.875530 12613 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:48.938827 12797 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:48.959096  5269 catalog_manager.cc:5697] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 21, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 21 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:18:48.973994  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 141141us
I20260709 13:18:48.979729  5269 catalog_manager.cc:5697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 24, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 24 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:48.979710  5340 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:48.973287 12793 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:48.993860  5269 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 18, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 18 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:18:49.014583  5269 catalog_manager.cc:5697] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 12 to 23, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 23 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.988974 12613 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:49.026681 12888 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:49.027341 12888 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.027765 12888 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:49.027956 12881 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.090s	user 0.004s	sys 0.000s
I20260709 13:18:49.031303  5522 raft_consensus.cc:1240] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:48.993479 12793 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:49.033715  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 122566us
I20260709 13:18:49.037747  5515 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:18:49.033680 12613 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:49.043462 12874 log.cc:927] Time spent T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:49.043514 12613 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:49.063582  5369 raft_consensus.cc:2410] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 26 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:18:49.067540 12806 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:49.069762  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.067624  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:49.070447  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.071112 12810 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.071777 12810 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:49.071064  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.074961  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.072929 12810 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:49.081838  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46491.3us
I20260709 13:18:49.014360 12721 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:49.088546  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:49.088749  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 157350us
I20260709 13:18:49.034670 12793 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:49.092994  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:49.116082  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 201243us
I20260709 13:18:49.087308 12721 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.127509  5521 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:18:49.144750  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.149952  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.117980 12797 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:49.110378 12817 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:49.100142 12835 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:18:49.126839 12721 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.156769  5520 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:49.154443  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.159088  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:49.116624 12497 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:49.171501  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.172194  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.172844  5449 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 10.
W20260709 13:18:49.174512 12883 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:18:49.176280  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.176936  5524 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:49.177731  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.178367  5515 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:49.189718  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45341.3us
I20260709 13:18:49.190825  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:49.186568  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:49.194123  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:49.197539  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.200906  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.206964 12891 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:49.181209 12497 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:49.208379 12880 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:49.210405  5523 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:49.211529  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.212132  5523 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:49.213254 12846 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:49.212033  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.214411 12846 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:49.214787 12846 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:49.215864 12719 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:49.215692 12846 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.216563 12719 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:49.217603 12778 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:49.217859  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.217983 12778 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:49.219172 12711 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:18:49.219666  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.219579 12778 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.220916 12778 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.217849  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.219614 12711 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.222579 12711 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:49.222841  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.223706  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.200824  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.225829  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.226039  5517 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:49.225931 12797 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.227064  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.227154  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.228246  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.228451  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.228865  5517 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 19.
I20260709 13:18:49.207477 12891 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.247702  5520 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:49.217193 12846 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:49.252343  5523 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:49.252601  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.196717 12895 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:18:49.270917  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.275336  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.285398  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.289713  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.291901  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.289258  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.269268 12895 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:49.297551  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.300977  5520 raft_consensus.cc:2393] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:49.249183 12891 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:49.306923  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 116223us
W20260709 13:18:49.305898  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 125832us
I20260709 13:18:49.310899  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.311978 12887 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:49.300635 12895 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:49.312611 12895 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:49.265377 12497 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.299595 12792 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:49.324347  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.324527  5446 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:18:49.324998  5444 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.325479  5441 raft_consensus.cc:1275] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 25 index: 11. (index mismatch)
I20260709 13:18:49.327484 12888 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:49.330024  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.336345  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.323495  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:49.337206  5449 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:49.343032  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.346086 12792 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:49.346932  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.348726  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.350016 12613 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.353709 12694 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:18:49.198794 12817 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.363340 12817 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:49.332935 12721 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.265915 12904 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:49.301767 12827 consensus_queue.cc:1059] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 13:18:49.367977 12721 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.368423 12827 raft_consensus.cc:3055] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:49.368856 12827 raft_consensus.cc:740] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:49.369887 12827 consensus_queue.cc:260] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.371222 12827 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:49.376152  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.380574  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.382874  5524 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:49.384485  5366 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:18:49.384559  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 237549us
I20260709 13:18:49.387827  5444 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:49.390244  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.391824  5442 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:49.394897  5442 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:18:49.398576  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.398772  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:18:49.401140  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 93670.5us
I20260709 13:18:49.402052  5339 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:49.405190  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:49.406234  5370 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:49.416949  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.408836  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.430615  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.416088  5489 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:49.409693  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.431291  5443 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:49.458211  5447 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 27: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:49.461071  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.416788 12497 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:49.408854 12719 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:18:49.479848  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.482442  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.481496  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.488114  5443 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.406836 12711 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.489804  5449 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:18:49.493870 12897 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.494457 12897 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.496656 12897 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.404723 12694 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.072s
I20260709 13:18:49.498080 12694 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:18:49.498459 12694 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:49.499782  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.500396  5446 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
W20260709 13:18:49.501474  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 103651us
I20260709 13:18:49.502636  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.502955 12613 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.504000  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.505012  5446 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:49.508517  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:49.459656 12792 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:49.509290  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:49.460501 12903 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:49.486012 12497 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.476372 12898 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:49.518543  5447 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.477456 12797 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.469473 12887 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.499329 12694 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.531453  5368 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:18:49.544755  5414 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:49.532068  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 99957.9us
I20260709 13:18:49.444762 12793 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.546793  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:49.538703  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 137299us
I20260709 13:18:49.531431 12834 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:49.533346 12497 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:49.566072  5443 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:49.558754  5369 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
W20260709 13:18:49.572767  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 155900us
I20260709 13:18:49.573523  6076 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:18:49.576571  5372 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:18:49.577010  5372 pending_rounds.cc:85] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 14
I20260709 13:18:49.578608  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.577366  5372 pending_rounds.cc:107] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:18:49.579332  5520 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.579383  5372 raft_consensus.cc:2889] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:49.535909 12792 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.532907 12895 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.540153 12897 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:18:49.554209 12899 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:49.585170 12694 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:49.544397 12613 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:18:49.585201  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.583272  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:18:49.591626  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53449.8us
W20260709 13:18:49.592211  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.547246 12797 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.532682 12903 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.545433 12887 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.603726  5444 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:49.592080 12904 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.611788  5515 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:49.618309  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:49.621304 12908 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.622798  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.623553 12817 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:49.613910 12775 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:49.613466 12711 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.678860  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:49.633618 12817 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:18:49.684213  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66018.8us
W20260709 13:18:49.682859  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 78575.4us
I20260709 13:18:49.690505  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:49.694555  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 78732.7us
I20260709 13:18:49.685081 12904 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:49.688688 12817 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.700338 12889 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.091s
W20260709 13:18:49.704149 12892 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:18:49.705340 12897 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:18:49.701287 12879 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:49.719544 12792 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.716941 12905 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.725942 12835 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:49.639904 12908 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.727778 12835 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.728320 12835 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.729521 12908 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:49.725944  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 103245us
I20260709 13:18:49.732455  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.740975 12895 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.750234 12916 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.750547 12895 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:49.750996 12895 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:49.752413 12916 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.753931  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.710428 12806 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:49.755357 12916 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.756449  5369 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 11. (term mismatch)
I20260709 13:18:49.756846  5369 pending_rounds.cc:85] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Aborting all ops after (but not including) 10
I20260709 13:18:49.757035 12903 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.758157 12793 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.751816 12895 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.759519 12887 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.760869 12797 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.765935 12697 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:49.766827 12929 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:49.801160 12929 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:49.803710  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:49.803081  5520 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:49.804335  6076 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.708613 12904 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.770045 12888 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:49.757054  5369 pending_rounds.cc:107] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Aborting uncommitted NO_OP operation due to leader change: 24.11
W20260709 13:18:49.784022  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51646.8us
I20260709 13:18:49.813872  5447 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:49.813875  5369 raft_consensus.cc:2889] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:49.782868  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:49.784582  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 94231.8us
I20260709 13:18:49.784910  5370 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
W20260709 13:18:49.785282  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 103105us
I20260709 13:18:49.767297 12778 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:49.818243  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:49.825822  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.826833  5368 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:18:49.827960  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.815977 12895 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:49.830282  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:49.820406 12887 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.841220 12887 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.842914  5416 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:49.843590 12887 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.844000 12905 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.844868 12887 raft_consensus.cc:2804] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:49.844537 12905 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.848479  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.853847  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:49.859678  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.803401 12929 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.797186 12817 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:49.813572 12904 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:49.813242 12797 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.870429  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:49.818409 12778 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:49.872061  6076 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:49.875450  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.875865  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:49.876520  5415 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:49.876757  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 94044us
I20260709 13:18:49.866578  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:49.882107 12835 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:49.864948 12908 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:18:49.883838 12905 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.884044  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.881909 12925 consensus_queue.cc:1048] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:18:49.849016 12887 raft_consensus.cc:697] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:49.870023 12888 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:18:49.884913 12845 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:49.910885  5414 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:49.873924 12697 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:49.815374 12891 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.915902  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:49.911345  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.912629 12792 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:18:49.931627  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47648.2us
I20260709 13:18:49.919145 12908 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:49.935808 12935 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:49.936671  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.937398 12930 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.917199 12845 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:49.940903  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:49.941676 12721 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:49.908684 12797 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.943418  5448 raft_consensus.cc:2368] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21.
I20260709 13:18:49.944550 12891 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.917199 12933 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:49.885146 12750 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:18:49.947767 12889 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:49.914453 12905 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:49.941673  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:49.956241  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:49.963987 12792 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:49.956856 12730 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.987733 12730 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.989882 12730 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.990247 12904 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.961848 12727 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:18:49.963795 12930 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.992480 12904 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:49.961623 12778 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.962527  5521 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:49.942301  5519 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:49.964409  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.965855  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:49.973856  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 98058.1us
I20260709 13:18:49.979599  5369 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:49.940696 12887 consensus_queue.cc:237] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:49.939590 12817 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:50.025542  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:50.026952  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 61182.3us
W20260709 13:18:50.027101  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70955.8us
W20260709 13:18:49.966497 12827 consensus_meta.cc:287] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.595s	user 0.014s	sys 0.001s
I20260709 13:18:50.029518  5370 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:49.964479 12845 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:49.959717 12935 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.031224 12918 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.034634  5339 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:50.035080  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:49.985947 12792 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:49.957913 12908 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.042389  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:50.049228  5373 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:50.045506 12814 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:50.041453 12738 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:50.062054 12738 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:50.043902 12721 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:50.052399 12727 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:50.048424 12935 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.069376  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:50.025676 12497 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.052618 12908 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:50.085510 12797 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.088176 12497 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.089056  5367 raft_consensus.cc:2368] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:50.076190 12814 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:50.104990  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:50.106669  5490 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:50.111004  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76469.1us
I20260709 13:18:50.112500 12929 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.120388 12930 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.121457 12929 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.138283  5518 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:50.098683 12727 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:50.109495 12742 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:50.052325 12918 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:50.139390 12814 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:18:50.152678  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 236859us
I20260709 13:18:50.156530  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:50.157382  5444 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 13:18:50.159756  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.166765  5441 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:50.140829 12806 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:50.168982  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:50.170423  5448 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:50.155021  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:50.109541 12750 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:18:50.173372  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.174625  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.202127  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:50.202812  5444 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:50.207461  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:50.208114  5374 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.209510  5373 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:50.205122  5448 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:50.149528 12846 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:50.178445  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:50.149937 12926 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.153692 12817 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:18:50.214648  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:50.215953  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:50.217181  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48306.1us
I20260709 13:18:50.222254  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:50.222548  5414 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:50.173561 12806 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.214366  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:50.224502  5366 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:50.224643  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:50.177819 12835 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:50.176457 12742 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:50.143467 12738 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.230232  5444 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:50.169605 12898 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:18:50.240059  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:50.214380 12945 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.205830 12855 consensus_queue.cc:1059] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:18:50.256300  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.221510 12793 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:18:50.218964 12810 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:50.227612 12806 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.226364 12730 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.260790  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:50.232231 12887 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.221664 12846 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.270100  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:50.287760  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 47794.1us
I20260709 13:18:50.288615  5444 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:50.289304  5489 leader_election.cc:400] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 20 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21.
I20260709 13:18:50.258384 12939 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:50.273069  5374 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:50.293910 12904 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:50.292328  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.290514 12750 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:50.268951 12797 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:50.286674 12887 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.250555 12903 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:50.288919 12613 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.289057  5414 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:50.312886  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.313148  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.318957  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:50.321048  5524 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:50.321374  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:50.319339  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.323118  5518 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:50.320451  5522 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:18:50.216265 12926 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.327766  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:50.318465  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.331224  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:50.291870 12711 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:50.335609  5445 raft_consensus.cc:1275] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:50.255194 12902 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:18:50.337399  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:50.309118 12939 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:50.338318  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49733.5us
I20260709 13:18:50.363793  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:50.305505 12912 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:50.334026  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.269290 12845 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.311079 12897 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.287202 12730 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.266574 12742 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.265148 12945 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.341545 12711 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.329342 12810 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:50.362676 12629 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:50.341975 12895 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.371991 12903 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:50.362380 12902 consensus_queue.cc:1243] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer b781c7e31b7145aea647a7ff649e6ac7 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:50.342202 12891 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:18:50.415985  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 97154.7us
I20260709 13:18:50.256457 12727 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.447764  5524 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:50.329978 12613 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.369544 12939 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:50.425117 12905 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:50.435660 12711 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:50.446408 12758 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.368887 12855 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:50.486483  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 122771us
W20260709 13:18:50.483686  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 154831us
I20260709 13:18:50.495009  5366 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
W20260709 13:18:50.504166 12946 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:18:50.504478 12846 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.453202 12916 consensus_queue.cc:1059] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:18:50.507288  5414 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:50.459455 12895 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.484927 12918 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:50.419370 12897 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:50.512292 12855 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:50.551342 12942 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:18:50.551981 12855 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:50.554842 12959 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:50.555330 12959 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:50.556294 12959 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.560662 12613 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.562234 12845 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:50.563397  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 75715.1us
I20260709 13:18:50.563755 12895 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.564268  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:50.541998  5521 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
W20260709 13:18:50.567257  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 104506us
I20260709 13:18:50.579061  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:50.541584 12943 log.cc:927] Time spent T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:18:50.597537 12959 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.587531 12891 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:50.543896 12793 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:50.599653  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 67969.8us
I20260709 13:18:50.614516  5340 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:50.547222 12730 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.548840 12897 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:50.618040  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53855.6us
I20260709 13:18:50.618448 12927 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:50.619010 12927 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:50.619855 12927 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.577133 12629 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.622345 12629 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.626977 12887 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.599206 12918 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:50.629108 12918 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.488792 12758 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:50.640784 12935 consensus_meta.cc:287] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.001s
I20260709 13:18:50.629655 12918 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.625131 12629 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:50.670413 12955 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:50.679328 12959 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.633692 12730 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:18:50.680231 12959 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.682278 12916 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:50.682757 12916 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:50.683480 12926 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.683684 12916 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.685321 12916 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:50.690629 12758 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.577505 12903 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:50.693804  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.641701 12960 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.641297 12935 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.653548 12887 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.680294 12945 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.747172 12959 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.747460 12960 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.759829 12960 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.641367 12711 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:50.754487 12908 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.001s
I20260709 13:18:50.763046 12711 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.772913 12742 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.763718 12908 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.773756 12742 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.775413 12918 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.775813 12742 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:50.705111 12806 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.783252 12806 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:50.784610 12928 raft_consensus.cc:3055] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:50.785053 12928 raft_consensus.cc:740] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:50.787159 12935 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.787912  5446 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:18:50.791841 12918 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.792703  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:50.888862  5416 leader_election.cc:400] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:50.794728 12925 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.802210  5521 raft_consensus.cc:1240] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:50.766876 12887 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.889454 12918 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:50.890158 12918 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.890591 12918 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:50.890524 12925 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.891522 12887 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:50.892519  6073 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:50.893028 12925 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:50.803690 12778 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:50.809894 12750 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:50.810907  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:50.812562 12964 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.815541  5373 raft_consensus.cc:1240] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:50.775435 12908 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:50.817847  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:50.909157  6076 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 14.
I20260709 13:18:50.826129  5366 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:18:50.832360  5447 pending_rounds.cc:85] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 9
I20260709 13:18:50.910874  5447 pending_rounds.cc:107] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:18:50.911185  5447 raft_consensus.cc:2889] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:50.840013 12952 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.332s	user 0.001s	sys 0.001s
I20260709 13:18:50.841518  5375 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 25. Current term is 26. Ops: [25.11-25.11]
I20260709 13:18:50.845657  5449 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:50.833026  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.847744  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:50.848444  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:50.914579  5448 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.914789  5374 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:50.849704  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:50.858022  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.859321  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:50.915647  5522 raft_consensus.cc:3060] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:50.860710  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:50.916237  5524 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:50.863672  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:50.918262  5370 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:50.866444  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:50.867795  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:50.869686  5516 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:18:50.871194  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:50.919744  5371 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.871194  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.873066  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:50.920918  5520 raft_consensus.cc:2368] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:50.873265  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.856338 12907 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:50.877808  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.878113  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:50.921780  5519 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:50.879787  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:50.888751  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96124.9us
I20260709 13:18:50.929105  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.929309  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:50.930393  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.930908  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.792479 12928 consensus_queue.cc:260] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:50.931496  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.931711 12928 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.894821  5416 leader_election.cc:403] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260709 13:18:50.908330  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 97508.8us
I20260709 13:18:50.924578  5442 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:50.935576  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.937213  5518 raft_consensus.cc:2368] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:50.930491  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:50.931638  5515 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:50.938409  5443 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:50.925580  6072 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
W20260709 13:18:50.940675  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51965.1us
I20260709 13:18:50.941565  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:50.936239  5446 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 13.
I20260709 13:18:50.943636  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:50.936520 12857 consensus_queue.cc:1175] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b781c7e31b7145aea647a7ff649e6ac7" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 10 index: 9 } }
I20260709 13:18:50.917912 12964 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.966024 12935 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:50.943612 12907 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:50.966840 12888 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:50.967443 12888 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:50.968466 12888 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:50.970338 12923 consensus_queue.cc:1175] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 11 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:50.917616 12891 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:50.983652  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:50.949054  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:50.987738  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.988401  5441 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 13.
I20260709 13:18:50.990084  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:50.991377  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.991988  5449 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:50.968981 12907 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:50.994876  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.990760  5367 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:50.998698  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.999738  5443 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:50.885131 12939 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:51.005780  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 65291.8us
I20260709 13:18:51.007092  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:51.009318  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:51.010767  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.978360 12727 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:51.035058  5444 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:51.011417  5442 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:51.038311  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:50.926079 12887 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:18:51.053181  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:50.965746 12964 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.041306 12939 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.058933  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:51.059628  5446 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.997555 12891 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:51.066617  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.044886  5523 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:51.014526  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:51.017614  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:51.018497  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:51.030432  5524 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:51.069330  5443 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:51.070449  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:51.071432  5524 raft_consensus.cc:2368] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:51.072954  5521 raft_consensus.cc:1275] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:51.054052  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.055783  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.075394  5519 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:51.005352 12827 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.088619 12827 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.089987  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.091513  5370 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:51.092144 12827 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.076534  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.093914  5368 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
W20260709 13:18:51.098213 12967 log.cc:927] Time spent T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.330s	user 0.003s	sys 0.000s
I20260709 13:18:51.097457  5522 raft_consensus.cc:2468] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:51.103892  5414 leader_election.cc:400] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:51.108347  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.057117 12846 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:51.077525  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.080406  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:51.080160 12918 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.117347  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:51.081624 12697 consensus_queue.cc:1048] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:51.083910 12899 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:51.056398  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.127928  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.056756 12727 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.109660  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:51.114584  5374 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:51.115406  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.116166  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.117980  5524 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:51.118412  5489 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:51.134882  5522 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:51.119167  5448 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:51.077311  5371 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 18.
I20260709 13:18:51.126844  5366 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:51.132613  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.138826  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.139731  5523 raft_consensus.cc:2393] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:51.136065  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:51.145267  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.101979 12891 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:51.176154  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.184463  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.185212  5522 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:51.186619  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:51.188866  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.131629 12846 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:51.191074 12899 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:51.131305 12939 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:51.193794  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.142737 12897 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:51.149760 12827 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:51.146984 12895 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:51.147471 12887 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:51.231760  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.236599  5339 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:51.264099  5523 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:51.248219  5522 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:51.139565 12727 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:51.188611 12793 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:51.260419  5519 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:51.260449  5524 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:51.272370  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.273252  5522 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:51.265849  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:51.258833 12957 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.282050  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.265513 12827 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.273944 12903 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:51.270557 12775 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:51.296967  5446 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:51.285530 12719 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:51.291940 12827 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:51.306282 12891 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.309552 12750 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:51.310038  5446 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:51.310286 12750 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:51.310870  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:51.311502  5442 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:51.300060 12775 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.317940 12775 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:51.318483 12973 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:18:51.311527  5449 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:18:51.334757  6042 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:51.336390  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.342221  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:51.343319  5448 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
W20260709 13:18:51.348086  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 219497us
I20260709 13:18:51.303555 12719 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.291468 12957 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:51.356181  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 270459us
W20260709 13:18:51.349803 12972 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
I20260709 13:18:51.362509 12979 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:51.345927 12846 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.353087 12719 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:51.359400  5490 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:51.367205  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 191161us
I20260709 13:18:51.375073  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:51.375847  5414 leader_election.cc:400] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:51.377353  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.386312  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:51.363056 12979 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.388581  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:51.359956 12908 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:18:51.369303 12918 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.394703  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:51.390545  5414 leader_election.cc:400] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:51.395954  5414 leader_election.cc:403] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.388415 12887 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:51.363389 12899 consensus_queue.cc:1059] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:18:51.392252 12979 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:51.408420 12887 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:51.409624 12957 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.410164 12908 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:51.410529 12962 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.621s	user 0.002s	sys 0.006s
I20260709 13:18:51.429829 12980 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 17. Current term is 18.
I20260709 13:18:51.440515  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:51.441681 12778 consensus_meta.cc:287] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.004s
I20260709 13:18:51.444141  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.446983 12775 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.432312 12887 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:51.410658  5523 raft_consensus.cc:1275] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:51.415380  5522 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:51.407182 12750 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:51.459924  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:51.426925 12978 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:51.460526  5522 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:51.460788 12978 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:51.461200 12978 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:51.417302  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:51.421059  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:51.465835 12899 raft_consensus.cc:3055] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:51.466305 12899 raft_consensus.cc:740] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:51.467149 12899 consensus_queue.cc:260] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.468343  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:51.468555  5516 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:51.468891 12899 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:51.424894  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.392830 12897 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:51.398742 12939 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:51.470026 12939 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:51.470256  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45480.8us
I20260709 13:18:51.470468 12939 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:51.470557 12925 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:51.471098 12925 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:51.435351 12895 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:51.471721 12895 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:51.472182 12895 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:51.471961 12925 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.387972 12903 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:18:51.479301 12939 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.481047  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:51.396970 12945 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:51.481510 12939 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.481917 12945 consensus_queue.cc:1243] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:51.482905  5516 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:51.445271  5518 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:51.441244  5521 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:18:51.489732  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:51.490494  5524 raft_consensus.cc:2393] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:51.494168  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:51.496290  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.497985  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3475) took 1173 ms. Trace:
I20260709 13:18:51.499248  5375 raft_consensus.cc:2368] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20.
W20260709 13:18:51.499732  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 82553.9us
I20260709 13:18:51.501180  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:51.502672  5339 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:51.504549  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:51.498400  5444 rpcz_store.cc:276] 0709 13:18:50.311898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.314143 (+  2245us) service_pool.cc:224] Handling call
0709 13:18:50.314474 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.049964 (+735490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.485143 (+435179us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540029e0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:51.485368 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656707328}
I20260709 13:18:51.510003  5524 pending_rounds.cc:85] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 10
I20260709 13:18:51.510414  5524 pending_rounds.cc:107] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:18:51.510787  5524 raft_consensus.cc:2889] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:51.508261 12939 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:51.519021  5371 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:51.516371  5449 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:18:51.519634  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:51.524349  5373 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 26: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:51.522269  5450 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 26: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:51.513556  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:51.498896 12945 consensus_queue.cc:1048] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:18:51.473402 12925 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:51.549940  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:51.538443  5415 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.556130  5522 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:51.552583  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:51.508378 12907 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.564257  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 228465us
I20260709 13:18:51.514709 12918 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:51.508008 12742 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:51.521145 12778 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:51.535494 12730 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:51.587944  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:51.594174  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 207940us
I20260709 13:18:51.617127  5517 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
W20260709 13:18:51.603678  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 209045us
W20260709 13:18:51.621667  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 108190us
I20260709 13:18:51.548823 12978 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.625358  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:51.629102  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:51.629853  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 118740us
I20260709 13:18:51.613545 12918 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.563120 12719 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.558461 12939 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:51.644161  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:51.639915  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:51.623874 12730 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:51.572496 12887 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.647487  5371 raft_consensus.cc:2368] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:51.627352 12738 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:51.573690 12907 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.650976  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:51.651983  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:51.626909 12742 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:51.654597  5449 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:51.654676  5444 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:18:51.626900 12983 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:51.653317  5416 leader_election.cc:400] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20.
I20260709 13:18:51.658288  5416 leader_election.cc:403] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.661194  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:51.661830  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:51.644801 12918 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:51.666244  5450 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:51.621999 12888 consensus_queue.cc:1059] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:18:51.670120  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:51.640668 12778 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:51.655989 12738 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.677681 12738 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:51.628623 12713 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:18:51.649757 12775 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.650358 12730 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:51.647876 12986 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:18:51.642728 12903 consensus_queue.cc:1048] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:18:51.683918  5517 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:51.671878 12897 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:51.682379 12990 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:51.672175 12895 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.667197 12983 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:51.730031  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 76980.9us
W20260709 13:18:51.734694  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 61533.9us
I20260709 13:18:51.690740 12979 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:51.710376 12775 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:51.702440 12997 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:18:51.737257 12985 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:18:51.713368 13000 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:51.716934 12996 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:18:51.737756 12806 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.744647 12775 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:51.773327  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 113329us
I20260709 13:18:51.747965 13000 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:51.792498  5416 leader_election.cc:400] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:51.792903  5416 leader_election.cc:403] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.775456 12775 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:51.772939 13002 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.796737  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 126737us
I20260709 13:18:51.742872 12742 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.798163 12903 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:51.814391 12991 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:18:51.848513 12895 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.766952 12806 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.833501 12719 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.863441  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:51.742013 12778 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.791432 13000 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:51.851238  5449 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:51.858632  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.872346  5374 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:51.873414  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:51.877676 12891 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 19. Current term is 20.
W20260709 13:18:51.880952 12992 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.147s	user 0.001s	sys 0.001s
I20260709 13:18:51.881839 12978 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:51.883811  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.278038  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:51.891469 12887 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:51.861830 13001 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.063s	user 0.005s	sys 0.000s
W20260709 13:18:51.865299  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 125041us
I20260709 13:18:51.862937  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:51.900907  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 362559us
I20260709 13:18:51.855057 12888 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:51.876972 12738 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.922729  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:51.906186 12846 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:51.855581 13002 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.945192  5367 raft_consensus.cc:2368] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:51.917100 12888 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.924896 12996 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:51.926204 12979 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:51.950762  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 203940us
I20260709 13:18:51.965526 12996 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.943058 12846 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:51.984083  5340 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:51.929992 13004 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:18:51.985777 12806 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:52.025024  5416 leader_election.cc:400] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:52.025501  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:52.030369  5416 leader_election.cc:403] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.988521 12939 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:51.988700 12996 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.990080 12990 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:51.990527 12727 consensus_meta.cc:287] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.004s
I20260709 13:18:52.052452 12727 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:51.987651 12888 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.055526 12727 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:51.947124 12999 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:18:52.055831 12806 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:18:52.029302  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.058619  5375 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:52.059995  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:51.992527 12903 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:52.056946  5372 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:52.062851  5449 raft_consensus.cc:3060] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:52.027698  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:52.032835  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:52.031029  5374 raft_consensus.cc:2368] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:52.034955  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.039245  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:52.049554  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65567.8us
I20260709 13:18:52.035213  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:52.067736  5367 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:18:52.067998  5340 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:52.068360  5518 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:52.069442  5375 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:52.075080  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:52.076407 12979 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:52.016682 12827 consensus_meta.cc:287] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.003s
W20260709 13:18:52.004029 12899 consensus_meta.cc:287] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.535s	user 0.015s	sys 0.003s
W20260709 13:18:52.014638 13012 log.cc:927] Time spent T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:18:52.085237  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:52.081135  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:52.087248  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47331.2us
I20260709 13:18:52.098572  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:51.994959 12738 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:51.995927 12918 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.015338 12983 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:51.993326 12730 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.023166 12775 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.020467 13000 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.155238  5516 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
W20260709 13:18:52.140231  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 86986.5us
I20260709 13:18:52.099141  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:52.096802  5449 raft_consensus.cc:2468] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 15.
I20260709 13:18:52.135367  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38156 (request call id 658) took 1122 ms. Trace:
I20260709 13:18:52.104530  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:52.177982  5372 rpcz_store.cc:276] 0709 13:18:51.012590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.012761 (+   171us) service_pool.cc:224] Handling call
0709 13:18:52.135136 (+1122375us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001856d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:52.135274 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306011520}
I20260709 13:18:52.179844  5517 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:52.049155 12945 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:52.107043 13007 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:52.183947 12987 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.450s	user 0.000s	sys 0.003s
I20260709 13:18:52.184352 12888 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:52.191629  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:52.192008 13022 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:52.192260 12897 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:52.193671  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:52.224591  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:52.225232  5446 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:52.225721  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:52.132670 12957 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:52.196153  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:51.994637 13002 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.107739  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:52.083427 12994 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:18:52.205196  5416 leader_election.cc:400] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:52.237986  5416 leader_election.cc:403] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:52.239085  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:52.239179  6073 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 15: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
W20260709 13:18:52.133327 12908 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 13:18:52.211056  5444 raft_consensus.cc:2393] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:18:52.243446  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 145003us
I20260709 13:18:52.222998  5366 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:52.223299  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:52.194381  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:52.136088 12929 raft_consensus.cc:3055] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:52.231689  5370 raft_consensus.cc:2368] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:18:52.107280 12907 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:52.263883  5446 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:52.100543 12827 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.215152 12978 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:52.233000 12925 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.233597 13026 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.237799 12994 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.221983 12899 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:18:52.253924 12998 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:52.234880 13022 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.246943 12957 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:52.246016 12929 raft_consensus.cc:740] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:52.252619 12908 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:52.270021 12903 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
W20260709 13:18:52.372382  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 130341us
W20260709 13:18:52.379546  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 134798us
I20260709 13:18:52.268916 13003 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:18:52.252072 12995 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.359930  5447 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
W20260709 13:18:52.390437  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 167260us
W20260709 13:18:52.358325  5414 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.131:36363 timed out after 1.728s (SENT) [suppressed 8 similar messages]
I20260709 13:18:52.238883 12897 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:52.350432 12994 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:52.275527 12907 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.244928 13007 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.424670  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:18:52.273774 12935 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.128s
I20260709 13:18:52.440536 13003 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:52.360244 12998 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:52.441854 12998 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:52.444785 13007 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:52.423107 13034 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:52.357230 13027 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:52.344901 12978 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.447443 13008 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:52.448506 12897 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:52.448163 12907 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.435186 12995 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.451936 12846 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:52.454780 13019 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:52.456766 12998 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:52.461402 13025 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:18:52.462363 12915 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.462292  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:52.529757  6042 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:52.536171  5519 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:52.463953  5517 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:18:52.537189  5517 pending_rounds.cc:85] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 13
I20260709 13:18:52.537470  5517 pending_rounds.cc:107] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:18:52.464457  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:52.465595  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:52.458438 12994 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.465644 12999 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
W20260709 13:18:52.469640 13018 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.483s	user 0.003s	sys 0.000s
I20260709 13:18:52.348129 13026 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.475942 12957 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.482355 13000 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:52.483433 12918 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.484056 12929 consensus_queue.cc:260] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.485963 12827 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.348199 12925 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.494261 12775 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.542156 12915 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:52.507241  5520 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:52.507750  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:52.523514  5448 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 25. Current term is 26. Ops: [25.11-25.11]
I20260709 13:18:52.553354 13022 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.554448 12925 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:52.554507 12915 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.525360  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:52.513846 13008 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:52.537703  5517 raft_consensus.cc:2889] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:52.543916  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 79519.3us
I20260709 13:18:52.556363  6076 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 11.
I20260709 13:18:52.528788 12846 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.559748  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:52.549878  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:52.494535 13014 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.511s	user 0.002s	sys 0.000s
W20260709 13:18:52.544641  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 79111.3us
I20260709 13:18:52.560797  5442 raft_consensus.cc:2393] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 26: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:52.561053  5444 raft_consensus.cc:2393] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 21: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:52.546967 12979 raft_consensus.cc:2804] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:52.568044  5340 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:52.580632  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:52.580950  5517 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:18:52.581285  5521 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:52.581971  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:52.583241  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:52.584229  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:52.584733  5517 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:52.585675 12999 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:52.586573  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:52.586429 12999 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.587131  5518 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:52.588014 12719 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:52.588498  5515 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:52.585781  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:52.593489  5523 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:52.607712  5521 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:52.518142 13034 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.601227  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:52.624619  5442 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:52.558784 13008 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:52.618213  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:52.568437 13000 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.623366  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.560087 13037 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:52.567487 13017 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:52.638831  5375 raft_consensus.cc:1240] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 25. Current term is 26. Ops: [25.11-25.11]
I20260709 13:18:52.656394  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:52.657313  5519 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:52.660149  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:52.666414  5443 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:52.676668  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:52.678066  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:52.588534 12719 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:52.594631 12979 raft_consensus.cc:697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:52.722146  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.736490  5373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44106 (request call id 2702) took 1103 ms. Trace:
I20260709 13:18:52.757951 13003 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:52.758599 13003 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:52.759692 13003 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.655925 13000 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:52.733247 13018 log.cc:927] Time spent T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:18:52.636250 12629 consensus_queue.cc:1059] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:18:52.700704 13017 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.803397 13015 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:52.701406 13046 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:52.815912 13015 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.816457 13046 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.702483 12998 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.565681 12846 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.798029 12986 raft_consensus.cc:3055] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:52.819296 12986 raft_consensus.cc:740] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:52.803668 13017 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.820343 12986 consensus_queue.cc:260] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 25.11, Last appended by leader: 11, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.822009 13009 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:52.737156  5373 rpcz_store.cc:276] 0709 13:18:51.620789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.621472 (+   683us) service_pool.cc:224] Handling call
0709 13:18:51.621845 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.656289 (+ 34444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.656667 (+   378us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.673356 (+ 16689us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.899078 (+225722us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:51.899138 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.899276 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.493643 (+594367us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:52.686557 (+192914us) raft_consensus.cc:1685] finished
0709 13:18:52.686585 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.723705 (+ 37120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14950,"raft.queue_time_us":37988,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":18765,"spinlock_wait_cycles":106860800,"thread_start_us":215295,"threads_started":2,"wal-append.queue_time_us":241486}
I20260709 13:18:52.822782  5524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2870) took 1331 ms. Trace:
I20260709 13:18:52.822710 13009 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.823300  5524 rpcz_store.cc:276] 0709 13:18:51.491104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.509149 (+ 18045us) service_pool.cc:224] Handling call
0709 13:18:51.509774 (+   625us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:51.538805 (+ 29031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.538856 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:51.539611 (+   755us) log.cc:844] Serialized 52 byte log entry
0709 13:18:51.897749 (+358138us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b180035a6a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:18:51.912550 (+ 14801us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:51.912946 (+   396us) log.cc:844] Serialized 14 byte log entry
0709 13:18:51.921296 (+  8350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.921385 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.468605 (+547220us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:52.822513 (+353908us) raft_consensus.cc:1685] finished
0709 13:18:52.822536 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.822701 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43187,"prepare.queue_time_us":192,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":51504,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":12696,"spinlock_wait_cycles":139306624,"thread_start_us":14546,"threads_started":1,"wal-append.queue_time_us":407434}
I20260709 13:18:52.825803 12979 consensus_queue.cc:237] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:52.830534  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.822120 12986 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:52.834961  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:52.835824  5524 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
I20260709 13:18:52.656962 13040 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:52.850915  6041 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:52.695721  5446 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:52.856377 12976 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:52.856441  5520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36806 (request call id 2856) took 1950 ms (client timeout 1728 ms). Trace:
I20260709 13:18:52.856959 12976 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:52.857050  5520 rpcz_store.cc:269] 0709 13:18:50.902993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.940148 (+ 37155us) service_pool.cc:224] Handling call
0709 13:18:51.468197 (+528049us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d520a0 00007fc1d8d51984 00007fc1d22cc6d4 00007fc1d22cc662
0709 13:18:52.853527 (+1385330us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b540016d0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:52.853685 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295617792}
I20260709 13:18:52.857785 12976 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:52.851058 13040 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:52.875468  5442 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:52.884500 13037 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:52.896659  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.897624  5373 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:52.901743  5523 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:52.905385 13009 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:52.907264  5370 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:52.886209 13003 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:52.944162  5518 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:52.912284 12907 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:52.913043  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.913673  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:52.948494  5519 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:52.923897  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.924809  5490 leader_election.cc:400] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:18:52.949208  5490 leader_election.cc:403] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:18:52.925915 12719 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:52.926645  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.910243 12629 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:52.929510 12994 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.949271  5370 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:18:52.925786  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.908631 12697 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:18:52.946669  5517 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:18:52.954672  5367 raft_consensus.cc:2368] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27.
I20260709 13:18:52.955225  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:52.958153  5370 raft_consensus.cc:2393] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:52.959777  5366 raft_consensus.cc:1240] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:52.910944  5443 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:18:52.967964  5520 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:18:52.969079  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:52.980979  5521 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:52.981845  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:52.982482  5522 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:52.958981 12907 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:18:52.966668 12918 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:52.959394 12629 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.987313 12846 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:52.986723 12925 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:53.003576 12978 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:52.962373 13040 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.988209 13037 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:52.978488 13017 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:53.034813  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 59029.2us
I20260709 13:18:53.036303  5522 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 28.
W20260709 13:18:53.029068 12945 consensus_meta.cc:287] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.827s	user 0.007s	sys 0.007s
I20260709 13:18:53.038656 12945 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23.
I20260709 13:18:53.039255 12978 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:53.039779 12978 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:53.042109 12978 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:53.089401 12978 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.095907 12978 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.098212 12978 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:53.098258 13000 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:53.101933  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:53.103184 12989 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:53.103610 12989 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:53.104022 12989 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:53.106832  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.108135 12945 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:53.108690 12945 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:53.110481  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.110867 12945 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:53.111579 12697 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:53.106976  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:53.045030 13049 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:53.118160 12989 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:53.119843 12629 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:53.119997 12999 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.120561 12998 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:53.121145 12998 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.122311  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:53.123304 12998 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.123481 12989 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:53.125113  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.125753  5443 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 11.
I20260709 13:18:53.127635 13008 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:53.128096  5372 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:53.128700  5516 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 23. Current term is 24. Ops: []
W20260709 13:18:53.131182  5414 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.008s	sys 0.052s
W20260709 13:18:53.131657  5414 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.009s	sys 0.052s
I20260709 13:18:53.020182 12925 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:53.140869  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 782533us
I20260709 13:18:53.142620 12925 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:53.143441  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.137616 12730 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.152345  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:53.153465  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:53.154417  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.155522  5521 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:53.156598  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:53.137840 13015 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:53.138940 13034 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.018836 12918 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:53.147781  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.148301  5450 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:53.151147  5522 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:53.171070  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:53.175302  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:53.176009  5521 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 14: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:53.173772  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.159789  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:53.162730  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.178224  5517 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:53.163403  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:53.179226  5518 raft_consensus.cc:2393] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 11: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:53.163573  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.179545  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.180068  5442 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:53.180202  5449 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:53.164544  5524 raft_consensus.cc:1240] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:53.165102  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.165582  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.182484 12929 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:53.179010  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:53.184679  5369 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 14.
I20260709 13:18:53.164783  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.159003 12738 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:53.185739  5446 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:53.188170 12976 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:53.069742 13035 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.120s
I20260709 13:18:53.189962 13046 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.151820 12988 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:18:53.193528  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:53.194373  5447 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:53.194523 13008 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:53.197197  6072 raft_consensus.cc:2368] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:18:53.201830  5443 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 12. (term mismatch)
I20260709 13:18:53.202394  5443 pending_rounds.cc:85] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 11
I20260709 13:18:53.202664  5443 pending_rounds.cc:107] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 24.12
I20260709 13:18:53.203040 12976 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.203330  5443 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:53.174724 13049 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.205509 13049 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.206277  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:53.207008  5520 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:53.209059 12778 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:53.209843 12778 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:53.210222 12738 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:53.210906  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:53.210738 12738 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:53.210703 12778 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.211277  5415 leader_election.cc:400] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:18:53.211630  5415 leader_election.cc:403] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:18:53.211992 12738 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.212805 12994 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:18:53.174173  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.177342  5515 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:53.181126  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:53.217098  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.215664 12989 raft_consensus.cc:3060] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:53.222512  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.230683  5447 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 28.
I20260709 13:18:53.235100  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:53.235320  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:53.236285  5490 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.236922  5414 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:53.237323  5520 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
I20260709 13:18:53.238317  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:53.243198  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.243485  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:53.244145  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.244469  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.245357  5520 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:53.170311 12918 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:53.250723  6041 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:18:53.296109  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.194626 12995 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:53.300451  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52443.3us
W20260709 13:18:53.300771  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50135us
I20260709 13:18:53.301144  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:53.296856  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.302450  5524 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:53.298501  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.304351  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:53.222314 13049 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.160923 12925 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.114s
I20260709 13:18:53.221668 12994 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:53.307955  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:53.235368 13023 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:53.299563  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48933.3us
I20260709 13:18:53.215582 13017 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:18:53.234932 12697 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:53.254582 13003 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:18:53.298699 13034 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.274557 12750 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:53.275115 12978 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:53.274508 12998 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.314551 13015 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:53.307039 12923 raft_consensus.cc:2804] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:53.326738  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.329979  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.332602  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.372694  5442 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:53.313783  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.336902  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:53.274940  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:53.339505  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.346194  5519 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:53.373616  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.348574  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:53.374544  5369 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:53.348634  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:53.254422 12993 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:18:53.254999 12899 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:18:53.234349 13021 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:53.354159  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:53.379046  6043 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.017s	sys 0.041s
W20260709 13:18:53.379451  6043 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.017s	sys 0.042s
W20260709 13:18:53.379792  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 665517us
I20260709 13:18:53.380353  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.355792  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.381685  5443 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 14.
I20260709 13:18:53.384012  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.384678  5445 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:53.275224 12945 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:53.314307 12629 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:53.378516  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:53.320338  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:53.368367  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:53.339424 13026 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:53.346910  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:53.373842  5448 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:53.405840  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.358325 12978 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.339040 13023 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.425740  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:53.428650  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:53.442849  5450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 3189) took 1223 ms. Trace:
I20260709 13:18:53.443392  5450 rpcz_store.cc:276] 0709 13:18:52.191991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.194153 (+  2162us) service_pool.cc:224] Handling call
0709 13:18:53.415228 (+1221075us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b540019c654. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:53.415391 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827235584}
I20260709 13:18:53.377370 12697 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:53.412449 12986 consensus_meta.cc:287] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.004s
W20260709 13:18:53.452155  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 112400us
W20260709 13:18:53.440259 13047 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:18:53.403961 13003 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 28 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:18:53.457121  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 78664.2us
I20260709 13:18:53.423269 12978 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:53.446798 13030 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:18:53.357942 13034 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.406566 13021 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.440412 12903 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.377025 13015 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.461712  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.424752 12923 raft_consensus.cc:697] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:53.465023  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:53.470168  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 200972us
I20260709 13:18:53.452414 12697 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:53.462553 13040 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:53.511144  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.495954  5414 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:53.521857  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56904.1us
I20260709 13:18:53.441497 12994 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.542421  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:53.525033 12750 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.523000 13040 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:53.547019  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:53.550535  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 72105.7us
I20260709 13:18:53.558619  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:53.530375 12997 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:53.488055 12903 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.544203 13000 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:53.563730 13040 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:53.591846  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 96658.4us
I20260709 13:18:53.565477 12997 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.566850 13011 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:53.577607 12899 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:53.554279 12945 consensus_queue.cc:1059] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:53.577386 13048 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:53.605989  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 196081us
I20260709 13:18:53.577703 12793 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:18:53.603389  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 141778us
I20260709 13:18:53.562323 12750 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.619256  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.546188 13003 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.622435  5490 leader_election.cc:400] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27.
I20260709 13:18:53.603816 12997 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:53.638561  5490 leader_election.cc:403] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 13:18:53.640712  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.642303  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.580689 13068 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:18:53.663761  5367 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 13:18:53.607970 12899 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:53.668713  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 108633us
I20260709 13:18:53.676563  5489 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.618872 12793 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:53.680238 13054 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:18:53.609807 13011 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.583098 12923 consensus_queue.cc:237] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:53.681362 12899 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:53.691596 12793 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:53.680441 13026 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27.
I20260709 13:18:53.692130 12730 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:18:53.751526  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 114339us
I20260709 13:18:53.694932 13023 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:53.745968 13057 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:18:53.733498 13076 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:53.773321  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 152270us
I20260709 13:18:53.774471  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:53.776152  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 91137.8us
W20260709 13:18:53.757601 13060 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.277s	user 0.001s	sys 0.001s
I20260709 13:18:53.743993 13034 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.738238 13066 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:53.748692 13000 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:53.751633 13078 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:53.783314  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:53.766487 13055 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 13:18:53.767999 13061 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:18:53.755127 13021 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.794337 13086 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:53.839665 13086 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.840175 13086 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:53.795123 13079 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:53.798116 13067 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:18:53.801349  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:53.806310 12750 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:53.814105 13058 log.cc:927] Time spent T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 13:18:53.815502 13072 log.cc:927] Time spent T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:53.817973 12981 raft_consensus.cc:3055] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:53.823078 12806 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:53.885602 12806 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:53.887959 13083 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:53.886700 12806 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.764819 13015 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:53.766001 13081 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:18:53.856487  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55392.7us
I20260709 13:18:53.891753  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.893400 13035 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:53.895397 13086 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.897377 12903 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.898041 12903 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:53.898518 12903 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:53.899991 13070 log.cc:927] Time spent T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
I20260709 13:18:53.868060 13077 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:53.860996 13079 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.876452 12981 raft_consensus.cc:740] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:53.879954 13011 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:53.888792 13083 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:53.907713  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:53.842944 13065 raft_consensus.cc:3055] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:53.920462 13065 raft_consensus.cc:740] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:53.909286 12993 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 13:18:53.904119 12989 consensus_meta.cc:287] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.001s
W20260709 13:18:53.919598 12929 consensus_meta.cc:287] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.000s
I20260709 13:18:53.903304  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:53.836138  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43667.2us
W20260709 13:18:53.968817  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 65549.8us
I20260709 13:18:53.969944  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:53.988303  5521 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:53.989485  5447 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:53.907639 12903 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:53.994798  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 364643us
W20260709 13:18:54.000378  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.002712  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:53.951117 12806 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:53.933087 13077 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.004806  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.010661  5517 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 21: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:54.008996  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.014349  5521 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
W20260709 13:18:54.015636  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 422585us
I20260709 13:18:53.971935 12989 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599) with higher term. Message: Invalid argument: T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 11. Current term is 12.
I20260709 13:18:54.021993  5516 raft_consensus.cc:1240] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:54.021062  5517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:53.991159 13076 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:54.003016 13046 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:54.018402  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:53.994699 12895 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:53.791304 12945 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.213s
I20260709 13:18:53.989715 13079 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:54.005702  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 363451us
W20260709 13:18:54.020035  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 447220us
I20260709 13:18:53.994340 12957 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:53.935122 12697 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.022957  5517 raft_consensus.cc:606] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.029240  5521 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:54.029491  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:54.033058  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.016646 13077 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.017683 13026 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:54.056763  5515 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:18:54.059536  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.015200 13027 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:54.024571 12929 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.059752  5517 raft_consensus.cc:614] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:54.060734  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:54.035547 13034 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:54.078975  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.079267  5448 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:54.080068 13089 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.086855 13089 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.071789 13040 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.088316  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.089783 13094 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.090409 13094 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.091193 13088 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.091954 13088 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.092636 13094 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.020135 13065 consensus_queue.cc:260] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.093307 12989 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:54.094017 12989 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.094451 12989 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:54.037575 12899 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:54.084048  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:54.082931  5490 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.084201  5450 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:54.099752  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.100409  5521 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:54.085438  5449 raft_consensus.cc:2468] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 12.
I20260709 13:18:54.084604  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.089128 13089 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.056069 13046 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:54.110971 13066 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.111732 13066 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.116451 12697 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:54.111176 12899 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:54.080096 12929 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.121033 12929 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.104065 13086 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:54.124127 13096 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:54.125254 13076 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.080242 13027 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:54.136291  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.147017 13083 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.149780 13035 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:54.150672 13098 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:54.137882  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.152393  5443 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:18:54.153582  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.154192  5443 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.150597 13035 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:54.151844 13011 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:54.160845 13095 consensus_queue.cc:1175] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "544c82a50cc4477886bb6f7d58f455ca" responder_term: 21 status { last_received { term: 21 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 21 index: 12 } }
I20260709 13:18:54.149014 12997 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.077332 13026 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.164847 12997 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.166940 13026 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:54.072305 12925 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:54.072834 13074 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:18:54.139204 13088 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.140223 13065 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.036104 12895 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.173660  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.178372  5443 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
W20260709 13:18:54.186864  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 104009us
I20260709 13:18:54.189682 12697 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:54.192381  5517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "862a628beec44315b003538bc747056b"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:18:54.192664  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 108684us
I20260709 13:18:54.193089  5517 raft_consensus.cc:606] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.193753  5414 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:54.180505 12978 consensus_meta.cc:287] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.703s	user 0.006s	sys 0.006s
I20260709 13:18:54.198995  5340 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:54.179116 12925 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.202688  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:54.203962  5446 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:54.205456  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.185380 12907 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.195044 13068 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.210245  5446 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:54.210355  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.046973 12981 consensus_queue.cc:260] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:54.207053 13037 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:54.214932  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.216223  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.223102  5515 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:54.197634 13003 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:54.207581  5443 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:54.220072  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.224493  5520 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:54.211656  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.196967 13083 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:54.208168 12925 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:54.204679 13089 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:54.226934  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.202838 13099 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.230240  5446 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:54.224241 13037 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.203115 12978 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.250797 13093 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:54.249387  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:54.261410  5446 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:54.268752  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.274842  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.276000  5519 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:54.308384  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.226127 12923 consensus_queue.cc:1059] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:18:54.233493 13089 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.220818 12907 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.224542 12793 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.317997  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a64a51af80064074aad9aefb8f176299"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:54.326231  5522 raft_consensus.cc:606] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.243187 13099 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:54.319975  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.303937 12929 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:54.230811 13003 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:54.222424 13068 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.252604 13037 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:54.232090 12957 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
W20260709 13:18:54.342487  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 110386us
I20260709 13:18:54.244292 12983 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:54.347482  5441 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: [25.12-25.12]
I20260709 13:18:54.247437 13075 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 13:18:54.364061  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.374518  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.375056  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.375715  5374 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:54.375870  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.377490 12907 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:54.381809 13027 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:54.382994 13105 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:18:54.383374 13003 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:54.384469 12925 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:54.386482  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.324509 13089 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:54.334220 12827 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.342051 12929 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.338464 13093 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:54.373379  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.388986  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.390017  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.393713  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.394587  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.336828 13011 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:18:54.396402  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.396555  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:54.397743  5374 raft_consensus.cc:2393] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 15: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:54.398311  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:54.405455 13110 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:18:54.407907 13099 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:54.408979 13084 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.530s	user 0.002s	sys 0.000s
I20260709 13:18:54.410880 13079 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:54.412364 12978 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:54.409864 13077 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.414279 13068 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.415992  5370 raft_consensus.cc:1275] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:54.392154 12929 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.398711 13066 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.421880 13065 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:54.398172 13117 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.441792  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.432929  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:54.409885 12793 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.391696 12983 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:54.392004 12827 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.463397  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.431018 12907 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:54.433542 12895 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.422959 12957 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
W20260709 13:18:54.478566  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 82516.2us
I20260709 13:18:54.466657  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.480422  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.481379  5369 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:54.457891 13008 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.476594 12989 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:54.544224  5375 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:54.484550 13066 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:54.489840 13111 log.cc:927] Time spent T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:18:54.490782 12775 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.491505 13103 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.491626 13093 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.492288 13118 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.493403  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
W20260709 13:18:54.496711  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.556902  5415 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:54.499490 13077 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.457003 13065 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.542394  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.542632  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:54.543017  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:54.460949 12925 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:54.541646 12806 consensus_meta.cc:287] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.001s
I20260709 13:18:54.552047  5448 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:54.541584 12895 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.553098 12995 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:54.566463  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:54.567737  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:54.579599  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:54.569630  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.570825  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.571285  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.562810  5524 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:18:54.501037 12907 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:54.555022  5521 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.594496  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:54.595854  5369 raft_consensus.cc:2368] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:18:54.545047 13008 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.560452 13088 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.568387 13065 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:54.597536  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:54.617215  5524 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:54.590689  5523 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:54.618618  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:54.553790 12775 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.626040 12775 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.626611  5519 raft_consensus.cc:1240] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:54.630205 12827 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.632011  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58818 (request call id 3522) took 1305 ms. Trace:
I20260709 13:18:54.632441  5447 rpcz_store.cc:276] 0709 13:18:53.326307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.326458 (+   151us) service_pool.cc:224] Handling call
0709 13:18:54.631817 (+1305359us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b540019cb54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:54.631947 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419118976}
I20260709 13:18:54.581979 13017 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.594820 12978 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:54.596675  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:54.561482 13118 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.637893  5490 leader_election.cc:400] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:18:54.568490 12899 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.582289 12903 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:54.622885  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:54.582501 12895 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.633677  5521 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:54.634076  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:54.567987 12793 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:54.633178  5524 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:54.635085  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.648926  5447 raft_consensus.cc:2368] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22.
I20260709 13:18:54.596393 12730 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:54.638262  5490 leader_election.cc:403] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:18:54.559322 13103 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.598712 13068 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:54.639443 13066 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:54.651160  5521 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:18:54.639492 13052 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: Append to log took a long time: real 1.253s	user 0.004s	sys 0.000s
I20260709 13:18:54.641628  5369 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:54.660344  5519 raft_consensus.cc:1240] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:54.640058 13017 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.662555  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.684557  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:54.666285  5444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3533) took 1334 ms. Trace:
I20260709 13:18:54.678318  5414 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:54.685197  5444 rpcz_store.cc:276] 0709 13:18:53.332266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.408997 (+ 76731us) service_pool.cc:224] Handling call
0709 13:18:53.445449 (+ 36452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.513176 (+ 67727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.513209 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.513277 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:53.513307 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.666065 (+1152758us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b5400238a54. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:54.666112 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.666225 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155262208}
I20260709 13:18:54.668407 13068 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.662834 13103 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.670120 12989 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:54.658377 12978 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:18:54.692226  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:54.669760 12903 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.693859 12903 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.694279  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3499) took 1398 ms. Trace:
W20260709 13:18:54.694913  5449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39322 (request call id 623) took 1477 ms (client timeout 1553 ms). Trace:
W20260709 13:18:54.695574  5449 rpcz_store.cc:269] 0709 13:18:53.217876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.251272 (+ 33396us) service_pool.cc:224] Handling call
0709 13:18:54.694732 (+1443460us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54003223d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:54.694855 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671044480}
I20260709 13:18:54.696202 12903 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.696787 12903 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.696820  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.676949  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.697680  5449 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:54.698379  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.698701  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.699083  5515 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:54.699501  5449 raft_consensus.cc:2368] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:18:54.700440  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.702381 13083 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:54.702858  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:54.703632 13083 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:54.705605  5521 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:54.706971 12907 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:54.708774  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:54.658399 12806 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:54.662770 12895 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.666304 12983 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.642608 12827 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:18:54.689915  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.689790 13068 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.767195  5366 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:54.692874 12995 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:54.672956 13118 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.693142 12989 raft_consensus.cc:2764] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:18:54.693316 13017 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.687345 12775 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.717283  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:54.719071  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.715801  5517 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:54.712811  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:54.710497  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.694657  5518 rpcz_store.cc:276] 0709 13:18:53.296032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.296170 (+   138us) service_pool.cc:224] Handling call
0709 13:18:53.296612 (+   442us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:53.409202 (+112590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.409253 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:53.409895 (+   642us) log.cc:844] Serialized 52 byte log entry
0709 13:18:53.554747 (+144852us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:53.554811 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.681790 (+1126979us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540016cbd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:54.681843 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.681899 (+    56us) raft_consensus.cc:1685] finished
0709 13:18:54.681913 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.694212 (+ 12299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4588,"raft.queue_time_us":8879,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":18390,"spinlock_wait_cycles":247269632,"thread_start_us":94512,"threads_started":1,"wal-append.queue_time_us":163011}
W20260709 13:18:54.730973 13119 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 13:18:54.646984 12899 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.697409 12903 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.713843 13089 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.634306 13088 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.713356  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:54.725875 12988 consensus_queue.cc:1048] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:54.735052  5522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:54.841042  5522 raft_consensus.cc:606] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:54.841540  5522 raft_consensus.cc:614] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:54.711539 13008 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:54.709914  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:54.842489  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:54.709340 13123 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:54.708827 13011 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:54.843497  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.843983 13090 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.718298  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.844023 13011 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.844830 13090 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.845225  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.845618  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.846549  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.705320  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:54.777920 12995 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:54.710011  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:54.847457  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 142215us
I20260709 13:18:54.847563 13023 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:54.847829  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.848093 13023 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.848202  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.848583 13023 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.848914  5444 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:54.850009  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.744479 13103 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:54.850697 13103 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:54.711974  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.721534 13037 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.746491  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:54.742074 12929 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.679203 13066 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:54.870158  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.767732  5369 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 15.
I20260709 13:18:54.753489 12806 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.843444 13088 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.787397  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:18:54.889231  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 101980us
I20260709 13:18:54.890244  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.891184  5375 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
I20260709 13:18:54.891608  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:54.846695 13011 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.846894  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.743721  5521 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:54.843680  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.739534  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.856133  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:54.848798  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:54.862937  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:54.896740  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 48021.4us
I20260709 13:18:54.871223  5443 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:54.820902 13118 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.780061 13065 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.875608  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:54.876022 13103 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:54.876296 12806 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.878059  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.879302  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:54.881623 13090 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.884016 13040 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.864675 12976 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:18:54.820119 12918 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:18:54.852633 12895 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.918251 12895 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.918536 13008 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:54.914201 12793 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.920154 12793 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.920646 12895 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:54.922304 13085 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.546s	user 0.000s	sys 0.005s
I20260709 13:18:54.922847  5367 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:54.923815  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3532) took 1591 ms. Trace:
I20260709 13:18:54.924091  5367 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:54.924192  5445 rpcz_store.cc:276] 0709 13:18:53.331975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.408600 (+ 76625us) service_pool.cc:224] Handling call
0709 13:18:53.449083 (+ 40483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:53.624262 (+175179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.624315 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:53.625151 (+   836us) log.cc:844] Serialized 26 byte log entry
0709 13:18:53.644241 (+ 19090us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:53.644307 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.376140 (+731833us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b18002b1b00. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:18:54.921715 (+545575us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:18:54.923528 (+  1813us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540023a854. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:54.923577 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.923628 (+    51us) raft_consensus.cc:1685] finished
0709 13:18:54.923639 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.923760 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":185771,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":9518,"spinlock_wait_cycles":449596928,"thread_start_us":51496,"threads_started":2,"wal-append.queue_time_us":167531}
I20260709 13:18:54.927306 12995 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.927803  5445 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:18:54.928611  5367 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: []
W20260709 13:18:54.930227 13071 log.cc:927] Time spent T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 1.274s	user 0.000s	sys 0.004s
I20260709 13:18:54.822103 12775 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.902472 13094 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:18:54.932367 12775 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.933609 13037 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.905087 13093 consensus_queue.cc:1059] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:18:54.938359 13068 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.887542  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.780369 13091 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.897519  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:18:54.941990  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 44570.1us
W20260709 13:18:54.766453 12994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.014s	sys 0.002s
W20260709 13:18:54.943377 12994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.020s	sys 0.006s
I20260709 13:18:54.907182 13118 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:54.899451  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:54.944159  6076 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:54.944034 13091 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.946671  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.949744  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.949970  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.950528  5518 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:54.902426  5375 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:54.898209 13003 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:54.907996  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:54.950232  5441 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:54.953500  5446 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.953052  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.952977  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:54.908646 12989 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:54.874311 13066 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:54.911729 12827 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:54.911826  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:54.954825  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:54.959522  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:54.940003 13117 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:54.949471 13095 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:54.947043 12976 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:54.945298 13118 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:54.947798 13088 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.946408 13008 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:54.949916 13094 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.998100 12986 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:54.998437 12995 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:55.058368 13133 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:55.058151 12986 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.060110 12793 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.060477 12986 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:54.960557 13068 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.061715 13068 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:55.063546  5450 raft_consensus.cc:1275] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:55.063608  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.065194 13068 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:55.065594 13099 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:55.066016  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.066156 13099 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.068217 13099 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:54.960126 12989 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.072896  5446 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:55.076748  5442 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:54.939244 13077 consensus_queue.cc:1059] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:18:54.962419 12827 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:54.999272 12775 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:55.123251  5489 leader_election.cc:400] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22.
I20260709 13:18:55.020147 12895 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:18:55.103848 13008 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:54.962534 13003 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:55.139775  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:55.134080  5489 leader_election.cc:403] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.134654  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.133665 13090 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.080606 12989 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:55.074052 12793 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.171947  5446 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:18:55.147411 13128 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:18:55.206955  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 83916.1us
I20260709 13:18:55.140522 12775 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:55.125779 12925 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.993559 13078 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.159s
I20260709 13:18:55.137495 12827 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:55.211532  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:55.210518 13090 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.090570 12976 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:55.077131 13088 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.226702  5489 leader_election.cc:400] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:18:55.230710  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.153654 13023 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.236157  5449 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:55.243609 13136 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:18:55.259095 12827 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.262247 12827 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.264780 12978 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:55.212615 13081 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 21. Current term is 22.
I20260709 13:18:55.275781  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.213801 12775 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.277226  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.277832  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:55.280054  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.280551  5450 raft_consensus.cc:1240] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:18:55.280700  5441 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:55.266045 13091 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.078349 13094 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.213147 12793 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.277899 12929 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.227442 12925 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.291932  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:55.294176  5450 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:55.277693 12899 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.273243 13098 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:55.295111  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.285872 13065 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:55.302886  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 72249.5us
I20260709 13:18:55.303810  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.313251 13077 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.314078 13077 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.319496 13089 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:55.322274 13135 log.cc:927] Time spent T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:18:55.323485  5523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 2903) took 1074 ms. Trace:
I20260709 13:18:55.323869  5523 rpcz_store.cc:276] 0709 13:18:54.249473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.619437 (+369964us) service_pool.cc:224] Handling call
0709 13:18:54.619757 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.620148 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.620176 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.620634 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.896251 (+275617us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:54.896294 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.896359 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.323264 (+426905us) raft_consensus.cc:1685] finished
0709 13:18:55.323287 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.323427 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":275167,"threads_started":1,"wal-append.queue_time_us":519607}
W20260709 13:18:55.327944  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.329622 12738 raft_consensus.cc:3055] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:55.330120 12738 raft_consensus.cc:740] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:55.330192 12976 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.331104 12738 consensus_queue.cc:260] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.332264 12738 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:55.333531 12629 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:55.339614 12806 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.340656 13090 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.341934 13023 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.344956  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.346745  5489 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.347576 13140 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:55.348078 13091 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:55.349017  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:55.355607  5442 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:55.363791  5489 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.300393 13098 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:55.354125 13094 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.376806  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:55.379377  5442 raft_consensus.cc:1240] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: [25.12-25.12]
I20260709 13:18:55.380574  5416 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:55.383838 13090 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:55.386003  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:55.390650 12793 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.297875 13003 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.368141 12899 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:55.367369 13098 raft_consensus.cc:3060] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.368379 12629 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:55.395735 12907 raft_consensus.cc:993] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:55.404104  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:55.413125 13090 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:55.405341 13094 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:55.407228 12899 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:55.422631 12899 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:55.428025 12989 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.428782 12925 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.429761  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:55.407837  5450 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:55.444046  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:55.450536  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.446547 13090 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:55.449100 12907 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:18:55.452559 13090 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:55.453212 13090 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:55.451329  5441 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:18:55.460449  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:55.463878  5269 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 160) took 12009 ms (client timeout 15000 ms). Trace:
I20260709 13:18:55.441210  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:55.466766  5416 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:55.467154  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.441517 13142 raft_consensus.cc:1081] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:55.470340  5443 raft_consensus.cc:1240] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:18:55.471144 12730 raft_consensus.cc:3055] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:55.471654 12730 raft_consensus.cc:740] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:55.471176 12907 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.463155  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.467784  5447 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:55.472710 12907 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.473958 12929 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:55.476058 12907 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.473722  5441 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:55.485136  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.487126  6042 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.488210  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:55.486845  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:55.489267  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:55.489965  5523 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.463546 13081 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:55.497226 13081 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.498298 12986 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:55.498696 12986 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:55.499454 13081 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.499584 12986 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.483994 12929 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:18:55.501547 13139 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:55.501953 13139 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:55.493201  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.503312  5523 raft_consensus.cc:2468] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:55.493474  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.494053  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.505589  5515 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 27 because replica has last-logged OpId of term: 25 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 10.
W20260709 13:18:55.494666 13066 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.003s
I20260709 13:18:55.494738  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.495993 13088 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.489775 12976 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:55.507577  5516 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:55.501936  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.506827  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3239) took 1295 ms. Trace:
I20260709 13:18:55.508643  5443 rpcz_store.cc:276] 0709 13:18:54.211575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.943399 (+731824us) service_pool.cc:224] Handling call
0709 13:18:54.943780 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.470773 (+526993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.506515 (+ 35742us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54003bd154. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:55.506758 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1210359680}
I20260709 13:18:55.508592 13066 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.510691  5450 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:55.510799  5518 raft_consensus.cc:2368] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
W20260709 13:18:55.512408  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.512650 13066 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:55.464497  5269 rpcz_store.cc:269] 0709 13:18:43.438233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.438420 (+   187us) service_pool.cc:224] Handling call
0709 13:18:43.698367 (+259947us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf6090 00007fc1d3d94f3a 00007fc1d9b4b1cc 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:55.447685 (+11749318us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:49.332219 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:49.333200 (+   981us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:49.333276 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:18:49.333307 (+    31us) tablet.cc:662] Decoding operations
0709 13:18:49.335621 (+  2314us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:49.335768 (+   147us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:49.335815 (+    47us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:49.353299 (+ 17484us) tablet.cc:701] Row locks acquired
0709 13:18:49.353369 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:18:49.353637 (+   268us) write_op.cc:270] Start()
0709 13:18:49.353837 (+   200us) write_op.cc:276] Timestamp: P: 1783603129353554 usec, L: 0
0709 13:18:49.353869 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:18:49.373751 (+ 19882us) log.cc:844] Serialized 6693 byte log entry
0709 13:18:49.884931 (+511180us) op_driver.cc:464] REPLICATION: finished
0709 13:18:49.967631 (+ 82700us) write_op.cc:301] APPLY: starting
0709 13:18:49.967697 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:50.036825 (+ 69128us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:50.036942 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:50.780731 (+743789us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:50.781014 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:18:50.781064 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:50.790054 (+  8990us) log.cc:844] Serialized 155 byte log entry
0709 13:18:50.790241 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.790412 (+   171us) write_op.cc:454] Released schema lock
0709 13:18:50.790475 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:50.874827 (+ 84352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:50.875983 (+  1156us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":236451,"reported_tablets":43,"spinlock_wait_cycles":493741824,"child_traces":[["op",{"apply.queue_time_us":82484,"apply.run_cpu_time_us":26371,"apply.run_wall_time_us":895636,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75187,"num_ops":17,"prepare.queue_time_us":160519,"prepare.run_cpu_time_us":20395,"prepare.run_wall_time_us":250296,"raft.queue_time_us":174144,"raft.run_cpu_time_us":34375,"raft.run_wall_time_us":76347,"replication_time_us":530854,"thread_start_us":359120,"threads_started":4,"wal-append.queue_time_us":229142,"wal-append.run_cpu_time_us":54505,"wal-append.run_wall_time_us":2164175}]]}
I20260709 13:18:55.506940 13139 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.514460 13139 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.484243 13089 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:18:55.519259  5517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:18:55.472590 12730 consensus_queue.cc:260] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:55.520147  5517 raft_consensus.cc:606] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.520825 12730 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:55.522352 12903 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.524988  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:55.525162 12629 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:55.487389 12978 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.478163 13094 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:55.537505 13094 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:55.537957 13094 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:55.534853  5522 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:55.501317 12986 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.553215  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.553809  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.556383  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.559562 13035 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:55.562044 13081 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.562637 13081 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.563607 13095 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:55.564002 13095 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:55.564806 13081 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.566850  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.570120  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:55.570979  5373 raft_consensus.cc:2368] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:55.525779 12629 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.536561 12978 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.570680  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.573613  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.578006  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.580183  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.501538  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:55.576030  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:55.581866  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 80429us
I20260709 13:18:55.582557  5489 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.586822  5372 raft_consensus.cc:1240] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27. Ops: []
I20260709 13:18:55.587327  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.588052  5373 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:55.597442  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.628237  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39322 (request call id 628) took 1242 ms. Trace:
I20260709 13:18:55.528540 12989 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.695931  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:18:55.701599  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 120410us
I20260709 13:18:55.696324  5367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:59536
I20260709 13:18:55.698246  5450 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:18:55.705065  5447 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:18:55.628094 13068 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:18:55.707577  5441 raft_consensus.cc:2410] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 13:18:55.602118 13117 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:55.564996 13095 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.585328  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:55.627866 13081 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:55.713874  5445 rpcz_store.cc:276] 0709 13:18:54.386283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.950054 (+563771us) service_pool.cc:224] Handling call
0709 13:18:54.994323 (+ 44269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.075516 (+ 81193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.075549 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.093597 (+ 18048us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.368880 (+275283us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:55.368944 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.578436 (+209492us) spinlock_profiling.cc:243] Waited 79.5 ms on lock 0x7b54002ad0d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:55.578509 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.578573 (+    64us) raft_consensus.cc:1685] finished
0709 13:18:55.578589 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.628162 (+ 49573us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20129,"raft.queue_time_us":2800,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":57617,"spinlock_wait_cycles":182828416,"thread_start_us":137239,"threads_started":1,"wal-append.queue_time_us":238434}
W20260709 13:18:55.736706  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 151423us
I20260709 13:18:55.737816  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.741786  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.743921  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.745711  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.747833  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.749522  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:55.749850  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:55.701433 13078 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:55.737816  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:55.754647  5416 leader_election.cc:400] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:55.755587  5416 leader_election.cc:403] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.706445 13068 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:55.701084 12925 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:55.765108  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.766126  5375 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
I20260709 13:18:55.695142 13066 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:55.628726 12923 consensus_queue.cc:1048] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:18:55.775418  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.776146  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:55.777081  6040 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.779075  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.730741 13035 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.780675  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.728758 12994 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:55.790717 12629 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.696902 12775 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:55.795797 13011 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:55.763981 12999 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
W20260709 13:18:55.797829  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 94814.6us
I20260709 13:18:55.762995 13068 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:55.731069 13081 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:55.819200  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.820811  5366 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:55.822319  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.823841  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:55.818467  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:55.762363 12929 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:55.772426 12907 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:55.835608  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:55.824867 13078 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:55.823436 12957 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:55.848145 12978 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:55.848670  5370 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:55.762053 12738 consensus_queue.cc:1059] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:18:55.819027 12793 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:55.769239 12778 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:18:55.855666 12775 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:55.866775 13074 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:55.859076  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:55.839232  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:55.845220 13122 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:55.852545 13081 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.873011  5340 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:55.803970 13066 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.857653 12907 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.772737 12925 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.802380 12899 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.822831 13035 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.867043 13078 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.889885 13090 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.824200 12994 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:55.896756  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 197011us
I20260709 13:18:55.904039  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:55.926800  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.906347  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:55.928167  5518 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:55.908211 13165 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.878338 12629 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:55.923787  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:55.891844 12989 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:55.915127 12907 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:55.931011  5521 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:55.914551 13049 raft_consensus.cc:3055] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:55.916210 12738 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:55.926054 13078 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:18:55.935791  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 107056us
W20260709 13:18:55.947680  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.878032 12793 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:55.933661 12989 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.937230 13065 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:55.888409 13068 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.934293 13122 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:18:55.963793  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 140645us
I20260709 13:18:55.946357 12730 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:55.939000 13049 raft_consensus.cc:740] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:55.959273 12978 consensus_queue.cc:1059] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:18:55.978266 13049 consensus_queue.cc:260] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.978948  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:55.979766 13049 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:55.982041 13148 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:18:55.984601  5524 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:55.986007  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 540366us
W20260709 13:18:55.987517  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.987540 13023 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.988225 13023 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:55.990463 13023 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:55.994726 12994 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.006479 12925 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.010236 13068 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:55.939455 13165 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.015641 13165 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.018206 12793 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:56.022588  5367 raft_consensus.cc:606] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:56.036849  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.038312  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.040222 12793 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:56.040843 12793 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:56.041780 12793 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:56.042546  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.044456  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:56.049304  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:56.050261 12899 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.052366 13077 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.054291 13091 raft_consensus.cc:993] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:56.054647 12629 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.054821 13091 raft_consensus.cc:1081] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:56.055171 12629 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:56.055713 13091 raft_consensus.cc:3055] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:18:56.056092 13091 raft_consensus.cc:740] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:56.058121 13158 log.cc:927] Time spent T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:56.060998  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.061292  5517 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:56.062264  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:56.066545  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.961935  5518 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:56.057361  5339 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:56.073045  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.081404  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.082806  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:55.967411 12989 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:56.095726  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.056967 13091 consensus_queue.cc:260] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.096712  5367 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
W20260709 13:18:56.110662  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.121549  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.110162  5371 raft_consensus.cc:1240] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:56.129030  5414 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.087391 13037 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:56.133524  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.096599  5446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "862a628beec44315b003538bc747056b"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:18:56.085639  6043 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:56.136647  5446 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:56.137146  5446 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:56.140535  5414 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.104835 12981 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:56.104606 13117 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:56.146199  5339 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:56.149878  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 226174us
W20260709 13:18:56.151213  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 65733.6us
I20260709 13:18:56.162480  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:56.164906  5449 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:56.144013 13089 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:56.099706 13011 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:18:56.143594 13088 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:56.144204 13076 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:56.217972  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.105592 12730 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:18:56.106292 13081 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.188423  5375 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:18:56.105859 12907 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.145503 13161 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:56.150926 12983 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:56.151077 13091 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:56.107784 13078 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.195420  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.188264  5446 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.234157  5450 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28.
W20260709 13:18:56.196328  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 55933.1us
I20260709 13:18:56.175923 12997 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:56.152694 13077 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:18:56.204555  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.205377  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.183411 13139 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:56.229982  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.231325  5524 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 13:18:56.197451 13087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.009s	sys 0.016s
I20260709 13:18:56.235411  5414 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.196866 12738 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:56.236856  5447 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
I20260709 13:18:56.237617  5442 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:56.240381  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.241677  5414 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.243014 13011 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:56.243235 13086 consensus_queue.cc:1059] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:56.243569 13011 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.244060 13011 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:56.244323 13086 raft_consensus.cc:3055] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:56.243237  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.237591  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:56.204257 13098 consensus_meta.cc:287] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.003s
I20260709 13:18:56.250185  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.224112 13166 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:56.254628  5516 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 26: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:56.255224  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.203858 13066 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.238883 13035 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.258800  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:56.261934  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:18:56.240361 13087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.010s	sys 0.016s
I20260709 13:18:56.259600  5522 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 27: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:56.263784  5414 leader_election.cc:400] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:56.232805 13160 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:56.262179  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:56.267040  5446 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.263509 12993 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:56.255131 13088 raft_consensus.cc:2804] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:56.263237 13139 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:56.252385 13086 raft_consensus.cc:740] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:56.244643 13037 raft_consensus.cc:3055] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:56.235965 12986 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.236567 12925 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.264678  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.251965 13076 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:56.269114  5450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a64a51af80064074aad9aefb8f176299"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:18:56.233388 13090 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.265347 13089 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:56.273649 13160 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.288664 13089 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:56.289225 13089 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:56.290503 13160 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.272940 12778 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:18:56.273409 13166 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:18:56.276836 13037 raft_consensus.cc:740] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:56.261528 12997 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:56.294358 13037 consensus_queue.cc:260] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.295212 12997 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.295835 13037 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.296540 13081 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.208937  5265 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:56.298748  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:56.298983  5265 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:56.299929  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.300999  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.303122  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:56.303722  5515 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:56.304001  5515 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:56.304709  5515 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.305938  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.306007  5517 raft_consensus.cc:2393] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:56.306620  5372 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:56.281819 12925 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:56.319186 13094 consensus_meta.cc:287] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.000s
I20260709 13:18:56.319657 13094 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.320487 12925 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.294377 13078 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.323526 13065 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.324139 13065 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:56.261819 13098 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.285620 13173 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:56.351635 13098 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.354683  6073 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
W20260709 13:18:56.356016  6073 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59510 (request call id 259) took 1610 ms (client timeout 2037 ms). Trace:
I20260709 13:18:56.356657  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:56.356775 13069 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.357438 13069 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:56.359026  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:56.358811 13089 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.286401 12986 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.284349 12738 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.362831 12986 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:56.276193 13156 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:18:56.312386  5515 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:56.330930 13088 raft_consensus.cc:697] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:56.364274  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3243) took 1617 ms. Trace:
I20260709 13:18:56.276557 12730 consensus_queue.cc:1059] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:18:56.365777 12730 raft_consensus.cc:3055] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:56.311559  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.331406  5450 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:56.366158 12730 raft_consensus.cc:740] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:56.366415  5450 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:56.364652 13088 consensus_queue.cc:237] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.367093 12730 consensus_queue.cc:260] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.368283 12730 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:56.338220  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.338577  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.338994  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.370355  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.370530  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.371599  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.371955  5447 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:18:56.372123  5444 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:56.339579 13166 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:56.336710  5265 catalog_manager.cc:5697] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 16 to 22, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 22 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.329622 12993 consensus_queue.cc:1059] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:18:56.341411  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.341722 12806 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.343091 12907 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.377060  5515 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
I20260709 13:18:56.309901  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.346418 13117 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:56.348425 13077 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:18:56.356418  6073 rpcz_store.cc:269] 0709 13:18:54.746102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.746236 (+   134us) service_pool.cc:224] Handling call
0709 13:18:56.355829 (+1609593us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400a4c4d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:56.355935 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3437404032}
I20260709 13:18:56.364646  5448 rpcz_store.cc:276] 0709 13:18:54.746784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.070666 (+323882us) service_pool.cc:224] Handling call
0709 13:18:55.127587 (+ 56921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.128147 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:55.128187 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.128832 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.507638 (+378806us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:18:55.735070 (+227432us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b180034ee20. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c81e07 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b 00007fc1d392bd23 00007fc1d392c0d1 00007fc1d3d47a0f
0709 13:18:55.933290 (+198220us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:55.933340 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.933409 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.364053 (+430644us) raft_consensus.cc:1685] finished
0709 13:18:56.364074 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.364214 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":1838,"raft.run_wall_time_us":374205,"spinlock_wait_cycles":22288000,"thread_start_us":197652,"threads_started":1,"wal-append.queue_time_us":963524}
I20260709 13:18:56.235737 13161 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.378433  5517 raft_consensus.cc:2393] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:56.344918 12629 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.387831  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.400954  5447 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:18:56.391449  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.393674  5444 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
W20260709 13:18:56.398013  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 86523us
I20260709 13:18:56.403872  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:56.384014  5450 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.405607  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.407737  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.408334  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.413839  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:56.410295  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.421039  5489 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.429836  5518 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:56.385193 13117 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:56.447177  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:56.444196  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:56.407282 12903 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:56.448299  5414 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.417160 13166 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:56.461184  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:56.422438 12993 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:56.441190 12986 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:18:56.469923  5447 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:56.441872 13078 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:18:56.470418  5446 raft_consensus.cc:2468] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:56.471560  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.449465  5489 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.414812 12907 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:18:56.450467 13068 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:56.473889 13034 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:56.495762  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 46407.4us
I20260709 13:18:56.474364 12719 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.476320 12989 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.466071 13087 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:56.497171  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.461856 13090 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:56.508548  5489 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.503897 13160 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.484813 12986 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.495807 13078 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.520881  5445 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 27: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:56.522377 12986 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:18:56.522581 13142 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.523227 13098 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:56.517676 13162 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:56.520364  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.507500 12899 raft_consensus.cc:2804] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:56.532861 13089 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.533807 13162 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:56.534761 13162 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.523845 13098 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.454886 13037 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:18:56.548452  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:56.524958  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:56.513561 13094 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.485069 13166 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:56.564390  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.508292 13087 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.516353 13090 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:56.545002 12907 raft_consensus.cc:2804] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:56.543277 13078 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:56.520152 13160 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.522190 13069 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.506436 12719 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.581568  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:56.581656  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.544888 12899 raft_consensus.cc:697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:56.546221 13161 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.585486  5447 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:56.558990 13139 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:18:56.559399 13142 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:56.596021  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.611472  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.612272  5373 raft_consensus.cc:3060] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:56.612679  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.613714  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.613754  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.614343  5367 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:56.518263 13117 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.615058  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.584233 13034 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:18:56.624440  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.588534 13076 raft_consensus.cc:2764] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:18:56.583287 13094 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.626754  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.633153  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.633596 13165 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.634114 13165 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.635185 12899 consensus_queue.cc:237] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.594816 13173 consensus_queue.cc:1059] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 13:18:56.638911 13173 raft_consensus.cc:3055] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:56.639343 13173 raft_consensus.cc:740] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:56.640409 13173 consensus_queue.cc:260] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:56.642143 13179 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:18:56.624274  5265 catalog_manager.cc:5697] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.645995 13017 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:56.646590 13017 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:56.648664  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.651491 13011 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:56.654119 13181 log.cc:927] Time spent T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:56.654709 13094 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.655401  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.656041  5521 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:18:56.600596 12997 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.595355 12907 raft_consensus.cc:697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:56.659528  5414 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.668321  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.629235  5516 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 24.
I20260709 13:18:56.629473 13160 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.662228 13076 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.658213  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.619405 13161 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:56.676851 12907 consensus_queue.cc:237] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.630594 13034 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.630867 12903 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.730775  5367 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:56.657020 13094 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.685701 13076 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:56.686136  5371 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:56.617659 13065 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.696594 13090 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.698526 13166 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.699862 13098 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.702628 12989 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.703198 13173 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:56.705572 13142 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:56.706331  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.750902  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.751554  5371 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:56.751601  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.722234 13161 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:56.713405  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.713829  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.756129  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.714504 13087 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.715114  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.737955 12903 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:56.721606  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 53367.1us
I20260709 13:18:56.724957  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:56.764431  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.766341  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.766933  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:56.768260  5517 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 27: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:56.728008  5522 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 27.
I20260709 13:18:56.679205 12719 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.733491  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.733696 13023 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:56.663452  5265 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 reported cstate change: term changed from 18 to 21, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 21 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.754374  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.716625  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.758836  5366 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:56.743575 13068 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:56.785049 13023 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.793879 13023 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:56.797529 13095 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:56.802196 13140 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:56.802641 13140 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:56.803650 13140 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.804957 13140 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:56.806252 13086 consensus_queue.cc:260] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.807543 13086 raft_consensus.cc:3060] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:56.809650  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.810312  5448 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 24.
I20260709 13:18:56.810690 13165 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.811703 12629 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.814384 12903 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.818385 13023 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.819973 12986 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.821954  5374 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 27: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:56.781823  5445 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 26: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:56.781603  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.674816 12997 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.823299  5519 raft_consensus.cc:1240] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 28. Current term is 29. Ops: []
I20260709 13:18:56.824951 12997 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.823342  5375 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:56.793208 13034 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:56.831806 13177 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.357s	user 0.002s	sys 0.000s
I20260709 13:18:56.836519  5450 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.836336 13078 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.838196  5370 raft_consensus.cc:2393] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:56.758698 13161 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:56.841867  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.842634  5449 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:56.838356  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:56.849882  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.853513  5524 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:56.846437  6072 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:56.855557 13011 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.856302  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.857131  5450 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:18:56.862061 13188 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:18:56.863765 13008 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.864302 13008 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.868167 13066 raft_consensus.cc:993] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:56.868763 12986 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.869560 13074 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.870085 13074 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.872265 13074 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.868769 13066 raft_consensus.cc:1081] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:18:56.878170 13008 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.880823 13017 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:56.888293  6042 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.890103  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.883313  5519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3547) took 1314 ms. Trace:
I20260709 13:18:56.892584  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.891235  5519 rpcz_store.cc:276] 0709 13:18:55.569136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.572426 (+  3290us) service_pool.cc:224] Handling call
0709 13:18:56.646099 (+1073673us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800090098. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:18:56.646322 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.823731 (+177409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.882935 (+ 59204us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540025dad4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:56.883225 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461316096}
I20260709 13:18:56.893847  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.896427  5524 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 27 because replica has last-logged OpId of term: 25 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 13:18:56.896785  5448 raft_consensus.cc:1240] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:56.896838  5446 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 27: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:56.897603  5373 raft_consensus.cc:2468] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:56.904549  5450 raft_consensus.cc:2468] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:56.905531  5442 raft_consensus.cc:1240] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: [23.15-25.16]
W20260709 13:18:56.910148 13155 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.006s	sys 0.004s
W20260709 13:18:56.910634 13155 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.006s	sys 0.004s
I20260709 13:18:56.912351  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.913499  5373 raft_consensus.cc:2393] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:56.914669  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.918000  5524 raft_consensus.cc:2393] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 22: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:56.918120  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.919906  5373 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:56.917702  5450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:18:56.922645  5450 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:18:56.923888  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.924943  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.925794  5517 raft_consensus.cc:1240] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:56.926452  5371 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:56.924355  5450 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:56.923503  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:56.927821  5449 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:56.920964  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.929787  5516 raft_consensus.cc:1240] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 27. Current term is 28. Ops: [27.14-27.14]
I20260709 13:18:56.922067  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.934267  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:56.939678  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.939721  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:56.941805  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:56.911376 12981 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:56.949143  5450 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.948134 12981 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.951442  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.951821 12981 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:56.930662 13068 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.952656 13068 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.954790 13068 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:56.957743 13023 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:56.961122 13191 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:18:56.949810 12997 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:18:56.967476 12997 raft_consensus.cc:3055] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:56.968101 13078 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:56.937518 13035 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:18:56.971186 13161 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.935529 13074 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:18:56.974180 13074 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:56.974548 13074 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:56.975332 13074 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:56.976462 13074 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:56.949241 12986 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:56.979140 12986 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:56.979671 12986 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:56.949357 12778 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:56.936295 12899 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:56.995281  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.972996  5489 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:56.998003  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:56.999706  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:56.999445  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:57.008195  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:57.009178  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:57.009442  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:57.009873  5521 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:18:57.024300  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:56.973299 13161 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:57.025753  5489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.026077  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:57.028771  5450 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.028632  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.968071 12997 raft_consensus.cc:740] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:57.033087  5444 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:56.996438 13023 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:57.021925 13078 raft_consensus.cc:2804] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:57.056167  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:57.056835  5521 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:57.050355  5449 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:57.057132  5521 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:57.058063  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:57.057961  5521 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.059068  5521 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:57.027302 12907 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:57.061920  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.066183  5371 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:57.063577  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:56.996268 13017 consensus_queue.cc:1059] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:18:57.073092  5449 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:57.027757 13091 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:57.072402  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.000913 12899 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.088011  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:57.089618  5373 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 27: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:57.072742  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:57.092996  5520 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 27: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:57.090166  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.051968 13192 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:57.103245  5516 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:18:57.106169  5368 raft_consensus.cc:2368] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:57.065999 12907 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.071333 13160 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:57.074697 13078 raft_consensus.cc:697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:57.061822 13023 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.123696  5443 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:18:57.091648 12806 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:57.125141  5443 pending_rounds.cc:85] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 8
I20260709 13:18:57.127241  5443 pending_rounds.cc:107] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:18:57.127593  5443 raft_consensus.cc:2889] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:57.107934 13192 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.117990 12907 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:57.134260  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.099040 13091 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.115268  5520 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:57.115978  5371 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
I20260709 13:18:57.104328 13008 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:18:57.126276 13160 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:57.148116  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.132578 12806 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.135174 13066 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.104913 12997 consensus_queue.cc:260] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.132287 13192 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:57.138490  5521 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:57.161523 13066 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.164135 13066 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.170125 12999 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.170822 12999 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:57.174624  5371 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:57.181164  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.182260  5371 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 27: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:57.186434 13023 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.188732 13117 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:57.192190 13065 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.195595 13076 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
W20260709 13:18:57.200974 13193 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:57.178174 13091 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.205088 13003 raft_consensus.cc:3055] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 28 LEADER]: Stepping down as leader of term 28
W20260709 13:18:57.206954 13199 log.cc:927] Time spent T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:57.208974 12899 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.177393 13078 consensus_queue.cc:237] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.212597  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.236896  5449 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 15.
I20260709 13:18:57.213835  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.215121  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.215334  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.202973 12806 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.221099  5521 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:57.225361  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.240710  5443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3586) took 1040 ms. Trace:
I20260709 13:18:57.225745  5447 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:57.225169  5339 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.233130  5448 raft_consensus.cc:1240] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:57.242054  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.234331  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.232766  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.237847  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.242722  5373 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:57.242931  5449 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:18:57.239485  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.239506  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.239120  5371 raft_consensus.cc:2410] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 27 because replica has last-logged OpId of term: 25 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 11.
I20260709 13:18:57.241122  5443 rpcz_store.cc:276] 0709 13:18:56.199785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.200550 (+   765us) service_pool.cc:224] Handling call
0709 13:18:56.204838 (+  4288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.133134 (+928296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.236406 (+103272us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b540029d1d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:57.240593 (+  4187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111955840}
I20260709 13:18:57.224502 13003 raft_consensus.cc:740] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:57.232463 13160 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.248111 12738 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:57.248322 13008 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.230516 12993 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:57.248932 13008 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:57.249303 12993 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.239755  5414 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:57.252764  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.253809  5371 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:57.256050  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.256709  5448 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:57.258095  5373 raft_consensus.cc:2468] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 28.
I20260709 13:18:57.257992  5521 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:57.251116 13008 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:57.268512  5490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.271263  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:57.272572  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.273329  5371 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 24.
I20260709 13:18:57.274734  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:57.255924 13076 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:18:57.277022  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.276826  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:57.278003  5521 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:57.278512  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.279129  5450 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
W20260709 13:18:57.279697  5338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.266402 12719 consensus_queue.cc:1059] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:18:57.286505 12719 raft_consensus.cc:3055] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:57.286929 12719 raft_consensus.cc:740] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:57.237182 12986 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.279117  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:57.276784  5414 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:57.292436  5450 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:18:57.269124 13049 consensus_queue.cc:1059] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:18:57.296530  5489 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:57.293732 13008 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:18:57.273996 12993 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.308513  5414 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:57.305675  5519 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:57.295917 13098 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:57.295681 13065 raft_consensus.cc:2764] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election decision vote started in defunct term 27: won
I20260709 13:18:57.248334 13003 consensus_queue.cc:260] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.305542 12629 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:57.325006 12629 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.298964 13166 raft_consensus.cc:3055] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:18:57.297966 13076 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:18:57.332552  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.334503  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:57.335840  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:57.338061  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:57.309875 13023 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:57.321827 12903 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:57.342469  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.320073 13098 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.347080  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.327697 12629 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:57.326876 13166 raft_consensus.cc:740] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:57.351223 12957 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:18:57.351893 13079 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:57.319547 13049 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:18:57.356802  5416 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:57.345680 13003 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:18:57.367420  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:57.348443 12903 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.369244  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:57.315999 12719 consensus_queue.cc:260] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.371037  5416 leader_election.cc:400] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:57.349558 13098 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:57.380116  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 67849.3us
I20260709 13:18:57.381682  5416 leader_election.cc:403] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.337610 12994 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:18:57.386264 12957 consensus_queue.cc:1059] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:57.388024  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:57.354288 12999 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.336913 12981 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 25 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:57.391476 13023 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26.
I20260709 13:18:57.366175 13035 consensus_queue.cc:1059] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:18:57.371836 13090 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:57.383103 12738 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:57.391673  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52066.3us
I20260709 13:18:57.397941  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:57.402999  5521 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:57.390406  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.405189  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.407380  5442 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:57.407711  5518 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:18:57.380371 12903 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:57.412819  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.400697  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:57.419085  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:57.427610  5366 raft_consensus.cc:1275] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:57.426108  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:57.453758  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43779.7us
I20260709 13:18:57.427752  5375 raft_consensus.cc:1275] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:57.426692  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.456535  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.428545  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.457588  5366 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:57.390697 13049 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:57.399416 13011 raft_consensus.cc:3055] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:57.428958  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.465543  5369 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:57.465950  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.466569  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.413347 12719 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:57.424969  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.424317  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.461774  5521 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 25.
I20260709 13:18:57.425275  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:18:57.463276  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50647.6us
I20260709 13:18:57.482761  5370 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:57.483474  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.484253  5370 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:18:57.486230 13066 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:57.399762 12738 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.490630  5372 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:18:57.491073 12738 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:57.421200  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:57.495136  5368 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 23: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:57.428100  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.467866  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.496475  5369 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:57.458561 13089 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:57.470424 13192 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:57.471134 13205 log.cc:927] Time spent T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:18:57.472666  5375 raft_consensus.cc:1275] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:57.473505 13208 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:57.474864  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:57.467036 13140 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:57.462522 13166 consensus_queue.cc:260] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.423401 13017 consensus_queue.cc:1059] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:18:57.395830 12981 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.459370 13023 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:18:57.458961  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:57.464833 13049 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.503933  5366 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 25.
I20260709 13:18:57.464382 12778 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:57.396459 12907 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.415206 12999 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:57.465286 13011 raft_consensus.cc:740] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:57.511879  5371 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:18:57.417657 13076 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.413903 13034 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:57.511283 12986 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.524044  5369 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:18:57.526895  5448 raft_consensus.cc:1240] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:57.502979 13211 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.561383 13211 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.563681 13211 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.531780  6043 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:57.563818 13098 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.564890 12981 raft_consensus.cc:2804] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:57.565460 12981 raft_consensus.cc:697] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 25 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:18:57.540961 12907 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.541630  5516 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:18:57.542974 12903 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:57.508746 13079 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:18:57.554340 13011 consensus_queue.cc:260] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.556821 13192 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.527820 13049 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:57.569321  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84276.4us
I20260709 13:18:57.581460  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.568694 13140 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:57.569247 12981 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:57.585042 12903 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:18:57.584829 13140 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.589694 12997 raft_consensus.cc:3060] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:57.591192 13140 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.595881 13049 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.596913  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.597662 13207 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:57.598479  5490 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.599256 13207 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:57.600713 13098 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.601358 13049 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.602262 13008 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:57.602852 13008 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:57.603448 13160 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:57.606308  5490 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.607162 13216 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:57.608606  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.609441 13216 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:57.613212  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:57.614118  5517 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:18:57.618238  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:57.611220  5490 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:18:57.705678  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 94531.5us
I20260709 13:18:57.706941  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.713124 13217 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:57.715097  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.714179 13217 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:57.742097  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.757109  5490 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.749538 13160 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:18:57.771644  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.776539 13216 raft_consensus.cc:2764] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:18:57.578389 12738 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.779390 12738 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:57.603778 13008 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:57.753988 13217 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:57.802212 13217 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:57.802654 13217 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:57.835754  5490 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.834156 12629 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:57.845738 13216 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:18:57.847056  5515 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:57.848359 13140 consensus_queue.cc:1048] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:57.884047  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48412us
I20260709 13:18:57.885206  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.899372 12899 consensus_queue.cc:1048] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:57.901775 12629 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:57.890210 13098 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:57.936957  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 167613us
I20260709 13:18:57.948673  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:57.896378 13207 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:57.981261  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 89166.5us
I20260709 13:18:57.984342  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:57.967695 12976 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:57.971203 13117 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:58.003597 13091 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:58.006858  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.007948  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.008507  5370 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.007979  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.008574  5368 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:18:58.010625  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.011145  5375 raft_consensus.cc:3060] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:58.011741  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.012408  5366 raft_consensus.cc:2368] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:18:58.009491  5374 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:58.015807  5374 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:18:58.016278  5368 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:58.002102 13117 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:58.037571  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 63643.3us
I20260709 13:18:58.038057  5371 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:18:58.048343  5370 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:58.055734  5490 leader_election.cc:400] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:18:58.056288  5490 leader_election.cc:403] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:18:58.045872 13207 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:18:58.070670 13207 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:58.071189 13207 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:58.002817 12976 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:58.074745  5375 raft_consensus.cc:2468] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:58.038594 13117 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:58.074344  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:58.039402 12997 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.074791 12806 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.078706 12986 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:58.078601 12629 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:18:58.081676 12986 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:58.085659 13216 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:58.086155 13216 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:58.086521 13216 raft_consensus.cc:3060] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:58.086784  5368 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:58.089730 12806 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:18:58.094216 12997 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:58.096513 12997 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:58.106060 13221 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.330s	user 0.000s	sys 0.009s
I20260709 13:18:58.096541 12976 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:58.114581 13207 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.116606 13207 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:58.136394 13011 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:58.139022  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.140236  5368 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 22: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
W20260709 13:18:58.149987  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 676937us
I20260709 13:18:58.150581 13074 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:58.155844  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:58.156633  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.157230 13173 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:58.157821 13173 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:58.158665 13206 log.cc:927] Time spent T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.762s	user 0.017s	sys 0.000s
I20260709 13:18:58.156633  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:58.160552 13173 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.161041  5522 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:58.190658 13089 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:58.196631  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.191334  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.217060  5450 raft_consensus.cc:3060] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.179947 13210 raft_consensus.cc:3055] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:58.224059 13210 raft_consensus.cc:740] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:58.216948 13089 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.193971 13166 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:58.225061 13210 consensus_queue.cc:260] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.226338 13210 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:58.228171  5448 raft_consensus.cc:1275] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:18:58.204485  5523 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:58.229555  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.174074  5372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44090 (request call id 3779) took 1461 ms. Trace:
I20260709 13:18:58.231245 12976 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:58.231519  5372 rpcz_store.cc:276] 0709 13:18:56.712822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.713036 (+   214us) service_pool.cc:224] Handling call
0709 13:18:58.173827 (+1460791us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400393fd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:18:58.173988 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652910848}
I20260709 13:18:58.174049  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.166257  5516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3591) took 1060 ms. Trace:
I20260709 13:18:58.217372  5515 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:58.198542 13078 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.162030  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 740944us
I20260709 13:18:58.233382  5448 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:18:58.234412  5516 rpcz_store.cc:276] 0709 13:18:57.105842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.105998 (+   156us) service_pool.cc:224] Handling call
0709 13:18:57.106498 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:57.568065 (+461567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.165919 (+597854us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400379bd4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:18:58.166187 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":999970560}
W20260709 13:18:58.167421  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.238776  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.189465  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.240754  5449 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:58.219619 13088 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:58.243083  5373 raft_consensus.cc:2410] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 28 because replica has last-logged OpId of term: 27 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 13.
I20260709 13:18:58.243201 13088 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:58.254560 13066 consensus_queue.cc:1048] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:58.235141 13078 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.260351 13088 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:58.161363 13173 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.261369  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.260524 13078 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:58.262130 13173 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.263550  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:58.266366 13173 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.165588 12929 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:18:58.235710  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:58.170786  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:58.164983 13023 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:58.270702  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:58.271533 13023 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.272130 13074 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:58.272326  5416 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:58.268574  5441 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:58.274441 13192 raft_consensus.cc:2804] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:18:58.275106 13192 raft_consensus.cc:697] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:18:58.276206 13192 consensus_queue.cc:237] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.277240 13023 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.281989 13166 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:58.282393  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:58.282660 13166 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.285367 13166 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.287366 13088 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:58.288210 13088 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:58.296406 13088 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:58.286434  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:58.298352  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:58.334661  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 48360.9us
I20260709 13:18:58.335242  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:58.234568 13089 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.304009  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:58.341301  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.344136  6072 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:58.305112  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:58.309762  5450 raft_consensus.cc:2468] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:18:58.180899  5444 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:18:58.134001 12993 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.315732 13023 consensus_queue.cc:1048] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:18:58.303287 13239 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:18:58.349822  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.344412  5515 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:58.301333 12929 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:58.356547  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:58.370553  5450 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 22.
I20260709 13:18:58.359126  5489 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:58.358021 12986 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.348407 13088 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:58.329087 13049 consensus_queue.cc:1059] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:18:58.360978 13066 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:18:58.354743 13074 raft_consensus.cc:2764] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 13:18:58.378258 13217 consensus_meta.cc:287] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.004s
I20260709 13:18:58.364835 13098 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:18:58.361276 12993 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.395530 12986 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.412385 12986 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:58.400558 13228 raft_consensus.cc:2804] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:58.428244 13216 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.409235 13217 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.419790 13228 raft_consensus.cc:697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:58.430701 13228 consensus_queue.cc:237] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:58.474007  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.477376  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:58.479635  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.354389  5441 raft_consensus.cc:3060] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:58.489522  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 130276us
W20260709 13:18:58.494536  5490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.129:43931 timed out after 2.221s (SENT) [suppressed 1 similar messages]
I20260709 13:18:58.503415  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:58.505517  5443 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:58.509584 12929 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:58.512110 12929 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.513772  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:58.514698  5450 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:58.515828 12929 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.517689 13023 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.518778 13023 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.520524 12993 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.522270 13088 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:58.570377 13089 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:58.569695  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 75354.1us
I20260709 13:18:58.581861 13088 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.586447 13011 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:58.587124 13011 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.587633 13011 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.593775 13224 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:58.594731 13224 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.596385  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.597613 13090 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:58.598692 13090 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.606431  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.607793  5373 raft_consensus.cc:2393] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:58.596525 13087 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:18:58.587116  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.585258  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 108383us
I20260709 13:18:58.623965  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.630607 13089 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.634707 13087 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:58.643044  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66029.9us
W20260709 13:18:58.643805  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 62144.3us
I20260709 13:18:58.644639 13023 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.649462 13049 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.650374 13049 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.653452  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.653110 13049 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.664990 12730 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:58.666014 12730 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.668941 12730 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.676378  5520 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:18:58.633272 13089 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.683044 13239 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.683935 13239 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.686487  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.687419  5444 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.696569  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.697497  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.698472  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.706151  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:58.718161  5516 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:58.719998  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:58.720849  5450 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:58.727651  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.734190  5375 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:58.738297 13087 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.739053 13090 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.740279 13239 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.745764 12778 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:58.748248 12999 consensus_queue.cc:1059] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:58.750135 12999 raft_consensus.cc:3055] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:58.750660 12999 raft_consensus.cc:740] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:58.751861 12999 consensus_queue.cc:260] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.753144 13088 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.754276 12999 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:58.755559 13224 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.756460 13217 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:58.766199 12730 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.767122 12730 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.591310  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:58.775480  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.775672 13074 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:58.776566 13074 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.781513  5442 raft_consensus.cc:1240] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:58.782635 12730 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.772269  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:58.783296  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:58.783797  5368 raft_consensus.cc:2393] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 28: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:58.784363  5450 raft_consensus.cc:2393] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 23: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:58.784228  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.784986  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.792251 13074 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.787097  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:58.802009  5373 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25. Re-sending same reply.
I20260709 13:18:58.794214  5441 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:18:58.795022 13166 raft_consensus.cc:3055] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:18:58.804812 13166 raft_consensus.cc:740] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:58.806193 13166 consensus_queue.cc:260] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.807394 13166 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:58.810081  5446 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:58.811672  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.811749  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:58.812505  5446 raft_consensus.cc:2393] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:58.786058  5368 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:18:58.796383 13216 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:58.813115  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:18:58.815107  5449 raft_consensus.cc:2393] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 26: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:18:58.816735  5449 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 13. (term mismatch)
I20260709 13:18:58.817126  5449 pending_rounds.cc:85] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 12
I20260709 13:18:58.817364  5449 pending_rounds.cc:107] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 25.13
I20260709 13:18:58.817669  5449 raft_consensus.cc:2889] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:58.819003 12929 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.819594 12929 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:58.821923  5367 raft_consensus.cc:2468] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:18:58.824955 12929 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:58.834405  5366 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:18:58.835013  5444 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:58.837924  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:58.839164 12999 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:58.839607 12999 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:58.840019 12999 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.843305 13011 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:58.846624  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:58.855258  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:58.864251  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.873996  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.874876  5516 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:18:58.877559  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:58.878322  5447 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
W20260709 13:18:58.880189 13117 consensus_meta.cc:287] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.782s	user 0.008s	sys 0.010s
I20260709 13:18:58.881493 13251 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:18:58.885820 13117 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.888652  5490 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:58.865396 13011 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:58.891929 13216 raft_consensus.cc:2804] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:58.892625 13216 raft_consensus.cc:697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:18:58.893074  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 47189.7us
I20260709 13:18:58.893992 13216 consensus_queue.cc:237] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:18:58.896169  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:58.897127  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.897876  5520 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 28.
I20260709 13:18:58.898578  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.889612  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.899899  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.900025  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.896294  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.900987  5522 raft_consensus.cc:2410] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:18:58.901495  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.902091  5517 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:58.902441  5521 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 29: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:58.903208  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.904503 13003 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.905181 13003 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.905926 12730 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.906448 12730 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.907225 13074 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:58.907930 13003 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.908516  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:58.908892 12730 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.909950 13003 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:58.911141  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.906589  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:18:58.905153 13210 consensus_meta.cc:287] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.012s
I20260709 13:18:58.903247 13166 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:58.913482 13166 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:58.913584  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:58.915134 13224 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:18:58.914618 13166 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.915566 13224 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.916038 13224 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:18:58.907961 13074 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.919926 13088 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.920691 13088 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.921604 13210 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:18:58.922086 13210 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.923476 13088 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.923856 13210 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:58.920121 13074 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:58.925765  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:18:58.926388 13088 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:58.927104 13088 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:58.929015  5521 raft_consensus.cc:3060] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:18:58.929936  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.930810  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.931311  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.931982  5522 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:18:58.932335  5414 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:58.933228 13239 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:58.936920  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.937088  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.938158 13239 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:58.938392  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.898104 13251 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:58.939591 13251 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:58.940035 13251 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:58.926303  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.943279  5518 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:18:58.946120  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:58.924642  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:58.987326  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:58.986140 13098 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:18:58.992498 13162 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:18:58.993299 13162 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:59.005620 13150 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 13:18:59.009032 13011 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:59.018270 13251 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:58.995827 13162 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:18:59.038264  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 63308.1us
I20260709 13:18:59.044729 13011 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.045574 13011 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.048244 13011 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.050812 13117 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.052997 13251 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:59.053066  6072 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:59.054122 13228 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:18:59.057852 13210 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.059002  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.059764  5522 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:18:59.060787  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:59.060138  5266 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:59.061676  5516 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:18:59.065655  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 141179us
I20260709 13:18:59.070472  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:59.071175  5524 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:18:59.073290  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:59.083745 13207 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:59.087932  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.092916  5524 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:18:59.097628  5516 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:59.098601  6072 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:18:59.014950 13224 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.095662 13210 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.106280  5521 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:18:59.115669 13091 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:59.116922 13091 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.117461 13091 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:59.123076  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:18:59.124908  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:59.125438 13088 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.126159 13239 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:59.126626 13239 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:59.127193 13239 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:59.128870 13117 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.129452 13117 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.114066 13098 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:18:59.136801  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.152133  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:59.152813  5518 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:18:59.152915  5340 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:59.153920 13210 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:59.154436 13210 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:59.155421 13210 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:18:59.157166  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.157913  5339 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:59.158903  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:59.159782  5339 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:59.159785 12730 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:18:59.160861 12730 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:59.161010 13003 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:59.161013 12997 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:59.162686 12997 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.162118 12730 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.163095 12997 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.166625 13003 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:59.166776  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.167572  5519 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:18:59.167881 13003 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.166952  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:18:59.172749  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:59.173691 13087 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:59.174120 13087 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.174479 13087 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:18:59.176146  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51287.9us
I20260709 13:18:59.182159  5515 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 26: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:18:59.188902  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.195418  5518 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 29.
I20260709 13:18:59.186667  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:59.200143  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.201200  5339 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:59.205138 13166 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:18:59.205793 13166 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 29 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:18:59.206924 13166 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.211928  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.192692 13074 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:18:59.218286  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:18:59.175218 13117 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.219326  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:59.136375 13224 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.225687  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:59.244757  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.192879 13089 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:59.260083  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.260540  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.260970  5372 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
W20260709 13:18:59.275408  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56160us
I20260709 13:18:59.276038  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.276861  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.277571  5370 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 29.
I20260709 13:18:59.278379 13207 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:59.280161 13217 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:59.281441  5490 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:59.282223  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.282717  5490 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:18:59.283885 13161 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:59.285269 13161 raft_consensus.cc:2804] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:59.285781 13161 raft_consensus.cc:697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:59.286669 13161 consensus_queue.cc:237] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.290843  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.291815  5367 raft_consensus.cc:2410] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:18:59.303216 13078 raft_consensus.cc:2764] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election decision vote started in defunct term 26: won
I20260709 13:18:59.345053 13087 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.351493  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.352432  5371 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
I20260709 13:18:59.380939  5369 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:59.385071  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.392086  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:59.357934 13087 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.408169  5450 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:59.375149 13023 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:59.412214  5374 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:18:59.389179 13011 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.427206 12999 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 13:18:59.419920 13228 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:18:59.476455  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 193811us
I20260709 13:18:59.478565 13207 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:18:59.467118 13023 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.475289 12999 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.473784 13011 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.482474 13228 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.512372 13049 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:18:59.510869 13239 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.552062 13091 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.553628 13207 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.554680 13091 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:18:59.566226 13262 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:18:59.569749 13256 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 13:18:59.572243 13011 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.574034 12999 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.576011 13239 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:59.577919  5265 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 156) took 27980 ms (client timeout 15000 ms). Trace:
I20260709 13:18:59.556442 13049 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:18:59.585475 13228 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:18:59.585353 13049 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:18:59.619781 13011 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.620150 13259 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:18:59.620502 13011 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.616369 13003 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:59.623306 13003 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.623799 13011 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.627843 12997 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.654340  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.656013  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:59.662590  5515 raft_consensus.cc:2368] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24.
I20260709 13:18:59.668949  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.674744  5515 raft_consensus.cc:2410] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 28 because replica has last-logged OpId of term: 25 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 10.
I20260709 13:18:59.671232  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.676831 13011 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:59.707829 13011 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.713742  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:18:59.737252  5522 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.704290 13117 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:59.742761  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:18:59.578555  5265 rpcz_store.cc:269] 0709 13:18:31.597448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.633747 (+ 36299us) service_pool.cc:224] Handling call
0709 13:18:59.577609 (+27943862us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:57.145814 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:57.165836 (+ 20022us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:57.165902 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:18:57.165928 (+    26us) tablet.cc:662] Decoding operations
0709 13:18:57.166751 (+   823us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:57.166855 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:57.166891 (+    36us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:57.167521 (+   630us) tablet.cc:701] Row locks acquired
0709 13:18:57.167545 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:18:57.167731 (+   186us) write_op.cc:270] Start()
0709 13:18:57.167872 (+   141us) write_op.cc:276] Timestamp: P: 1783603137167674 usec, L: 0
0709 13:18:57.167897 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:57.168670 (+   773us) log.cc:844] Serialized 2068 byte log entry
0709 13:18:57.284852 (+116182us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d0c820ac 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9ec02 00007fc1d392620b
0709 13:18:57.752861 (+468009us) op_driver.cc:464] REPLICATION: finished
0709 13:18:58.003674 (+250813us) write_op.cc:301] APPLY: starting
0709 13:18:58.003789 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:58.106288 (+102499us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:58.106335 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:58.333182 (+226847us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:58.374102 (+ 40920us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:18:58.385507 (+ 11405us) write_op.cc:312] APPLY: finished
0709 13:18:58.409117 (+ 23610us) log.cc:844] Serialized 56 byte log entry
0709 13:18:58.417556 (+  8439us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:58.419593 (+  2037us) write_op.cc:454] Released schema lock
0709 13:18:58.421010 (+  1417us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:58.429286 (+  8276us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:58.429322 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":973949,"reported_tablets":56,"spinlock_wait_cycles":19840,"child_traces":[["op",{"apply.queue_time_us":250520,"apply.run_cpu_time_us":12063,"apply.run_wall_time_us":425572,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":156097,"prepare.run_cpu_time_us":14229,"prepare.run_wall_time_us":178455,"raft.queue_time_us":456998,"raft.run_cpu_time_us":43510,"raft.run_wall_time_us":339713,"replication_time_us":582446,"spinlock_wait_cycles":9385344,"thread_start_us":621404,"threads_started":5,"wal-append.queue_time_us":186226}]]}
W20260709 13:18:59.759035  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 340692us
W20260709 13:18:59.771512  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 541495us
I20260709 13:18:59.772842  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.776227 13283 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.778312 12997 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.797638 13023 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.769536 13090 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:59.756793 13117 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.801143 13089 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:59.801705 13283 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.807924  5366 raft_consensus.cc:1275] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:18:59.801847  5416 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.815807  5339 leader_election.cc:400] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24.
I20260709 13:18:59.816215  5339 leader_election.cc:403] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
W20260709 13:18:59.818739  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58974.5us
I20260709 13:18:59.816977 13090 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:59.820181 13087 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:59.824751 13087 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.834247 13298 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:59.852540 13283 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.853148 13301 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:59.853821 13301 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:18:59.857338  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 55702.6us
I20260709 13:18:59.867105 13301 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.870224  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.880999 12997 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.881685 12997 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.888621 12997 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:59.883476  5266 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 47) took 28862 ms (client timeout 15000 ms). Trace:
W20260709 13:18:59.894919 13295 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.143s	user 0.002s	sys 0.002s
I20260709 13:18:59.896700 13011 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.902271  5369 raft_consensus.cc:1275] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:18:59.905929  5271 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:59.914942  5522 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:18:59.921630  5271 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 11 to 13, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 13 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:18:59.924676  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
W20260709 13:18:59.921733  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 51603.5us
I20260709 13:18:59.928946  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:18:59.929893  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.926703  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:18:59.933691  5370 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:59.933928 13270 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:59.934540 13264 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.410s	user 0.000s	sys 0.001s
I20260709 13:18:59.930553 13011 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:18:59.936117  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.936774 13011 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.937692 13301 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:18:59.938134  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.939278 13003 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.940181 13011 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.940733 13090 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:59.944023  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.946552  5519 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:18:59.948726  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.932888 13228 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.958065  5446 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:59.963364  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:18:59.956593  5522 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:18:59.930758 13087 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.972515 12999 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.975389  5339 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:18:59.981160  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.953181 13301 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.952113 13224 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.954205 13117 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:18:59.976224 13011 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:59.965772 13161 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:18:59.997326  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:00.007898  5446 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:00.019306 13304 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:00.020027 12899 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.020913 12899 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.021473  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.021791  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.023329 12899 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:00.024214  5518 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:00.025710  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.026994 13303 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:00.028363  6072 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:00.032462  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:18:59.957636 13228 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:18:59.992107 13301 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.024215  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:18:59.989495 12999 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.013496 13299 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.070905  5515 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:19:00.074039  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 103325us
I20260709 13:19:00.074913  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:18:59.998374 13224 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.060535 13304 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:00.093858 13304 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.060024 13162 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:19:00.094864 13224 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:18:59.895030  5266 rpcz_store.cc:269] 0709 13:18:31.012638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.020905 (+  8267us) service_pool.cc:224] Handling call
0709 13:18:31.870791 (+849886us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b5400002490. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c680b2 00007fc1d9be1a89 00007fc1d9b79da6 00007fc1d9b4b088 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc
0709 13:18:59.874616 (+28003825us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:59.131011 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:59.131929 (+   918us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:59.132022 (+    93us) write_op.cc:435] Acquired schema lock
0709 13:18:59.132068 (+    46us) tablet.cc:662] Decoding operations
0709 13:18:59.132762 (+   694us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:59.132911 (+   149us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:59.132966 (+    55us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:59.178491 (+ 45525us) tablet.cc:701] Row locks acquired
0709 13:18:59.178580 (+    89us) write_op.cc:260] PREPARE: finished
0709 13:18:59.220295 (+ 41715us) write_op.cc:270] Start()
0709 13:18:59.231834 (+ 11539us) write_op.cc:276] Timestamp: P: 1783603139192694 usec, L: 0
0709 13:18:59.231891 (+    57us) op_driver.cc:348] REPLICATION: starting
0709 13:18:59.232983 (+  1092us) log.cc:844] Serialized 532 byte log entry
0709 13:18:59.544940 (+311957us) op_driver.cc:464] REPLICATION: finished
0709 13:18:59.649624 (+104684us) write_op.cc:301] APPLY: starting
0709 13:18:59.649732 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:59.651536 (+  1804us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:59.651654 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:59.652366 (+   712us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:59.652617 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:59.658990 (+  6373us) write_op.cc:312] APPLY: finished
0709 13:18:59.659348 (+   358us) log.cc:844] Serialized 24 byte log entry
0709 13:18:59.659566 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:59.659665 (+    99us) write_op.cc:454] Released schema lock
0709 13:18:59.659765 (+   100us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:59.660256 (+   491us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:59.660287 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1733066,"reported_tablets":8,"spinlock_wait_cycles":8330624,"child_traces":[["op",{"apply.queue_time_us":83514,"apply.run_cpu_time_us":4377,"apply.run_wall_time_us":10640,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":48613,"prepare.run_cpu_time_us":4833,"prepare.run_wall_time_us":103758,"replication_time_us":285162,"thread_start_us":71946,"threads_started":2}]]}
I20260709 13:19:00.083614  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:00.101495 12899 consensus_queue.cc:1048] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:00.102768  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:00.103643 13302 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:00.104382 13302 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.104573  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:00.104830 13302 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.083393 13003 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:00.084607 13303 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:00.013260 13283 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:19:00.087878 13228 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:00.089732 13034 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:00.090173 13301 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.091761 13087 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:00.033018 13161 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.076874 13299 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.100226 13090 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:00.107210  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:00.116534 13270 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:19:00.110240 13089 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:00.127643  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.120977 12997 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:19:00.152561  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 134278us
I20260709 13:19:00.159807  5515 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:19:00.170037  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.155893 12999 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.171428 13162 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:00.155809  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 48667.3us
I20260709 13:19:00.174281  5416 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:00.175168 13089 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:00.175681  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:00.157390 13303 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:00.156626 13270 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.161598 13313 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.163764 13299 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.135811 13023 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.177726  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:00.169283  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:00.176537 13089 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:00.179450 13303 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.134516 13078 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:19:00.189252  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:00.190068  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:00.207331  5371 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:00.208027  5375 raft_consensus.cc:1275] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:00.215623  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.209389  5370 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:19:00.193970 13270 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:00.209497  5374 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
I20260709 13:19:00.235671  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.235579  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:00.236792  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59194.3us
I20260709 13:19:00.237460  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:00.237835  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.236858  5523 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:19:00.242551  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.243825  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:00.209616 13303 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:00.208760 13301 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.258365  5444 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:00.220183 13090 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.251806  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.220568 13228 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:00.261694 12929 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:19:00.270804 13300 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:00.271334 13300 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:00.271793 13300 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:00.275421 13090 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.278460 13090 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.251997 13088 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.279829 13088 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.282651 13088 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:00.283794 13310 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260709 13:19:00.289840 13161 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:00.295233 13298 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24.
I20260709 13:19:00.252259 13239 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.298216 13239 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.301535 13239 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.246074 13302 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.249187 13074 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.307278  5446 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:19:00.221001 13023 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.303817  5443 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
I20260709 13:19:00.257237 13210 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:00.313442  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:00.199775 13313 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.332804  5521 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:19:00.368520  5447 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 24: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:00.373081  5522 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:19:00.320170 13210 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.302784 13301 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.377916 13210 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:00.358966 13074 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.384178  5521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:19:00.404618  5521 raft_consensus.cc:606] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:00.405040  5521 raft_consensus.cc:614] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.426997 13313 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:00.427873  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:00.428609  5366 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:19:00.428679 13023 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:00.430218  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.434067  5372 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
W20260709 13:19:00.457934  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 207536us
W20260709 13:19:00.459000  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 195864us
W20260709 13:19:00.543131  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 168829us
I20260709 13:19:00.680733 13023 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.681746  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "862a628beec44315b003538bc747056b"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:19:00.682353  5516 raft_consensus.cc:606] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:00.682660  5516 raft_consensus.cc:614] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.684438 13098 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:00.681349 13023 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.686829 13023 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.687247  6072 consensus_queue.cc:237] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:00.688201 13302 consensus_queue.cc:1048] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:00.689725  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.689862  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.690400  5445 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:19:00.691170  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.692812 13090 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:00.693063  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.693403 13090 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:00.693512 13300 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.695432  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.695693 13090 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:00.696038 13300 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.705595  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.706344  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.715030  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:00.715754  5443 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:00.715474 13210 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.684954 13098 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.718521  5369 raft_consensus.cc:2368] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27.
I20260709 13:19:00.719640 13098 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:00.719771  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.720425  5449 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:19:00.725955  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.726816  5448 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 26: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:00.726931  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.727161  5516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:19:00.727805  5516 raft_consensus.cc:606] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:00.727914  5449 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:00.726965  5521 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:19:00.712431  5490 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:19:00.733805  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51273.5us
I20260709 13:19:00.738116  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:00.740774  5490 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:00.768337  5449 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:00.777441  5449 raft_consensus.cc:1275] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:00.763003  5490 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:00.780660  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.735632 13300 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:00.748136 13314 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:00.787945  5414 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:00.780155 13239 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:00.781128 13207 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:19:00.811707 13303 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.001s
I20260709 13:19:00.747787 13217 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:19:00.806468 13314 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.862419  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:00.815189 13090 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:00.877646 13090 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:00.878841 13090 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.818418 13162 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.818395 13239 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.856927 13207 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.893843 13207 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:00.894991 13216 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:00.895431 13216 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:00.866333 13303 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.895807 13216 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:00.850014 13300 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.897876  5446 raft_consensus.cc:1240] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:00.875233 13317 consensus_queue.cc:1048] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 13:19:00.886957  5449 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:19:00.874483  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:00.892095 13239 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:00.892544 13162 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.885087 13314 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:00.902063 13074 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:00.876690 13270 consensus_meta.cc:287] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.001s
I20260709 13:19:00.888041 13161 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.922436  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:00.924243  5449 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:00.923987 13161 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:00.926905 13161 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:00.929348 13162 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:00.940198  5449 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:19:00.908617 13210 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:00.946705  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.947013  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:00.907933 13270 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:00.953928  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.953964  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:00.948002  5449 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:00.949362  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:00.950035  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 168465us
W20260709 13:19:00.964943  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.949651  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.971189  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.978138  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.988960  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.989248  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:00.990134  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:00.997102 13313 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:01.002425 13088 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:01.002604 13303 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.003080 13088 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.003371 13303 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.004051 13303 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.005235  5443 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:19:01.020054  5524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
I20260709 13:19:01.027189  5524 raft_consensus.cc:606] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.027814  5524 raft_consensus.cc:614] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:01.019140 13303 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.030881  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.024844  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.031661  5441 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 29
I20260709 13:19:01.031694  5443 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:19:01.010459 13301 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.005337 13088 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.055511  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:01.005935 13300 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.058959 13270 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.058826  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.064798  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.043139 13098 consensus_queue.cc:1059] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:19:01.060861  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.026820 13313 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:01.053783  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.065708  5450 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:19:01.072149  5520 raft_consensus.cc:2393] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 26: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:01.073889  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.074680  5523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5"
dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:51720
W20260709 13:19:01.070348  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 332924us
I20260709 13:19:01.078243  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.075253  5523 raft_consensus.cc:606] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.081220  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:01.084547  5524 raft_consensus.cc:2393] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 29: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:01.086097  5449 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:19:01.087687  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.088742  5449 raft_consensus.cc:2368] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24.
I20260709 13:19:01.068599 13334 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:01.098038  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.113027  5445 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:01.093310  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 330338us
I20260709 13:19:01.111088  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.114370  5449 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:19:01.115563  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.116392  5449 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:19:01.110020  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.116562  5441 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 29.
I20260709 13:19:01.117645  5442 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:19:01.069363 13162 consensus_queue.cc:1048] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:19:01.128485  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.130115  5449 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.125835 13313 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.138551  5490 leader_election.cc:400] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27.
I20260709 13:19:01.139154  5490 leader_election.cc:403] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:01.140026  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:01.138675  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 402325us
I20260709 13:19:01.098172 13272 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:19:01.144305  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:01.149950  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:01.155434  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 184386us
I20260709 13:19:01.166249  5448 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:01.167781  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.170739  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:01.171911  5372 raft_consensus.cc:2410] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 27 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 13.
I20260709 13:19:01.170095  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.120301 13334 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.178326  5441 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:19:01.185815  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:01.190092  5442 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:19:01.191732  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.195201 13351 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.196038 13351 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.198943 13351 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.199709 13351 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:01.200107 13351 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.200439 13351 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:01.187172  5369 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:19:01.206041  5449 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
W20260709 13:19:01.208472  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 64892.7us
I20260709 13:19:01.162176 13217 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:19:01.208472  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:01.210765  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.219844  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.230645  5448 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:19:01.245662  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.251266  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.251339  5442 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:01.254735  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.238145 13098 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:01.260187  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.261509  5449 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:19:01.262516  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.264529  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.266300  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.263171  5448 raft_consensus.cc:2376] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 29. Re-sending same reply.
I20260709 13:19:01.271142  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.266902  5442 raft_consensus.cc:2376] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27. Re-sending same reply.
I20260709 13:19:01.277402 13207 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.287617  5445 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:19:01.289407  5448 raft_consensus.cc:2393] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 27: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:01.245553 13345 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 13:19:01.293708  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.248400 13239 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.303984  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.313650 13334 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:01.299469 13348 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:19:01.315798  5444 raft_consensus.cc:2393] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 27: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:01.295413 13339 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.323288  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 66704.6us
I20260709 13:19:01.267881 13098 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:01.333751  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.341387 13216 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.342291  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3689) took 1112 ms. Trace:
I20260709 13:19:01.321957 13210 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:01.342701  5518 rpcz_store.cc:276] 0709 13:19:00.230376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.999246 (+768870us) service_pool.cc:224] Handling call
0709 13:19:00.999678 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:01.028889 (+ 29211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:01.028933 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:01.029538 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:19:01.195150 (+165612us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:01.195204 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:01.195296 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.342091 (+146795us) raft_consensus.cc:1685] finished
0709 13:19:01.342111 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.342235 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40372,"raft.queue_time_us":32912,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6535,"thread_start_us":165148,"threads_started":1,"wal-append.queue_time_us":259166}
W20260709 13:19:01.371795  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69771us
I20260709 13:19:01.376423  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.375452 13216 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.375087 13301 raft_consensus.cc:493] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:19:01.382684 13330 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.526s	user 0.003s	sys 0.002s
I20260709 13:19:01.382246 13301 raft_consensus.cc:515] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:01.355315 13314 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.392055 13314 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.394312 13321 raft_consensus.cc:3055] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:01.394783 13321 raft_consensus.cc:740] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:01.398856  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.397913  5516 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:19:01.403692  5515 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36792 (request call id 3688) took 1179 ms. Trace:
I20260709 13:19:01.385229 13301 leader_election.cc:290] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:01.419409  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.420506  5441 raft_consensus.cc:2368] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 22. Current term is 23.
I20260709 13:19:01.423026  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.356555 13351 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.431957  6042 leader_election.cc:400] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 22. Current term is 23.
I20260709 13:19:01.432477  6042 leader_election.cc:403] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:19:01.404222  5515 rpcz_store.cc:276] 0709 13:19:00.221622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.304279 (+ 82657us) service_pool.cc:224] Handling call
0709 13:19:00.314543 (+ 10264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.363181 (+ 48638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.363240 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.372744 (+  9504us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.460294 (+ 87550us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:00.460356 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.460464 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.334684 (+874220us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:19:01.396421 (+ 61737us) raft_consensus.cc:1685] finished
0709 13:19:01.396455 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.401093 (+  4638us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14019,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":13259,"spinlock_wait_cycles":13600640,"thread_start_us":72170,"threads_started":1,"wal-append.queue_time_us":385189}
I20260709 13:19:01.364660 13210 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
W20260709 13:19:01.420369  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44028.2us
I20260709 13:19:01.436534  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.343806 13339 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.440542  5445 raft_consensus.cc:2368] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 22. Current term is 23.
I20260709 13:19:01.444940  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.445855  5449 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26. Re-sending same reply.
W20260709 13:19:01.448500  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 80837.7us
I20260709 13:19:01.403761 13270 raft_consensus.cc:493] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:19:01.442821  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 232448us
I20260709 13:19:01.395628 13321 consensus_queue.cc:260] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.462330 13270 raft_consensus.cc:515] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:01.464044 13217 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27.
I20260709 13:19:01.438913 13355 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e for earlier term 22. Current term is 23.
I20260709 13:19:01.465258 13270 leader_election.cc:290] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:01.467343 13351 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.471378  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.434708 13314 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:19:01.482453  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.486457  5523 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:19:01.496168  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.496737  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.491923  5340 leader_election.cc:400] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24.
I20260709 13:19:01.499137  5515 raft_consensus.cc:2410] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:01.499475  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:01.473543 13339 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.499719  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:01.514547  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:01.516451 13098 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:01.487847 13314 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:01.531845  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:01.511147 13239 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.530548 13314 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:01.545235  5518 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:19:01.536204 13275 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:01.550055 13275 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.563831 13318 raft_consensus.cc:993] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:19:01.564566 13098 raft_consensus.cc:1081] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:19:01.575054 13207 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.576355 13275 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.541177 13334 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:01.510637 13270 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:19:01.540969 13372 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.090s	user 0.000s	sys 0.004s
I20260709 13:19:01.589310 13334 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:01.610294  6041 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.612715 13375 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.612815 13374 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:01.613334 13375 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.615705 13375 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.611207 13334 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:19:01.610342 13224 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.001s
I20260709 13:19:01.633387 13078 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:01.634012 13078 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.638545  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:01.639137 13078 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.639217  5521 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:01.627413 13224 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.007s	sys 0.001s
I20260709 13:19:01.654651  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.663168  5518 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
W20260709 13:19:01.665143  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 165490us
I20260709 13:19:01.667393  5340 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:01.669288  5518 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:01.672825  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.682938 13314 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.689055  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.653931 13303 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:01.662022  5521 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:19:01.672078 13333 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:01.683030 13317 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:01.626685 13374 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:01.702503 13317 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:01.702337 13283 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:01.711645 13317 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.712824 13317 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:01.713721 13283 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:01.714438 13283 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:01.719414  5414 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:01.720688 13270 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:01.721222 13270 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.721689 13270 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:01.722420 13374 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:01.723147 13358 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:01.723654 13358 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.725960 13314 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.707906 13379 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:01.697662 13303 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.728180  5489 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:01.730026 13303 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.731683 13314 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:01.732272 13314 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:01.732725 13314 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:01.733990 13358 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.736343  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:01.702855 13333 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.737701 13333 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:01.737987  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.739063 12899 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:01.739964 13337 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:01.740679 13337 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.743382 13337 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:01.743253  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23048b90f57d48a4be8be78bc78d9204" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:01.743324  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef276ea910334ad38fb1112a61709988" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:01.769907  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.771163  5443 raft_consensus.cc:2393] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:01.774292 13374 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.775039 13374 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.787701 13279 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:01.788574 13279 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:01.792611 13279 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:01.794027 13375 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:01.795567 13375 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.798480  5369 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:19:01.801271  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:01.804931 13374 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.807317 13375 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.717119 13283 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:01.754521  5339 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:01.811069  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:01.813568  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 59170.2us
I20260709 13:19:01.824525 13333 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.825837 13383 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:01.733047 13334 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.831351  5445 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:19:01.835707  5516 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 12 to 18, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:01.840862  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:01.878429  5372 raft_consensus.cc:2368] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:19:01.841281  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.879529  5441 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 30 because replica has last-logged OpId of term: 28 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
W20260709 13:19:01.842275  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 153292us
I20260709 13:19:01.846589  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.851389  5339 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:01.910655  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:01.911516  5372 raft_consensus.cc:2368] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:19:01.913666  5340 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.926841  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.930392 13383 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:19:01.931191 13382 log.cc:927] Time spent T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:19:01.932035  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 80779.2us
I20260709 13:19:01.933454  5369 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 28: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:19:01.948529  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:01.949723  5372 raft_consensus.cc:2410] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for term 30 because replica has last-logged OpId of term: 28 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 13:19:01.953351  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:01.972154  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:01.945238 13224 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:01.945698 13304 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:01.978152  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.933843 13270 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.993443  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:01.994501  5441 raft_consensus.cc:3060] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:19:01.997758  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.998788  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.998466  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.000226  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:01.963737  5448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:19:02.006414  5448 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:02.006803  5448 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:02.010630 13334 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:01.931807 13383 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:01.990029 13374 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:01.950670 13283 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:19:01.957967 13366 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:19:02.021595 13351 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:02.022452 13379 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:02.024323  5442 raft_consensus.cc:1275] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:19:02.024596  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85174.4us
I20260709 13:19:01.982846 13304 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.030400  5441 raft_consensus.cc:2468] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28.
I20260709 13:19:02.042076  5443 raft_consensus.cc:2368] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
W20260709 13:19:02.031275  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.031519 13381 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:02.031826 13369 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.106s
I20260709 13:19:02.032086  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:02.044840  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44727.4us
I20260709 13:19:02.047518  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.044667 13304 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:02.068470  5446 raft_consensus.cc:1240] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:02.067833  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:02.054814 13216 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:02.070883  5370 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:02.071002  5340 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.061857 13389 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:02.078183  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.078852  5375 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:19:02.079018  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.079211  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.079646  5373 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:19:02.070825  5339 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:02.083531  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.089893  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.074043 13216 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.073462 13334 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:19:02.082187 13369 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:02.134505  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.081956 13333 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.137790  5269 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.085204 13352 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:02.146772 13283 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:02.149798  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.152395  5370 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
I20260709 13:19:02.158226  5448 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:02.164186  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 162914us
I20260709 13:19:02.162400  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.165093  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:02.166967  5521 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 28: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:02.165704  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:02.167999  5518 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:02.169510  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:02.171522  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:02.121094 13377 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:02.176709  5370 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:19:02.178692  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:02.170706  5523 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 29.
I20260709 13:19:02.181732  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.182874 13369 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:02.183491 13369 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:02.183929  5339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.185674 13369 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:02.188614 13351 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:02.188628  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.190092 13353 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:02.191478  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.193318 13321 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:02.193672 13224 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:02.195443  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:02.196252 13353 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:19:02.196643 13353 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.196964 13353 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:19:02.198750  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.210528  5520 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:02.214618 13074 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:02.215220 13074 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.195974  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:02.217571 13375 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:02.218108 13375 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:02.219009 13074 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.219012 13375 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.220163 13210 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:02.223043  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:02.224640  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.228395 13355 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index 12 to 18, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:02.087155 13385 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.079s
I20260709 13:19:02.158403 13352 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:02.239140 13352 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:02.239903  5271 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 48) took 15236 ms (client timeout 15000 ms). Trace:
I20260709 13:19:02.239542  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:02.242897 13342 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:02.243103  5269 catalog_manager.cc:5697] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 25, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 25 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.246059 13351 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:02.245105  5269 catalog_manager.cc:5697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.248243  5269 catalog_manager.cc:5697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 25, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 25 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.254341  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.258422  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.259070  5441 raft_consensus.cc:2376] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26. Re-sending same reply.
I20260709 13:19:02.259747  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.260018  5518 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:19:02.262794  5448 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.260653  5447 raft_consensus.cc:2376] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22. Re-sending same reply.
I20260709 13:19:02.254935  5442 raft_consensus.cc:2376] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 29. Re-sending same reply.
I20260709 13:19:02.265218  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.265816  5442 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:02.268072  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:02.269290  5370 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:19:02.273763  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:02.273821  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:02.274547  5518 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:02.273386  5269 catalog_manager.cc:5697] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 24, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 24 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.274912  5518 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:02.287029  5269 catalog_manager.cc:5697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 24, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 24 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.293519  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.293888  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.293223  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.296195  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.296959  5443 raft_consensus.cc:2376] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27. Re-sending same reply.
I20260709 13:19:02.297787  5519 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 25: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:19:02.173604 13283 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:02.289041  5269 catalog_manager.cc:5697] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 22, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 22 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.299777  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.301800  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.302656  5446 raft_consensus.cc:2376] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22. Re-sending same reply.
I20260709 13:19:02.304903  5447 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:02.306962  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:19:02.240321  5271 rpcz_store.cc:269] 0709 13:18:47.003669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.004480 (+   811us) service_pool.cc:224] Handling call
0709 13:19:02.239800 (+15235320us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:00.176708 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:00.288047 (+111339us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:00.288102 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:19:00.288124 (+    22us) tablet.cc:662] Decoding operations
0709 13:19:00.288689 (+   565us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:00.288777 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:00.288817 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:19:00.375070 (+ 86253us) tablet.cc:701] Row locks acquired
0709 13:19:00.377764 (+  2694us) write_op.cc:260] PREPARE: finished
0709 13:19:00.385772 (+  8008us) write_op.cc:270] Start()
0709 13:19:00.393790 (+  8018us) write_op.cc:276] Timestamp: P: 1783603140383318 usec, L: 0
0709 13:19:00.399087 (+  5297us) op_driver.cc:348] REPLICATION: starting
0709 13:19:00.403567 (+  4480us) log.cc:844] Serialized 912 byte log entry
0709 13:19:00.950627 (+547060us) op_driver.cc:464] REPLICATION: finished
0709 13:19:01.224185 (+273558us) write_op.cc:301] APPLY: starting
0709 13:19:01.233984 (+  9799us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:01.309589 (+ 75605us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:01.309694 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:01.310980 (+  1286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:01.311146 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:19:01.311192 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:01.311402 (+   210us) log.cc:844] Serialized 32 byte log entry
0709 13:19:01.334554 (+ 23152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.336741 (+  2187us) write_op.cc:454] Released schema lock
0709 13:19:01.339928 (+  3187us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:01.342132 (+  2204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:01.342163 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":320846,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":253702,"apply.run_cpu_time_us":5472,"apply.run_wall_time_us":121985,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":187417,"prepare.run_cpu_time_us":5359,"prepare.run_wall_time_us":258385,"replication_time_us":523628,"thread_start_us":198936,"threads_started":2}]]}
I20260709 13:19:02.248245 13216 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:02.295380  5518 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.312480  5518 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:02.310915  5269 catalog_manager.cc:5697] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 9 to 16, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 16 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.315960  5269 catalog_manager.cc:5697] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 24, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 24 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.316469 13353 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.317647 13395 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:02.317708  5269 catalog_manager.cc:5697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 26. New cstate: current_term: 26 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.318326 13395 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.319725 13353 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 30 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.320726 13395 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.319887  5269 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 26, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 26 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.323064  5269 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 26. New cstate: current_term: 26 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.330802  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.331750  5444 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:19:02.333947  5518 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 27.
I20260709 13:19:02.341467  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.343300  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:02.345186  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.335225  5339 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:02.345386  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.346149  5448 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 29.
I20260709 13:19:02.342882  5414 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:02.351610  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.353103  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.353745  5448 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:19:02.355737  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:02.356333  5519 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:19:02.358870  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.360790  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.363404  5448 raft_consensus.cc:2393] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 28: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:02.363106  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.366189  5448 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:19:02.367216  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:02.294224 13346 consensus_queue.cc:1048] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 13:19:02.293188 13074 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:19:02.370321  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.371222  5269 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 18, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 18 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.375182  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.375981  5444 raft_consensus.cc:2393] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 25: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:02.376647  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.377287  5269 catalog_manager.cc:5697] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 22, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 22 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.378919  5269 catalog_manager.cc:5697] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 22 to 25, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 25 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.380925  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.381855  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.383018  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:02.364244 12929 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:02.396979  5269 catalog_manager.cc:5697] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:02.363092 13369 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:19:02.374384 13314 consensus_meta.cc:287] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.002s
I20260709 13:19:02.363083 13090 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:02.400188  5269 catalog_manager.cc:5697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 26, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 26 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.416386  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.417394  5373 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:19:02.404069  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.419895  5269 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 26, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 26 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.421816  5269 catalog_manager.cc:5697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 22, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 22 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.423817  5269 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.430312  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:02.418871 13090 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.430634  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:02.432731 13376 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.419061 12929 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 27 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:02.435479 12929 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.442628  5269 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.390223 13283 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:02.445822  5269 catalog_manager.cc:5697] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 23, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 23 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.459074  5489 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:02.465041  5269 catalog_manager.cc:5697] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 15 to 23, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 23 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.466647  5269 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.467868  5269 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 22 to 23, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 23 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:19:02.455847  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.469141  5269 catalog_manager.cc:5697] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 21, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 21 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.409871  5415 leader_election.cc:304] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:02.463131  5519 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 30.
W20260709 13:19:02.472993  5415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 63404.4us
I20260709 13:19:02.473907  5415 leader_election.cc:304] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:02.475049  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.477874  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.479943 13283 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.414996 13314 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.482604  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.427939 13369 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:02.491220  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:02.493140  5339 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:02.487797  5269 catalog_manager.cc:5697] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 25, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 25 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.488894  5519 raft_consensus.cc:1240] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:02.497311  5269 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 20, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 20 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:02.488971  5489 leader_election.cc:400] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:19:02.500929  5375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80"
dest_uuid: "86b410d62f4040c39d33dc0698998562"
mode: GRACEFUL
new_leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:59536
W20260709 13:19:02.501951  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.499425  5489 leader_election.cc:403] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:19:02.502169  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:02.500490  5269 catalog_manager.cc:5697] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 23, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 23 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.501698  5375 raft_consensus.cc:606] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Received request to transfer leadership to TS b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.478230 13275 raft_consensus.cc:2804] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:02.478444 13074 raft_consensus.cc:2749] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.486193 13394 raft_consensus.cc:2749] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:02.514664 13376 raft_consensus.cc:993] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
W20260709 13:19:02.515436 13398 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.203s	user 0.000s	sys 0.004s
I20260709 13:19:02.512620 13342 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:02.524232  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.504318 13299 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:19:02.591208  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.512436  6076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:19:02.528421  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51958.3us
I20260709 13:19:02.534672  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:02.540812  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.596730  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 72550.2us
I20260709 13:19:02.558414  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.588533  5374 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:02.597685  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.598213  5269 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:02.599911  5269 catalog_manager.cc:5697] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 26, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 26 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:02.588294 13313 raft_consensus.cc:1081] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:19:02.630766  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.588478 13275 raft_consensus.cc:697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 28 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:02.634765  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:02.601951 13352 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:02.649063  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.649760 13270 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.650605 13355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58040 (request call id 0) took 2220 ms. Trace:
I20260709 13:19:02.654274  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:02.622264 13298 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:02.657779  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.625206 13299 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 30 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:02.677496  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:02.663714 13394 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:02.683533 13394 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.683900 13299 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.686256  5374 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:19:02.688336 13304 consensus_meta.cc:287] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.003s
I20260709 13:19:02.633204 13353 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:19:02.650628 13275 consensus_queue.cc:237] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 25.11, Last appended by leader: 11, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.665354 13342 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:02.700417  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.657392 13389 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:02.644783 13376 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:19:02.713789  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:02.714797  5366 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:02.671049 13351 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:19:02.722254  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:02.732468  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.689182 13304 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.735898  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:02.741531  5373 raft_consensus.cc:2368] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 26. Current term is 27.
I20260709 13:19:02.738236  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:02.711803 13389 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:02.774633  5442 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:19:02.735261 13274 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:19:02.759850  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:02.837500 13283 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:02.839375 13405 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:19:02.843009 13404 log.cc:927] Time spent T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:19:02.695411 13369 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:02.858366 13408 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:19:02.861466  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.749333 13385 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:02.776589 13389 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:02.881000  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.882632  5450 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:19:02.822613 13314 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:02.900085 13406 log.cc:927] Time spent T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:19:02.902324 13321 consensus_meta.cc:287] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.000s
I20260709 13:19:02.879873 13274 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.907902 13274 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.910530 13274 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:02.875695 13074 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.917868 13074 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.919772  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:02.920639 13074 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.896567 13394 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.924649 13383 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:02.925072  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.886686 13385 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.926424 13383 consensus_queue.cc:1059] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:02.928033 13385 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:02.928040 13279 raft_consensus.cc:3055] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:02.928825 13279 raft_consensus.cc:740] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:02.921049  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:02.930059 13410 log.cc:927] Time spent T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:19:02.929704 13279 consensus_queue.cc:260] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:02.930922 13279 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:02.930989  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:02.969767  5444 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:02.969053  5448 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:19:02.971828  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:02.972621  5519 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 27: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:19:02.932479 13408 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:02.980088  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:02.885339  5442 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58818
I20260709 13:19:02.988976  5519 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 15. (term mismatch)
I20260709 13:19:02.989609  5519 pending_rounds.cc:85] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Aborting all ops after (but not including) 14
I20260709 13:19:02.981321  5442 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:19:02.974774 13401 log.cc:927] Time spent T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 13:19:02.662010 13355 rpcz_store.cc:276] 0709 13:19:00.430493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.430673 (+   180us) service_pool.cc:224] Handling call
0709 13:19:00.700422 (+269749us) log.cc:844] Serialized 494 byte log entry
0709 13:19:00.947413 (+246991us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b180032a0a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c19c0a 00007fc1da359219 00007fc1d0ca1a40 00007fc1d0c9c4e4 00007fc1d0c9c455 00007fc1d3ce5b0b 00007fc1d3d6ab63 00007fc1d3d92752 00007fc1d3d8a9fa
0709 13:19:02.650500 (+1703087us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238377,"raft.queue_time_us":252782,"raft.run_cpu_time_us":1620,"raft.run_wall_time_us":82846,"spinlock_wait_cycles":19153280}
I20260709 13:19:02.991392  5519 pending_rounds.cc:107] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 13:19:02.991345  5517 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:03.001709  5519 raft_consensus.cc:2889] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:02.993988  5442 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.006330  5522 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:19:03.006920  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:03.011153  5490 leader_election.cc:400] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:19:02.967983 13298 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.996075  5366 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 27.
I20260709 13:19:02.998490 13304 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.031932  5490 leader_election.cc:403] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:19:03.029664  5442 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.049300  5490 leader_election.cc:400] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25.
I20260709 13:19:03.038643  5444 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:19:03.042320  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:03.050568  5519 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:03.050491  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:03.043287 13416 log.cc:927] Time spent T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:19:03.052799  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.027617 13274 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.062022  5445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3722) took 1100 ms. Trace:
I20260709 13:19:03.058435  5490 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.016104 13283 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:19:03.062575  5445 rpcz_store.cc:276] 0709 13:19:01.953697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.956085 (+  2388us) service_pool.cc:224] Handling call
0709 13:19:01.980225 (+ 24140us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:02.249690 (+269465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.249724 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:02.282638 (+ 32914us) log.cc:844] Serialized 52 byte log entry
0709 13:19:02.472149 (+189511us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:02.657739 (+185590us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.030853 (+373114us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.054108 (+ 23255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.054185 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.054233 (+    48us) raft_consensus.cc:1685] finished
0709 13:19:03.054245 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.054377 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32826,"prepare.queue_time_us":178868,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":81943,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"thread_start_us":889223,"threads_started":4,"wal-append.queue_time_us":205210}
I20260709 13:19:03.048194 13420 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:03.047930 13300 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:03.085609  5442 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.053689 13337 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca for earlier term 22. Current term is 23.
I20260709 13:19:03.090726  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.087155  5259 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9d883e5d309d4113a821624777a85d05 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:03.091782 13376 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:03.092623 13303 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 LEADER]: Stepping down as leader of term 26
W20260709 13:19:03.094734 13409 log.cc:927] Time spent T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:03.095148 12899 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:03.082314 13353 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.066690 13274 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.105952  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.089536  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.066808 13216 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:19:03.135809  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.129774  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.192548  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.079999 13304 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:03.176433  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:19:03.195255  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 105819us
I20260709 13:19:03.196182  5490 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.130805 13303 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:19:03.175522  5259 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 108772us
I20260709 13:19:03.187692  5444 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:03.204181  5490 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.190425 13300 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:03.207391 13300 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:03.133033 13376 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.194295 13353 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.211730 13353 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.211813 13376 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:03.209250 13389 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:03.213152 13421 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:19:03.214478 13389 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.200229 13314 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:03.200887  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 192555us
I20260709 13:19:03.223358  5519 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:19:03.223767  5340 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:19:03.273074  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 49447.2us
I20260709 13:19:03.226056 13303 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.228768 13274 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:03.202229 13337 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:19:03.230196  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 152478us
I20260709 13:19:03.278083  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:03.256349  5490 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.129112 13420 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:03.268044 13300 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:03.296587 13300 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.298851 13300 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.273168  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:03.274956  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.251693 13091 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:03.309409  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.310030  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.276510  5450 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 30.
I20260709 13:19:03.286266  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:03.275429 13369 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:03.290724 13090 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.292922  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.295536 13420 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:03.296075 13314 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:03.316963  5444 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:19:03.318625  5416 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.286439 13337 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:03.325003  5367 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:19:03.329897  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.334007  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.334354  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.334666  5372 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.308544 13091 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:03.319360 13303 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:03.319868 13300 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:03.320096 13418 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:03.341290  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.337904  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:03.323256 13299 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:03.347232  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:03.342693 13090 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:03.319567 13298 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:19:03.323352 13369 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:03.363569  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:19:03.317992 13161 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:19:03.331861 13337 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:03.319465 13389 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:19:03.320999 13283 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:19:03.334229 13420 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:03.383001  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.344467 13091 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:03.354874 13424 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:03.394238  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.367452 13394 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:03.399012  5518 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:19:03.401506  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.407014  5416 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.407207  5366 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
I20260709 13:19:03.411813  5372 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:19:03.415854  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.423879  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.392432 13376 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:03.430370 13090 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:03.395964 12929 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:03.425375  5442 raft_consensus.cc:2955] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 12 to 18, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:03.444365  5416 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.398818 13418 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:03.393291 13279 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:19:03.446292 13090 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:03.410924 13395 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:03.423997 13417 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:03.455775  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 59595.9us
I20260709 13:19:03.456312  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.443568 13351 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:03.445518 13376 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.440328 12929 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:03.471696  5416 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.451923 13394 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:19:03.474159 13376 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:03.469838 12929 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:03.475811 13074 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:03.477731  5372 raft_consensus.cc:1240] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:03.480026  5366 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 28 index: 12. (index mismatch)
I20260709 13:19:03.480739  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.482236  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.485292  5447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58816 (request call id 3425) took 1102 ms. Trace:
I20260709 13:19:03.487888 13395 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:03.446686 13369 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.484098 13090 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:03.451470 13418 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.485947  5447 rpcz_store.cc:276] 0709 13:19:02.383152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.477583 (+ 94431us) service_pool.cc:224] Handling call
0709 13:19:03.481160 (+1003577us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b540007d928. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b69924 00007fc1d8d52227 00007fc1d8d51ab8 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:19:03.485227 (+  4067us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9813888}
I20260709 13:19:03.468734 13270 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:03.491294  5416 leader_election.cc:400] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 26. Current term is 27.
I20260709 13:19:03.492039  5416 leader_election.cc:403] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
W20260709 13:19:03.493081 13437 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:19:03.496117  5441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3418) took 1158 ms. Trace:
I20260709 13:19:03.483628 13417 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:03.500449 13417 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931) with higher term. Message: Invalid argument: T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 26. Current term is 27.
I20260709 13:19:03.503504  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:03.504848  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:03.482671 13351 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.496529  5441 rpcz_store.cc:276] 0709 13:19:02.338116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.620492 (+282376us) service_pool.cc:224] Handling call
0709 13:19:02.620888 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:02.696634 (+ 75746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.696673 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:02.706379 (+  9706us) log.cc:844] Serialized 52 byte log entry
0709 13:19:02.910135 (+203756us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:19:03.065222 (+155087us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:03.109984 (+ 44762us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.176709 (+ 66725us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.191306 (+ 14597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.191414 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.485640 (+294226us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18003d2ac0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:19:03.495902 (+ 10262us) raft_consensus.cc:1685] finished
0709 13:19:03.495924 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.496052 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89912,"prepare.queue_time_us":43747,"prepare.run_wall_time_us":42944,"raft.queue_time_us":60497,"raft.run_cpu_time_us":2560,"raft.run_wall_time_us":329477,"spinlock_wait_cycles":57495424,"thread_start_us":378475,"threads_started":2,"wal-append.queue_time_us":473284}
I20260709 13:19:03.517331  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.518118  5490 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.518260  5374 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 16.
I20260709 13:19:03.525377 13321 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:03.527001  5490 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:03.527920 13321 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:03.528354 13321 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.528713 13321 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:03.531479 13275 consensus_queue.cc:1059] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:03.532683 13161 raft_consensus.cc:3055] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:03.533211 13161 raft_consensus.cc:740] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:03.534214 13161 consensus_queue.cc:260] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.536127 13161 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:03.536258  5416 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.537671 13210 raft_consensus.cc:993] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: : Instructing follower b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:19:03.538255 13394 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:03.538683  5416 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:03.539443 13394 raft_consensus.cc:2804] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:03.539738  5370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44106 (request call id 2822) took 1170 ms. Trace:
I20260709 13:19:03.539921 13394 raft_consensus.cc:697] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:03.540310  5370 rpcz_store.cc:276] 0709 13:19:02.369833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.380655 (+ 10822us) service_pool.cc:224] Handling call
0709 13:19:03.539493 (+1158838us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400259ed4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d902fa 00007fc1d8d51b17 00007fc1d22cc6d4 00007fc1d22cc662 00007fc1d22cc591 00007fc1d22cc50c 00007fc1d22cb7c2 00007fc1d20c748c 00007fc1d20c68c6 00007fc1d20c626f
0709 13:19:03.539651 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954930944}
I20260709 13:19:03.541002 13394 consensus_queue.cc:237] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.551591  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.551874  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:03.554477 13321 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.555451  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.570411  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.570801  5490 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:03.573408  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.572045  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:03.582800  5371 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 16: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:19:03.584739  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.557175 13321 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:03.559965  5372 raft_consensus.cc:1240] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:03.552969 13351 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.593204  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.595233  5374 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 18.
I20260709 13:19:03.573128 13342 raft_consensus.cc:1081] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Signalling peer b781c7e31b7145aea647a7ff649e6ac7 to start an election
I20260709 13:19:03.534228 13091 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.586517 13344 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:03.605872  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.610618  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.596441 13385 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:03.583746 13376 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:19:03.615878 13091 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:03.625744  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.627538  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.628274  5373 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:03.609377 13344 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:03.644883  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:03.645327  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.646258  5370 raft_consensus.cc:2468] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:19:03.647433  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.641834 13344 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.666688  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:03.667754  5445 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:19:03.672384 12929 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:03.691111  5375 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:03.692876  5516 raft_consensus.cc:1240] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:03.694095  5369 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:19:03.699183  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:03.701006  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:03.702487  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:03.702772  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:03.703207  5524 raft_consensus.cc:3055] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:03.703639  5524 raft_consensus.cc:740] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:03.704480  5521 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:19:03.706248  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:03.707572  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:03.707901  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.704896  5524 consensus_queue.cc:260] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.710304 13417 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:03.710889 13417 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.711234 13344 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.719261  5516 raft_consensus.cc:1240] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:03.723191  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.724850  5524 raft_consensus.cc:3060] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.731427 13337 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.734074  5445 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 53eb858bdf82438d83f1be6a01da2e0e for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:03.734997  5524 raft_consensus.cc:2468] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:19:03.735447  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:03.736485 13333 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:03.737138 13333 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.737648  5520 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:03.740366 13333 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.740617 13419 consensus_queue.cc:1059] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:03.741854 13419 raft_consensus.cc:3055] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:03.742210 13419 raft_consensus.cc:740] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:03.743048 13419 consensus_queue.cc:260] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.744285 13419 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:03.736186  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 18.
I20260709 13:19:03.745290  5444 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 13:19:03.763931  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:19:03.752789  5443 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:19:03.757854  5447 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:03.781961  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:03.788040  5371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:03.675894 12929 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:03.788782  5371 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 20.
I20260709 13:19:03.789604  5414 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.791671  5367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.807328  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:03.808346  5450 raft_consensus.cc:3060] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:19:03.751140 13432 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.401s	user 0.000s	sys 0.003s
I20260709 13:19:03.772850 13417 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.844729  5414 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:03.844030  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 51541us
I20260709 13:19:03.860566  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.852020  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.867086  5414 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:03.869845 12929 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:03.870829 13270 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:03.871497 13074 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:03.872644  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.873839  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.874899  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:03.875008 13417 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:03.875691 13090 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:03.876173 13270 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:03.876904 13270 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:19:03.892812  5450 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28.
I20260709 13:19:03.885754 13344 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:03.900674  5340 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:03.847887 13424 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:03.902539  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:03.905550  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
W20260709 13:19:03.866391 13432 log.cc:927] Time spent T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:19:03.908001  5340 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.889550 13352 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:19:03.896014 13314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.014s
I20260709 13:19:03.875705 13417 consensus_queue.cc:1059] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:19:03.923867  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3427) took 1067 ms. Trace:
I20260709 13:19:03.907557 13074 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:03.908962 13224 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:19:03.921046 13314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.007s	sys 0.015s
I20260709 13:19:03.924373  5449 rpcz_store.cc:276] 0709 13:19:02.856141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.931825 (+ 75684us) service_pool.cc:224] Handling call
0709 13:19:02.932180 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.999417 (+ 67237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.999451 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.018729 (+ 19278us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.319091 (+300362us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:19:03.342530 (+ 23439us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.354189 (+ 11659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.354268 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.535613 (+181345us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b48001203d8. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8cacb37 00007fc1d8cac9ca 00007fc1d8da426f 00007fc1d8da3f37 00007fc1d8db855c 00007fc1d8db8508 00007fc1d8db8488 00007fc1d8db8443 00007fc1d8db76ec 00007fc1d7ce1a96
0709 13:19:03.750378 (+214765us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:19:03.923614 (+173236us) raft_consensus.cc:1685] finished
0709 13:19:03.923640 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.923800 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35165,"prepare.queue_time_us":23259,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2967,"raft.queue_time_us":24010,"raft.run_cpu_time_us":3304,"raft.run_wall_time_us":189165,"spinlock_wait_cycles":16314496,"thread_start_us":264008,"threads_started":1,"wal-append.queue_time_us":312203}
I20260709 13:19:03.901870 13445 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:19:03.907294 13304 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:19:03.923727 13216 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:03.913645 13333 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 13:19:03.943286 13426 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.648s	user 0.007s	sys 0.001s
I20260709 13:19:03.945554  5446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3421) took 1576 ms. Trace:
I20260709 13:19:03.945900  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:03.946015  5446 rpcz_store.cc:276] 0709 13:19:02.368946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.664875 (+295929us) service_pool.cc:224] Handling call
0709 13:19:02.665202 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.681967 (+ 16765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.682026 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.716729 (+ 34703us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.109527 (+392798us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:03.189690 (+ 80163us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.191673 (+  1983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.191773 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.689043 (+497270us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:19:03.945170 (+256127us) raft_consensus.cc:1685] finished
0709 13:19:03.945299 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.945484 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1667,"prepare.queue_time_us":81947,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":45,"raft.queue_time_us":35172,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":12427,"spinlock_wait_cycles":4127488,"thread_start_us":288202,"threads_started":1,"wal-append.queue_time_us":491650}
I20260709 13:19:03.948678  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:03.929338 13314 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 27 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:03.950269 13314 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.940363 13216 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:03.953548 13216 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:03.931730 13394 raft_consensus.cc:3055] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:03.955719 13394 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:03.956624 13394 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.957890 13394 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.964069 13418 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:03.965315 13161 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.965865 13161 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.966471  5450 raft_consensus.cc:2468] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:19:03.928704 13224 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:03.973155 13224 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.978571  5442 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80"
dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
 from {username='slave'} at 127.0.0.1:58816
I20260709 13:19:03.979285  5442 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:03.979677  5442 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:03.949294  5446 raft_consensus.cc:2376] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28. Re-sending same reply.
I20260709 13:19:03.982812 13300 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:03.983408 13300 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:03.984212 13343 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:03.986126  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:03.972589  5373 raft_consensus.cc:2468] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28.
W20260709 13:19:03.992828  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 140889us
I20260709 13:19:03.995632  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:03.997615  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:04.003263  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:04.007798  5489 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:03.938575 13074 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.023567  5442 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.028184  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:04.028892  5369 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
I20260709 13:19:04.001082 13337 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:04.032747 13224 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.034065 13441 raft_consensus.cc:2804] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:04.034829 13441 raft_consensus.cc:697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 28 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:04.035847 13441 consensus_queue.cc:237] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.019119  5489 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:04.042207  5445 raft_consensus.cc:1275] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 28 index: 12. (index mismatch)
W20260709 13:19:04.048615  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.984956 13343 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.060981  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:04.017446 13355 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:19:04.052071 13337 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:04.076869 13434 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.683s	user 0.001s	sys 0.002s
I20260709 13:19:04.086983  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:04.091596  5416 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:04.055956 13216 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.135838 13394 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:19:04.126322 13455 log.cc:927] Time spent T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:19:04.142352  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 50865.9us
I20260709 13:19:04.147127  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:04.124781 13369 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:04.125859 13321 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:04.155664  5446 raft_consensus.cc:2468] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 17.
I20260709 13:19:04.159705  5416 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:04.166909  5448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58816 (request call id 3430) took 1310 ms. Trace:
I20260709 13:19:04.167373  5448 rpcz_store.cc:276] 0709 13:19:02.856857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.999265 (+142408us) service_pool.cc:224] Handling call
0709 13:19:02.999603 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.000245 (+   642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.000280 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.017146 (+ 16866us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.260604 (+243458us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:03.260646 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.260724 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.076164 (+815440us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0bc5c85 00007fc1d0bc66a2 00007fc1d39381db 00007fc1d3933aaf 00007fc1d392786e 00007fc1d3926bb6 00007fc1d39267d8 00007fc1d3930221 00007fc1d39301d9 00007fc1d3930169
0709 13:19:04.166563 (+ 90399us) raft_consensus.cc:1685] finished
0709 13:19:04.166599 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.166841 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19277,"raft.queue_time_us":5758,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":14530,"spinlock_wait_cycles":5262720,"thread_start_us":164751,"threads_started":1,"wal-append.queue_time_us":276596}
I20260709 13:19:04.149076 13300 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:04.159729 13394 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:04.150615 13353 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:19:04.167768 13090 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:04.203331  5490 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:04.162349 13321 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.188172 13394 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:04.211866  5416 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:04.218468  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:04.228724 12929 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:04.212842 13344 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:04.211483 13394 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:04.216498 13224 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:04.244105  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 189985us
I20260709 13:19:04.226629 13090 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:04.208415 13300 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:19:04.227734 13074 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:04.262778  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:04.266098  5489 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:04.267688  5518 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 27 LEADER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:04.271268  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:04.237831 13343 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:04.240109 13344 raft_consensus.cc:697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:04.248085 13352 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:19:04.276149  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 89303.8us
I20260709 13:19:04.259909 13090 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:19:04.279157 13462 log.cc:927] Time spent T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:19:04.305505  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 98341.7us
I20260709 13:19:04.286204 13352 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:04.286264 13090 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:04.289904 13343 raft_consensus.cc:2804] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:04.288516 13216 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:04.277287 13314 consensus_queue.cc:1048] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:19:04.315814  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 105748us
W20260709 13:19:04.354588 13460 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:19:04.355952  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:04.344806 13343 raft_consensus.cc:697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:19:04.362056 13464 log.cc:927] Time spent T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:04.362459 13343 consensus_queue.cc:237] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:04.365943 13466 log.cc:927] Time spent T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:19:04.357343  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:04.367725  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:04.371306 13090 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.377388  5444 raft_consensus.cc:1240] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:04.386725  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:04.388191  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:04.388845  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:04.405591  5442 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:04.406570 13090 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:04.412366  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:04.412694  5368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:04.413053  5375 raft_consensus.cc:3055] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:04.413460  5375 raft_consensus.cc:740] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:19:04.403709 13453 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.444s	user 0.003s	sys 0.000s
I20260709 13:19:04.413738  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:04.424540  5375 consensus_queue.cc:260] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.425937  5375 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.427207  5516 raft_consensus.cc:1240] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:04.394901 13321 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:04.442507  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 124103us
I20260709 13:19:04.410686 13161 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:04.453763  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:04.475426  5490 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:04.474570  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:04.350270 13344 consensus_queue.cc:237] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:04.493259  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 58673.7us
I20260709 13:19:04.495911  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:04.505282  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 78336us
I20260709 13:19:04.495056 13486 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:04.542640 13486 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:04.543134 13486 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:04.552459 13486 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.509272 13478 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:19:04.558491 13465 log.cc:927] Time spent T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 13:19:04.561689  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.564373 13486 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:04.577386  5520 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 13:19:04.587556 13352 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.597954 13411 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:04.598523 13411 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:19:04.599658 13411 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:04.600914 13411 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:04.589035  5414 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:04.589475  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:04.630651  5375 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
W20260709 13:19:04.645301  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 56352.1us
I20260709 13:19:04.653167  5416 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:04.641512 13161 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:04.689044 13418 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.656787 13424 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:04.678257 13074 raft_consensus.cc:2804] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:04.705265  5375 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:04.716238  5518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36806 (request call id 3049) took 1016 ms. Trace:
I20260709 13:19:04.752971  5518 rpcz_store.cc:276] 0709 13:19:03.699391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.708075 (+  8684us) service_pool.cc:224] Handling call
0709 13:19:03.708351 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.268177 (+559826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.715879 (+447702us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540016b7d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:19:04.716149 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285932928}
W20260709 13:19:04.726328 13450 log.cc:927] Time spent T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:19:04.742949  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 244344us
I20260709 13:19:04.756466  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:04.609089 13394 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:04.761958  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 258614us
I20260709 13:19:04.762938 13375 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:04.765648  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:04.671594 13419 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 13:19:04.782264  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:04.770577  5375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:04.772308  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:04.777056  5373 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:04.785943  5449 raft_consensus.cc:1240] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:04.786875  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 312406us
I20260709 13:19:04.805787  5372 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:04.766429 13074 raft_consensus.cc:697] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:04.821072 13445 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:04.757261 13418 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.826327  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:04.816710 13385 consensus_queue.cc:1059] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:19:04.833633 13385 raft_consensus.cc:3055] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:04.833999  5489 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:04.834048 13385 raft_consensus.cc:740] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:04.835772 13494 raft_consensus.cc:2804] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:04.836577 13494 raft_consensus.cc:697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:04.836480 13385 consensus_queue.cc:260] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.838160 13385 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:04.837957 13494 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.838632 13468 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:04.853300  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:04.854131  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:04.897572  5517 raft_consensus.cc:1275] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:19:04.905093  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:04.905810  5515 raft_consensus.cc:3060] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:04.907876  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53281.7us
I20260709 13:19:04.908624  5490 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:04.854031 13485 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:04.964706  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:04.965322  5414 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:04.978189  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69638.8us
I20260709 13:19:04.981647  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:04.992383  5414 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:04.906409 13487 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:05.004261  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 296912us
W20260709 13:19:05.009555  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.010097  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:04.965669 13090 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:05.000465 13270 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:05.018445  5442 raft_consensus.cc:1240] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:05.028671 13270 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:05.029659 13074 consensus_queue.cc:237] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.031738 13424 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:05.000681 13274 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.033804 13419 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:05.033990 13274 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.034426 13419 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:04.986894 13275 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:05.039834  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:05.045857  5443 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:19:05.015084 13467 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:05.006357 13344 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:19:04.996691 13468 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:19:05.061900  5449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3752) took 1295 ms. Trace:
I20260709 13:19:05.069329  5449 rpcz_store.cc:276] 0709 13:19:03.766832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.262406 (+495574us) service_pool.cc:224] Handling call
0709 13:19:04.268865 (+  6459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.797911 (+529046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.061574 (+263663us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540023a854. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8ce01 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c 00007fc1d20c68c6
0709 13:19:05.061819 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188692864}
I20260709 13:19:05.036343 13090 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.016419 13487 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:05.083704 13394 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.095392 13508 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:05.183063 13492 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:05.173475 13418 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:05.202129 13498 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:19:05.203882 13090 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:05.212386  5340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.003s	sys 0.010s
I20260709 13:19:05.212473 13274 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:05.213006  5340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.003s	sys 0.010s
W20260709 13:19:05.214046 13501 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:19:05.213371  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 716484us
I20260709 13:19:05.195446 13508 consensus_queue.cc:1048] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:19:05.195729 13492 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.229455 13492 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.238329 13487 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:05.251113 13411 consensus_meta.cc:287] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: Time spent flushing consensus metadata: real 0.650s	user 0.013s	sys 0.002s
I20260709 13:19:05.252907  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:05.257011  5515 raft_consensus.cc:2468] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:19:05.266970 13352 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.255052 13300 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:05.283249 13300 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.285598 13395 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:05.286057 13395 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:05.255191 13366 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:05.286913 13395 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.287386 13366 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.288156 13395 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:05.291236 13515 log.cc:927] Time spent T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.065s	user 0.001s	sys 0.002s
W20260709 13:19:05.293072 13503 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:19:05.296851 13366 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.297451 13300 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:05.298041 13512 log.cc:927] Time spent T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 13:19:05.311177 13270 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:05.311764 13270 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.321686  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:05.322402  5366 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:19:05.323567  5373 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 13:19:05.326023  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 190867us
I20260709 13:19:05.340837  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:05.347110  5373 raft_consensus.cc:1275] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:19:05.348804  5443 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:19:05.351215  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:05.325664 13210 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:05.358520  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:05.361101 13270 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.363629  5443 raft_consensus.cc:2393] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 17: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:05.365130  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562"
I20260709 13:19:05.365945  5373 raft_consensus.cc:2393] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 19: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:19:05.367153  5373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:05.370963  5374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:05.376039  5369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:05.376919  5369 raft_consensus.cc:2393] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 86b410d62f4040c39d33dc0698998562 in this term.
I20260709 13:19:05.377559  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:05.378898  5366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
W20260709 13:19:05.386996  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 338360us
I20260709 13:19:05.337538 13419 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.344802 13300 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:05.451517  5444 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 13:19:05.453047  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 66289.6us
W20260709 13:19:05.451547  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 71856.4us
I20260709 13:19:05.457258  5372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "86b410d62f4040c39d33dc0698998562" is_pre_election: true
I20260709 13:19:05.460906  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:05.453506  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:05.465346  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 152722us
I20260709 13:19:05.466346  5443 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:19:05.373567 13480 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.368247 13366 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:05.385720 13418 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
W20260709 13:19:05.483600  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.505730  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:05.381009 13210 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.503159  5490 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:05.485078 13278 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:05.484432 13419 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
W20260709 13:19:05.535907  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 62455.5us
I20260709 13:19:05.539196  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.465691 13300 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.485085 13366 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.499768 13418 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.555724  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.561959  5522 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:19:05.496452 13480 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.594244  5520 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:05.593629  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:05.569254  4246 tablet_server.cc:179] TabletServer@127.4.37.129:0 shutting down...
I20260709 13:19:05.554153 13499 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:05.600761  5515 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 27. Current term is 28. Ops: []
I20260709 13:19:05.601343  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.602346  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.542695 13419 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.570081 13389 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.609200  5373 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 27.
I20260709 13:19:05.601444  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.606036 13499 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.617194  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:05.619642 13522 log.cc:927] Time spent T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:05.595888 13314 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
I20260709 13:19:05.615132 13321 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:05.637348  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:05.643828 13480 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.614356 13389 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.647282 13389 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.652207 13492 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:05.662645  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.617050 13351 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.668711 13351 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.671078 13351 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:05.673875 13524 log.cc:927] Time spent T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:05.612532 13441 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:19:05.679522  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.685181  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.688875 13353 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:05.689594 13353 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.690107  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.706822 13488 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 13:19:05.708217  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70972.5us
I20260709 13:19:05.710464 13366 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.636950 13321 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:05.712984 13210 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.715930 13337 consensus_queue.cc:1059] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:05.716616 13314 consensus_queue.cc:1048] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:19:05.718178  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 253338us
I20260709 13:19:05.721839  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.722160  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.621985 13499 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:05.746994  5442 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:19:05.745134  5416 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 22 similar messages]
I20260709 13:19:05.737037 13275 raft_consensus.cc:3055] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:05.739733 12929 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.759793  5414 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:05.717267 13337 consensus_queue.cc:1059] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:19:05.771754  5442 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:05.736671 13274 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:19:05.762413 13275 raft_consensus.cc:740] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:05.776439 13270 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:05.800482  5340 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:05.810781  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46909.8us
I20260709 13:19:05.813515  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:05.775869 12929 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.829186  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:05.811089 13353 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.840601 13529 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:05.809670 13418 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.842358 12929 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.799877 13394 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:05.857317  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:05.863461  5442 raft_consensus.cc:1275] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:05.800819 13521 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.069s
I20260709 13:19:05.846261 13216 raft_consensus.cc:3055] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:05.832902 13419 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:05.866252 13445 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:05.829535 13480 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:19:05.872278 13366 raft_consensus.cc:3060] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:05.847213 13394 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:05.879369 13216 raft_consensus.cc:740] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
W20260709 13:19:05.938344  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 192211us
W20260709 13:19:05.949671  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 176616us
I20260709 13:19:05.985836  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:05.998150  5414 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:06.002547  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 255686us
I20260709 13:19:05.872117 13275 consensus_queue.cc:260] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.011758  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:06.009748 13419 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:06.040208 12929 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:19:06.040763 12929 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:06.041689 12929 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.040297 13216 consensus_queue.cc:260] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.047106 13216 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:06.010293 13395 consensus_meta.cc:287] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.004s
W20260709 13:19:06.060957  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 315844us
I20260709 13:19:06.004910 13074 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:06.061229  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54921.9us
I20260709 13:19:06.042770 12929 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:06.066833  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:19:06.069123  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60508.5us
I20260709 13:19:06.075683 13270 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:06.076001 13502 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:06.076295 13270 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.076594 13502 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.078778 13270 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.079454 13270 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.079921 13270 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.080811 13300 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.081357 13300 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:06.078826 13502 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.082043 13502 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:06.081832 13300 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.082433 13502 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.082845 13502 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:06.083217 13270 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.083943 13300 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.071833 13419 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.098675 13419 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.100957 13419 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.101326 13502 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.070071 13508 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:06.103595 13502 leader_election.cc:290] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.058182 13366 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:06.150774  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.151834  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.154681  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.155265  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.105154 13275 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:06.155869  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.158881  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.183112  5415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.175143 13487 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.185267 13539 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.174319 13375 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
W20260709 13:19:06.183930  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.149273 13502 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:06.161502  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.209393  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.185738 13487 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:06.177249 13508 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:06.192034 13530 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.218686  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.232019 13321 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.228065 13508 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.239358 13508 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.185966 13539 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:19:06.194260 13502 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:06.276480  5487 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.228255 13542 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:06.195638 13375 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:06.281169  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 214423us
I20260709 13:19:06.265028 13224 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:06.261857 13321 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:06.230054 13530 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.295015 13544 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.295554 13544 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.296283 13530 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.297089  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.297392  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.297886  5445 raft_consensus.cc:2393] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 24: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:06.298116  5446 raft_consensus.cc:2393] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 28: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:06.287464 13542 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.299222  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.300671  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.300835 13542 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.279994 13394 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.301268  5446 raft_consensus.cc:2468] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 24.
I20260709 13:19:06.304697 13542 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.305277 13542 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.307027  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:06.307536 13542 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.307753 13389 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.308079 13542 raft_consensus.cc:3060] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:06.308495  5340 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:06.308344 13389 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.310091  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:06.310671 13389 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.311254 13389 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:06.311652  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:06.312885 13279 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:06.313560 13279 raft_consensus.cc:2804] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:06.313928 13279 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.314265 13279 raft_consensus.cc:3060] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:06.315090  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.316350  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.316264  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.316859  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.317608  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.317994  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:06.318222  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.317611  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:06.321627  5416 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.325204  5518 raft_consensus.cc:1275] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:06.326313  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.327692  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.282795 13385 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.335919  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.355826  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.289678 13543 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.367260  5518 raft_consensus.cc:2393] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 27: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:06.349143 13508 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.288002 13224 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.335096 13542 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:06.335237 13468 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.344606 13369 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.364674 13544 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.404220 13542 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.410537 13542 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.412719 13542 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.414012 13314 consensus_queue.cc:1048] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:06.421774 13521 consensus_queue.cc:1048] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:06.402958 13369 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.427004 13369 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:06.391186 13499 consensus_meta.cc:287] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 13:19:06.433388 13499 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.434463 13224 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.436640  5516 raft_consensus.cc:2368] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25.
I20260709 13:19:06.437544 13539 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931)
I20260709 13:19:06.438078 13499 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:06.438598 13502 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.439363 13487 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:06.384001 13543 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:06.442582  6043 leader_election.cc:336] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:06.443967 13375 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:06.442718 13543 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.390249 13508 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:06.449265 13543 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.398264 13468 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.369827 13385 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:19:06.450766  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:06.459223  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.460819  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.462253  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.456092  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.484783  5444 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:19:06.457737  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.478979  6070 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:19:06.486658  5441 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:19:06.458940 13385 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:06.492614  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:06.493402  6072 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
I20260709 13:19:06.500219 13279 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:06.502912  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.507946  5444 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:19:06.449402 13508 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:06.455137 13468 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:06.508502  5447 raft_consensus.cc:1275] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:19:06.532560  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.555047  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.452608 12899 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:19:06.531167 13385 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:06.530102 13502 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:19:06.570107  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 212396us
I20260709 13:19:06.550832 13539 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.449848 13543 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.554549 13424 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:19:06.594195  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.588507 13502 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.560361 13545 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.627409  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.628160  5516 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 27.
I20260709 13:19:06.631806  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.630138  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:06.634032  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.637284 13352 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:06.637810 13352 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:06.638183 13352 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.639372  5415 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:06.640623  5516 raft_consensus.cc:2393] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 23: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:06.590963 13385 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.650544 13521 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:06.651140 13521 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.651552 13521 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:06.652729 13385 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.667080 13279 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.599581 13539 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.624416 13545 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.669920  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.670775  5449 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 21: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:06.604849 13424 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:06.673002  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.673666  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 254791us
W20260709 13:19:06.684551  5416 leader_election.cc:336] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:06.709311  5416 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:06.710088 13543 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.710528 13395 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:06.711647 13539 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:06.713838  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.714749  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.715435  5416 leader_election.cc:336] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:06.715953  5416 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:06.704828 13424 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.719597 13511 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:06.720418 13511 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:06.707052 13502 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.708730 13545 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:06.724334 13511 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:06.727782  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:06.735574  5271 catalog_manager.cc:5697] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 13 to 15, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 15 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.737481  5271 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 18 to 23, leader changed from 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 23 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:06.739673  5271 catalog_manager.cc:5697] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 12 to 18, term changed from 23 to 25, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New cstate: current_term: 25 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.751771 13424 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:06.753391 13389 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:19:06.765169  5416 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:06.765863  5416 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:06.769496  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:06.773715  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56263.1us
W20260709 13:19:06.774339  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 360306us
I20260709 13:19:06.802914  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.803684  5521 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:19:06.774434 13424 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:06.807315  5340 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:06.807493  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.812343  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.815527  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.816694  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:06.817408  5450 raft_consensus.cc:3060] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:19:06.774973 13389 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:06.845325  5518 raft_consensus.cc:2393] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 28: Already voted for candidate 544c82a50cc4477886bb6f7d58f455ca in this term.
I20260709 13:19:06.827199  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.835562  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.846588  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 19.
I20260709 13:19:06.849028  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.853821  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.855049  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.856022  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.856954  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:06.859799  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 52578.1us
I20260709 13:19:06.862046  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.862982  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.863579  5446 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:19:06.863811  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.860524  5340 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:06.865233  5414 leader_election.cc:400] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25.
I20260709 13:19:06.865877  5414 leader_election.cc:403] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:06.846213  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.867585  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.868145  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.869751  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:06.871528  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.876991  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.878089  5523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.879184  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:06.879781  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.880249  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.874186  5269 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 161) took 7612 ms. Trace:
I20260709 13:19:06.881069  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:06.883327  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:06.882628  5416 leader_election.cc:336] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:06.881973  5524 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:19:06.885382  5416 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:06.892016  5450 raft_consensus.cc:2468] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:19:06.887166  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:06.893077  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.846396 13545 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:19:06.874914  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.883231 13502 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:06.859474 13543 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:06.875499 13471 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:06.883534 13492 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.883822 13529 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.881366  5269 rpcz_store.cc:276] 0709 13:18:59.249595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.249962 (+   367us) service_pool.cc:224] Handling call
0709 13:19:06.861296 (+7611334us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:03.177518 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:03.214609 (+ 37091us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:03.214650 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:19:03.214672 (+    22us) tablet.cc:662] Decoding operations
0709 13:19:03.290866 (+ 76194us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:03.290938 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:03.290969 (+    31us) tablet.cc:685] Acquiring locks for 31 operations
0709 13:19:03.293263 (+  2294us) tablet.cc:701] Row locks acquired
0709 13:19:03.293409 (+   146us) write_op.cc:260] PREPARE: finished
0709 13:19:03.325614 (+ 32205us) write_op.cc:270] Start()
0709 13:19:03.328273 (+  2659us) write_op.cc:276] Timestamp: P: 1783603143323268 usec, L: 0
0709 13:19:03.328303 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:19:03.436779 (+108476us) log.cc:844] Serialized 12078 byte log entry
0709 13:19:03.885593 (+448814us) op_driver.cc:464] REPLICATION: finished
0709 13:19:04.119847 (+234254us) write_op.cc:301] APPLY: starting
0709 13:19:04.126849 (+  7002us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:04.566319 (+439470us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:04.566435 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:05.668563 (+1102128us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:05.668940 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 13:19:05.668986 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:05.669551 (+   565us) log.cc:844] Serialized 267 byte log entry
0709 13:19:05.875330 (+205779us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.925795 (+ 50465us) write_op.cc:454] Released schema lock
0709 13:19:05.935992 (+ 10197us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:06.058856 (+122864us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:06.061359 (+  2503us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":524166,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":186740,"apply.run_cpu_time_us":78626,"apply.run_wall_time_us":1915840,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133707,"num_ops":31,"prepare.queue_time_us":339783,"prepare.run_cpu_time_us":39381,"prepare.run_wall_time_us":485625,"raft.queue_time_us":231300,"raft.run_cpu_time_us":7897,"raft.run_wall_time_us":192264,"replication_time_us":537326,"thread_start_us":710005,"threads_started":5,"wal-append.queue_time_us":441139,"wal-append.run_cpu_time_us":21263,"wal-append.run_wall_time_us":1044822}]]}
I20260709 13:19:06.884130 13478 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:06.918390  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:06.947808  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 53720.3us
W20260709 13:19:06.895155  5416 leader_election.cc:336] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:06.957964  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 70854.8us
W20260709 13:19:06.941318  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 66449us
I20260709 13:19:06.896828  5450 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 28.
W20260709 13:19:07.012962  5490 leader_election.cc:336] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:06.860677 13389 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:06.976084  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:06.884402 13385 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:06.978127  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.013715  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.940796 13528 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:19:07.050432  5490 leader_election.cc:336] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:06.897019 13344 consensus_queue.cc:1059] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.150s
I20260709 13:19:06.895264 13539 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 for earlier term 24. Current term is 25.
I20260709 13:19:07.050194  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:06.974603 13511 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:06.896528 13279 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:07.012009 13542 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:06.943192 13491 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:07.016999  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:06.940891 13337 consensus_queue.cc:1048] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.123s
I20260709 13:19:07.051606 13304 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:06.979123 13529 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:07.101758  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 84830.3us
I20260709 13:19:06.974578 13521 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:07.013895 13543 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:06.970974 13502 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.065290 13528 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.017117 13352 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:07.063155 13385 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:07.100425 13549 raft_consensus.cc:3055] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:19:07.091971 13511 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:06.947353 13545 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:06.978838 13492 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.120420  5449 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53eb858bdf82438d83f1be6a01da2e0e in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
I20260709 13:19:07.123041  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:07.080397 13375 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:07.014390 13478 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.111462 13528 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:07.103530 13471 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.112955 13352 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:07.109290 13543 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:19:07.141124 13470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.019s	sys 0.051s
I20260709 13:19:07.109867 13521 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:07.103674 13542 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.109015 13529 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.128424 13511 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:07.124521 13549 raft_consensus.cc:740] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:07.112658 13502 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:07.160997  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 89967.2us
I20260709 13:19:07.096953 13279 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.137385 13210 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:07.106490 13491 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:07.166606 13470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.019s	sys 0.051s
I20260709 13:19:07.183343  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.014057  5416 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:07.191474  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 296330us
W20260709 13:19:07.192591  5416 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:07.194437  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 120247us
I20260709 13:19:07.193089  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.139572 13375 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.166153  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.189908 13210 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.211745 13210 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:07.213104 13491 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.215046 13542 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.222398 13521 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.223945 13521 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:19:07.198750 13445 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:07.221190 13210 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.227671 13478 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.228816 13210 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.190231 13502 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:07.209087  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:19:07.209558  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44024.7us
W20260709 13:19:07.304348  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 181364us
I20260709 13:19:07.312697  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:19:07.316716  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 59932us
I20260709 13:19:07.318284  5489 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:19:07.324929  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 115909us
W20260709 13:19:07.324997  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 230586us
I20260709 13:19:07.328135  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:07.333623  6073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:19:07.275182 12899 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:07.337235  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
W20260709 13:19:07.337510  5442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.033s	sys 0.037s
W20260709 13:19:07.339325  5442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.033s	sys 0.037s
I20260709 13:19:07.266314 13502 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:07.360577  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 168021us
I20260709 13:19:07.363073  5339 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
W20260709 13:19:07.363308  5416 leader_election.cc:336] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.324774 13344 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.364286  5416 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.323724 13385 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:07.333036 13313 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.380913 13375 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:07.381264  5416 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.381798 13545 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.381743  5416 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.341728 13424 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:07.382997  5416 leader_election.cc:336] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.383226 13424 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:07.383440  5416 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.384061 13492 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:07.384584  5416 leader_election.cc:336] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.385002  5416 leader_election.cc:304] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.386567 13545 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:07.386785 13445 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:07.387272 13545 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:19:07.387413 13529 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:07.389755 13344 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.392616 13344 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:07.336664 13544 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:07.403925 13544 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:07.404422 13544 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:07.407693 13389 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:07.400830  6073 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 21.
W20260709 13:19:07.394976 13554 log.cc:927] Time spent T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:19:07.398428 13558 log.cc:927] Time spent T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:19:07.410327 13279 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.401690 13313 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.365914 13314 raft_consensus.cc:2804] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:07.434624 13502 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.278918 13549 consensus_queue.cc:260] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.444330  5442 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58818 (request call id 3795) took 1093 ms. Trace:
I20260709 13:19:07.339092 12899 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.466854  5442 rpcz_store.cc:276] 0709 13:19:06.350971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.492953 (+141982us) service_pool.cc:224] Handling call
0709 13:19:06.493243 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.493613 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:06.786177 (+292564us) log.cc:844] Serialized 14 byte log entry
0709 13:19:07.339735 (+553558us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:07.340186 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:19:07.340317 (+   131us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:07.340354 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.340423 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:07.442215 (+101792us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b1800140800. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d0c9f3f3 00007fc1d0ca17c1 00007fc1d0ca1779 00007fc1d0ca1709 00007fc1d0ca16d1 00007fc1d0ca09cd 000000000038f354 000000000038f199 00007fc1d0c8283a
0709 13:19:07.444010 (+  1795us) raft_consensus.cc:1685] finished
0709 13:19:07.444119 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:07.444266 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27769,"prepare.queue_time_us":255252,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":5169,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":25944,"spinlock_wait_cycles":112498304,"thread_start_us":773445,"threads_started":2,"wal-append.queue_time_us":626986}
I20260709 13:19:07.471057  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:07.477766  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:07.453598 13395 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.476780 12899 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:07.471894 13314 raft_consensus.cc:697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:07.478107 13549 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:07.482851 13389 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:07.486280 13572 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:19:07.519272  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 133249us
I20260709 13:19:07.487428 13395 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.512346 13389 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
W20260709 13:19:07.523135  5416 leader_election.cc:336] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.523593  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.525245  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.526604  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:07.527097  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 149675us
I20260709 13:19:07.527245  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:07.524878  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:07.530797  5416 leader_election.cc:336] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.531319  5416 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.530880  5449 raft_consensus.cc:1240] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Rejecting Update request from peer 544c82a50cc4477886bb6f7d58f455ca for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:19:07.535568 13313 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:07.518543 13572 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.522537 13419 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:07.538319 13572 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.539103 13571 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:07.541536  5416 leader_election.cc:336] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.542155  5416 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.542403 13389 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:07.542987 13502 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:07.544092  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:07.544236  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:07.544765  5444 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28.
I20260709 13:19:07.545953  5340 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.546995 13279 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.548076  5340 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.549230 13279 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.550628  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.552295 13567 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:07.552428 13528 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.553571  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.554464 13567 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:07.556329  5340 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.557562 13530 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.555223 13314 consensus_queue.cc:237] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:07.554477  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.559638  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.559818  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:07.566900  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.574676 13530 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:07.575223 13530 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:07.575594 13530 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:07.578270 13571 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:07.578958 13571 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.521685 13511 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.564616  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.528580 13521 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:07.605921  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:07.622964  5488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.583278 13511 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.632316 13567 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:07.633260  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:07.634184  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:07.634801  5515 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:07.636919  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.637760  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:07.639099  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.640363  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.641093  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.641640  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.644887  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.646589  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.644913  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.648626  5443 raft_consensus.cc:2368] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22.
I20260709 13:19:07.656869  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:07.656888  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60802.6us
I20260709 13:19:07.660986  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.581389 13571 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.665241  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.662458  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.663714  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.668515  5520 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 21.
I20260709 13:19:07.665196  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.664259  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.664592  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:07.586807 13395 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.633733 13557 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:07.679181  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:07.686133  5442 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:07.693697  5515 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:19:07.706688  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:07.696039  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:07.708102  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:07.718107  5442 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 20.
I20260709 13:19:07.721724  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:07.728412  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 144236us
I20260709 13:19:07.733872  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:07.740592  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:07.759483  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:07.741336 13445 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:07.748380 13567 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:07.798623  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:07.812211  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:07.813707 13575 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:07.814301 13575 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.814713 13314 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:19:07.814723 13575 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:07.815375 13314 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:07.815881 13314 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:19:07.818174 13587 log.cc:927] Time spent T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:07.828630  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.829679 13574 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
W20260709 13:19:07.830797  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 77505.4us
I20260709 13:19:07.830252 13574 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.836138 13574 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.840852  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:07.844198  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.846114  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:07.842397  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 46965.8us
W20260709 13:19:07.842625  5416 leader_election.cc:336] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.856663  5416 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.860106  5340 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.854481 13279 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.866501  5416 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.866961  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:07.869163  5416 leader_election.cc:336] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.841015 13528 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:07.870680  5416 leader_election.cc:336] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.870818  5340 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.871148  5416 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.869853 13424 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:07.863883 13279 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.877203  5339 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
W20260709 13:19:07.874471  5416 leader_election.cc:336] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.877979  5416 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.864710 13530 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.877516  5340 leader_election.cc:400] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 21 election: Vote denied by peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703) with higher term. Message: Invalid argument: T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22.
I20260709 13:19:07.825276 13575 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.871876 13502 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:07.871687 13224 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:07.881312  5416 leader_election.cc:336] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.890615  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.891745  5416 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.894409 13279 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:07.895908  5416 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.900283  5449 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 23.
I20260709 13:19:07.875008 13571 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.877053 13528 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:07.909106  5416 leader_election.cc:336] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.905947  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:07.914397  5416 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.881004 13574 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:07.920138  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.922056  5450 raft_consensus.cc:2393] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544c82a50cc4477886bb6f7d58f455ca in current term 22: Already voted for candidate b781c7e31b7145aea647a7ff649e6ac7 in this term.
W20260709 13:19:07.922406  5416 leader_election.cc:336] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.926033  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.879680 13389 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:07.882938 13548 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:07.928678  5416 leader_election.cc:336] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.929322  5416 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.902308 13424 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:07.932469  5416 leader_election.cc:336] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.911899 13351 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.933194  5416 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.944146 13389 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:07.944576  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.945305 13389 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.945670 13351 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:07.946096  5340 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:07.919441 13573 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:19:07.951651  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 94052.3us
I20260709 13:19:07.928449 13508 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:19:07.953605  5416 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.959234  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:07.959901  5515 raft_consensus.cc:3060] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:07.948825 13575 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:07.959920 13571 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:07.958724  5416 leader_election.cc:336] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:07.961858 13314 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.965651 13521 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:07.963726 12899 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:07.966374  5441 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:07.942656 13568 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.947644 13548 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:07.963258  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:07.971074  5515 raft_consensus.cc:2468] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 22.
I20260709 13:19:07.985633  5518 raft_consensus.cc:2368] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24.
I20260709 13:19:07.952688 13385 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:08.015663  5416 leader_election.cc:336] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:08.034760  5416 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:08.040506  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 125381us
I20260709 13:19:07.965467 13314 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:08.053015  5441 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 28.
I20260709 13:19:08.057142  5414 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:08.060848 13508 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:08.065807  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:08.073828  5524 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 25.
I20260709 13:19:08.063833  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:08.074623  5521 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:08.070350 13508 raft_consensus.cc:2804] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:19:08.083341  5416 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:08.083870 13508 raft_consensus.cc:697] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:08.033380 13575 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:08.086210  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 99278.5us
I20260709 13:19:08.085219  5521 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 28.
I20260709 13:19:08.117689  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:08.043992 13574 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:08.118435 13544 consensus_meta.cc:287] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Time spent flushing consensus metadata: real 0.714s	user 0.013s	sys 0.000s
I20260709 13:19:08.145992 13508 consensus_queue.cc:237] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.147854 13557 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:08.151455 13351 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:08.154840 12899 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:08.162297 13544 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.130723 13530 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.172557 13544 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.132910 13574 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.193032  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:08.207906  5521 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:19:08.209272  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:19:08.222687  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 353438us
W20260709 13:19:08.222765  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 96859.3us
I20260709 13:19:08.214497 13575 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:08.227154  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:08.233268  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:08.233855  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:08.234617  5521 raft_consensus.cc:2368] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 28. Current term is 29.
I20260709 13:19:08.232409 13575 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:08.245285 13530 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:08.268496 13445 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:19:08.282734  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 365963us
W20260709 13:19:08.289659  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 55309.2us
W20260709 13:19:08.361872  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 85944us
W20260709 13:19:08.368682  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 76419.1us
I20260709 13:19:08.294368 13602 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.371487  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:08.379146  6070 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:08.379554 13574 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.384733  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:08.368534 13445 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:08.387812  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:08.388245 13445 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.388949 13601 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:08.389447 13601 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.389799 13601 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:08.392251  5339 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:08.393738 13602 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.394975 13605 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:08.395605 13605 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 28 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:08.295890 13575 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.396605 13605 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.407568  5441 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 28.
I20260709 13:19:08.423175  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:08.428414 13602 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.401911 13385 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:08.433521 13385 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.420678 13275 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:08.437569 13275 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.415665 13492 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.452906 13492 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.455296 13492 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.452066 13275 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:08.436373 13385 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:08.458613  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 43712.8us
I20260709 13:19:08.479063  5340 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:08.483479  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:08.485378  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:08.495587  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:08.497066  5442 raft_consensus.cc:1240] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 21. Current term is 22. Ops: []
W20260709 13:19:08.499120  5490 leader_election.cc:336] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:08.501470  5490 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:08.489094 13595 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 13:19:08.516362  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 100820us
I20260709 13:19:08.517441  5339 leader_election.cc:400] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 28 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 28. Current term is 29.
I20260709 13:19:08.489365 13607 consensus_queue.cc:1059] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
W20260709 13:19:08.543771  5490 leader_election.cc:336] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:08.514531 13275 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.548753  5490 leader_election.cc:336] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:08.548870 13595 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 28 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:08.566644 13492 raft_consensus.cc:3055] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:08.567138 13492 raft_consensus.cc:740] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:08.567242 13595 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.568051 13492 consensus_queue.cc:260] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:08.569278 13492 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:08.570408  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52010.6us
I20260709 13:19:08.577229  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:08.583189  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:08.583091  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:08.549234 13275 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.595597 13275 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:08.617363  5489 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:08.619503 13593 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:08.631110  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:08.631819  5444 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:08.636847  5449 raft_consensus.cc:1275] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:19:08.637585  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:08.638151  5441 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:08.627677 13572 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:08.671711  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 145073us
W20260709 13:19:08.673631  5490 leader_election.cc:336] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:08.674149  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 82725.9us
I20260709 13:19:08.681129  5444 raft_consensus.cc:2468] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 29.
I20260709 13:19:08.685882 13385 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.686970 13385 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.693712 13385 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.685912  5441 raft_consensus.cc:2468] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:19:08.703933  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:08.716372  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 170115us
W20260709 13:19:08.729450  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 104472us
I20260709 13:19:08.732213  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:08.733103  5446 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28.
W20260709 13:19:08.740317  5416 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:08.741701  5416 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:08.742137  5416 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:08.676240 13572 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.746485 13574 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.762038 13521 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:08.750829 13575 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:08.756564 12899 consensus_queue.cc:1048] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:19:08.764511 13601 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.779668  5489 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:08.782735  5489 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:08.793313 13572 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.791865  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:08.775910 13521 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.790421 13441 raft_consensus.cc:2804] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:08.796416 13549 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:08.796375 13441 raft_consensus.cc:697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:08.785188 13321 raft_consensus.cc:2804] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:19:08.771474 13574 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.798758 13441 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.793836 13601 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.771507  5339 leader_election.cc:400] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Vote denied by peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363) with higher term. Message: Invalid argument: T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24.
W20260709 13:19:08.770306  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 119517us
I20260709 13:19:08.802562  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:08.807857 13321 raft_consensus.cc:697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 29 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:08.871332  5271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 49) took 5375 ms. Trace:
W20260709 13:19:08.874262  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 102999us
I20260709 13:19:08.910189  5339 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:08.906350  5271 rpcz_store.cc:276] 0709 13:19:03.495459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.495645 (+   186us) service_pool.cc:224] Handling call
0709 13:19:03.704546 (+208901us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf6090 00007fc1d3d94f3a 00007fc1d9b4b1cc 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:19:08.870773 (+5166227us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:07.314825 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:07.399183 (+ 84358us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:07.399223 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:19:07.399242 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:07.399837 (+   595us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:07.399896 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:07.399935 (+    39us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:07.400276 (+   341us) tablet.cc:701] Row locks acquired
0709 13:19:07.400291 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:19:07.400454 (+   163us) write_op.cc:270] Start()
0709 13:19:07.400580 (+   126us) write_op.cc:276] Timestamp: P: 1783603147400404 usec, L: 0
0709 13:19:07.400602 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:07.401387 (+   785us) log.cc:844] Serialized 1292 byte log entry
0709 13:19:07.811744 (+410357us) op_driver.cc:464] REPLICATION: finished
0709 13:19:07.920515 (+108771us) write_op.cc:301] APPLY: starting
0709 13:19:07.927509 (+  6994us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:08.067671 (+140162us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:08.067831 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:08.259947 (+192116us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:08.277441 (+ 17494us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:19:08.279873 (+  2432us) write_op.cc:312] APPLY: finished
0709 13:19:08.301812 (+ 21939us) log.cc:844] Serialized 40 byte log entry
0709 13:19:08.363255 (+ 61443us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:08.369344 (+  6089us) write_op.cc:454] Released schema lock
0709 13:19:08.378114 (+  8770us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:08.393088 (+ 14974us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:08.393117 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128424,"reported_tablets":5,"spinlock_wait_cycles":223175424,"child_traces":[["op",{"apply.queue_time_us":89595,"apply.run_cpu_time_us":10240,"apply.run_wall_time_us":490450,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":522683,"prepare.run_cpu_time_us":27831,"prepare.run_wall_time_us":251338,"raft.queue_time_us":253538,"raft.run_cpu_time_us":30007,"raft.run_wall_time_us":56047,"replication_time_us":410989,"spinlock_wait_cycles":59264,"thread_start_us":476020,"threads_started":4,"wal-append.queue_time_us":132822}]]}
I20260709 13:19:08.911473 13321 consensus_queue.cc:237] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.803723 13574 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:08.922401  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 119748us
I20260709 13:19:08.922698 13467 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:19:08.923466 13467 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.924005 13467 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:08.814630 13521 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:08.898320 13502 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:08.938845 13502 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:08.941303 13467 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:08.878715  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:08.948428 13467 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:08.960139 13601 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:08.953967 13530 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:08.976186 13502 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:19:08.980890  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 102671us
I20260709 13:19:08.989606  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:08.990659  5442 raft_consensus.cc:3060] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:08.999747  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:08.999790  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:09.002882  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.008222  5521 raft_consensus.cc:1275] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:19:09.010344  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 100493us
I20260709 13:19:09.011945  5339 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:09.023052  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.024457  5449 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:19:09.053510  5490 leader_election.cc:336] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.055008  5521 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 13:19:09.056357  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.063210 13530 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:09.069442 13502 consensus_queue.cc:1048] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:09.044903  5442 raft_consensus.cc:2468] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 29.
W20260709 13:19:09.063330  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 51760.7us
I20260709 13:19:09.096997  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.104467  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:09.123011  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.124984  5489 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:09.121795  5273 catalog_manager.cc:5697] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 18 to 20, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 20 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:09.133827 13344 raft_consensus.cc:2804] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:19:09.134639 13344 raft_consensus.cc:697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 29 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:09.136293 13344 consensus_queue.cc:237] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.137600 13321 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:09.139735  5441 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:19:09.139645 13321 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.143064 13321 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:09.149290  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:09.150013  5515 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:09.164410  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.165014  5524 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:19:09.165395  5519 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:09.167959  5515 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 26.
I20260709 13:19:09.170640 13508 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:09.177124  5524 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 29 LEADER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 28. Current term is 29. Ops: []
I20260709 13:19:09.178540 13549 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:09.180845  5516 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:09.179379 13549 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.184882 13549 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:09.188891  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.190200 13601 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.190984 13601 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.193940  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.212031 13601 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:09.212916 13471 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.213449 13480 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:09.213791 13471 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.214987  5521 raft_consensus.cc:1240] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Rejecting Update request from peer b781c7e31b7145aea647a7ff649e6ac7 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 13:19:09.214154 13480 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.237914 13480 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:09.243000 13375 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:19:09.250659  5416 consensus_peers.cc:597] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.231001 13508 consensus_queue.cc:1059] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:19:09.229121 13471 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:09.255887 13502 raft_consensus.cc:3055] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:09.256346 13502 raft_consensus.cc:740] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:09.280828 13492 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:09.392292 13511 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.096s
W20260709 13:19:09.411423  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 113028us
I20260709 13:19:09.411924  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.289376 13492 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.419754  5441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.423183  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.418507 13492 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:09.433689  5446 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:09.287076 13502 consensus_queue.cc:260] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.451951 13502 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:09.454844 13480 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:09.455504 13480 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:19:09.464033 13511 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:09.464717 13511 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.469156 13511 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:09.471997  5442 raft_consensus.cc:1240] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 28. Current term is 29. Ops: []
I20260709 13:19:09.474116 13467 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:19:09.480706 13511 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:09.481561 13511 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:09.482157 13492 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:09.482807 13492 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.484656 13511 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:09.474325  5339 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:09.509341  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
W20260709 13:19:09.530570 13606 log.cc:927] Time spent T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:09.508949 13224 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:09.484967 13492 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:09.553345  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 84768.5us
I20260709 13:19:09.561754 13224 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:09.517596 13480 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:09.567899  5444 raft_consensus.cc:1275] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:19:09.576342 13375 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
W20260709 13:19:09.579442  5413 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.579114 13530 consensus_queue.cc:1059] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:19:09.584900  5416 leader_election.cc:336] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.585733  5416 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:09.588353  5490 leader_election.cc:336] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.562630 13224 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.577062 13375 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.603565  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.604362  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.605944 13521 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:09.606402  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.607960  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.613830 13530 raft_consensus.cc:3055] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:19:09.614353 13530 raft_consensus.cc:740] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:09.615379 13492 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.616114 13492 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.615372 13530 consensus_queue.cc:260] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.619535 13530 raft_consensus.cc:3060] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:09.623044 13492 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:09.644421  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 59554.3us
W20260709 13:19:09.645799  5416 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.649109  5416 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:09.651513  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 182710us
I20260709 13:19:09.657107 13375 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:09.663565  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 69423.5us
I20260709 13:19:09.666476 13224 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:09.643098 13492 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:19:09.663666 13549 consensus_queue.cc:1048] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:19:09.652880  5450 raft_consensus.cc:1275] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:19:09.655777  5339 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:09.656551 13624 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:19:09.691504  5490 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.692109  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:09.699234 13608 consensus_queue.cc:1059] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:19:09.706374 13375 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:09.689893 13521 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 13:19:09.707772  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 52092.6us
I20260709 13:19:09.712975  5339 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:09.708364 13608 consensus_queue.cc:1243] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [LEADER]: Peer 544c82a50cc4477886bb6f7d58f455ca log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:19:09.716296  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.719306 13624 raft_consensus.cc:3055] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:09.720046 13624 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:09.709008 13572 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:09.721884 13572 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Becoming Leader. State: Replica: 86b410d62f4040c39d33dc0698998562, State: Running, Role: LEADER
I20260709 13:19:09.723457 13572 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.717235 13608 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:09.727033 13624 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.730211 13624 raft_consensus.cc:3060] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:09.734997  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.733145  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.737901  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:09.742311  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54151.2us
W20260709 13:19:09.743891  5490 leader_election.cc:336] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.744458  5490 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:09.740152  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.749265 13314 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:09.746106 13375 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:09.749240  5260 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 119111us
I20260709 13:19:09.763664 13549 consensus_queue.cc:1048] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 13:19:09.767411 13511 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:09.768049 13511 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.771508  5449 raft_consensus.cc:1240] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Rejecting Update request from peer 86b410d62f4040c39d33dc0698998562 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:09.772816 13511 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:09.771498 13375 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:09.774132  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 128391us
W20260709 13:19:09.775215  5416 leader_election.cc:336] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.775704  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:09.778995 13642 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:09.791325 13411 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.792243 13411 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:09.796391 13411 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:09.799754  6043 leader_election.cc:336] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.813020  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.815456  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.817173  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:09.825628  5341 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.827170  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83304us
I20260709 13:19:09.833598 13314 raft_consensus.cc:2749] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:09.835135  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:09.850126  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 72722.6us
I20260709 13:19:09.855346  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:09.857299  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:42599, user_credentials={real_user=slave}} blocked reactor thread for 86674.6us
I20260709 13:19:09.874176  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.868954 13608 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.875008 13608 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:09.875746  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.870682  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.882426  5339 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:09.877385 13608 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:09.887939  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.897652 13646 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:09.898662 13646 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:09.905817  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:09.928858  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9d883e5d309d4113a821624777a85d05: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:19:09.920476 13508 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:09.930806 13508 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:09.915410  5490 consensus_peers.cc:597] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.934231  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.937803  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.943651  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:09.944393  6070 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:19:09.946807  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.951915  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:09.953929  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:09.963310  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:09.964423 13646 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:09.971194  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562; no voters: 
I20260709 13:19:09.972396 13645 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:09.978684 13508 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:09.990257  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 107905us
I20260709 13:19:09.997434 13646 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:09.999531  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.000996  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:09.973011 13645 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.003698  5443 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86b410d62f4040c39d33dc0698998562 in term 22.
I20260709 13:19:10.028223  5339 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.041078 13492 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:10.041620  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.009382 13645 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.050663  5339 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.054770  5339 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.055972 13646 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.068854 13224 raft_consensus.cc:493] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:10.069734 13224 raft_consensus.cc:515] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:10.074674 13572 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:10.075541 13572 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:10.079362  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.080370  5449 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 22.
W20260709 13:19:10.099817  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45154.8us
W20260709 13:19:10.100785  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 90647.8us
I20260709 13:19:10.102005  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:10.102057 13530 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:10.126179  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:19:10.126835 13651 log.cc:927] Time spent T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:19:10.127512 13607 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:10.108898 13445 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:10.128041 13607 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:10.151281 13635 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:10.151894 13635 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.152295 13635 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.156555 13224 leader_election.cc:290] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:19:10.161332 13654 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:19:10.196282  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 83513.9us
I20260709 13:19:10.197688 13572 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:10.164026 13607 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:10.192261 13659 log.cc:927] Time spent T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:19:10.250550 13645 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:10.253629 13645 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:19:10.253520  5416 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:10.257347  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:10.274931  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.276633  5339 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:10.282595  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.286273 13530 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.287021  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:10.287213 13530 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:10.289700 13521 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:10.305133 13572 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:10.305874  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.306649 13492 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.305804 13572 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:10.307469 13492 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.309373 13572 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:10.307468  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.322892 13664 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:10.331571  5340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 60659.6us
I20260709 13:19:10.333271  5339 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:10.338688  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 210423us
W20260709 13:19:10.347218  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 58806.8us
I20260709 13:19:10.352100  5339 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.354028  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.357241 13635 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:10.360680 13635 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:10.361693 13511 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:10.361783  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 91951.3us
I20260709 13:19:10.365312  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.367578  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:10.373559  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:10.374212  5449 raft_consensus.cc:3060] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.347707 13664 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:10.394776  5271 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 50) took 1448 ms. Trace:
I20260709 13:19:10.395525  5271 rpcz_store.cc:276] 0709 13:19:08.947060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.947255 (+   195us) service_pool.cc:224] Handling call
0709 13:19:10.394693 (+1447438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35731,"reported_tablets":4}
W20260709 13:19:10.397137  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 45671us
I20260709 13:19:10.406344  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.409377  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.408260  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:10.408474  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:19:10.410985  6070 raft_consensus.cc:2393] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 86b410d62f4040c39d33dc0698998562 in current term 23: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
W20260709 13:19:10.410859  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 57220.9us
W20260709 13:19:10.415652  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.421584  5339 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.422504 13664 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:10.423528  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 68012us
I20260709 13:19:10.429611  5449 raft_consensus.cc:2468] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 23.
I20260709 13:19:10.433264  6042 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:19:10.434180  6043 leader_election.cc:336] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:10.434558 13411 raft_consensus.cc:2804] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:10.435702 13411 raft_consensus.cc:697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 23 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:19:10.436730 13411 consensus_queue.cc:237] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:10.440337  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.441802  5269 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.444264 13664 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:10.445235  5269 catalog_manager.cc:5697] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:19:10.458006  5273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 160) took 43046 ms (client timeout 15000 ms). Trace:
I20260709 13:19:10.461410  5340 leader_election.cc:304] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.449077  5269 catalog_manager.cc:5697] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 24. New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.468080  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.474167  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:10.473024  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d883e5d309d4113a821624777a85d05" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:10.476178  5522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:10.479080  5519 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:19:10.469271  5269 catalog_manager.cc:5697] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 28, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 28 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.479516  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:10.467694 13492 raft_consensus.cc:2749] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:10.480357  5269 catalog_manager.cc:5697] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 29. New cstate: current_term: 29 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.488125  5269 catalog_manager.cc:5697] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:10.497162  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.496505  5269 catalog_manager.cc:5697] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 22 to 28, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 28 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.505780 13445 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:10.506505 13445 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:10.508589 13445 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:10.508667 13645 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:10.509353 13645 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:10.510373 13645 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:10.510869  5446 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 86b410d62f4040c39d33dc0698998562: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 14. (term mismatch)
I20260709 13:19:10.512284  5446 pending_rounds.cc:85] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Aborting all ops after (but not including) 13
I20260709 13:19:10.512522  5446 pending_rounds.cc:107] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: Aborting uncommitted NO_OP operation due to leader change: 25.14
I20260709 13:19:10.512796  5446 raft_consensus.cc:2889] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.512825 13645 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:10.515728  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:10.517102  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.520522 13666 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:10.524174 13607 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.524688 13607 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:10.505750  5269 catalog_manager.cc:5697] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 24, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.526827 13607 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:10.460893  5273 rpcz_store.cc:269] 0709 13:18:27.411831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.413643 (+  1812us) service_pool.cc:224] Handling call
0709 13:18:27.675649 (+262006us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf6090 00007fc1d3d94f3a 00007fc1d9b4b1cc 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:19:10.457920 (+42782271us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:09.618859 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:09.619524 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:09.619589 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:19:09.619608 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:09.619995 (+   387us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:09.620077 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:09.620106 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:09.620408 (+   302us) tablet.cc:701] Row locks acquired
0709 13:19:09.620456 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:19:09.620632 (+   176us) write_op.cc:270] Start()
0709 13:19:09.620826 (+   194us) write_op.cc:276] Timestamp: P: 1783603149620568 usec, L: 0
0709 13:19:09.620870 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:19:09.642945 (+ 22075us) log.cc:844] Serialized 537 byte log entry
0709 13:19:10.011176 (+368231us) op_driver.cc:464] REPLICATION: finished
0709 13:19:10.025099 (+ 13923us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b18001629a0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d9b67de1 00007fc1d9b745b1 00007fc1d39344bc 00007fc1d0c8248b 00007fc1d9adcab9 00007fc1d0c9e69b 00007fc1d0c9c93f 00007fc1d0c9c455 00007fc1d3d09190 00007fc1d3d02ae7 00007fc1d3d01dd9
0709 13:19:10.123112 (+ 98013us) write_op.cc:301] APPLY: starting
0709 13:19:10.133498 (+ 10386us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:10.162083 (+ 28585us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d8932a 00007fc1d3d0ef14 00007fc1d3d0eec3 00007fc1d3d0ee38 00007fc1d3d0edf3 00007fc1d3d0e0dc 00007fc1d3d37e16 00007fc1d3d1fcbb 00007fc1d3d0a39d 00007fc1d3d0dd75
0709 13:19:10.249475 (+ 87392us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:10.249527 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:10.250480 (+   953us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:10.250742 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:19:10.250806 (+    64us) write_op.cc:312] APPLY: finished
0709 13:19:10.251074 (+   268us) log.cc:844] Serialized 24 byte log entry
0709 13:19:10.251988 (+   914us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:10.252078 (+    90us) write_op.cc:454] Released schema lock
0709 13:19:10.252137 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:10.252566 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:10.252596 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10893,"reported_tablets":58,"spinlock_wait_cycles":29981568,"child_traces":[["op",{"apply.queue_time_us":88283,"apply.run_cpu_time_us":4812,"apply.run_wall_time_us":140890,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":198069,"prepare.run_cpu_time_us":50827,"prepare.run_wall_time_us":263299,"raft.queue_time_us":95187,"raft.run_cpu_time_us":22098,"raft.run_wall_time_us":164430,"replication_time_us":390001,"spinlock_wait_cycles":29366272,"thread_start_us":317225,"threads_started":4,"wal-append.queue_time_us":250175}]]}
W20260709 13:19:10.526846  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.532416  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.532315  5269 catalog_manager.cc:5697] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 11 to 17, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.547767 13608 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:10.548398 13608 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:10.557281 13608 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:10.561208  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:10.561970  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:10.569644  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.572347  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:10.573590  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:10.574095  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:10.541992  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.575766  5269 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 26 to 30. New cstate: current_term: 30 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:19:10.582895  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.588222  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.591372 13608 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:10.595983  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.598616  5339 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.605741 13608 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:10.607544 13608 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:10.610186  5269 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 27, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 27 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.611977  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.611660  5269 catalog_manager.cc:5697] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 17 to 23, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 23 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.613507 13445 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:10.618374  5339 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.621763 13607 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.636181  5269 catalog_manager.cc:5697] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 22 to 23, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 23 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.638469  5339 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:10.647789 13607 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:10.649178  5339 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.650923 13607 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:10.645748  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.653519  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.654438 13607 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:10.653180  5269 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.671402  5269 catalog_manager.cc:5697] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 23 to 24, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:10.674875  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.696601  5269 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.698258  5269 catalog_manager.cc:5697] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.703464  5269 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
W20260709 13:19:10.708626  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:10.711040  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:10.715847  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet 6fbe0fc532464dc7bdc351bd1ac98fd2: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:10.720674  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet 505e05548ee2401d969672320dea8a9b: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:10.724159  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet bd0b01346dc74436aa3ac464cde50753: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:10.728893  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.723950  5269 catalog_manager.cc:5697] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.742518  5269 catalog_manager.cc:5697] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 19 to 24, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.745198  5269 catalog_manager.cc:5697] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 16 to 17, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 17 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:10.780532 13480 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.781152 13480 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:10.783582 13480 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:10.784749  5490 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 205 similar messages]
I20260709 13:19:10.785116  5446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:10.785116  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:10.788558  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.788764  5340 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:10.789786 13480 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:10.815231  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.835628  5515 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
W20260709 13:19:10.838685  4246 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 5400)
I20260709 13:19:10.851492  5446 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:19:10.852444  5490 consensus_peers.cc:597] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:10.854679  5489 consensus_peers.cc:597] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfa8a3a375f94c92a91bd291429fb615. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.855484 13467 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:10.860556  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:10.884694 13662 raft_consensus.cc:2955] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
W20260709 13:19:10.895097  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.905313  5447 raft_consensus.cc:1275] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:19:10.916106  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:10.916836  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:10.897500  5446 raft_consensus.cc:2955] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:19:10.919950 13669 consensus_queue.cc:1048] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:11.496119 13492 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.501262 13492 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:11.503640 13492 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:11.514289 13686 raft_consensus.cc:493] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.514987 13686 raft_consensus.cc:515] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:11.517696 13684 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:11.518296 13684 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:11.520444 13684 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:11.499939 13685 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.527081 13685 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:10.952930  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.536482  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 585297us
I20260709 13:19:11.537240 13685 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:11.537992 13686 leader_election.cc:290] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:11.595331  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:11.630476  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:11.635078  5515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:11.654047  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:11.656162  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:11.661669  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ced41742c4474d4197a4dfeed7d56536" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:11.679937  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 46030.8us
I20260709 13:19:11.720816  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:11.723457 13624 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:19:11.737435  5340 leader_election.cc:304] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:11.739739  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 56495.6us
I20260709 13:19:11.745103 13664 raft_consensus.cc:2749] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:11.745308  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9d883e5d309d4113a821624777a85d05: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:19:11.760735  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 83721.5us
I20260709 13:19:11.764401  5340 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:11.765244 13685 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:11.773638  5339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 45310us
I20260709 13:19:11.780211  5269 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37120 (request call id 162) took 2812 ms. Trace:
W20260709 13:19:11.787482  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.788251  5416 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:11.780676  5269 rpcz_store.cc:276] 0709 13:19:08.968017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.969416 (+  1399us) service_pool.cc:224] Handling call
0709 13:19:11.780143 (+2810727us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:10.821925 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:10.822489 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:10.822519 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:19:10.822538 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:10.824165 (+  1627us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:10.824261 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:10.824289 (+    28us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:19:10.834298 (+ 10009us) tablet.cc:701] Row locks acquired
0709 13:19:10.834318 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:10.834455 (+   137us) write_op.cc:270] Start()
0709 13:19:10.834563 (+   108us) write_op.cc:276] Timestamp: P: 1783603150834407 usec, L: 0
0709 13:19:10.834583 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:19:10.835310 (+   727us) log.cc:844] Serialized 8230 byte log entry
0709 13:19:10.963120 (+127810us) op_driver.cc:464] REPLICATION: finished
0709 13:19:11.013000 (+ 49880us) write_op.cc:301] APPLY: starting
0709 13:19:11.013105 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:11.049675 (+ 36570us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:11.049831 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:11.066079 (+ 16248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:11.066374 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:19:11.066435 (+    61us) write_op.cc:312] APPLY: finished
0709 13:19:11.066906 (+   471us) log.cc:844] Serialized 187 byte log entry
0709 13:19:11.067073 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:11.067270 (+   197us) write_op.cc:454] Released schema lock
0709 13:19:11.067334 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:11.070376 (+  3042us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:11.070404 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4906,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":49559,"apply.run_cpu_time_us":27068,"apply.run_wall_time_us":57340,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91907,"num_ops":21,"prepare.queue_time_us":29247,"prepare.run_cpu_time_us":5364,"prepare.run_wall_time_us":26602,"replication_time_us":128291,"thread_start_us":45774,"threads_started":2}]]}
I20260709 13:19:11.802568 13704 ts_tablet_manager.cc:933] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:11.839214  4246 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 5400)
I20260709 13:19:11.841378  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:11.846407 13704 tablet_copy_client.cc:323] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.131:36363
I20260709 13:19:11.848585  5534 tablet_copy_service.cc:140] P 544c82a50cc4477886bb6f7d58f455ca: Received BeginTabletCopySession request for tablet bfa8a3a375f94c92a91bd291429fb615 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:34858)
I20260709 13:19:11.849229  5534 tablet_copy_service.cc:161] P 544c82a50cc4477886bb6f7d58f455ca: Beginning new tablet copy session on tablet bfa8a3a375f94c92a91bd291429fb615 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:34858: session id = 53eb858bdf82438d83f1be6a01da2e0e-bfa8a3a375f94c92a91bd291429fb615
I20260709 13:19:11.868528  5534 tablet_copy_source_session.cc:215] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:11.872677 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa8a3a375f94c92a91bd291429fb615. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:11.874850  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.875579  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.906998 13704 tablet_copy_client.cc:806] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:11.908301 13704 tablet_copy_client.cc:670] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:11.852758  5266 catalog_manager.cc:5697] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:11.941195 13572 raft_consensus.cc:493] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.941864 13572 raft_consensus.cc:515] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:11.943997 13572 leader_election.cc:290] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:11.956014  5414 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:11.958117 13684 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:11.961580 13607 raft_consensus.cc:493] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:11.962289 13607 raft_consensus.cc:515] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:11.964807 13607 leader_election.cc:290] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:11.978760  5266 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 26 to 27, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 27 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.999480  5516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.001078  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.004884  5266 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 16 to 24, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:12.028069 13607 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:12.028836 13607 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:12.038257  5304 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccf00 after lost signal to thread 4249
W20260709 13:19:12.039613  5304 debug-util.cc:398] Leaking SignalData structure 0x7b0800241060 after lost signal to thread 5307
W20260709 13:19:12.040467  5304 debug-util.cc:398] Leaking SignalData structure 0x7b080003c2e0 after lost signal to thread 5399
W20260709 13:19:12.040812  5304 debug-util.cc:398] Leaking SignalData structure 0x7b080003c1c0 after lost signal to thread 5400
W20260709 13:19:12.043021  5304 debug-util.cc:398] Leaking SignalData structure 0x7b08001f92a0 after lost signal to thread 5474
W20260709 13:19:12.043493  5304 debug-util.cc:398] Leaking SignalData structure 0x7b0800326e80 after lost signal to thread 5475
W20260709 13:19:12.045270  5304 debug-util.cc:398] Leaking SignalData structure 0x7b0800264fe0 after lost signal to thread 5548
W20260709 13:19:12.047086  5304 debug-util.cc:398] Leaking SignalData structure 0x7b080023d180 after lost signal to thread 6101
W20260709 13:19:12.047487  5304 debug-util.cc:398] Leaking SignalData structure 0x7b0800243f00 after lost signal to thread 6102
I20260709 13:19:12.137846 13607 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.166647  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac3d18b18df469b8638e92d4034ba81" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.170030  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.179422  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36b8170596a4e4eb051a1d9ee58e16c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 25 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.177872 13480 raft_consensus.cc:493] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:12.180286 13480 raft_consensus.cc:515] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:12.183207 13480 leader_election.cc:290] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
W20260709 13:19:12.274772  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 97085.6us
I20260709 13:19:12.268141 13666 raft_consensus.cc:493] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.296407 13666 raft_consensus.cc:515] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.299829 13666 leader_election.cc:290] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.305217  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.314502  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d659cc559a5e4a99be73c9ce46dd2cf4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.338619 13704 tablet_copy_client.cc:538] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:12.356077 13445 raft_consensus.cc:493] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.356797 13445 raft_consensus.cc:515] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.359438 13445 leader_election.cc:290] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.365368  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.366300  5340 leader_election.cc:304] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.367161 13704 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
I20260709 13:19:12.372797  6072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b301483f19c4d508e00d917819ac039" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:12.379323 13686 raft_consensus.cc:2749] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:12.390650  5340 leader_election.cc:304] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.391553  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.402494 13688 raft_consensus.cc:2749] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:12.396921  5339 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.406512 13688 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:12.423629  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.424376  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:12.436154  5269 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 24 to 26, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 26 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:12.437959  5269 catalog_manager.cc:5697] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 26 to 29, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 29 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.439972  5269 catalog_manager.cc:5697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:12.441458  5269 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 18 to 20, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to 86b410d62f4040c39d33dc0698998562 (127.4.37.129). New cstate: current_term: 20 leader_uuid: "86b410d62f4040c39d33dc0698998562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:12.448370 13688 raft_consensus.cc:493] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.449023 13688 raft_consensus.cc:515] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.451366 13688 leader_election.cc:290] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.452370 13624 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.452867 13624 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.454864 13624 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.456471  5340 leader_election.cc:304] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:12.458539 13624 raft_consensus.cc:2749] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:12.483254  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1289dc7debf403aa87416568de586e6" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.483400  5449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5ebf56a6624ec4803ae0c224dfc44e" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.484475  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.485601  5444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.493567  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d519198f00cc429b8d95c8d66a24c7f5" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.493585  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fbe0fc532464dc7bdc351bd1ac98fd2" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.443732  5269 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index -1 to 16, term changed from 21 to 24, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.503460 13645 raft_consensus.cc:493] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.504222 13645 raft_consensus.cc:515] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.507196 13645 leader_election.cc:290] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.510119  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.522226 13688 raft_consensus.cc:493] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.522775 13688 raft_consensus.cc:515] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:12.524170  5340 leader_election.cc:304] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.524904 13688 leader_election.cc:290] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:12.526060 13688 raft_consensus.cc:2749] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:12.526646  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:12.528533  5340 leader_election.cc:304] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.530179 13686 raft_consensus.cc:2749] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.533546  5269 catalog_manager.cc:5697] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 22, leader changed from 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 22 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } }
I20260709 13:19:12.536645  5269 catalog_manager.cc:5697] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 27 to 29, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 29 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:12.555810  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:12.559259  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d219441478644a3e8915df9d2083022c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.559993  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0276d804ade348368656bbe6805214df" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.562137  5340 leader_election.cc:304] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.568112 13645 raft_consensus.cc:2749] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:12.568527  5340 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.569459 13645 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:12.575742  5340 leader_election.cc:304] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.576622 13710 raft_consensus.cc:2749] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:12.577064  5340 leader_election.cc:304] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.583323 13624 raft_consensus.cc:2749] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.650147 13704 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:12.651239 13704 tablet_bootstrap.cc:492] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:19:12.651584  5266 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 162) took 5827 ms. Trace:
I20260709 13:19:12.653833  5266 rpcz_store.cc:276] 0709 13:19:06.847897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.869890 (+ 21993us) service_pool.cc:224] Handling call
0709 13:19:12.650399 (+5780509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:12.052980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:12.053837 (+   857us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:12.053892 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:19:12.053920 (+    28us) tablet.cc:662] Decoding operations
0709 13:19:12.054823 (+   903us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:12.054921 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:12.054953 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:12.055318 (+   365us) tablet.cc:701] Row locks acquired
0709 13:19:12.055341 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:19:12.055503 (+   162us) write_op.cc:270] Start()
0709 13:19:12.055621 (+   118us) write_op.cc:276] Timestamp: P: 1783603152055447 usec, L: 0
0709 13:19:12.055644 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:12.056370 (+   726us) log.cc:844] Serialized 1307 byte log entry
0709 13:19:12.285744 (+229374us) op_driver.cc:464] REPLICATION: finished
0709 13:19:12.344945 (+ 59201us) write_op.cc:301] APPLY: starting
0709 13:19:12.345034 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:12.410536 (+ 65502us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:12.410649 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:12.415272 (+  4623us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:12.415473 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:19:12.415516 (+    43us) write_op.cc:312] APPLY: finished
0709 13:19:12.415743 (+   227us) log.cc:844] Serialized 40 byte log entry
0709 13:19:12.416521 (+   778us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.416633 (+   112us) write_op.cc:454] Released schema lock
0709 13:19:12.416674 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:12.496616 (+ 79942us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:12.496649 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":58,"child_traces":[["op",{"apply.queue_time_us":58943,"apply.run_cpu_time_us":6084,"apply.run_wall_time_us":151643,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":38439,"prepare.run_cpu_time_us":3722,"prepare.run_wall_time_us":3722,"replication_time_us":229923,"thread_start_us":104077,"threads_started":2}]]}
I20260709 13:19:12.652004 13704 ts_tablet_manager.cc:1403] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.299s	user 0.049s	sys 0.009s
I20260709 13:19:12.683187 13704 raft_consensus.cc:359] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:19:12.684368 13704 raft_consensus.cc:740] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:19:12.685308 13704 consensus_queue.cc:260] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:19:12.689049 13704 ts_tablet_manager.cc:1434] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:19:12.728073  5534 tablet_copy_service.cc:342] P 544c82a50cc4477886bb6f7d58f455ca: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-bfa8a3a375f94c92a91bd291429fb615 received from {username='slave'} at 127.0.0.1:34858
I20260709 13:19:12.729128  5534 tablet_copy_service.cc:434] P 544c82a50cc4477886bb6f7d58f455ca: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-bfa8a3a375f94c92a91bd291429fb615 on tablet bfa8a3a375f94c92a91bd291429fb615 with peer 53eb858bdf82438d83f1be6a01da2e0e
I20260709 13:19:12.704273 13624 raft_consensus.cc:493] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.740401 13624 raft_consensus.cc:515] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } }
I20260709 13:19:12.762216 13645 raft_consensus.cc:493] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.762943 13645 raft_consensus.cc:515] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.767140  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.811758 13645 leader_election.cc:290] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.812048  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:12.815148  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:12.815899  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae97666ff274da1b89c929a0af197ce" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.826318  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1ab6ed89888463bba6c2914a30a48d7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.828403  5339 leader_election.cc:304] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.827984  5340 leader_election.cc:304] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.829694 13686 raft_consensus.cc:2749] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.830260 13710 raft_consensus.cc:2749] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:12.826125 13624 leader_election.cc:290] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:12.839735  4246 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 5400)
W20260709 13:19:12.848734  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9d883e5d309d4113a821624777a85d05: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:19:12.848397  5268 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 46) took 56729 ms (client timeout 15000 ms). Trace:
W20260709 13:19:12.850204  5268 rpcz_store.cc:269] 0709 13:18:16.119354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.120233 (+   879us) service_pool.cc:224] Handling call
0709 13:19:12.848195 (+56727962us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7817,"reported_tablets":6}
I20260709 13:19:12.830961 13687 raft_consensus.cc:493] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.861814 13687 raft_consensus.cc:515] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.865365  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.866437 13710 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:12.865365  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041443b19a6248948edd8e88378fd175" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.868459  5340 leader_election.cc:304] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.867086 13710 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.869356 13624 raft_consensus.cc:2749] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:12.871526 13624 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.872007  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.874033  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64a51af80064074aad9aefb8f176299" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.874545  6070 raft_consensus.cc:1217] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 LEARNER]: Deduplicated request from leader. Original: 24.15->[24.16-24.16]   Dedup: 24.16->[]
I20260709 13:19:12.874076 13687 leader_election.cc:290] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.877224  5339 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.872303 13710 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.872021 13624 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.893903 13624 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.888055 13645 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:12.896497 13688 raft_consensus.cc:493] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.896670 13686 raft_consensus.cc:493] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.897022 13688 raft_consensus.cc:515] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.897279 13686 raft_consensus.cc:515] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.899530 13688 leader_election.cc:290] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.899797 13686 leader_election.cc:290] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.900436  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.901681  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.903175  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.906704  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f62ebef8b04990ab6f34443d897c80" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.910246  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d1e120f33ae49089fa860a4ac895b35" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.911007  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "879d2cd65f6c495494da47d5d0edf67f" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.914647  5339 leader_election.cc:304] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.916502  5339 leader_election.cc:304] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.917459 13624 raft_consensus.cc:2749] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.919106  5339 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.916692 13710 raft_consensus.cc:2749] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:12.920480 13624 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.927038 13624 raft_consensus.cc:493] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.927639 13624 raft_consensus.cc:515] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.930751  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.933054 13624 leader_election.cc:290] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.933112 13686 raft_consensus.cc:493] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.934203 13686 raft_consensus.cc:515] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.936005  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca2e1b811ab74659a981695c9bb25bc7" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.937796 13687 raft_consensus.cc:493] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:12.938791  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.940442 13686 leader_election.cc:290] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.938381 13687 raft_consensus.cc:515] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.942003  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85a688fd7794c83bef13f0caeceda13" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.943395  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.945227  5339 leader_election.cc:304] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.947624 13686 raft_consensus.cc:2749] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:12.948191  5339 leader_election.cc:304] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.951494 13686 raft_consensus.cc:2749] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:12.956144  5267 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37112 (request call id 161) took 24278 ms (client timeout 15000 ms). Trace:
I20260709 13:19:12.963922  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e0f2ddc67f4a12a80821b5a945c5c4" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:12.965587  5339 leader_election.cc:304] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:12.964617 13710 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:12.968715 13710 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:12.961864 13687 leader_election.cc:290] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:12.975049  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:12.978806 13710 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:12.979640  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:12.983615 13710 raft_consensus.cc:2749] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.985656  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31315bfcd25442efb6a2944803593a9c" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:12.987645  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.963577  5267 rpcz_store.cc:269] 0709 13:18:48.677890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.678098 (+   208us) service_pool.cc:224] Handling call
0709 13:18:48.866195 (+188097us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf6090 00007fc1d3d94f3a 00007fc1d9b4b1cc 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:19:12.955911 (+24089716us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44424,"reported_tablets":58,"spinlock_wait_cycles":13185280}
I20260709 13:19:12.987661  5339 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:13.015900 13710 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:13.051936  5545 debug-util.cc:398] Leaking SignalData structure 0x7b080039dbe0 after lost signal to thread 4249
W20260709 13:19:13.053247  5545 debug-util.cc:398] Leaking SignalData structure 0x7b0800395780 after lost signal to thread 5307
W20260709 13:19:13.053987  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08003954c0 after lost signal to thread 5399
W20260709 13:19:13.054297  5545 debug-util.cc:398] Leaking SignalData structure 0x7b0800395580 after lost signal to thread 5400
W20260709 13:19:13.055512  5545 debug-util.cc:398] Leaking SignalData structure 0x7b080039d820 after lost signal to thread 5474
W20260709 13:19:13.055817  5545 debug-util.cc:398] Leaking SignalData structure 0x7b080039d7c0 after lost signal to thread 5475
W20260709 13:19:13.057011  5545 debug-util.cc:398] Leaking SignalData structure 0x7b080039d020 after lost signal to thread 5548
W20260709 13:19:13.059943  5545 debug-util.cc:398] Leaking SignalData structure 0x7b0800271600 after lost signal to thread 6101
W20260709 13:19:13.060281  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08003af980 after lost signal to thread 6102
I20260709 13:19:13.025969 13710 raft_consensus.cc:493] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:13.062745 13710 raft_consensus.cc:515] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:13.088025  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:13.088025  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bad22fee0614f38b77d2fbec2761370" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:13.078088 13710 leader_election.cc:290] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:13.082753 13686 raft_consensus.cc:493] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:13.095329 13686 raft_consensus.cc:515] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:13.090891  5416 consensus_peers.cc:597] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:13.098146  5340 leader_election.cc:304] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:13.106312 13686 leader_election.cc:290] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:13.114599  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:13.117859  5273 catalog_manager.cc:5697] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.121556  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b92e5b61b340dc9b480b452ceee4a0" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:13.114033 13688 raft_consensus.cc:2749] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:13.131036  5340 leader_election.cc:304] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca
I20260709 13:19:13.127068 13710 raft_consensus.cc:493] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 53eb858bdf82438d83f1be6a01da2e0e)
I20260709 13:19:13.138017 13710 raft_consensus.cc:515] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:13.145972 13710 leader_election.cc:290] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:13.159554  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:13.161616 13710 raft_consensus.cc:2749] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:13.165640  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe06c4beff94d32a1cfc10e6b7cacb8" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:13.182466  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.186647  5340 leader_election.cc:304] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:13.188061 13687 raft_consensus.cc:2749] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:19:13.197055  5272 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 157) took 19451 ms (client timeout 15000 ms). Trace:
W20260709 13:19:13.205581  5272 rpcz_store.cc:269] 0709 13:18:53.745346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.758286 (+ 12940us) service_pool.cc:224] Handling call
0709 13:19:13.196854 (+19438568us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1298566,"reported_tablets":56}
W20260709 13:19:13.242877  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.261905  5265 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37110 (request call id 158) took 3654 ms. Trace:
I20260709 13:19:13.262492  5265 rpcz_store.cc:276] 0709 13:19:09.607270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.607527 (+   257us) service_pool.cc:224] Handling call
0709 13:19:09.918727 (+311200us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003511d4. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf6090 00007fc1d3d94f3a 00007fc1d9b4b1cc 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:19:13.261728 (+3343001us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25844,"reported_tablets":56,"spinlock_wait_cycles":494719232}
W20260709 13:19:13.268534  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.270756  5273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39748 (request call id 51) took 2714 ms. Trace:
W20260709 13:19:13.291675  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.292645  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:13.283661  5273 rpcz_store.cc:276] 0709 13:19:10.556744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.564105 (+  7361us) service_pool.cc:224] Handling call
0709 13:19:13.270677 (+2706572us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:13.205733 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:13.206468 (+   735us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:13.206508 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:19:13.206529 (+    21us) tablet.cc:662] Decoding operations
0709 13:19:13.206931 (+   402us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:13.207028 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:13.207068 (+    40us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:13.207285 (+   217us) tablet.cc:701] Row locks acquired
0709 13:19:13.207304 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:19:13.207482 (+   178us) write_op.cc:270] Start()
0709 13:19:13.207621 (+   139us) write_op.cc:276] Timestamp: P: 1783603153207423 usec, L: 0
0709 13:19:13.207650 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:19:13.208386 (+   736us) log.cc:844] Serialized 532 byte log entry
0709 13:19:13.258657 (+ 50271us) op_driver.cc:464] REPLICATION: finished
0709 13:19:13.261174 (+  2517us) write_op.cc:301] APPLY: starting
0709 13:19:13.261260 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:13.262502 (+  1242us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:13.262611 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:13.263310 (+   699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:13.263477 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:19:13.263520 (+    43us) write_op.cc:312] APPLY: finished
0709 13:19:13.263733 (+   213us) log.cc:844] Serialized 24 byte log entry
0709 13:19:13.264852 (+  1119us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.264935 (+    83us) write_op.cc:454] Released schema lock
0709 13:19:13.264974 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":514,"reported_tablets":1,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":2232,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":67557,"prepare.run_cpu_time_us":2923,"prepare.run_wall_time_us":3018,"replication_time_us":50859,"thread_start_us":74122,"threads_started":2}]]}
I20260709 13:19:13.294528  4246 tablet_replica.cc:333] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.298259  4246 raft_consensus.cc:2243] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.299105  4246 raft_consensus.cc:2272] T ced41742c4474d4197a4dfeed7d56536 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.307540  4246 tablet_replica.cc:333] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.350172 13710 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.350754 13710 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:13.355195 13710 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:13.356369  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:13.356484  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f76d25595424c71acc6031d1608a975" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:13.360574  5340 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:13.361753 13710 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:13.362771  4246 raft_consensus.cc:2243] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.385388  4246 raft_consensus.cc:2272] T 35a03ca070694c4880dc2efbf4b89052 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.390638  4246 tablet_replica.cc:333] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
W20260709 13:19:13.434438  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.435526  4246 raft_consensus.cc:2243] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.436800  4246 raft_consensus.cc:2272] T 4a548ed234e342789833cf138d282543 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:13.444342  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.453893  4246 tablet_replica.cc:333] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.455116  4246 raft_consensus.cc:2243] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.456362  4246 raft_consensus.cc:2272] T 04c8c3b741e7461c8c4c145d8b652ece P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.459612  4246 tablet_replica.cc:333] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.460538  4246 raft_consensus.cc:2243] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.462136  4246 raft_consensus.cc:2272] T 23d42b81e4844d79aa9b7194da0bacd0 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.464538 13696 raft_consensus.cc:1064] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:19:13.470141 13696 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:13.483764  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.488935  6070 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 LEARNER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:13.492233 13699 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:13.500063  5447 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:13.501681 13711 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:19:13.513111  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.519249  4246 tablet_replica.cc:333] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.521925  4246 raft_consensus.cc:2243] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:19:13.532305  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.534909  4246 raft_consensus.cc:2272] T 1a0a4db2904f41359369d5678178fb28 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:13.538245  5490 consensus_peers.cc:597] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.551613  4246 tablet_replica.cc:333] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.555060  4246 raft_consensus.cc:2243] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:13.563412  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.571439 13711 raft_consensus.cc:2955] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:13.581382  6070 raft_consensus.cc:2955] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:13.586838  4246 raft_consensus.cc:2272] T a64a51af80064074aad9aefb8f176299 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.590121  4246 tablet_replica.cc:333] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.591049  4246 raft_consensus.cc:2243] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.592209  4246 raft_consensus.cc:2272] T 98e834db0dd44fe4a118d1b82fb1ff47 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.595270  4246 tablet_replica.cc:333] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.596290  4246 raft_consensus.cc:2243] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.597856  4246 raft_consensus.cc:2272] T 879d2cd65f6c495494da47d5d0edf67f P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.600657  4246 tablet_replica.cc:333] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.601707  4246 raft_consensus.cc:2243] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:19:13.602284  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.602855  4246 raft_consensus.cc:2272] T c06ab136607a405bbdfe9d04f533a566 P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.609923 13710 raft_consensus.cc:493] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.610469 13710 raft_consensus.cc:515] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:13.612602 13710 leader_election.cc:290] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:13.616278  5442 raft_consensus.cc:2955] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:13.619180  5266 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: config changed from index 16 to 17, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.624048  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:13.626785  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8a3a375f94c92a91bd291429fb615" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:13.639859  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.643334  5339 leader_election.cc:304] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:13.644690 13624 raft_consensus.cc:2749] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:13.654189  4246 tablet_replica.cc:333] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.655337  4246 raft_consensus.cc:2243] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:13.669824  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.674214  4246 raft_consensus.cc:2272] T 6f76d25595424c71acc6031d1608a975 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.687714  4246 tablet_replica.cc:333] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.688324 13710 raft_consensus.cc:493] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.688978 13710 raft_consensus.cc:515] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:13.688630  4246 raft_consensus.cc:2243] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.697372 13710 leader_election.cc:290] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:13.702478  4246 raft_consensus.cc:2272] T 6bad22fee0614f38b77d2fbec2761370 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.709399  4246 tablet_replica.cc:333] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.709721  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:13.710412  4246 raft_consensus.cc:2243] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.711692  4246 raft_consensus.cc:2272] T f68a24d9e2f74d7697fec4f27e4c7f0c P 86b410d62f4040c39d33dc0698998562 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.713855  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862a628beec44315b003538bc747056b" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:13.716264  5339 leader_election.cc:304] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:13.716419  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.717147 13624 raft_consensus.cc:2749] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:13.718799  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:13.724969  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:13.743361 13686 raft_consensus.cc:493] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 544c82a50cc4477886bb6f7d58f455ca)
I20260709 13:19:13.743984 13686 raft_consensus.cc:515] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:13.746721 13686 leader_election.cc:290] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:13.749478  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:13.754204  4246 tablet_replica.cc:333] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.755208  4246 raft_consensus.cc:2243] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.756224  4246 raft_consensus.cc:2272] T 271a3e03527c4fd990f6961a94d3b6ce P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.761806  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec36d10767c748a59dbf28cb7fc52487" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:13.764943  5340 leader_election.cc:304] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:13.766166 13710 raft_consensus.cc:2749] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:13.771616  5518 consensus_queue.cc:237] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:13.772710  4246 tablet_replica.cc:333] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.775784  4246 raft_consensus.cc:2243] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.780165  6070 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:19:13.781282  4246 raft_consensus.cc:2272] T 04c2527a380a499db649c9aa30957175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.780201  5450 raft_consensus.cc:1275] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:19:13.782744 13730 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:19:13.794446 13711 consensus_queue.cc:1048] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:13.799546  4246 tablet_replica.cc:333] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.800542  4246 raft_consensus.cc:2243] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.801143  4246 raft_consensus.cc:2272] T b85a688fd7794c83bef13f0caeceda13 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.804536  4246 tablet_replica.cc:333] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.803889 13696 raft_consensus.cc:2955] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:13.805912  4246 raft_consensus.cc:2243] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.806815  4246 raft_consensus.cc:2272] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.809966  4246 tablet_replica.cc:333] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.810832  4246 raft_consensus.cc:2243] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.811848  4246 pending_rounds.cc:70] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Trying to abort 1 pending ops.
I20260709 13:19:13.812132  4246 pending_rounds.cc:77] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562: Aborting op as it isn't in flight: id { term: 21 index: 16 } timestamp: 7305638492343263232 op_type: NO_OP noop_request { }
I20260709 13:19:13.812631  4246 raft_consensus.cc:2889] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:13.812990  4246 raft_consensus.cc:2272] T 0276d804ade348368656bbe6805214df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.816080  4246 tablet_replica.cc:333] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.816988  4246 raft_consensus.cc:2243] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.817626  4246 pending_rounds.cc:70] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Trying to abort 1 pending ops.
I20260709 13:19:13.817865  4246 pending_rounds.cc:77] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562: Aborting op as it isn't in flight: id { term: 23 index: 15 } timestamp: 7305638495808937984 op_type: NO_OP noop_request { }
I20260709 13:19:13.818686  4246 raft_consensus.cc:2889] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:13.819046  4246 raft_consensus.cc:2272] T bfa8a3a375f94c92a91bd291429fb615 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.831218  4246 tablet_replica.cc:333] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.832284  4246 raft_consensus.cc:2243] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.833784  4246 raft_consensus.cc:2272] T 4e6e697f3d3040e4b2c502a614c55888 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.836759  6070 raft_consensus.cc:2955] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:13.842213 13710 raft_consensus.cc:493] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.843286 13710 raft_consensus.cc:515] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:13.849364  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:13.852674 13710 leader_election.cc:290] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:13.854110  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92b870ccd68b4f2da5f6e32b1dfe77aa" candidate_uuid: "86b410d62f4040c39d33dc0698998562" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:13.855809  5339 leader_election.cc:304] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86b410d62f4040c39d33dc0698998562; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:13.852452  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.861071  4246 tablet_replica.cc:333] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.862238  4246 raft_consensus.cc:2243] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.863471 13710 raft_consensus.cc:2749] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:19:13.867583  5450 raft_consensus.cc:2955] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index 17 to 18, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:13.871842  4246 raft_consensus.cc:2272] T 5e725a9779684377b88a2fbc508c37df P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.876405  4246 tablet_replica.cc:333] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.877339  4246 raft_consensus.cc:2243] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.877986  4246 pending_rounds.cc:70] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Trying to abort 2 pending ops.
I20260709 13:19:13.878248  4246 pending_rounds.cc:77] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Aborting op as it isn't in flight: id { term: 28 index: 18 } timestamp: 7305638496542846976 op_type: NO_OP noop_request { }
I20260709 13:19:13.878589  4246 raft_consensus.cc:2889] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:13.878933  4246 pending_rounds.cc:77] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562: Aborting op as it isn't in flight: id { term: 27 index: 17 } timestamp: 7305638471736360960 op_type: NO_OP noop_request { }
I20260709 13:19:13.879319  4246 raft_consensus.cc:2889] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:13.878648  5273 catalog_manager.cc:5697] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 17 to 18, VOTER 86b410d62f4040c39d33dc0698998562 (127.4.37.129) evicted. New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:13.879671  4246 raft_consensus.cc:2272] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 86b410d62f4040c39d33dc0698998562 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.882824  4246 tablet_replica.cc:333] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.883710  4246 raft_consensus.cc:2243] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.887564  4246 raft_consensus.cc:2272] T d219441478644a3e8915df9d2083022c P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.891443  4246 tablet_replica.cc:333] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.897205  4246 raft_consensus.cc:2243] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.897887  4246 raft_consensus.cc:2272] T ca2e1b811ab74659a981695c9bb25bc7 P 86b410d62f4040c39d33dc0698998562 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.909449  4246 tablet_replica.cc:333] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.909308  5258 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bfa8a3a375f94c92a91bd291429fb615 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:19:13.934170  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bfa8a3a375f94c92a91bd291429fb615: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:19:13.934921  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.935976  4246 raft_consensus.cc:2243] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.936812  4246 raft_consensus.cc:2272] T ec36d10767c748a59dbf28cb7fc52487 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.941272  4246 tablet_replica.cc:333] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.942507  4246 raft_consensus.cc:2243] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.943181  4246 raft_consensus.cc:2272] T 82b92e5b61b340dc9b480b452ceee4a0 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.948099  4246 tablet_replica.cc:333] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.951874  4246 raft_consensus.cc:2243] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.953008  4246 raft_consensus.cc:2272] T 505e05548ee2401d969672320dea8a9b P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.956321  4246 tablet_replica.cc:333] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.957132  4246 raft_consensus.cc:2243] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.957698  4246 raft_consensus.cc:2272] T e3f62ebef8b04990ab6f34443d897c80 P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.960872  4246 tablet_replica.cc:333] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.961660  4246 raft_consensus.cc:2243] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.962270  4246 raft_consensus.cc:2272] T 4d1e120f33ae49089fa860a4ac895b35 P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.965291  4246 tablet_replica.cc:333] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.965914  4246 raft_consensus.cc:2243] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.966876  4246 raft_consensus.cc:2272] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.969044  4246 tablet_replica.cc:333] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.969924  4246 raft_consensus.cc:2243] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.971081  4246 raft_consensus.cc:2272] T db91d6fa74dd4308ae267c81a83d8d5f P 86b410d62f4040c39d33dc0698998562 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.974041  4246 tablet_replica.cc:333] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.974969  4246 raft_consensus.cc:2243] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.975734  4246 raft_consensus.cc:2272] T 31315bfcd25442efb6a2944803593a9c P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:13.987190  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.989094  4246 tablet_replica.cc:333] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:13.990840  4246 raft_consensus.cc:2243] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:13.992169  4246 raft_consensus.cc:2272] T d07d1fef577c411787d1f686a4774389 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.003288  4246 tablet_replica.cc:333] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.004204  4246 raft_consensus.cc:2243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.004869  4246 raft_consensus.cc:2272] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.008535  4246 tablet_replica.cc:333] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.009717  4246 raft_consensus.cc:2243] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.010836  4246 raft_consensus.cc:2272] T c3b5667547cf44e88316b27d3edb3a4c P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.020151  4246 tablet_replica.cc:333] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.020977  4246 raft_consensus.cc:2243] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.022354  4246 raft_consensus.cc:2272] T 12cac82a5dba4ed4b6457efb7b474a24 P 86b410d62f4040c39d33dc0698998562 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.044072  4246 tablet_replica.cc:333] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.045528  4246 raft_consensus.cc:2243] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.046275  4246 raft_consensus.cc:2272] T d659cc559a5e4a99be73c9ce46dd2cf4 P 86b410d62f4040c39d33dc0698998562 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.049993  4246 tablet_replica.cc:333] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.050846  4246 raft_consensus.cc:2243] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.051858  4246 raft_consensus.cc:2272] T 9d883e5d309d4113a821624777a85d05 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.061100  4246 tablet_replica.cc:333] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.062049  4246 raft_consensus.cc:2243] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.063357  4246 raft_consensus.cc:2272] T 2efc28bc52fe484b89b667f19e0fe8ce P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.074365  4246 tablet_replica.cc:333] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.075523  4246 raft_consensus.cc:2243] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.076651  4246 raft_consensus.cc:2272] T b7ef40d8b72f47f9b405aa70b3a9d166 P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.081135  4246 tablet_replica.cc:333] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.081997  4246 raft_consensus.cc:2243] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.083154  4246 raft_consensus.cc:2272] T 9510ba0f78fa4449a7cc7fde29e88b4d P 86b410d62f4040c39d33dc0698998562 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.086186  4246 tablet_replica.cc:333] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.086963  4246 raft_consensus.cc:2243] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.087553  4246 raft_consensus.cc:2272] T 7b301483f19c4d508e00d917819ac039 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.096053  4246 tablet_replica.cc:333] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.096946  4246 raft_consensus.cc:2243] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.097610  4246 raft_consensus.cc:2272] T c1ab6ed89888463bba6c2914a30a48d7 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.101142  4246 tablet_replica.cc:333] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.101997  4246 raft_consensus.cc:2243] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.102631  4246 raft_consensus.cc:2272] T 041443b19a6248948edd8e88378fd175 P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.115892  4246 tablet_replica.cc:333] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.116886  4246 raft_consensus.cc:2243] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.117682  4246 raft_consensus.cc:2272] T be5ebf56a6624ec4803ae0c224dfc44e P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.121922  4246 tablet_replica.cc:333] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.122768  4246 raft_consensus.cc:2243] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.123562  4246 raft_consensus.cc:2272] T e1289dc7debf403aa87416568de586e6 P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.127132  4246 tablet_replica.cc:333] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.128473  4246 raft_consensus.cc:2243] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.129781  4246 raft_consensus.cc:2272] T b655965f5ab4410b8f331ea47595c0fd P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.133800  4246 tablet_replica.cc:333] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.134640  4246 raft_consensus.cc:2243] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.135392  4246 raft_consensus.cc:2272] T 5ae97666ff274da1b89c929a0af197ce P 86b410d62f4040c39d33dc0698998562 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.138603  4246 tablet_replica.cc:333] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.139400  4246 raft_consensus.cc:2243] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.140062  4246 raft_consensus.cc:2272] T d519198f00cc429b8d95c8d66a24c7f5 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.143703  4246 tablet_replica.cc:333] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.144452  4246 raft_consensus.cc:2243] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.145658  4246 raft_consensus.cc:2272] T 28ae73f1403d44db9d77ab1da61496ea P 86b410d62f4040c39d33dc0698998562 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.148720  4246 tablet_replica.cc:333] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.149823  4246 raft_consensus.cc:2243] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.150424  4246 raft_consensus.cc:2272] T 862a628beec44315b003538bc747056b P 86b410d62f4040c39d33dc0698998562 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:14.159884  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:14.163594  4246 tablet_replica.cc:333] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.171345  4246 raft_consensus.cc:2243] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.174803  4246 raft_consensus.cc:2272] T efe06c4beff94d32a1cfc10e6b7cacb8 P 86b410d62f4040c39d33dc0698998562 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.179294  4246 tablet_replica.cc:333] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.180014  4246 raft_consensus.cc:2243] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.180850  4246 raft_consensus.cc:2272] T bac3d18b18df469b8638e92d4034ba81 P 86b410d62f4040c39d33dc0698998562 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.183842  4246 tablet_replica.cc:333] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.184544  4246 raft_consensus.cc:2243] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.192994  4246 raft_consensus.cc:2272] T 071f7516f6b64068bdcc88167bd9f6ae P 86b410d62f4040c39d33dc0698998562 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.197690  4246 tablet_replica.cc:333] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.198484  4246 raft_consensus.cc:2243] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:19:14.204612  4246 raft_consensus.cc:2272] T bd0b01346dc74436aa3ac464cde50753 P 86b410d62f4040c39d33dc0698998562 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:14.207573  4246 tablet_replica.cc:333] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562: stopping tablet replica
I20260709 13:19:14.208266  4246 raft_consensus.cc:2243] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:14.209110  4246 raft_consensus.cc:2272] T b36b8170596a4e4eb051a1d9ee58e16c P 86b410d62f4040c39d33dc0698998562 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:14.339262  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.344944  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:14.548436 13693 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.549003 13693 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.551848 13693 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.554165  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:14.559819  5490 leader_election.cc:336] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.560290  5490 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:14.561551 13693 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:14.661121 13739 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.661788 13739 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.664004 13739 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:14.665726  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:14.671666  5416 leader_election.cc:336] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.672255  5416 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.673540 13722 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.674158 13722 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.676625 13722 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:14.677096 13722 raft_consensus.cc:2749] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:14.678599  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:14.679369  5520 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 27.
I20260709 13:19:14.680692  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:14.681676 13739 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:14.682080 13739 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.682438 13739 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:14.687175 13699 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.687883 13699 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.690557 13699 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.695188  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:14.695938  5450 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
W20260709 13:19:14.697809  5490 leader_election.cc:336] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.698786  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.699987 13699 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:14.700456 13699 raft_consensus.cc:493] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.700917 13699 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:14.709582  5416 leader_election.cc:336] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.721114 13693 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.721896 13693 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.718591 13739 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.724291 13693 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.726372  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:14.731223 13722 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.732472 13722 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.735737  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:14.737531 13722 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:14.737879  5490 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.738160 13722 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.738654  5490 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:14.740243 13722 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.740883 13693 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:14.744928  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:14.746207 13699 raft_consensus.cc:515] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:14.748116  5416 leader_election.cc:336] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.747015 13722 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:14.755177  5490 leader_election.cc:336] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.757761  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c8c3b741e7461c8c4c145d8b652ece" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:14.758479  5448 raft_consensus.cc:3060] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:14.767930 13739 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:14.777995  5448 raft_consensus.cc:2468] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:19:14.771723 13699 leader_election.cc:290] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:14.793294  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.797971  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.785287  5416 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.799042  5416 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:14.800033  5416 leader_election.cc:336] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.802253  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a548ed234e342789833cf138d282543" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:14.802429 13739 raft_consensus.cc:2749] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:14.802927  5520 raft_consensus.cc:3060] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:14.800468  5416 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.804734 13739 raft_consensus.cc:2749] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:14.810890  5520 raft_consensus.cc:2468] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 28.
I20260709 13:19:14.817266 13722 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.818703 13722 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.822549  5489 leader_election.cc:304] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.822588  5414 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.824064 13739 raft_consensus.cc:2804] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:14.824295 13746 raft_consensus.cc:2804] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:14.824631 13739 raft_consensus.cc:697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:14.824878 13746 raft_consensus.cc:697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:14.825824 13746 consensus_queue.cc:237] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.827250 13693 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.827826 13693 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:14.828414  5416 leader_election.cc:336] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.830281 13693 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.832508 13693 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.833144 13693 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.834822  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:14.836213 13693 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:14.839049  5490 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.839496  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:14.840327  5448 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:19:14.841878  5489 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:14.842005 13722 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:14.842777 13693 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:19:14.826543 13739 consensus_queue.cc:237] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:14.847306  5490 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.851593  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.852707 13744 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:14.853129 13744 raft_consensus.cc:493] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.853502 13745 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.853897  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:14.854198 13745 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.853513 13744 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:14.856343 13745 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.857753  5414 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.858741  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:14.861457 13743 raft_consensus.cc:2749] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:14.867432  5266 catalog_manager.cc:5697] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 22 to 23, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 23 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.874470 13744 raft_consensus.cc:515] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.877157 13744 leader_election.cc:290] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.878314  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a03ca070694c4880dc2efbf4b89052" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:14.879041  5450 raft_consensus.cc:3060] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:19:14.874949  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.881208  5490 leader_election.cc:336] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.881675  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:14.887142  5450 raft_consensus.cc:2468] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:19:14.888748  5489 leader_election.cc:304] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:14.889685 13744 raft_consensus.cc:2804] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:14.891171  5273 catalog_manager.cc:5697] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 27 to 28, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 28 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.884305 13745 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:14.893929 13744 raft_consensus.cc:697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:14.905689 13745 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:14.905846  5490 leader_election.cc:336] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.906324 13745 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.901611 13744 consensus_queue.cc:237] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.911906  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:14.913646  5442 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
I20260709 13:19:14.914893  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:14.915766 13693 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:14.916167 13693 raft_consensus.cc:493] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.916536 13693 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:19:14.917268  5490 leader_election.cc:336] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.922286 13745 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.925766 13745 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.926313 13745 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:14.935894  5490 leader_election.cc:336] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.937055 13745 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.938438 13693 raft_consensus.cc:515] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.942878  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:14.943512  5450 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:19:14.944397  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.946101 13699 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:14.946753 13699 raft_consensus.cc:493] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.947126 13699 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:14.959146 13699 raft_consensus.cc:515] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:14.963486  5490 leader_election.cc:336] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.967381 13739 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.968016 13739 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.971938 13746 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.974279  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:14.974342 13746 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.974958  5520 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
W20260709 13:19:14.975379  5416 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:14.975749  5490 leader_election.cc:336] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.976142  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:14.964442  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0a4db2904f41359369d5678178fb28" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:14.977571  5450 raft_consensus.cc:3060] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:14.978775 13722 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:14.979207 13722 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.979583 13722 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:14.981719 13693 leader_election.cc:290] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.983747  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c06ab136607a405bbdfe9d04f533a566" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:14.984357  5442 raft_consensus.cc:3060] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:14.990223 13722 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:14.992668 13739 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:14.994539 13746 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:14.995645  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:14.998167 13739 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:14.998823 13739 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:14.999161  5416 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:14.996229  5442 raft_consensus.cc:2468] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28.
I20260709 13:19:15.002805  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.003486  5489 leader_election.cc:304] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.005510 13746 raft_consensus.cc:2804] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:15.006075 13746 raft_consensus.cc:697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 28 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:15.007660 13743 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.016065 13743 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.018273 13743 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.019738  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.020288 13739 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.020413  5520 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 30.
I20260709 13:19:15.022074  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.022985 13743 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:19:15.023414 13743 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.023850 13743 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:19:15.011785  5416 leader_election.cc:336] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.030426  5416 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.031294 13739 raft_consensus.cc:2749] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:14.961374 13699 leader_election.cc:290] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.007351 13746 consensus_queue.cc:237] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.033209 13743 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.034762 13718 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:15.035226  5490 leader_election.cc:336] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.035351 13718 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:15.036914  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68a24d9e2f74d7697fec4f27e4c7f0c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:15.037204 13722 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.035722  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:15.037612  5520 raft_consensus.cc:3060] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:19:15.038565 13699 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:15.041878 13722 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.042495 13722 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.043283  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d42b81e4844d79aa9b7194da0bacd0" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:15.043888  5518 raft_consensus.cc:3060] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:15.045851  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.046543  5524 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:19:15.047430  5520 raft_consensus.cc:2468] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 31.
I20260709 13:19:15.047772  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.048368 13743 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.048988  5414 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:19:15.050081  6043 leader_election.cc:336] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.050158 13749 raft_consensus.cc:2804] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:19:15.050649 13739 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.051249 13739 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.051724  5450 raft_consensus.cc:2468] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 24.
I20260709 13:19:15.052901  5489 leader_election.cc:304] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.053781 13746 raft_consensus.cc:2804] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:15.054289 13746 raft_consensus.cc:697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:15.048974 13743 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:15.055200 13746 consensus_queue.cc:237] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.056835  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.055454 13743 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.058853 13718 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.058985 13739 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.064888 13743 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:15.072436  5518 raft_consensus.cc:2468] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 27.
I20260709 13:19:15.063112  5266 catalog_manager.cc:5697] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 24 to 25, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 25 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.075946  5414 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.090263  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.091318  5450 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 23.
I20260709 13:19:15.089602 13722 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.093573 13722 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.095046  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.085525 13739 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.094131 13722 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:15.092667 13749 raft_consensus.cc:697] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 31 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:15.097540 13734 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:15.102701 13734 raft_consensus.cc:493] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.103114 13734 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:15.105317  5416 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.107239  5416 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.109579 13722 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:15.110241 13722 raft_consensus.cc:2804] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:15.110699 13722 raft_consensus.cc:697] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:15.100008 13739 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.113520 13745 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.114086 13745 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.114859 13739 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.116153 13745 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.118624  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.111599 13722 consensus_queue.cc:237] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.121750 13734 raft_consensus.cc:515] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:15.124462  5416 leader_election.cc:336] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.125351  5416 leader_election.cc:336] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.129691  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.125762  5416 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
W20260709 13:19:15.130370  6043 leader_election.cc:336] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.134157 13749 consensus_queue.cc:237] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.138625 13734 leader_election.cc:290] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:15.141214  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 45033.7us
I20260709 13:19:15.146232  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:15.147022  6070 raft_consensus.cc:2393] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b781c7e31b7145aea647a7ff649e6ac7 in current term 24: Already voted for candidate 53eb858bdf82438d83f1be6a01da2e0e in this term.
I20260709 13:19:15.147203  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e834db0dd44fe4a118d1b82fb1ff47" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:15.147776  5450 raft_consensus.cc:3060] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:15.155470 13743 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.158243  5416 leader_election.cc:336] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.163607  5416 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 53eb858bdf82438d83f1be6a01da2e0e, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.161921  5450 raft_consensus.cc:2468] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53eb858bdf82438d83f1be6a01da2e0e in term 24.
I20260709 13:19:15.162499 13757 raft_consensus.cc:2749] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:15.165491 13755 raft_consensus.cc:2749] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:15.165999  5416 leader_election.cc:336] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.167126  5416 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.167865 13755 raft_consensus.cc:2749] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:15.169749  5266 catalog_manager.cc:5697] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 27 to 28, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 28 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.170809 13743 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.172377  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c2527a380a499db649c9aa30957175" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:15.172519  6042 leader_election.cc:304] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.173138  5518 raft_consensus.cc:3060] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:15.174225  5266 catalog_manager.cc:5697] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 23 to 24, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 24 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.186424 13744 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.187211 13744 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.188308 13718 raft_consensus.cc:2804] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:15.189229 13744 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:15.193282  5416 leader_election.cc:336] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.195008 13746 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.195650 13746 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.198086 13746 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.199112  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.199277  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.199397 13718 raft_consensus.cc:697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 LEADER]: Becoming Leader. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Running, Role: LEADER
I20260709 13:19:15.199800  5450 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 25.
I20260709 13:19:15.200103  5448 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:19:15.200516 13718 consensus_queue.cc:237] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:15.200991  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.202596  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.203717 13693 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:19:15.205286  5490 leader_election.cc:336] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.204295 13693 raft_consensus.cc:493] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.210747  5518 raft_consensus.cc:2468] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:19:15.211512  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:15.211916  5414 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.206595 13746 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:15.223160 13746 raft_consensus.cc:493] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.223654 13746 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:15.221613 13699 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.225647 13699 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.209722 13693 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:15.221719 13744 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:19:15.243186 13699 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.252278 13743 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.232705  5273 catalog_manager.cc:5697] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 30 to 31, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 31 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.252948 13743 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.255723  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.256026 13743 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.257036 13699 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.257616 13699 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.258018 13744 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.258551 13744 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.259796 13699 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.260629 13744 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.260674  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.222302 13722 raft_consensus.cc:2804] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:15.264938  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.266399 13743 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.272094 13693 raft_consensus.cc:515] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.272455 13743 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.273167 13745 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.274082  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.275278 13745 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.277911  5416 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.277567 13745 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.278419  5416 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.280930  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.281674 13743 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.282230 13749 raft_consensus.cc:2749] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:15.283222  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.283895  5520 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 29.
W20260709 13:19:15.282346  5416 leader_election.cc:336] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.249209 13746 raft_consensus.cc:515] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.285475  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:19:15.287564  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet b655965f5ab4410b8f331ea47595c0fd: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.290450 13749 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:19:15.290926 13749 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.291350 13749 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:19:15.274143 13722 raft_consensus.cc:697] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:15.294394 13722 consensus_queue.cc:237] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.305677  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bfa8a3a375f94c92a91bd291429fb615: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.308538  5416 consensus_peers.cc:597] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.311218 13746 leader_election.cc:290] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.312276  5266 catalog_manager.cc:5697] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: term changed from 23 to 24, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132). New cstate: current_term: 24 leader_uuid: "53eb858bdf82438d83f1be6a01da2e0e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:15.317766  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet 071f7516f6b64068bdcc88167bd9f6ae: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.319599 13755 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.320641 13755 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.322643 13693 leader_election.cc:290] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.322916 13745 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.323014 13755 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.323452 13745 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.325498  5490 leader_election.cc:336] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.326383  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
W20260709 13:19:15.327380  5490 leader_election.cc:336] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.328249  5490 consensus_peers.cc:597] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.328738  5490 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.332589  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e6e697f3d3040e4b2c502a614c55888" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:15.333732  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2efc28bc52fe484b89b667f19e0fe8ce" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:15.335059  5490 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:15.335220  5450 raft_consensus.cc:3060] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:15.336030 13745 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:15.334972  5321 auto_rebalancer.cc:629] Failed to schedule move for tablet 9510ba0f78fa4449a7cc7fde29e88b4d: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.337626 13699 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:15.335537  5448 raft_consensus.cc:3060] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:15.342231 13749 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.343228  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.345614  5450 raft_consensus.cc:2468] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:19:15.347698  5489 leader_election.cc:304] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.348580 13699 raft_consensus.cc:2804] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:15.349040 13699 raft_consensus.cc:697] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:15.349134  5443 raft_consensus.cc:1275] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:15.349843 13755 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.350449 13755 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.356465  5448 raft_consensus.cc:2468] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
I20260709 13:19:15.357471 13757 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.357970 13755 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.358037 13757 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.360527 13757 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.350000 13699 consensus_queue.cc:237] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.362207  5416 leader_election.cc:336] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.364647 13749 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 30 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.368871  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.370153 13749 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.370404 13745 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.370759 13749 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.370968 13745 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.372408  5273 catalog_manager.cc:5697] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 26 to 27, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 27 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.373708 13745 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.374218 13693 consensus_queue.cc:1048] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:19:15.382830  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.383632  5518 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:19:15.387660  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271a3e03527c4fd990f6961a94d3b6ce" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:15.389410  5450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:15.376657  5416 leader_election.cc:336] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.388497  5414 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.387744  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.392392  5518 raft_consensus.cc:3060] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:19:15.392467  5520 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 16.
I20260709 13:19:15.392534  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.392993  5489 leader_election.cc:304] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.379081  5443 raft_consensus.cc:1275] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:15.393774 13722 raft_consensus.cc:2749] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:15.394608 13743 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:15.394706  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
W20260709 13:19:15.392510  5416 leader_election.cc:336] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.395157 13743 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.395620 13743 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:15.395861 13739 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:15.396313 13739 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.396723 13739 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:15.378281  5273 catalog_manager.cc:5697] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 24 to 25, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 25 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.395831 13746 raft_consensus.cc:2804] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:15.398504 13746 raft_consensus.cc:697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:15.399492 13744 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.400111 13744 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.395533  5416 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b781c7e31b7145aea647a7ff649e6ac7; no voters: 544c82a50cc4477886bb6f7d58f455ca, 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.407081  5520 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:19:15.405561 13745 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:15.414228  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:15.414672 13745 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.417177 13757 raft_consensus.cc:2749] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:15.424172 13745 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.414179 13746 consensus_queue.cc:237] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.427517  5490 leader_election.cc:336] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.428099  5490 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:15.428804 13757 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:15.429070  5490 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.429659  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:15.429490 13757 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.431136 13699 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:15.432036 13757 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:15.435918  4246 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:15.436980  5416 leader_election.cc:336] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.413259 13744 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.436781 13739 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.410627 13749 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.429121 13693 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:15.439592  5518 raft_consensus.cc:2468] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 30.
W20260709 13:19:15.440876  5490 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.442914  5490 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:15.444701  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.446584  5443 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 26.
I20260709 13:19:15.446988 13746 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:15.441628 13745 consensus_queue.cc:1048] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:19:15.455485 13746 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:15.456210  5490 leader_election.cc:336] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.456374 13745 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:15.457093  5490 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.456857 13745 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.458781 13739 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.459839 13745 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.460503  5490 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:15.464565  5490 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.465281  5490 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:15.466748  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:15.456255 13693 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.467904 13693 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.468609 13744 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:15.469435 13745 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:15.475037  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:15.456224 13746 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.481122  5490 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.481777  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:15.472822  5273 catalog_manager.cc:5697] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 25 to 26, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 26 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.482887  5443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.484514  5414 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:19:15.482936  5490 leader_election.cc:336] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.483970  5443 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:19:15.487702  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.486425  5450 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:15.488953  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.489086 13749 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.489650  5520 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:19:15.489707 13749 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.490686  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0b01346dc74436aa3ac464cde50753" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:15.491235  5524 raft_consensus.cc:3060] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:15.492056 13749 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.488507  5442 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 28.
I20260709 13:19:15.492090  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.493544 13722 raft_consensus.cc:2804] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:19:15.493788 13745 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:15.489660  5518 raft_consensus.cc:1275] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:19:15.494757 13722 raft_consensus.cc:697] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 30 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:15.495239  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.496061 13744 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:15.496583 13744 raft_consensus.cc:493] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.496009 13722 consensus_queue.cc:237] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.496986 13744 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.499389 13693 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.494374 13745 raft_consensus.cc:493] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.482316 13746 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.505944  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.507272  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.508555 13739 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:15.508976 13739 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.508584  5442 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
I20260709 13:19:15.509135 13749 consensus_queue.cc:1048] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:15.473263 13743 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.507552 13745 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:15.508996  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
W20260709 13:19:15.507207  5489 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599): Couldn't send request to peer 53eb858bdf82438d83f1be6a01da2e0e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bac3d18b18df469b8638e92d4034ba81. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.517012  5518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.517645 13739 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:15.517743  5518 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 27.
I20260709 13:19:15.518891  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e725a9779684377b88a2fbc508c37df" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:15.519461  5524 raft_consensus.cc:2468] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 17.
I20260709 13:19:15.519529  5519 raft_consensus.cc:3060] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:15.520655  5490 leader_election.cc:336] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.521981  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.522511  5490 leader_election.cc:336] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.523178  5490 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.527004  5416 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.527866  5416 consensus_peers.cc:597] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:15.528304  5416 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.528872  5416 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.526676 13744 raft_consensus.cc:515] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.536231  5519 raft_consensus.cc:2468] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:19:15.537029 13749 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.521265 13693 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
W20260709 13:19:15.540912  5490 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.541934 13693 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.541849 13749 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.544875 13693 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.513314 13743 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.545650 13749 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:15.541277  5416 leader_election.cc:336] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.550189  5416 leader_election.cc:336] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.551138  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:19:15.542737  5490 leader_election.cc:336] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.552367 13699 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:15.549278 13745 raft_consensus.cc:515] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.554797 13744 leader_election.cc:290] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:15.559919  5416 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.571153  5490 leader_election.cc:336] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.555301 13745 leader_election.cc:290] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.557777 13699 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:19:15.558113  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.576478 13749 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.576944 13699 raft_consensus.cc:493] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.577533 13699 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:15.577261 13749 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.583150 13749 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:15.586122  5416 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.587095 13745 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:15.587841 13745 raft_consensus.cc:493] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.588245 13745 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:15.588330  5489 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:15.589407 13770 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:15.590124 13699 raft_consensus.cc:515] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.585951 13739 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.592872 13699 leader_election.cc:290] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.592821  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.596853 13749 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:15.597362 13749 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.598559  5414 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.599829  5448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7" is_pre_election: true
I20260709 13:19:15.600725  5448 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 22.
I20260709 13:19:15.597831 13749 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:15.602763 13743 raft_consensus.cc:2804] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:15.602924  5414 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.603494 13743 raft_consensus.cc:697] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:15.603955 13755 raft_consensus.cc:2804] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:15.607858  5447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6edac4f8b644eb9445f8d270ce2dd6" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:15.608552  5447 raft_consensus.cc:3060] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.610832  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505e05548ee2401d969672320dea8a9b" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:15.611578  5445 raft_consensus.cc:3060] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:15.611937  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.612820  5520 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 23.
I20260709 13:19:15.616752  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:15.617403  5520 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
I20260709 13:19:15.618996  5519 raft_consensus.cc:1275] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:19:15.620137  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.625681  5273 catalog_manager.cc:5697] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 26 to 27, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 27 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:15.647357  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:15.648089 13778 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.648664 13778 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.690078 13778 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.707119  5273 catalog_manager.cc:5697] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 29 to 30, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 30 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.710027  5447 raft_consensus.cc:2468] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:19:15.714135 13739 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.719527  5445 raft_consensus.cc:2468] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 27.
W20260709 13:19:15.722592  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 115009us
I20260709 13:19:15.694032 13770 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:15.730404  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:15.610733 13743 consensus_queue.cc:237] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.692376 13722 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.733253  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3b5667547cf44e88316b27d3edb3a4c" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:15.729947 13770 raft_consensus.cc:493] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.735862  5445 raft_consensus.cc:3060] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:15.728811 13755 raft_consensus.cc:697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:15.734035 13785 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:15.743731 13770 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.774430 13745 raft_consensus.cc:515] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.736227 13722 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.787667  5416 consensus_peers.cc:597] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.788405  5416 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.800323  5445 raft_consensus.cc:2468] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 29.
I20260709 13:19:15.756489 13785 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:15.809134 13785 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:15.814841  5416 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.815796  5416 consensus_peers.cc:597] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.816454  5416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111) [suppressed 344 similar messages]
I20260709 13:19:15.790426 13745 leader_election.cc:290] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:15.833525  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 213439us
I20260709 13:19:15.842082  5489 leader_election.cc:304] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.846485 13746 raft_consensus.cc:2804] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:15.847090 13746 raft_consensus.cc:697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:15.848027 13746 consensus_queue.cc:237] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.852473  5489 leader_election.cc:304] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.853646 13699 raft_consensus.cc:2804] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:15.854926  5489 leader_election.cc:304] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:15.854171 13699 raft_consensus.cc:697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 27 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:15.867429  5448 raft_consensus.cc:1275] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 53eb858bdf82438d83f1be6a01da2e0e: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:19:15.875341 13699 consensus_queue.cc:237] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.878490 13722 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.880386 13749 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.882879 13749 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:15.837618 13755 consensus_queue.cc:237] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.873258 13767 raft_consensus.cc:2804] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Leader election won for term 29
W20260709 13:19:15.874258  5490 leader_election.cc:336] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.889865  5490 leader_election.cc:336] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:15.877954 13762 consensus_queue.cc:1048] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.020s
I20260709 13:19:15.898095 13767 raft_consensus.cc:697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 29 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:15.918497 13770 raft_consensus.cc:515] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:15.924181 13770 leader_election.cc:290] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:15.920873 13767 consensus_queue.cc:237] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:15.926893  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:15.927399  5490 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.927897  5490 leader_election.cc:336] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.928800  5490 consensus_peers.cc:597] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.932750  5416 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.948709  6043 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.956627  5490 leader_election.cc:336] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.959065  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:15.959877  5490 consensus_peers.cc:597] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.960549  5490 leader_election.cc:336] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.958302  5416 leader_election.cc:336] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:15.961788  5416 consensus_peers.cc:597] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.008108 13785 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.027664  5273 catalog_manager.cc:5697] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 22 to 23, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 23 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:16.029785  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 169576us
I20260709 13:19:16.032596 13793 raft_consensus.cc:2955] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:19:16.044100 13743 consensus_queue.cc:1048] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:19:16.049353  5416 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:16.049813  5447 raft_consensus.cc:1275] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:16.047034  5266 catalog_manager.cc:5697] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 16 to 17, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 17 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.052690  5447 raft_consensus.cc:1275] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:19:16.052345  5266 catalog_manager.cc:5697] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 23 to 24, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 24 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.049649  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:16.061079  5445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db91d6fa74dd4308ae267c81a83d8d5f" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:16.061806  5445 raft_consensus.cc:3060] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:16.057895 13743 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:16.065721 13743 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:16.066119 13743 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:16.078369  5445 raft_consensus.cc:2468] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
I20260709 13:19:16.085122  5442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cac82a5dba4ed4b6457efb7b474a24" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b781c7e31b7145aea647a7ff649e6ac7"
I20260709 13:19:16.085866  5442 raft_consensus.cc:3060] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:16.096910  5442 raft_consensus.cc:2468] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 23.
I20260709 13:19:16.096438  5450 raft_consensus.cc:2955] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:19:16.110785 13785 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:16.120177  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:16.123556  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:16.124822  5518 raft_consensus.cc:1275] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 31 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 13:19:16.124293  5520 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
W20260709 13:19:16.125370  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:16.127669  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07d1fef577c411787d1f686a4774389" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:16.128328  5524 raft_consensus.cc:3060] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:16.132536  5518 raft_consensus.cc:1275] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:16.137090  5524 raft_consensus.cc:2468] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
W20260709 13:19:16.145241  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:16.151149  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:16.151875  5519 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:19:16.151439  5520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9510ba0f78fa4449a7cc7fde29e88b4d" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:16.153782  5520 raft_consensus.cc:3060] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:19:16.149308  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.159855  5490 consensus_peers.cc:597] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.131067 13743 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:16.163398  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:16.163686  5521 raft_consensus.cc:1275] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 13:19:16.163686 13743 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
W20260709 13:19:16.169685  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.170379  5416 consensus_peers.cc:597] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.171546  5521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b655965f5ab4410b8f331ea47595c0fd" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:16.171947  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ef40d8b72f47f9b405aa70b3a9d166" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:16.172246  5521 raft_consensus.cc:3060] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:16.172631  5517 raft_consensus.cc:3060] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:16.176803  5448 raft_consensus.cc:1275] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:19:16.180775  5517 raft_consensus.cc:2468] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 26.
I20260709 13:19:16.186003  5520 raft_consensus.cc:2468] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 28.
I20260709 13:19:16.187654  5273 catalog_manager.cc:5697] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 26 to 27, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 27 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.190260  5448 raft_consensus.cc:1275] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:16.189626  5273 catalog_manager.cc:5697] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 28 to 29, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 29 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.200367  5521 raft_consensus.cc:2468] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 24.
I20260709 13:19:16.206593 13785 consensus_queue.cc:1048] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:19:16.207741  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:16.226555 13809 ts_tablet_manager.cc:933] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: Initiating tablet copy from peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:16.228122  5414 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:16.228703 13749 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:16.229151 13749 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:16.229607 13749 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:16.229858 13777 consensus_queue.cc:1048] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:16.231289 13777 raft_consensus.cc:2804] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:16.231755 13777 raft_consensus.cc:697] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:16.232630 13777 consensus_queue.cc:237] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.236460  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:16.238943 13796 consensus_queue.cc:1048] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:16.244935 13722 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:16.245465 13722 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 86b410d62f4040c39d33dc0698998562)
I20260709 13:19:16.245854 13722 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:16.248793  5489 leader_election.cc:304] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:16.252012 13784 raft_consensus.cc:2804] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:16.252518 13755 consensus_queue.cc:1048] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:16.252555 13784 raft_consensus.cc:697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:16.253969 13749 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.254464 13784 consensus_queue.cc:237] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.256399 13749 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:16.263988 13722 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.240136 13791 consensus_queue.cc:1048] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:16.214857  5416 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:16.266793  5489 leader_election.cc:304] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:16.274753 13809 tablet_copy_client.cc:323] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.37.131:36363
I20260709 13:19:16.282604 13804 raft_consensus.cc:2804] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:16.283191 13804 raft_consensus.cc:697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:16.284229 13804 consensus_queue.cc:237] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.284281 13793 consensus_queue.cc:1048] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:16.285621 13782 consensus_queue.cc:1048] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:16.288421  5534 tablet_copy_service.cc:140] P 544c82a50cc4477886bb6f7d58f455ca: Received BeginTabletCopySession request for tablet bac3d18b18df469b8638e92d4034ba81 from peer 53eb858bdf82438d83f1be6a01da2e0e ({username='slave'} at 127.0.0.1:34858)
W20260709 13:19:16.288712  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 73885.9us
I20260709 13:19:16.289080  5534 tablet_copy_service.cc:161] P 544c82a50cc4477886bb6f7d58f455ca: Beginning new tablet copy session on tablet bac3d18b18df469b8638e92d4034ba81 from peer 53eb858bdf82438d83f1be6a01da2e0e at {username='slave'} at 127.0.0.1:34858: session id = 53eb858bdf82438d83f1be6a01da2e0e-bac3d18b18df469b8638e92d4034ba81
I20260709 13:19:16.297741  5414 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:16.299031  5414 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
I20260709 13:19:16.299891 13777 raft_consensus.cc:2804] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:16.300411 13777 raft_consensus.cc:697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:16.300632 13743 raft_consensus.cc:2804] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:16.301203 13743 raft_consensus.cc:697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 28 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:16.301412 13777 consensus_queue.cc:237] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.302075 13743 consensus_queue.cc:237] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.306041  5414 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 86b410d62f4040c39d33dc0698998562
W20260709 13:19:16.313071  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:16.306921 13785 raft_consensus.cc:2804] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:19:16.325587  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:16.317488  5273 catalog_manager.cc:5697] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: config changed from index -1 to 12, NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) added. New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } }
I20260709 13:19:16.330212  5534 tablet_copy_source_session.cc:215] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:16.350104  5517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ae73f1403d44db9d77ab1da61496ea" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:16.350807  5517 raft_consensus.cc:3060] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:16.355695  5519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "071f7516f6b64068bdcc88167bd9f6ae" candidate_uuid: "b781c7e31b7145aea647a7ff649e6ac7" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca"
I20260709 13:19:16.356637  5519 raft_consensus.cc:3060] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:16.318795 13722 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Requested vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:16.364836  5517 raft_consensus.cc:2468] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 27.
I20260709 13:19:16.330871 13785 raft_consensus.cc:697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
W20260709 13:19:16.362169 13810 log.cc:927] Time spent T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.008s
I20260709 13:19:16.390834  5519 raft_consensus.cc:2468] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b781c7e31b7145aea647a7ff649e6ac7 in term 25.
W20260709 13:19:16.436481  4246 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5396)
I20260709 13:19:16.488485  5414 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:16.503902  5414 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7; no voters: 
I20260709 13:19:16.503911 13780 raft_consensus.cc:2804] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:16.504819 13778 raft_consensus.cc:2804] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:16.504882 13780 raft_consensus.cc:697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 27 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:16.505484 13778 raft_consensus.cc:697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Becoming Leader. State: Replica: b781c7e31b7145aea647a7ff649e6ac7, State: Running, Role: LEADER
I20260709 13:19:16.505916 13780 consensus_queue.cc:237] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.506412 13778 consensus_queue.cc:237] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:16.510370  5519 raft_consensus.cc:1275] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:16.515076  5518 raft_consensus.cc:1275] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:16.535310 13809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac3d18b18df469b8638e92d4034ba81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:16.548589  5416 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:16.549875  5416 consensus_peers.cc:597] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.550482  5416 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:16.514284 13785 consensus_queue.cc:237] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:16.572634  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:16.575803  5450 raft_consensus.cc:1275] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:19:16.584738  5450 raft_consensus.cc:1275] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
W20260709 13:19:16.589090  5416 consensus_peers.cc:597] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.592131 13776 consensus_queue.cc:1048] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:16.593693 13722 consensus_queue.cc:1048] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:16.595790  5266 catalog_manager.cc:5697] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 22 to 23, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 23 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.602108  5266 catalog_manager.cc:5697] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 21, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 21 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.609287 13804 consensus_queue.cc:1048] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:16.609773  5442 raft_consensus.cc:1275] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:19:16.617388  5490 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.618121  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:16.625609 13826 consensus_queue.cc:1048] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:19:16.671115  5260 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 84704.7us
W20260709 13:19:16.675156  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.690874  5490 consensus_peers.cc:597] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.699998 13809 tablet_copy_client.cc:806] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:16.700964 13809 tablet_copy_client.cc:670] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Starting download of 1 WAL segments...
W20260709 13:19:16.725283  6042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 50402.1us
I20260709 13:19:16.681679 13770 consensus_queue.cc:1048] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 13:19:16.749943  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bfa8a3a375f94c92a91bd291429fb615: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:16.773774  5447 raft_consensus.cc:1275] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:16.791236 13809 tablet_copy_client.cc:538] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:19:16.812410  5490 consensus_peers.cc:597] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.826472  5447 raft_consensus.cc:1275] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:16.857518 13784 consensus_queue.cc:1048] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
W20260709 13:19:16.895998  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.897163  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.913048 13844 log.cc:927] Time spent T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:16.918292 13809 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap starting.
W20260709 13:19:16.921650  5416 consensus_peers.cc:597] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.933012  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44733.2us
I20260709 13:19:16.941735 13744 consensus_queue.cc:1048] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:19:16.943645  5416 consensus_peers.cc:597] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.944674  5416 consensus_peers.cc:597] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.948438  5519 raft_consensus.cc:1275] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 13:19:16.949657  5517 raft_consensus.cc:1275] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:19:16.951144  5516 raft_consensus.cc:1275] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:16.953841  5273 catalog_manager.cc:5697] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 25 to 26, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 26 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.956023  5273 catalog_manager.cc:5697] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 25 to 26, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 26 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.959079  5524 raft_consensus.cc:1275] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:16.964496 13757 consensus_queue.cc:1048] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:16.966197 13757 consensus_queue.cc:1048] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:16.975567 13778 consensus_queue.cc:1048] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:16.982837  5273 catalog_manager.cc:5697] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 23 to 24, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 24 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.984988  5273 catalog_manager.cc:5697] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 24 to 25, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 25 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.002853 13785 consensus_queue.cc:1048] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:19:17.014578  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.016638  5490 consensus_peers.cc:597] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.994002  5273 catalog_manager.cc:5697] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 26 to 27, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 27 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.026719  5273 catalog_manager.cc:5697] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 reported cstate change: term changed from 27 to 28, leader changed from 86b410d62f4040c39d33dc0698998562 (127.4.37.129) to b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130). New cstate: current_term: 28 leader_uuid: "b781c7e31b7145aea647a7ff649e6ac7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.040354  5517 raft_consensus.cc:1275] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:19:17.062065  5416 consensus_peers.cc:597] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:17.062898  5416 consensus_peers.cc:597] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:17.071859  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 54454.8us
I20260709 13:19:17.078416  5517 raft_consensus.cc:1275] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Refusing update from remote peer b781c7e31b7145aea647a7ff649e6ac7: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260709 13:19:17.097568 13852 log.cc:927] Time spent T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:17.108009 13785 consensus_queue.cc:1048] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:17.114372 13778 consensus_queue.cc:1048] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:19:17.160847  5416 consensus_peers.cc:597] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:17.176105  5490 consensus_peers.cc:597] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:17.176720  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.262045  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.262676  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.343786  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.437155  4246 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5396)
I20260709 13:19:17.440012 13809 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:17.441370 13809 tablet_bootstrap.cc:492] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: Bootstrap complete.
I20260709 13:19:17.442394 13809 ts_tablet_manager.cc:1403] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent bootstrapping tablet: real 0.525s	user 0.059s	sys 0.005s
I20260709 13:19:17.463245 13809 raft_consensus.cc:359] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:19:17.464391 13809 raft_consensus.cc:740] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 53eb858bdf82438d83f1be6a01da2e0e, State: Initialized, Role: LEARNER
I20260709 13:19:17.465303 13809 consensus_queue.cc:260] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } }
I20260709 13:19:17.473238 13809 ts_tablet_manager.cc:1434] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:19:17.475879  5534 tablet_copy_service.cc:342] P 544c82a50cc4477886bb6f7d58f455ca: Request end of tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-bac3d18b18df469b8638e92d4034ba81 received from {username='slave'} at 127.0.0.1:34858
I20260709 13:19:17.476334  5534 tablet_copy_service.cc:434] P 544c82a50cc4477886bb6f7d58f455ca: ending tablet copy session 53eb858bdf82438d83f1be6a01da2e0e-bac3d18b18df469b8638e92d4034ba81 on tablet bac3d18b18df469b8638e92d4034ba81 with peer 53eb858bdf82438d83f1be6a01da2e0e
W20260709 13:19:17.481855  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.494959  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:17.695649  6070 raft_consensus.cc:1217] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
W20260709 13:19:17.755532  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:17.953413  5490 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.112052  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:18.140152  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.163367  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:18.163973  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.189126 13831 raft_consensus.cc:1064] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: attempting to promote NON_VOTER 53eb858bdf82438d83f1be6a01da2e0e to VOTER
I20260709 13:19:18.198153 13831 consensus_queue.cc:237] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:18.233662  5416 consensus_peers.cc:597] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:18.246183  5490 consensus_peers.cc:597] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.246781  5490 consensus_peers.cc:597] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.258352  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.287822  5416 consensus_peers.cc:597] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.326954  5416 consensus_peers.cc:597] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.331851  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.337680  5490 consensus_peers.cc:597] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.342764  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:18.343294  6070 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEARNER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:18.346328  5443 raft_consensus.cc:1275] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Refusing update from remote peer 544c82a50cc4477886bb6f7d58f455ca: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:18.351756 13863 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:18.353724 13745 consensus_queue.cc:1048] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:19:18.371269  6043 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.389874  5490 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.390543  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:18.409118  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:18.412467 13831 raft_consensus.cc:2955] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
I20260709 13:19:18.420213  6070 raft_consensus.cc:2955] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:19:18.437806  4246 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:18.439965  5416 consensus_peers.cc:597] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:18.445542  5443 raft_consensus.cc:2955] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:19:18.459823  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:19:18.466013  5273 catalog_manager.cc:5697] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e reported cstate change: config changed from index 12 to 13, 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } } }
W20260709 13:19:18.610415  5416 consensus_peers.cc:597] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.685056  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.685765  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.697007  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.703671  5416 consensus_peers.cc:597] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.759822  5416 consensus_peers.cc:597] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.761262  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.772076  5490 consensus_peers.cc:597] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.791476  5490 consensus_peers.cc:597] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.803220  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.824687  5490 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.870015  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.908303  5416 consensus_peers.cc:597] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:18.934083  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bfa8a3a375f94c92a91bd291429fb615: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:18.949398  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.952659  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.079131  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.168431  5490 consensus_peers.cc:597] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.213198  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.246495  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 60001.2us
W20260709 13:19:19.304924  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:19.311510  5416 consensus_peers.cc:597] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.353997  5490 consensus_peers.cc:597] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.372007  5416 consensus_peers.cc:597] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.372792  5416 consensus_peers.cc:597] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.438541  4246 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:19.482949  5416 consensus_peers.cc:597] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.504370  5416 consensus_peers.cc:597] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.531242  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.588515  5416 consensus_peers.cc:597] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.646005  5490 consensus_peers.cc:597] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.711596  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.829363  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.847329  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:20.059736  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:20.104354  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:20.218706  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:20.410859  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:20.439139  4246 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:20.646420  6043 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:20.798339  5416 consensus_peers.cc:597] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:20.817061  5416 consensus_peers.cc:597] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:20.855854  5416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111) [suppressed 503 similar messages]
W20260709 13:19:20.859932  5416 consensus_peers.cc:597] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:20.866628  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:20.925814  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:20.963778  5416 consensus_peers.cc:597] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.091558  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.100219  5416 consensus_peers.cc:597] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.133800  5416 consensus_peers.cc:597] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.223908  5416 consensus_peers.cc:597] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.254165  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.399916  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.408558  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 86791.6us
W20260709 13:19:21.440397  4246 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:21.495707  5490 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.496891  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:21.497901  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:21.499179  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.499768  5490 consensus_peers.cc:597] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.500262  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.532202  5416 consensus_peers.cc:597] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.533039  5490 consensus_peers.cc:597] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.580459  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.595705  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.648031  5490 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.693545  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.791788  5416 consensus_peers.cc:597] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.898286  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:21.906141  5416 consensus_peers.cc:597] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.910213  5416 consensus_peers.cc:597] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.956660  5416 consensus_peers.cc:597] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.967921  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.968639  5490 consensus_peers.cc:597] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:21.988423  5416 consensus_peers.cc:597] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.046594  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.068821  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.097805  5490 consensus_peers.cc:597] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.182988  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.206632  5490 consensus_peers.cc:597] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.236644  5416 consensus_peers.cc:597] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.276000  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.382282  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.441521  4246 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:22.498529  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:22.547808  5490 consensus_peers.cc:597] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.548494  5490 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.642252  5490 consensus_peers.cc:597] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.743952  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.888557  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.914942  5490 consensus_peers.cc:597] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:22.960119  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc100 after lost signal to thread 4249
W20260709 13:19:22.961508  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08003101c0 after lost signal to thread 5307
W20260709 13:19:22.962997  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08003956e0 after lost signal to thread 5474
W20260709 13:19:22.964232  5545 debug-util.cc:398] Leaking SignalData structure 0x7b0800393060 after lost signal to thread 5548
W20260709 13:19:22.965767  5545 debug-util.cc:398] Leaking SignalData structure 0x7b08000a84e0 after lost signal to thread 6101
W20260709 13:19:23.032244  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.079226  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.097002  5416 consensus_peers.cc:597] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.102113  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bfa8a3a375f94c92a91bd291429fb615: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:23.149143  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.217113  6043 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.233649  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.271217  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.327297  5416 consensus_peers.cc:597] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.428432  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.442075  4246 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:23.480388  5416 consensus_peers.cc:597] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.490891  5416 consensus_peers.cc:597] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.595678  5416 consensus_peers.cc:597] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.610121  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.661650  5416 consensus_peers.cc:597] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.665618  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.745978  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.758175  5416 consensus_peers.cc:597] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.774727  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.791200  5490 consensus_peers.cc:597] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.865151  5490 consensus_peers.cc:597] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:23.881521  6041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 116327us
W20260709 13:19:23.898607  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.908377  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.940802  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.945247  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.983656  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.026386  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.039228  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.043357  5490 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.049606  5416 consensus_peers.cc:597] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.073508  5416 consensus_peers.cc:597] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.081719  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.162971  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:24.210906  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.227746  5490 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.304893  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.345616  5416 consensus_peers.cc:597] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.370138  5416 consensus_peers.cc:597] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.421106  5416 consensus_peers.cc:597] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.442557  4246 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:24.551433  5490 consensus_peers.cc:597] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.588034  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:24.702401  5490 consensus_peers.cc:597] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.753545  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.779776  5416 consensus_peers.cc:597] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.812580  5490 consensus_peers.cc:597] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.830230  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.876685  5490 consensus_peers.cc:597] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.887154  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.933630  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:24.952080  5416 consensus_peers.cc:597] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.962493  5490 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:25.104871  5490 consensus_peers.cc:597] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:25.259194  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:25.270244  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.294479  5490 consensus_peers.cc:597] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:25.443306  4246 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:25.447813  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.465723  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.588131  6043 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.596024  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.670276  5416 consensus_peers.cc:597] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.719378  5416 consensus_peers.cc:597] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:25.735877  5416 consensus_peers.cc:597] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.767547  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.798197  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.810012  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.864653  5490 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111) [suppressed 517 similar messages]
W20260709 13:19:25.915617  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:26.079627  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:26.122470  5416 consensus_peers.cc:597] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.122555  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.152258  5416 consensus_peers.cc:597] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.168076  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.205606  5416 consensus_peers.cc:597] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.268854  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.324572  5490 consensus_peers.cc:597] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.363997  5490 consensus_peers.cc:597] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.443881  4246 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:26.447086  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.451882  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.454811  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.485162  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.503198  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.505014  5416 consensus_peers.cc:597] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.520342  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.552554  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.557467  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:26.656620  5416 consensus_peers.cc:597] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.683424  5416 consensus_peers.cc:597] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.696130  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:26.718147  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.727567  5490 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.764730  5416 consensus_peers.cc:597] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.924681  5490 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.974794  5416 consensus_peers.cc:597] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:26.977936  5416 consensus_peers.cc:597] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.098502  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.109202  5490 consensus_peers.cc:597] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.186859  5416 consensus_peers.cc:597] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.254072  5490 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.270998  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.281929  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.325675  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.339387  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9d883e5d309d4113a821624777a85d05: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:27.374683  5490 consensus_peers.cc:597] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.393867  5490 consensus_peers.cc:597] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.444427  4246 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:27.516919  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:27.535818  5490 consensus_peers.cc:597] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.636655  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:27.661706  5490 consensus_peers.cc:597] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.791211  6043 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:27.811626  5416 consensus_peers.cc:597] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.867985  5490 consensus_peers.cc:597] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.874725  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.894520  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.055569  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.082131  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.163776  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 49664.7us
W20260709 13:19:28.193825  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.208089  5416 consensus_peers.cc:597] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.226083  5416 consensus_peers.cc:597] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.276072  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.310192  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.328661  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.444984  4246 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:28.494870  5416 consensus_peers.cc:597] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.498212  5416 consensus_peers.cc:597] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.618162  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:28.626915  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.688038  5490 consensus_peers.cc:597] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.739537  5416 consensus_peers.cc:597] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.740177  5416 consensus_peers.cc:597] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.790966  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:28.817480  5416 consensus_peers.cc:597] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:28.860872  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:28.850309  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:28.869280  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.892208  5489 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:36703, user_credentials={real_user=slave}} blocked reactor thread for 44750.2us
W20260709 13:19:28.895406  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:28.907987  5416 consensus_peers.cc:597] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:28.969650  5490 consensus_peers.cc:597] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:28.970283  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.042729  5416 consensus_peers.cc:597] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.059878  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:29.208709  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 95866.3us
W20260709 13:19:29.287639  5414 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:36363, user_credentials={real_user=slave}} blocked reactor thread for 75512.6us
W20260709 13:19:29.249506  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.313575  6043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 63963.5us
W20260709 13:19:29.369400  5490 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.424193  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.445367  5416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 53786.8us
W20260709 13:19:29.445791  4246 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 5396)
W20260709 13:19:29.458860  5416 consensus_peers.cc:597] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.459636  5416 consensus_peers.cc:597] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.460374  5416 consensus_peers.cc:597] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.502904  5416 consensus_peers.cc:597] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.508085  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.509027  5416 consensus_peers.cc:597] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.573648  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.587621  5416 consensus_peers.cc:597] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.002436  5490 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.003054  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.003911  5490 consensus_peers.cc:597] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.004392  5490 consensus_peers.cc:597] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.004856  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.008376  5416 consensus_peers.cc:597] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.025018  5490 consensus_peers.cc:597] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.031611  5490 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.043656  6043 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.091107  5490 consensus_peers.cc:597] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.152760  5416 consensus_peers.cc:597] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:30.197671  5490 consensus_peers.cc:597] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.260147  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:30.327195  4246 tablet_server.cc:196] TabletServer@127.4.37.129:0 shutdown complete.
W20260709 13:19:30.416308  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:30.441231  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.562565  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.574347  5416 consensus_peers.cc:597] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:19:30.628949  4246 tablet_server.cc:179] TabletServer@127.4.37.130:0 shutting down...
W20260709 13:19:30.635740  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.671741  5489 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.678678  6042 consensus_peers.cc:597] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.697880  5489 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.704838  5490 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.709304  5489 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.719354  5490 consensus_peers.cc:597] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.721537  5489 consensus_peers.cc:597] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.737409  5490 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.747162  5489 consensus_peers.cc:597] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.754516  5489 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.759258  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:30.760389  4246 tablet_replica.cc:333] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.761788  4246 raft_consensus.cc:2243] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.762938  4246 raft_consensus.cc:2272] T ced41742c4474d4197a4dfeed7d56536 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.765702  4246 tablet_replica.cc:333] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.766844  4246 raft_consensus.cc:2243] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.767964  4246 raft_consensus.cc:2272] T c06ab136607a405bbdfe9d04f533a566 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.776535  4246 tablet_replica.cc:333] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.777822  4246 raft_consensus.cc:2243] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.778900  4246 raft_consensus.cc:2272] T 879d2cd65f6c495494da47d5d0edf67f P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.783008  4246 tablet_replica.cc:333] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.784250  4246 raft_consensus.cc:2243] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.785992  4246 raft_consensus.cc:2272] T 4a548ed234e342789833cf138d282543 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.786653  5489 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.790223  4246 tablet_replica.cc:333] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.791729  4246 raft_consensus.cc:2243] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.793072  4246 raft_consensus.cc:2272] T 1a0a4db2904f41359369d5678178fb28 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.796763  4246 tablet_replica.cc:333] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.797924  4246 raft_consensus.cc:2243] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.799474  4246 raft_consensus.cc:2272] T a64a51af80064074aad9aefb8f176299 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.803160  4246 tablet_replica.cc:333] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.804270  4246 raft_consensus.cc:2243] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.805066  4246 raft_consensus.cc:2272] T 98e834db0dd44fe4a118d1b82fb1ff47 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.808346  4246 tablet_replica.cc:333] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.809357  4246 raft_consensus.cc:2243] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.810664  4246 raft_consensus.cc:2272] T 35a03ca070694c4880dc2efbf4b89052 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.813934  4246 tablet_replica.cc:333] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
W20260709 13:19:30.814601  5489 consensus_peers.cc:597] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.815074  4246 raft_consensus.cc:2243] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.823603  4246 raft_consensus.cc:2272] T f68a24d9e2f74d7697fec4f27e4c7f0c P b781c7e31b7145aea647a7ff649e6ac7 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:30.827397  4246 tablet_replica.cc:333] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
W20260709 13:19:30.830977  6042 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.831780  5489 consensus_peers.cc:597] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.833453  4246 raft_consensus.cc:2243] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.840588  4246 raft_consensus.cc:2272] T 04c8c3b741e7461c8c4c145d8b652ece P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.843370  5416 consensus_peers.cc:597] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:30.844491  4246 tablet_replica.cc:333] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.847422  4246 raft_consensus.cc:2243] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:30.849713  4246 raft_consensus.cc:2272] T 6f76d25595424c71acc6031d1608a975 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.845654  5489 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.853470  4246 tablet_replica.cc:333] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.854790  4246 raft_consensus.cc:2243] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:30.872105  5416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111) [suppressed 542 similar messages]
W20260709 13:19:30.877303  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:30.878036  4246 raft_consensus.cc:2272] T 6bad22fee0614f38b77d2fbec2761370 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.889222  5416 consensus_peers.cc:597] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:30.895421  4246 tablet_replica.cc:333] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.896489  4246 raft_consensus.cc:2243] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 30 LEADER]: Raft consensus shutting down.
W20260709 13:19:30.899221  5489 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.915699  5489 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.916620  5489 consensus_peers.cc:597] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.917380  6098 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7d20 after lost signal to thread 4249
W20260709 13:19:30.920853  6098 debug-util.cc:398] Leaking SignalData structure 0x7b08003215e0 after lost signal to thread 5307
I20260709 13:19:30.920912  4246 raft_consensus.cc:2272] T 271a3e03527c4fd990f6961a94d3b6ce P b781c7e31b7145aea647a7ff649e6ac7 [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.922510  6098 debug-util.cc:398] Leaking SignalData structure 0x7b08002eae80 after lost signal to thread 5474
W20260709 13:19:30.924036  6098 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea540 after lost signal to thread 5548
W20260709 13:19:30.925347  6098 debug-util.cc:398] Leaking SignalData structure 0x7b080037d640 after lost signal to thread 6101
W20260709 13:19:30.937649  5490 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.941092  5490 consensus_peers.cc:597] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:30.940503  4246 tablet_replica.cc:333] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.946245  4246 raft_consensus.cc:2243] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:19:30.950623  6042 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.961413  4246 raft_consensus.cc:2272] T 04c2527a380a499db649c9aa30957175 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.963711  5489 consensus_peers.cc:597] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.964704  6042 consensus_peers.cc:597] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.966892  5489 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.967536  5489 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:30.971864  6042 consensus_peers.cc:597] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.983667  4246 tablet_replica.cc:333] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.989959  4246 raft_consensus.cc:2243] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.991338  4246 raft_consensus.cc:2272] T b85a688fd7794c83bef13f0caeceda13 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.992105  5489 consensus_peers.cc:597] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:30.994117  4246 tablet_replica.cc:333] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:30.995015  4246 raft_consensus.cc:2243] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:30.996016  4246 raft_consensus.cc:2272] T c1e0f2ddc67f4a12a80821b5a945c5c4 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:30.999799  5416 consensus_peers.cc:597] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.000193  5489 consensus_peers.cc:597] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.011379  5489 consensus_peers.cc:597] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.028898  5489 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.055546  5490 consensus_peers.cc:597] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.061944  5489 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.066823  6042 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.067967  5489 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.072115  5489 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:31.070093  4246 tablet_replica.cc:333] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.076706  4246 raft_consensus.cc:2243] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.079993  4246 raft_consensus.cc:2272] T 0276d804ade348368656bbe6805214df P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:31.087982  5489 consensus_peers.cc:597] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.088935  5489 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.089634  5489 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:31.093057  4246 tablet_replica.cc:333] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.098145  4246 raft_consensus.cc:2243] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.098969  4246 raft_consensus.cc:2272] T 92b870ccd68b4f2da5f6e32b1dfe77aa P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.102041  4246 tablet_replica.cc:333] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.102862  4246 raft_consensus.cc:2243] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.103603  4246 raft_consensus.cc:2272] T d219441478644a3e8915df9d2083022c P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:31.109289  5489 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:31.113607  5489 consensus_peers.cc:597] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:31.115015  4246 tablet_replica.cc:333] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.116127  4246 raft_consensus.cc:2243] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.117441  4246 raft_consensus.cc:2272] T db91d6fa74dd4308ae267c81a83d8d5f P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.120457  4246 tablet_replica.cc:333] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.121381  4246 raft_consensus.cc:2243] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.130836  4246 raft_consensus.cc:2272] T 31315bfcd25442efb6a2944803593a9c P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.138227  4246 tablet_replica.cc:333] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.139104  4246 raft_consensus.cc:2243] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.140312  4246 raft_consensus.cc:2272] T d07d1fef577c411787d1f686a4774389 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:31.147267  5489 consensus_peers.cc:597] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:31.147293  4246 tablet_replica.cc:333] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.154879  4246 raft_consensus.cc:2243] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.155762  4246 raft_consensus.cc:2272] T ca2e1b811ab74659a981695c9bb25bc7 P b781c7e31b7145aea647a7ff649e6ac7 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.158989  4246 tablet_replica.cc:333] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.159895  4246 raft_consensus.cc:2243] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.160617  4246 raft_consensus.cc:2272] T ec36d10767c748a59dbf28cb7fc52487 P b781c7e31b7145aea647a7ff649e6ac7 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:31.164276  5489 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:31.175769  4246 tablet_replica.cc:333] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.176786  4246 raft_consensus.cc:2243] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.177373  4246 raft_consensus.cc:2272] T 4e6e697f3d3040e4b2c502a614c55888 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.180228  4246 tablet_replica.cc:333] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.181089  4246 raft_consensus.cc:2243] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.182659  4246 raft_consensus.cc:2272] T 5e725a9779684377b88a2fbc508c37df P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.193732  4246 tablet_replica.cc:333] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.194509  4246 raft_consensus.cc:2243] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:31.195505  5489 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:31.195690  4246 raft_consensus.cc:2272] T bfa8a3a375f94c92a91bd291429fb615 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.199024  4246 tablet_replica.cc:333] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.199923  4246 raft_consensus.cc:2243] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.209815  4246 raft_consensus.cc:2272] T e3f62ebef8b04990ab6f34443d897c80 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.212908  4246 tablet_replica.cc:333] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.216387  4246 raft_consensus.cc:2243] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.217514  4246 raft_consensus.cc:2272] T 4d1e120f33ae49089fa860a4ac895b35 P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.220418  4246 tablet_replica.cc:333] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.221164  4246 raft_consensus.cc:2243] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.222033  4246 raft_consensus.cc:2272] T 505e05548ee2401d969672320dea8a9b P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.224951  4246 tablet_replica.cc:333] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.249708  4246 raft_consensus.cc:2243] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.251328  4246 raft_consensus.cc:2272] T d659cc559a5e4a99be73c9ce46dd2cf4 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:31.251397  5416 consensus_peers.cc:597] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:31.257507  4246 tablet_replica.cc:333] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.258550  4246 raft_consensus.cc:2243] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.260499  4246 raft_consensus.cc:2272] T 9d883e5d309d4113a821624777a85d05 P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.264829  4246 tablet_replica.cc:333] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.282584  4246 raft_consensus.cc:2243] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.284324  4246 raft_consensus.cc:2272] T d519198f00cc429b8d95c8d66a24c7f5 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.295773  4246 tablet_replica.cc:333] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.296654  4246 raft_consensus.cc:2243] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.298004  4246 raft_consensus.cc:2272] T c3b5667547cf44e88316b27d3edb3a4c P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.301119  4246 tablet_replica.cc:333] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.310142  4246 raft_consensus.cc:2243] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.311095  4246 raft_consensus.cc:2272] T 12cac82a5dba4ed4b6457efb7b474a24 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.314514  4246 tablet_replica.cc:333] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.315433  4246 raft_consensus.cc:2243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.316568  4246 raft_consensus.cc:2272] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.328982  4246 tablet_replica.cc:333] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.330780  4246 raft_consensus.cc:2243] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.331507  4246 raft_consensus.cc:2272] T 4c6edac4f8b644eb9445f8d270ce2dd6 P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.334237  4246 tablet_replica.cc:333] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.335031  4246 raft_consensus.cc:2243] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.335695  4246 raft_consensus.cc:2272] T 041443b19a6248948edd8e88378fd175 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.357944  4246 tablet_replica.cc:333] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.358814  4246 raft_consensus.cc:2243] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.360728  4246 raft_consensus.cc:2272] T 9510ba0f78fa4449a7cc7fde29e88b4d P b781c7e31b7145aea647a7ff649e6ac7 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:31.369108  5260 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 43769.5us
W20260709 13:19:31.402899  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bfa8a3a375f94c92a91bd291429fb615: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:31.407130  4246 tablet_replica.cc:333] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.409607  4246 raft_consensus.cc:2243] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.411692  4246 raft_consensus.cc:2272] T b7ef40d8b72f47f9b405aa70b3a9d166 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.422577  4246 tablet_replica.cc:333] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.430835  4246 raft_consensus.cc:2243] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.431994  4246 raft_consensus.cc:2272] T c1ab6ed89888463bba6c2914a30a48d7 P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.436648  4246 tablet_replica.cc:333] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
W20260709 13:19:31.449565  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.449779  5416 consensus_peers.cc:597] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:31.451726  4246 raft_consensus.cc:2243] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:19:31.464775  5490 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.465492  5490 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.465993  5490 consensus_peers.cc:597] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:31.466467  4246 raft_consensus.cc:2272] T fd246431fed24a99b47e2ccdf988b1ff P b781c7e31b7145aea647a7ff649e6ac7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.469890  4246 tablet_replica.cc:333] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.473680  4246 raft_consensus.cc:2243] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.474797  4246 raft_consensus.cc:2272] T e1289dc7debf403aa87416568de586e6 P b781c7e31b7145aea647a7ff649e6ac7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.478019  4246 tablet_replica.cc:333] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.478928  4246 raft_consensus.cc:2243] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.480445  4246 raft_consensus.cc:2272] T b655965f5ab4410b8f331ea47595c0fd P b781c7e31b7145aea647a7ff649e6ac7 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.494283  4246 tablet_replica.cc:333] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.497378  4246 raft_consensus.cc:2243] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.498723  4246 raft_consensus.cc:2272] T 5ae97666ff274da1b89c929a0af197ce P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.502383  4246 tablet_replica.cc:333] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.507321  4246 raft_consensus.cc:2243] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.508306  4246 raft_consensus.cc:2272] T ef276ea910334ad38fb1112a61709988 P b781c7e31b7145aea647a7ff649e6ac7 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.511350  4246 tablet_replica.cc:333] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.512251  4246 raft_consensus.cc:2243] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.513831  4246 raft_consensus.cc:2272] T 28ae73f1403d44db9d77ab1da61496ea P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.517025  4246 tablet_replica.cc:333] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.517925  4246 raft_consensus.cc:2243] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.525928  4246 raft_consensus.cc:2272] T 2efc28bc52fe484b89b667f19e0fe8ce P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.529013  4246 tablet_replica.cc:333] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.529896  4246 raft_consensus.cc:2243] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.531720  4246 raft_consensus.cc:2272] T 23d42b81e4844d79aa9b7194da0bacd0 P b781c7e31b7145aea647a7ff649e6ac7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.534569  4246 tablet_replica.cc:333] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.535458  4246 raft_consensus.cc:2243] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.536852  4246 raft_consensus.cc:2272] T bac3d18b18df469b8638e92d4034ba81 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.540189  4246 tablet_replica.cc:333] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.541049  4246 raft_consensus.cc:2243] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.542048  4246 raft_consensus.cc:2272] T efe06c4beff94d32a1cfc10e6b7cacb8 P b781c7e31b7145aea647a7ff649e6ac7 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.546047  4246 tablet_replica.cc:333] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.546806  4246 raft_consensus.cc:2243] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:31.547127  5490 consensus_peers.cc:597] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:31.547483  4246 raft_consensus.cc:2272] T 862a628beec44315b003538bc747056b P b781c7e31b7145aea647a7ff649e6ac7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.550412  4246 tablet_replica.cc:333] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.551182  4246 raft_consensus.cc:2243] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.552588  4246 raft_consensus.cc:2272] T bd0b01346dc74436aa3ac464cde50753 P b781c7e31b7145aea647a7ff649e6ac7 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.555377  4246 tablet_replica.cc:333] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.556167  4246 raft_consensus.cc:2243] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.557333  4246 raft_consensus.cc:2272] T 23048b90f57d48a4be8be78bc78d9204 P b781c7e31b7145aea647a7ff649e6ac7 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.560185  4246 tablet_replica.cc:333] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.560843  4246 raft_consensus.cc:2243] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:31.562260  4246 raft_consensus.cc:2272] T 071f7516f6b64068bdcc88167bd9f6ae P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.565383  4246 tablet_replica.cc:333] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.567381  4246 raft_consensus.cc:2243] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.568426  4246 raft_consensus.cc:2272] T b36b8170596a4e4eb051a1d9ee58e16c P b781c7e31b7145aea647a7ff649e6ac7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:31.577735  4246 tablet_replica.cc:333] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7: stopping tablet replica
I20260709 13:19:31.578462  4246 raft_consensus.cc:2243] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:31.579486  4246 raft_consensus.cc:2272] T be5ebf56a6624ec4803ae0c224dfc44e P b781c7e31b7145aea647a7ff649e6ac7 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:31.589075  5490 consensus_peers.cc:597] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.619462  5490 consensus_peers.cc:597] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:31.674525  5490 consensus_peers.cc:597] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.761607  5490 consensus_peers.cc:597] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:31.823467 13934 raft_consensus.cc:493] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 31 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:31.824093 13934 raft_consensus.cc:515] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:31.829479 13910 raft_consensus.cc:493] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:31.830215 13910 raft_consensus.cc:515] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:31.832710 13910 leader_election.cc:290] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:31.833986 13934 leader_election.cc:290] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:31.857863  5489 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:31.862911  5490 leader_election.cc:336] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:31.866621  5490 leader_election.cc:304] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:31.870576 13934 raft_consensus.cc:2749] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:19:31.872200  5490 leader_election.cc:336] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:31.876619  5489 leader_election.cc:336] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:31.877177  5489 leader_election.cc:304] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:31.878477 13934 raft_consensus.cc:2749] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:31.949369  5490 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.992108  5490 consensus_peers.cc:597] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.002022  6043 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:32.165966 13910 raft_consensus.cc:493] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.166653 13910 raft_consensus.cc:515] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:32.175765  5489 leader_election.cc:336] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.176870 13910 leader_election.cc:290] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.182291 13934 raft_consensus.cc:493] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.182914 13934 raft_consensus.cc:515] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.191223 13934 leader_election.cc:290] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:32.201409  5489 leader_election.cc:336] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.218832  5490 leader_election.cc:336] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.219640  5490 leader_election.cc:304] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.220960 13910 raft_consensus.cc:2749] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:32.236440 13910 raft_consensus.cc:493] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.237057 13910 raft_consensus.cc:515] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.241413 13910 leader_election.cc:290] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.251117 13910 raft_consensus.cc:493] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.251936 13910 raft_consensus.cc:515] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.254657 13910 leader_election.cc:290] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:32.250416  5490 leader_election.cc:336] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.257673  5490 leader_election.cc:304] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:32.258957  5490 consensus_peers.cc:597] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.261798  5489 leader_election.cc:336] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.265746 13935 raft_consensus.cc:2749] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:32.273321  5490 consensus_peers.cc:597] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.274801  5489 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.279085  5490 leader_election.cc:336] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.279628  5490 leader_election.cc:304] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.281713 13910 raft_consensus.cc:2749] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 13:19:32.287696  5490 leader_election.cc:336] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.288300  5490 leader_election.cc:304] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.289170 13910 raft_consensus.cc:2749] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:32.313264  5490 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:32.341578 13910 raft_consensus.cc:493] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.342149 13910 raft_consensus.cc:515] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.344238 13910 leader_election.cc:290] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.351197 13910 raft_consensus.cc:493] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.351877 13910 raft_consensus.cc:515] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.354794 13910 leader_election.cc:290] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:32.358680  5489 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.362730  5489 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.363946 13910 raft_consensus.cc:493] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.364532 13910 raft_consensus.cc:515] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.366866 13935 raft_consensus.cc:493] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.367486 13935 raft_consensus.cc:515] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.369877 13935 leader_election.cc:290] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.378505 13931 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.379266 13931 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:32.387463  6042 leader_election.cc:336] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.391505 13931 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363)
I20260709 13:19:32.409991 13910 leader_election.cc:290] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.413614 13934 raft_consensus.cc:493] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.414288 13934 raft_consensus.cc:515] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.416683 13934 leader_election.cc:290] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.419855  5524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "53eb858bdf82438d83f1be6a01da2e0e" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "544c82a50cc4477886bb6f7d58f455ca" is_pre_election: true
I20260709 13:19:32.423775  6041 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e; no voters: 544c82a50cc4477886bb6f7d58f455ca, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.426709 13930 raft_consensus.cc:2749] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:32.448518 13910 raft_consensus.cc:493] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.449285 13910 raft_consensus.cc:515] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.452021 13910 leader_election.cc:290] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.487022 13908 raft_consensus.cc:493] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.488112 13908 raft_consensus.cc:515] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.490669 13908 leader_election.cc:290] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:32.503291  5490 leader_election.cc:336] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.503826  5490 leader_election.cc:304] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:32.514039  6043 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:32.515019 13908 raft_consensus.cc:2749] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:32.516147  5490 leader_election.cc:336] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.516605  5490 leader_election.cc:304] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.517829 13908 raft_consensus.cc:2749] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:32.523187  5489 leader_election.cc:336] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.559170  5489 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.559770  5489 leader_election.cc:336] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.560846  5490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:43931, user_credentials={real_user=slave}} blocked reactor thread for 44732.3us
W20260709 13:19:32.561489  5490 leader_election.cc:336] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.582195  5490 leader_election.cc:304] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.588187 13910 raft_consensus.cc:2749] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:32.626087  5490 leader_election.cc:336] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.626659  5490 leader_election.cc:304] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:32.632452  5489 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.634289  5489 leader_election.cc:336] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.635139 13908 raft_consensus.cc:2749] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:32.637771  5490 consensus_peers.cc:597] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.638279  5490 leader_election.cc:336] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.638672  5490 leader_election.cc:304] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.646302 13908 raft_consensus.cc:2749] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:32.658981  5490 leader_election.cc:336] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.667230  5490 leader_election.cc:304] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.670737 13908 raft_consensus.cc:2749] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:19:32.703944  5490 consensus_peers.cc:597] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.704579  5490 leader_election.cc:336] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.704787 13910 raft_consensus.cc:493] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.704999  5490 leader_election.cc:304] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.706236 13934 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.706822 13934 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
I20260709 13:19:32.709641 13935 raft_consensus.cc:2749] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:32.706319  5490 consensus_peers.cc:597] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.715492  5490 consensus_peers.cc:597] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:32.705376 13910 raft_consensus.cc:515] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.718928 13910 leader_election.cc:290] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:32.720005  6043 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:19:32.721060 13934 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:32.728132 13910 raft_consensus.cc:493] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.728683 13910 raft_consensus.cc:515] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
W20260709 13:19:32.729622  5490 consensus_peers.cc:597] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.731051  5490 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:32.734972 13910 leader_election.cc:290] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.737032  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e" is_pre_election: true
I20260709 13:19:32.737780  6070 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 20.
W20260709 13:19:32.734951  5490 leader_election.cc:336] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:32.753614  5490 leader_election.cc:336] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:32.758949  5490 consensus_peers.cc:597] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:32.764690  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: 
I20260709 13:19:32.768594 13910 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:32.769064 13910 raft_consensus.cc:493] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Starting leader election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.769456 13910 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:32.791080  5490 consensus_peers.cc:597] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.792193  5489 leader_election.cc:336] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.793042  5489 leader_election.cc:336] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.793280 13908 raft_consensus.cc:493] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.805542 13908 raft_consensus.cc:515] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.807626 13908 leader_election.cc:290] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.803222  5489 leader_election.cc:304] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
W20260709 13:19:32.811851  5490 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.812871 13908 raft_consensus.cc:2749] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:32.819708  4246 tablet_server.cc:196] TabletServer@127.4.37.130:0 shutdown complete.
I20260709 13:19:32.818190 13910 raft_consensus.cc:515] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:32.842896  5489 leader_election.cc:336] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.843462  5489 leader_election.cc:304] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.852763 13910 leader_election.cc:290] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Requested vote from peers b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703), 53eb858bdf82438d83f1be6a01da2e0e (127.4.37.132:42599)
I20260709 13:19:32.853479 13908 raft_consensus.cc:2749] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:32.859768  6043 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.865989  5489 leader_election.cc:336] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.866317  6070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd246431fed24a99b47e2ccdf988b1ff" candidate_uuid: "544c82a50cc4477886bb6f7d58f455ca" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "53eb858bdf82438d83f1be6a01da2e0e"
I20260709 13:19:32.866607  5489 leader_election.cc:304] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.867010  6070 raft_consensus.cc:3060] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:32.867550 13912 raft_consensus.cc:493] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:32.868098 13912 raft_consensus.cc:515] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:32.871125 13912 leader_election.cc:290] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:32.871795 13912 raft_consensus.cc:2749] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:32.875435  6070 raft_consensus.cc:2468] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544c82a50cc4477886bb6f7d58f455ca in term 21.
W20260709 13:19:32.876080  5489 leader_election.cc:336] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
W20260709 13:19:32.881799  5490 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:32.884575  5489 leader_election.cc:304] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53eb858bdf82438d83f1be6a01da2e0e, 544c82a50cc4477886bb6f7d58f455ca; no voters: b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.885593 13910 raft_consensus.cc:2804] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:32.886085 13910 raft_consensus.cc:697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Becoming Leader. State: Replica: 544c82a50cc4477886bb6f7d58f455ca, State: Running, Role: LEADER
I20260709 13:19:32.886972 13910 consensus_queue.cc:237] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } }
W20260709 13:19:32.890818  5489 leader_election.cc:336] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:32.891325  5489 leader_election.cc:304] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:32.892028 13908 raft_consensus.cc:2749] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:32.897987  5489 consensus_peers.cc:597] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:32.925338  5265 catalog_manager.cc:5697] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca reported cstate change: term changed from 20 to 21, leader changed from b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130) to 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131). New cstate: current_term: 21 leader_uuid: "544c82a50cc4477886bb6f7d58f455ca" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:33.006209  5489 consensus_peers.cc:597] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:33.007959 13908 raft_consensus.cc:493] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:33.008550 13908 raft_consensus.cc:515] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:33.010886 13908 leader_election.cc:290] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
I20260709 13:19:33.019420  4246 tablet_server.cc:179] TabletServer@127.4.37.131:0 shutting down...
W20260709 13:19:33.019531  5490 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:33.031824  6042 consensus_peers.cc:597] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:33.032162  5489 leader_election.cc:336] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:33.032701  5489 leader_election.cc:304] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:33.033591 13910 raft_consensus.cc:2749] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:33.053915  5489 consensus_peers.cc:597] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:33.064265 13908 raft_consensus.cc:493] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b781c7e31b7145aea647a7ff649e6ac7)
I20260709 13:19:33.065009 13908 raft_consensus.cc:515] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } }
I20260709 13:19:33.068759 13908 leader_election.cc:290] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931), b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703)
W20260709 13:19:33.072090  5490 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.085734  5490 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:33.088739  5489 leader_election.cc:336] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111)
I20260709 13:19:33.089329  5489 leader_election.cc:304] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544c82a50cc4477886bb6f7d58f455ca; no voters: 86b410d62f4040c39d33dc0698998562, b781c7e31b7145aea647a7ff649e6ac7
I20260709 13:19:33.090293 13912 raft_consensus.cc:2749] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:33.117508  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:19:33.120175  5490 consensus_peers.cc:597] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:33.122030  4246 tablet_replica.cc:333] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.123113  4246 raft_consensus.cc:2243] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.124750  4246 raft_consensus.cc:2272] T 4a548ed234e342789833cf138d282543 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.128196  4246 tablet_replica.cc:333] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.129189  4246 raft_consensus.cc:2243] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.130455  4246 raft_consensus.cc:2272] T 35a03ca070694c4880dc2efbf4b89052 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.133725  4246 tablet_replica.cc:333] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.134747  4246 raft_consensus.cc:2243] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.135968  4246 raft_consensus.cc:2272] T ced41742c4474d4197a4dfeed7d56536 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.139140  4246 tablet_replica.cc:333] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.140072  4246 raft_consensus.cc:2243] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.141301  4246 raft_consensus.cc:2272] T 879d2cd65f6c495494da47d5d0edf67f P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.144585  4246 tablet_replica.cc:333] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.145561  4246 raft_consensus.cc:2243] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.147073  4246 raft_consensus.cc:2272] T c06ab136607a405bbdfe9d04f533a566 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.150410  4246 tablet_replica.cc:333] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.151415  4246 raft_consensus.cc:2243] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.152817  4246 raft_consensus.cc:2272] T 1a0a4db2904f41359369d5678178fb28 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.156267  4246 tablet_replica.cc:333] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.157317  4246 raft_consensus.cc:2243] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.158869  4246 raft_consensus.cc:2272] T 04c8c3b741e7461c8c4c145d8b652ece P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.161970  4246 tablet_replica.cc:333] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.162927  4246 raft_consensus.cc:2243] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.163733  4246 raft_consensus.cc:2272] T f68a24d9e2f74d7697fec4f27e4c7f0c P 544c82a50cc4477886bb6f7d58f455ca [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.167173  4246 tablet_replica.cc:333] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.168092  4246 raft_consensus.cc:2243] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.168857  4246 raft_consensus.cc:2272] T 23d42b81e4844d79aa9b7194da0bacd0 P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.170544  6041 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Couldn't send request to peer 544c82a50cc4477886bb6f7d58f455ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.172020  4246 tablet_replica.cc:333] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.173034  4246 raft_consensus.cc:2243] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.175449  4246 raft_consensus.cc:2272] T 92b870ccd68b4f2da5f6e32b1dfe77aa P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.178659  4246 tablet_replica.cc:333] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.179555  4246 raft_consensus.cc:2243] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.180747  4246 raft_consensus.cc:2272] T d219441478644a3e8915df9d2083022c P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.183739  4246 tablet_replica.cc:333] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.184604  4246 raft_consensus.cc:2243] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.185415  4246 raft_consensus.cc:2272] T 271a3e03527c4fd990f6961a94d3b6ce P 544c82a50cc4477886bb6f7d58f455ca [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.188196  4246 tablet_replica.cc:333] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.189065  4246 raft_consensus.cc:2243] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.189723  4246 raft_consensus.cc:2272] T a64a51af80064074aad9aefb8f176299 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.192476  4246 tablet_replica.cc:333] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.193356  4246 raft_consensus.cc:2243] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.194449  4246 raft_consensus.cc:2272] T 04c2527a380a499db649c9aa30957175 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.197257  4246 tablet_replica.cc:333] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.198405  4246 raft_consensus.cc:2243] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.199838  4246 raft_consensus.cc:2272] T b85a688fd7794c83bef13f0caeceda13 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.200644  5489 consensus_peers.cc:597] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:33.203018  4246 tablet_replica.cc:333] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.206305  4246 raft_consensus.cc:2243] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.207532  4246 raft_consensus.cc:2272] T c1e0f2ddc67f4a12a80821b5a945c5c4 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.213733  4246 tablet_replica.cc:333] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.214704  4246 raft_consensus.cc:2243] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.215365  4246 raft_consensus.cc:2272] T 6f76d25595424c71acc6031d1608a975 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.218361  4246 tablet_replica.cc:333] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.219192  4246 raft_consensus.cc:2243] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.220381  4246 raft_consensus.cc:2272] T 6bad22fee0614f38b77d2fbec2761370 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.223083  4246 tablet_replica.cc:333] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.223913  4246 raft_consensus.cc:2243] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.225613  4246 raft_consensus.cc:2272] T 4e6e697f3d3040e4b2c502a614c55888 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.228221  4246 tablet_replica.cc:333] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.228971  4246 raft_consensus.cc:2243] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.229779  4246 raft_consensus.cc:2272] T 5e725a9779684377b88a2fbc508c37df P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.232364  4246 tablet_replica.cc:333] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.233143  4246 raft_consensus.cc:2243] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.234387  4246 raft_consensus.cc:2272] T bfa8a3a375f94c92a91bd291429fb615 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.236949  4246 tablet_replica.cc:333] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
W20260709 13:19:33.236943  6042 consensus_peers.cc:597] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:33.238085  4246 raft_consensus.cc:2243] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.239173  4246 raft_consensus.cc:2272] T 82b92e5b61b340dc9b480b452ceee4a0 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.242017  4246 tablet_replica.cc:333] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.242996  4246 raft_consensus.cc:2243] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.244333  4246 raft_consensus.cc:2272] T 505e05548ee2401d969672320dea8a9b P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.246330  5490 consensus_peers.cc:597] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:33.247273  4246 tablet_replica.cc:333] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.248272  4246 raft_consensus.cc:2243] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.249135  4246 raft_consensus.cc:2272] T e3f62ebef8b04990ab6f34443d897c80 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.252261  4246 tablet_replica.cc:333] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.253151  4246 raft_consensus.cc:2243] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.254269  4246 raft_consensus.cc:2272] T 4d1e120f33ae49089fa860a4ac895b35 P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.257139  4246 tablet_replica.cc:333] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.258118  4246 raft_consensus.cc:2243] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.259385  4246 raft_consensus.cc:2272] T db91d6fa74dd4308ae267c81a83d8d5f P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.262259  4246 tablet_replica.cc:333] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.263072  4246 raft_consensus.cc:2243] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.263839  4246 raft_consensus.cc:2272] T 31315bfcd25442efb6a2944803593a9c P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.266765  4246 tablet_replica.cc:333] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.267624  4246 raft_consensus.cc:2243] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.268235  4246 raft_consensus.cc:2272] T d07d1fef577c411787d1f686a4774389 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.271034  4246 tablet_replica.cc:333] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.271926  4246 raft_consensus.cc:2243] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.273834  4246 raft_consensus.cc:2272] T ca2e1b811ab74659a981695c9bb25bc7 P 544c82a50cc4477886bb6f7d58f455ca [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.274012  5489 consensus_peers.cc:597] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:33.276690  5489 consensus_peers.cc:597] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.278084  6042 consensus_peers.cc:597] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:33.276916  4246 tablet_replica.cc:333] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.281297  4246 raft_consensus.cc:2243] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.283777  4246 raft_consensus.cc:2272] T ec36d10767c748a59dbf28cb7fc52487 P 544c82a50cc4477886bb6f7d58f455ca [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.287292  4246 tablet_replica.cc:333] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.288283  4246 raft_consensus.cc:2243] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.289589  4246 raft_consensus.cc:2272] T e1289dc7debf403aa87416568de586e6 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.290410  5489 consensus_peers.cc:597] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:33.292858  4246 tablet_replica.cc:333] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.293915  4246 raft_consensus.cc:2243] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.294749  4246 raft_consensus.cc:2272] T b655965f5ab4410b8f331ea47595c0fd P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.297756  4246 tablet_replica.cc:333] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.298791  4246 raft_consensus.cc:2243] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.299983  4246 raft_consensus.cc:2272] T 5ae97666ff274da1b89c929a0af197ce P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.302765  4246 tablet_replica.cc:333] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.303857  4246 raft_consensus.cc:2243] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 29 LEADER]: Raft consensus shutting down.
W20260709 13:19:33.304452  5489 consensus_peers.cc:597] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:33.305354  4246 raft_consensus.cc:2272] T c3b5667547cf44e88316b27d3edb3a4c P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.308265  4246 tablet_replica.cc:333] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.309121  4246 raft_consensus.cc:2243] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.310554  4246 raft_consensus.cc:2272] T 12cac82a5dba4ed4b6457efb7b474a24 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.313388  4246 tablet_replica.cc:333] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.314284  4246 raft_consensus.cc:2243] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:33.314944  6041 consensus_peers.cc:597] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Couldn't send request to peer 544c82a50cc4477886bb6f7d58f455ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.315068  4246 raft_consensus.cc:2272] T d659cc559a5e4a99be73c9ce46dd2cf4 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.318392  4246 tablet_replica.cc:333] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.319417  4246 raft_consensus.cc:2243] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.320640  4246 raft_consensus.cc:2272] T 9d883e5d309d4113a821624777a85d05 P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.324350  4246 tablet_replica.cc:333] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.325222  4246 raft_consensus.cc:2243] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.326537  4246 raft_consensus.cc:2272] T 2efc28bc52fe484b89b667f19e0fe8ce P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.329444  4246 tablet_replica.cc:333] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.330323  4246 raft_consensus.cc:2243] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.330928  4246 raft_consensus.cc:2272] T b7ef40d8b72f47f9b405aa70b3a9d166 P 544c82a50cc4477886bb6f7d58f455ca [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.333707  4246 tablet_replica.cc:333] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.334559  4246 raft_consensus.cc:2243] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.335377  4246 raft_consensus.cc:2272] T 9510ba0f78fa4449a7cc7fde29e88b4d P 544c82a50cc4477886bb6f7d58f455ca [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.338251  4246 tablet_replica.cc:333] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.339138  4246 raft_consensus.cc:2243] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.339852  4246 raft_consensus.cc:2272] T 7b301483f19c4d508e00d917819ac039 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.342644  4246 tablet_replica.cc:333] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.343482  4246 raft_consensus.cc:2243] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.344099  4246 raft_consensus.cc:2272] T d519198f00cc429b8d95c8d66a24c7f5 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.347959  4246 tablet_replica.cc:333] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.349110  4246 raft_consensus.cc:2243] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.349962  4246 raft_consensus.cc:2272] T ef276ea910334ad38fb1112a61709988 P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.352680  4246 tablet_replica.cc:333] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.353550  4246 raft_consensus.cc:2243] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.354930  4246 raft_consensus.cc:2272] T 6fbe0fc532464dc7bdc351bd1ac98fd2 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.356771  6041 consensus_peers.cc:597] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Couldn't send request to peer 544c82a50cc4477886bb6f7d58f455ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:33.357712  4246 tablet_replica.cc:333] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.358397  4246 raft_consensus.cc:2243] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.359544  4246 raft_consensus.cc:2272] T 4c6edac4f8b644eb9445f8d270ce2dd6 P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.361595  4246 tablet_replica.cc:333] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.362213  4246 raft_consensus.cc:2243] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.363103  4246 raft_consensus.cc:2272] T 041443b19a6248948edd8e88378fd175 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.365044  4246 tablet_replica.cc:333] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.365697  4246 raft_consensus.cc:2243] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.366532  4246 raft_consensus.cc:2272] T c1ab6ed89888463bba6c2914a30a48d7 P 544c82a50cc4477886bb6f7d58f455ca [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.368696  4246 tablet_replica.cc:333] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.369282  4246 raft_consensus.cc:2243] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.370241  4246 pending_rounds.cc:70] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Trying to abort 1 pending ops.
I20260709 13:19:33.370468  4246 pending_rounds.cc:77] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca: Aborting op as it isn't in flight: id { term: 21 index: 15 } timestamp: 7305638596172414976 op_type: NO_OP noop_request { }
I20260709 13:19:33.370805  4246 raft_consensus.cc:2889] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:33.371093  4246 raft_consensus.cc:2272] T fd246431fed24a99b47e2ccdf988b1ff P 544c82a50cc4477886bb6f7d58f455ca [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.373616  4246 tablet_replica.cc:333] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.374194  4246 raft_consensus.cc:2243] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.374680  4246 raft_consensus.cc:2272] T 28ae73f1403d44db9d77ab1da61496ea P 544c82a50cc4477886bb6f7d58f455ca [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.376811  4246 tablet_replica.cc:333] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.377346  4246 raft_consensus.cc:2243] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.378751  4246 raft_consensus.cc:2272] T bac3d18b18df469b8638e92d4034ba81 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.380865  4246 tablet_replica.cc:333] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.381490  4246 raft_consensus.cc:2243] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.382028  4246 raft_consensus.cc:2272] T bd0b01346dc74436aa3ac464cde50753 P 544c82a50cc4477886bb6f7d58f455ca [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.383949  4246 tablet_replica.cc:333] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.384500  4246 raft_consensus.cc:2243] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.384979  4246 raft_consensus.cc:2272] T 23048b90f57d48a4be8be78bc78d9204 P 544c82a50cc4477886bb6f7d58f455ca [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.386835  4246 tablet_replica.cc:333] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.387379  4246 raft_consensus.cc:2243] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:33.387899  4246 raft_consensus.cc:2272] T 071f7516f6b64068bdcc88167bd9f6ae P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.390100  4246 tablet_replica.cc:333] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.390662  4246 raft_consensus.cc:2243] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.391549  4246 raft_consensus.cc:2272] T b36b8170596a4e4eb051a1d9ee58e16c P 544c82a50cc4477886bb6f7d58f455ca [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.393870  4246 tablet_replica.cc:333] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.394416  4246 raft_consensus.cc:2243] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.395570  4246 raft_consensus.cc:2272] T be5ebf56a6624ec4803ae0c224dfc44e P 544c82a50cc4477886bb6f7d58f455ca [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:33.397601  4246 tablet_replica.cc:333] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca: stopping tablet replica
I20260709 13:19:33.398116  4246 raft_consensus.cc:2243] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:19:33.398999  4246 raft_consensus.cc:2272] T 862a628beec44315b003538bc747056b P 544c82a50cc4477886bb6f7d58f455ca [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:33.521073  6042 consensus_peers.cc:597] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:33.539295  6041 consensus_peers.cc:597] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Couldn't send request to peer 544c82a50cc4477886bb6f7d58f455ca. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.131:36363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.539863  6041 consensus_peers.cc:597] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 544c82a50cc4477886bb6f7d58f455ca (127.4.37.131:36363): Couldn't send request to peer 544c82a50cc4477886bb6f7d58f455ca. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.131:36363: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:33.763682  6042 consensus_peers.cc:597] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:33.876340  6042 consensus_peers.cc:597] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e -> Peer b781c7e31b7145aea647a7ff649e6ac7 (127.4.37.130:36703): Couldn't send request to peer b781c7e31b7145aea647a7ff649e6ac7. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:36703: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:33.982719  6043 consensus_peers.cc:597] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e -> Peer 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): Couldn't send request to peer 86b410d62f4040c39d33dc0698998562. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:19:33.992645  4246 tablet_server.cc:196] TabletServer@127.4.37.131:0 shutdown complete.
I20260709 13:19:34.094643  4246 tablet_server.cc:179] TabletServer@127.4.37.132:0 shutting down...
I20260709 13:19:34.142939  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:34.143800  4246 tablet_replica.cc:333] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.144761  4246 raft_consensus.cc:2243] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.145620  4246 raft_consensus.cc:2272] T bfa8a3a375f94c92a91bd291429fb615 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.149024  4246 tablet_replica.cc:333] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.149807  4246 raft_consensus.cc:2243] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.151060  4246 raft_consensus.cc:2272] T 9d883e5d309d4113a821624777a85d05 P 53eb858bdf82438d83f1be6a01da2e0e [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.153498  4246 tablet_replica.cc:333] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.154105  4246 raft_consensus.cc:2243] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.155018  4246 raft_consensus.cc:2272] T 23048b90f57d48a4be8be78bc78d9204 P 53eb858bdf82438d83f1be6a01da2e0e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.157490  4246 tablet_replica.cc:333] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.158057  4246 raft_consensus.cc:2243] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:19:34.158494  6042 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.158870  4246 raft_consensus.cc:2272] T ef276ea910334ad38fb1112a61709988 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.161007  4246 tablet_replica.cc:333] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.161718  4246 raft_consensus.cc:2243] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEARNER]: Raft consensus shutting down.
I20260709 13:19:34.162197  4246 pending_rounds.cc:70] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Trying to abort 1 pending ops.
I20260709 13:19:34.162408  4246 pending_rounds.cc:77] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e: Aborting op as it isn't in flight: id { term: 10 index: 6 } timestamp: 7305637957653704704 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c06ab136607a405bbdfe9d04f533a566" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } } new_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "86b410d62f4040c39d33dc0698998562" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 43931 } } peers { permanent_uuid: "b781c7e31b7145aea647a7ff649e6ac7" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 36703 } attrs { replace: true } } peers { permanent_uuid: "544c82a50cc4477886bb6f7d58f455ca" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 36363 } } peers { permanent_uuid: "53eb858bdf82438d83f1be6a01da2e0e" member_type: NON_VOTER last_known_addr { host: "127.4.37.132" port: 42599 } attrs { promote: true } } } }
I20260709 13:19:34.163129  4246 raft_consensus.cc:2917] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 LEARNER]: Aborting config change with OpId 10.6: Aborted: Op aborted
I20260709 13:19:34.163486  4246 raft_consensus.cc:2889] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:19:34.163769  4246 raft_consensus.cc:2272] T c06ab136607a405bbdfe9d04f533a566 P 53eb858bdf82438d83f1be6a01da2e0e [term 10 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:19:34.166172  4246 tablet_replica.cc:333] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.166762  4246 raft_consensus.cc:2243] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.167677  4246 raft_consensus.cc:2272] T 0276d804ade348368656bbe6805214df P 53eb858bdf82438d83f1be6a01da2e0e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.169806  4246 tablet_replica.cc:333] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.170608  4246 raft_consensus.cc:2243] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.171725  4246 raft_consensus.cc:2272] T 7b301483f19c4d508e00d917819ac039 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.173847  4246 tablet_replica.cc:333] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.174386  4246 raft_consensus.cc:2243] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.175262  4246 raft_consensus.cc:2272] T 98e834db0dd44fe4a118d1b82fb1ff47 P 53eb858bdf82438d83f1be6a01da2e0e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.177321  4246 tablet_replica.cc:333] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.177906  4246 raft_consensus.cc:2243] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.178369  4246 raft_consensus.cc:2272] T fd246431fed24a99b47e2ccdf988b1ff P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.180364  4246 tablet_replica.cc:333] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.180883  4246 raft_consensus.cc:2243] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.181849  4246 raft_consensus.cc:2272] T 82b92e5b61b340dc9b480b452ceee4a0 P 53eb858bdf82438d83f1be6a01da2e0e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.184032  4246 tablet_replica.cc:333] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.184641  4246 raft_consensus.cc:2243] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:34.185201  4246 raft_consensus.cc:2272] T bac3d18b18df469b8638e92d4034ba81 P 53eb858bdf82438d83f1be6a01da2e0e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.187841  4246 tablet_replica.cc:333] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e: stopping tablet replica
I20260709 13:19:34.188364  4246 raft_consensus.cc:2243] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:19:34.189538  4246 raft_consensus.cc:2272] T efe06c4beff94d32a1cfc10e6b7cacb8 P 53eb858bdf82438d83f1be6a01da2e0e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:34.374780  4246 tablet_server.cc:196] TabletServer@127.4.37.132:0 shutdown complete.
I20260709 13:19:34.407363  4246 master.cc:562] Master@127.4.37.190:41135 shutting down...
W20260709 13:19:34.440367  5321 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:19:34.440701  5321 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:34.440925  5321 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:43.767665  5260 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111) [suppressed 431 similar messages]
W20260709 13:19:43.771503  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9d883e5d309d4113a821624777a85d05: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
W20260709 13:19:47.828393  5260 catalog_manager.cc:4755] TS 86b410d62f4040c39d33dc0698998562 (127.4.37.129:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bfa8a3a375f94c92a91bd291429fb615: Network error: Client connection negotiation failed: client connection to 127.4.37.129:43931: connect: Connection refused (error 111)
I20260709 13:19:48.059031  4246 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.060102  4246 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.060506  4246 tablet_replica.cc:333] T 00000000000000000000000000000000 P 76d1a118b8e24e8fbc379c88999cb11f: stopping tablet replica
I20260709 13:19:48.201134  4246 master.cc:584] Master@127.4.37.190:41135 shutdown complete.
I20260709 13:19:48.257216  4246 test_util.cc:182] -----------------------------------------------
I20260709 13:19:48.257524  4246 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602897722324-4246-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (266037 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:19:48.261224  4246 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.37.190:44771
I20260709 13:19:48.262427  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:48.268842 13953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.268848 13952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.269876 13955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:48.270251  4246 server_base.cc:1061] running on GCE node
I20260709 13:19:48.274035  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:48.274271  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:48.274379  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603188274367 us; error 0 us; skew 500 ppm
I20260709 13:19:48.274866  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:48.277518  4246 webserver.cc:533] Webserver started at http://127.4.37.190:39869/ using document root <none> and password file <none>
I20260709 13:19:48.278019  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:48.278182  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:48.278419  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:48.279724  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/master-0-root/instance:
uuid: "f1c0fed8c36f41399952408dd461e2a7"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.284772  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:48.288666 13960 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.289580  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:48.289943  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/master-0-root
uuid: "f1c0fed8c36f41399952408dd461e2a7"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.290225  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:48.304000  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:48.305292  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:48.349856  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.190:44771
I20260709 13:19:48.349962 14011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.190:44771 every 8 connection(s)
I20260709 13:19:48.354140 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.366776 14012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7: Bootstrap starting.
I20260709 13:19:48.371984 14012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.376482 14012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7: No bootstrap required, opened a new log
I20260709 13:19:48.378978 14012 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1c0fed8c36f41399952408dd461e2a7" member_type: VOTER }
I20260709 13:19:48.379439 14012 raft_consensus.cc:385] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.379706 14012 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c0fed8c36f41399952408dd461e2a7, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.380403 14012 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1c0fed8c36f41399952408dd461e2a7" member_type: VOTER }
I20260709 13:19:48.380893 14012 raft_consensus.cc:399] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:48.381099 14012 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:48.381392 14012 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.386297 14012 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1c0fed8c36f41399952408dd461e2a7" member_type: VOTER }
I20260709 13:19:48.386893 14012 leader_election.cc:304] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1c0fed8c36f41399952408dd461e2a7; no voters: 
I20260709 13:19:48.388235 14012 leader_election.cc:290] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:48.388945 14015 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.390836 14015 raft_consensus.cc:697] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 1 LEADER]: Becoming Leader. State: Replica: f1c0fed8c36f41399952408dd461e2a7, State: Running, Role: LEADER
I20260709 13:19:48.391762 14012 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:48.391844 14015 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1c0fed8c36f41399952408dd461e2a7" member_type: VOTER }
I20260709 13:19:48.399840 14016 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1c0fed8c36f41399952408dd461e2a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1c0fed8c36f41399952408dd461e2a7" member_type: VOTER } }
I20260709 13:19:48.400591 14016 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:48.399771 14017 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1c0fed8c36f41399952408dd461e2a7. Latest consensus state: current_term: 1 leader_uuid: "f1c0fed8c36f41399952408dd461e2a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1c0fed8c36f41399952408dd461e2a7" member_type: VOTER } }
I20260709 13:19:48.401019 14017 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:48.402865 14024 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:48.408564 14024 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:48.410806  4246 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:48.419296 14024 catalog_manager.cc:1383] Generated new cluster ID: da873d81d13e4b38b99d01e4cb85a838
I20260709 13:19:48.419601 14024 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:48.444435 14024 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:48.445926 14024 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:48.463001 14024 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7: Generated new TSK 0
I20260709 13:19:48.463689 14024 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:48.477777  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:48.484427 14033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.485981 14034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.488199 14036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:48.489519  4246 server_base.cc:1061] running on GCE node
I20260709 13:19:48.492663  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:48.492960  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:48.493153  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603188493127 us; error 0 us; skew 500 ppm
I20260709 13:19:48.493913  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:48.496615  4246 webserver.cc:533] Webserver started at http://127.4.37.129:41223/ using document root <none> and password file <none>
I20260709 13:19:48.497249  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:48.497521  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:48.497833  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:48.499157  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root/instance:
uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.504581  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:19:48.508795 14041 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.509824  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:48.510170  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.510715  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:48.528218  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:48.529910  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:48.531498  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:48.534222  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:48.534488  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.534755  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:48.534950  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.583057  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:33687
I20260709 13:19:48.583199 14103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:33687 every 8 connection(s)
I20260709 13:19:48.588985  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:48.597898 14108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.598124 14109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.602280 14111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:48.603374  4246 server_base.cc:1061] running on GCE node
I20260709 13:19:48.607692 14104 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44771
I20260709 13:19:48.608143 14104 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:48.608099  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:48.608681  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:48.608881  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603188608858 us; error 0 us; skew 500 ppm
I20260709 13:19:48.609288 14104 heartbeater.cc:507] Master 127.4.37.190:44771 requested a full tablet report, sending...
I20260709 13:19:48.609668  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:48.611780 13977 ts_manager.cc:194] Registered new tserver with Master: ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:48.612432  4246 webserver.cc:533] Webserver started at http://127.4.37.130:32879/ using document root <none> and password file <none>
I20260709 13:19:48.613086  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:48.613322  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:48.613620  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:48.614236 13977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52940
I20260709 13:19:48.615721  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-1-root/instance:
uuid: "ce90f8e60d79487db7509ae191b95a16"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.621373  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:19:48.625705 14116 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.626753  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:48.627130  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-1-root
uuid: "ce90f8e60d79487db7509ae191b95a16"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.627462  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:48.651002  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:48.652335  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:48.653980  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:48.656433  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:48.656688  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.656955  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:48.657136  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.705785  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.130:42769
I20260709 13:19:48.705910 14178 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.130:42769 every 8 connection(s)
I20260709 13:19:48.711764  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:48.721292 14182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.721900 14183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.726109 14185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:48.726959 14179 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44771
I20260709 13:19:48.727202  4246 server_base.cc:1061] running on GCE node
I20260709 13:19:48.727421 14179 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:48.728361  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:48.728538 14179 heartbeater.cc:507] Master 127.4.37.190:44771 requested a full tablet report, sending...
W20260709 13:19:48.728717  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:48.728982  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603188728959 us; error 0 us; skew 500 ppm
I20260709 13:19:48.729830  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:48.731292 13977 ts_manager.cc:194] Registered new tserver with Master: ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:48.732875  4246 webserver.cc:533] Webserver started at http://127.4.37.131:39077/ using document root <none> and password file <none>
I20260709 13:19:48.733465 13977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52950
I20260709 13:19:48.733642  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:48.733906  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:48.734261  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:48.735605  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-2-root/instance:
uuid: "86cbe005f1b04a3c99562111b01847e8"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.740450  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:48.744119 14190 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.745296  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:19:48.745883  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-2-root
uuid: "86cbe005f1b04a3c99562111b01847e8"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.746222  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:48.771189  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:48.772560  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:48.774271  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:48.776741  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:48.776947  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.777271  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:48.777451  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.829295  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.131:32995
I20260709 13:19:48.829588 14252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.131:32995 every 8 connection(s)
I20260709 13:19:48.834345  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:48.842805 14256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:48.844201 14257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:48.847152  4246 server_base.cc:1061] running on GCE node
I20260709 13:19:48.848810 14253 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44771
I20260709 13:19:48.849331 14253 heartbeater.cc:461] Registering TS with master...
W20260709 13:19:48.849381 14259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:48.850499 14253 heartbeater.cc:507] Master 127.4.37.190:44771 requested a full tablet report, sending...
I20260709 13:19:48.850579  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:48.850958  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:48.851156  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603188851143 us; error 0 us; skew 500 ppm
I20260709 13:19:48.851917  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:48.852922 13977 ts_manager.cc:194] Registered new tserver with Master: 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:48.854979  4246 webserver.cc:533] Webserver started at http://127.4.37.132:35495/ using document root <none> and password file <none>
I20260709 13:19:48.855001 13977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52956
I20260709 13:19:48.855911  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:48.856199  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:48.856544  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:48.857899  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-3-root/instance:
uuid: "4db315fd9fb94434a179b03f5b4c083d"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.862689  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:48.866495 14264 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.867498  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:48.867901  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-3-root
uuid: "4db315fd9fb94434a179b03f5b4c083d"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:19:48.868239  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:48.883733  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:48.885203  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:48.886701  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:48.889237  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:48.889559  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:19:48.889847  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:48.890048  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:48.941766  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.132:46307
I20260709 13:19:48.941895 14326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.132:46307 every 8 connection(s)
I20260709 13:19:48.958427 14327 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44771
I20260709 13:19:48.958913 14327 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:48.959774 14327 heartbeater.cc:507] Master 127.4.37.190:44771 requested a full tablet report, sending...
I20260709 13:19:48.962580 13977 ts_manager.cc:194] Registered new tserver with Master: 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:48.963316  4246 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018286638s
I20260709 13:19:48.964136 13977 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52964
I20260709 13:19:48.993043 13977 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52972:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:19:49.252223 14069 tablet_service.cc:1511] Processing CreateTablet for tablet 31dabf2cb78a41b3b7df2e4915051150 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:49.252378 14068 tablet_service.cc:1511] Processing CreateTablet for tablet 5d56a931d31246a4b5592ae7bb17e3c4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:49.254190 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31dabf2cb78a41b3b7df2e4915051150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.257850 14068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d56a931d31246a4b5592ae7bb17e3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.261831 14067 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8bde50cec1487ab96a9bf5e86c8fd4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:49.263456 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8bde50cec1487ab96a9bf5e86c8fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.267637 14144 tablet_service.cc:1511] Processing CreateTablet for tablet 31dabf2cb78a41b3b7df2e4915051150 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:49.269251 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31dabf2cb78a41b3b7df2e4915051150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.268918 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 5d56a931d31246a4b5592ae7bb17e3c4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:49.270696 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d56a931d31246a4b5592ae7bb17e3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.274823 14143 tablet_service.cc:1511] Processing CreateTablet for tablet 5d56a931d31246a4b5592ae7bb17e3c4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:49.276033 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9c5f286ddb4582a67c471c4f1bdc67 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:49.277688 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9c5f286ddb4582a67c471c4f1bdc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.278029 14142 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9c5f286ddb4582a67c471c4f1bdc67 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:49.279203 14217 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8bde50cec1487ab96a9bf5e86c8fd4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:49.279615 14066 tablet_service.cc:1511] Processing CreateTablet for tablet fb7823eaa6f143459fa2134dfd0f6aa1 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:49.280658 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8bde50cec1487ab96a9bf5e86c8fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.280944 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7823eaa6f143459fa2134dfd0f6aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.281904 14141 tablet_service.cc:1511] Processing CreateTablet for tablet fb7823eaa6f143459fa2134dfd0f6aa1 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:49.282740 14292 tablet_service.cc:1511] Processing CreateTablet for tablet 31dabf2cb78a41b3b7df2e4915051150 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:49.284274 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31dabf2cb78a41b3b7df2e4915051150. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.285612 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9c5f286ddb4582a67c471c4f1bdc67 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:49.287364 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9c5f286ddb4582a67c471c4f1bdc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.287295 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8bde50cec1487ab96a9bf5e86c8fd4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:49.287976 14215 tablet_service.cc:1511] Processing CreateTablet for tablet fb7823eaa6f143459fa2134dfd0f6aa1 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:49.289086 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8bde50cec1487ab96a9bf5e86c8fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.289336 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7823eaa6f143459fa2134dfd0f6aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.290782 14065 tablet_service.cc:1511] Processing CreateTablet for tablet 5c75fd8dc7cb4bdcb2456a29de8392e2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:49.292369 14065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c75fd8dc7cb4bdcb2456a29de8392e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.276541 14143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d56a931d31246a4b5592ae7bb17e3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.294081 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9c5f286ddb4582a67c471c4f1bdc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.297165 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7823eaa6f143459fa2134dfd0f6aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.301528 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 5c75fd8dc7cb4bdcb2456a29de8392e2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:49.303529 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c75fd8dc7cb4bdcb2456a29de8392e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.371593 14347 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:49.373787 14214 tablet_service.cc:1511] Processing CreateTablet for tablet 98da3e79bd3a47369b2c6d41e0151470 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:49.380447 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98da3e79bd3a47369b2c6d41e0151470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.388015 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 98da3e79bd3a47369b2c6d41e0151470 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:49.389873 14348 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:49.398388 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98da3e79bd3a47369b2c6d41e0151470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.402598 14347 tablet_bootstrap.cc:654] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:49.406267 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:49.418015 14349 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:49.421845 14144 tablet_service.cc:1511] Processing CreateTablet for tablet 5c75fd8dc7cb4bdcb2456a29de8392e2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:49.423290 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c75fd8dc7cb4bdcb2456a29de8392e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.438606 14349 tablet_bootstrap.cc:654] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.439045 14348 tablet_bootstrap.cc:654] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.444312 14351 tablet_bootstrap.cc:492] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:49.455303 14347 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:49.456238 14347 ts_tablet_manager.cc:1403] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.002s
I20260709 13:19:49.455273 14351 tablet_bootstrap.cc:654] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.458549 14349 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:49.459231 14349 ts_tablet_manager.cc:1403] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.002s
I20260709 13:19:49.495333 14065 tablet_service.cc:1511] Processing CreateTablet for tablet 98da3e79bd3a47369b2c6d41e0151470 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:49.502048 14065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98da3e79bd3a47369b2c6d41e0151470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.496039 14142 tablet_service.cc:1511] Processing CreateTablet for tablet d6eb8dec8f80469e908bba7053af18a1 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:49.506234 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eb8dec8f80469e908bba7053af18a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.500329 14347 raft_consensus.cc:359] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.510957 14347 raft_consensus.cc:385] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.512109 14348 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:49.515488 14348 ts_tablet_manager.cc:1403] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.008s
I20260709 13:19:49.516676 14289 tablet_service.cc:1511] Processing CreateTablet for tablet d6eb8dec8f80469e908bba7053af18a1 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:49.518857 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eb8dec8f80469e908bba7053af18a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.522962 14066 tablet_service.cc:1511] Processing CreateTablet for tablet cfe3a7dffcb540448cbeba5e852c5d65 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:49.525234 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe3a7dffcb540448cbeba5e852c5d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.524993 14141 tablet_service.cc:1511] Processing CreateTablet for tablet cfe3a7dffcb540448cbeba5e852c5d65 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:49.527374 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe3a7dffcb540448cbeba5e852c5d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.536926 14214 tablet_service.cc:1511] Processing CreateTablet for tablet d6eb8dec8f80469e908bba7053af18a1 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:49.537714 14349 raft_consensus.cc:359] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:49.538652 14349 raft_consensus.cc:385] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.539029 14349 raft_consensus.cc:740] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.539613 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 19c67d33181e414897d5de3731e98030 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:49.541215 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c67d33181e414897d5de3731e98030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.514631 14347 raft_consensus.cc:740] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.541807 14216 tablet_service.cc:1511] Processing CreateTablet for tablet cfe3a7dffcb540448cbeba5e852c5d65 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:49.539165 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eb8dec8f80469e908bba7053af18a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.542599 14347 consensus_queue.cc:260] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.544559 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe3a7dffcb540448cbeba5e852c5d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.520915 14348 raft_consensus.cc:359] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.548575 14349 consensus_queue.cc:260] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:49.549582 14348 raft_consensus.cc:385] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.550066 14348 raft_consensus.cc:740] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.551363 14348 consensus_queue.cc:260] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.559141 14351 tablet_bootstrap.cc:492] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:49.560201 14351 ts_tablet_manager.cc:1403] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.116s	user 0.024s	sys 0.017s
I20260709 13:19:49.565562 14067 tablet_service.cc:1511] Processing CreateTablet for tablet 19c67d33181e414897d5de3731e98030 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:49.567768 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c67d33181e414897d5de3731e98030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.577037 14143 tablet_service.cc:1511] Processing CreateTablet for tablet 19c67d33181e414897d5de3731e98030 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:49.579804 14217 tablet_service.cc:1511] Processing CreateTablet for tablet 54b6e843913d4557bdaf57a2c7a21aa3 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:49.581252 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b6e843913d4557bdaf57a2c7a21aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.585510 14143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c67d33181e414897d5de3731e98030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.589658 14292 tablet_service.cc:1511] Processing CreateTablet for tablet 54b6e843913d4557bdaf57a2c7a21aa3 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:49.591259 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b6e843913d4557bdaf57a2c7a21aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.594978 14179 heartbeater.cc:499] Master 127.4.37.190:44771 was elected leader, sending a full tablet report...
I20260709 13:19:49.584595 14351 raft_consensus.cc:359] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:49.595994 14351 raft_consensus.cc:385] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.596320 14327 heartbeater.cc:499] Master 127.4.37.190:44771 was elected leader, sending a full tablet report...
I20260709 13:19:49.596370 14351 raft_consensus.cc:740] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.600621 14348 ts_tablet_manager.cc:1434] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.085s	user 0.011s	sys 0.000s
I20260709 13:19:49.606201 14349 ts_tablet_manager.cc:1434] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.147s	user 0.022s	sys 0.031s
I20260709 13:19:49.607406 14104 heartbeater.cc:499] Master 127.4.37.190:44771 was elected leader, sending a full tablet report...
I20260709 13:19:49.608227 14349 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:49.611554 14351 consensus_queue.cc:260] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:49.616398 14348 tablet_bootstrap.cc:492] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:49.618008 14356 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.618717 14356 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.624285 14356 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:49.635761 14068 tablet_service.cc:1511] Processing CreateTablet for tablet 54b6e843913d4557bdaf57a2c7a21aa3 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:49.639544 14068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b6e843913d4557bdaf57a2c7a21aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.644268 14348 tablet_bootstrap.cc:654] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.660683 14347 ts_tablet_manager.cc:1434] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.204s	user 0.008s	sys 0.019s
I20260709 13:19:49.662010 14347 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:49.674531 14253 heartbeater.cc:499] Master 127.4.37.190:44771 was elected leader, sending a full tablet report...
I20260709 13:19:49.679422 14144 tablet_service.cc:1511] Processing CreateTablet for tablet 86e0da4aaa5c4c88adc94081e83baaab (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:49.680056 14215 tablet_service.cc:1511] Processing CreateTablet for tablet 86e0da4aaa5c4c88adc94081e83baaab (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:49.680904 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e0da4aaa5c4c88adc94081e83baaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.682407 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 86e0da4aaa5c4c88adc94081e83baaab (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:49.683884 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e0da4aaa5c4c88adc94081e83baaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.683911 14069 tablet_service.cc:1511] Processing CreateTablet for tablet 43ffc24773ec4a9c9458d3cad9fc75ef (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:49.694371 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e0da4aaa5c4c88adc94081e83baaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.694566 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ffc24773ec4a9c9458d3cad9fc75ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:49.696571 14328 tablet.cc:2406] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:49.699975 14351 ts_tablet_manager.cc:1434] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.139s	user 0.021s	sys 0.006s
I20260709 13:19:49.711885 14351 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:49.702121 14349 tablet_bootstrap.cc:654] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.703195 14140 tablet_service.cc:1511] Processing CreateTablet for tablet 43ffc24773ec4a9c9458d3cad9fc75ef (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:49.713631 14140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ffc24773ec4a9c9458d3cad9fc75ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.707458 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 43ffc24773ec4a9c9458d3cad9fc75ef (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:49.724458 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:49.726948 14117 leader_election.cc:343] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.732089 14359 raft_consensus.cc:493] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.733162 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 96745973797345908d4d9937507add14 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:49.734849 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96745973797345908d4d9937507add14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.732964 14359 raft_consensus.cc:515] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:49.740187 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ffc24773ec4a9c9458d3cad9fc75ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.744787 14142 tablet_service.cc:1511] Processing CreateTablet for tablet 96745973797345908d4d9937507add14 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:49.747018 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96745973797345908d4d9937507add14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.752388 14347 tablet_bootstrap.cc:654] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.754104 14359 leader_election.cc:290] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:49.777498 14217 tablet_service.cc:1511] Processing CreateTablet for tablet 0138f6cda3ff43d2bce4723559454144 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:49.779681 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0138f6cda3ff43d2bce4723559454144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.781893 14065 tablet_service.cc:1511] Processing CreateTablet for tablet 0138f6cda3ff43d2bce4723559454144 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:49.744876 14066 tablet_service.cc:1511] Processing CreateTablet for tablet 96745973797345908d4d9937507add14 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:49.783308 14065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0138f6cda3ff43d2bce4723559454144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.784267 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96745973797345908d4d9937507add14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.776484 14292 tablet_service.cc:1511] Processing CreateTablet for tablet 0138f6cda3ff43d2bce4723559454144 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:49.801131 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0138f6cda3ff43d2bce4723559454144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.804373 14143 tablet_service.cc:1511] Processing CreateTablet for tablet 0d768389115849fca4a304f575143630 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:49.810760 14143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d768389115849fca4a304f575143630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.818463 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:49.820356 14119 leader_election.cc:343] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.820870 14119 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:49.821585 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 0d768389115849fca4a304f575143630 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:49.822149 14356 raft_consensus.cc:2749] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.823032 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d768389115849fca4a304f575143630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.824205 14349 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:49.824846 14349 ts_tablet_manager.cc:1403] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.217s	user 0.033s	sys 0.042s
I20260709 13:19:49.828387 14349 raft_consensus.cc:359] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.829173 14349 raft_consensus.cc:385] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.829475 14349 raft_consensus.cc:740] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.830279 14349 consensus_queue.cc:260] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.830528 14067 tablet_service.cc:1511] Processing CreateTablet for tablet c846d4120a61419aaa527e656bebee8f (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:49.832017 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c846d4120a61419aaa527e656bebee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.832664 14357 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.833168 14357 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.854183 14348 tablet_bootstrap.cc:492] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:49.854861 14348 ts_tablet_manager.cc:1403] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.239s	user 0.026s	sys 0.030s
I20260709 13:19:49.857023 14347 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:49.857793 14347 ts_tablet_manager.cc:1403] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.196s	user 0.014s	sys 0.003s
I20260709 13:19:49.858600 14348 raft_consensus.cc:359] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:49.859417 14348 raft_consensus.cc:385] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.859721 14348 raft_consensus.cc:740] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.861601 14349 ts_tablet_manager.cc:1434] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.036s	user 0.016s	sys 0.008s
I20260709 13:19:49.862816 14349 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:49.865507 14141 tablet_service.cc:1511] Processing CreateTablet for tablet c846d4120a61419aaa527e656bebee8f (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:49.867257 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c846d4120a61419aaa527e656bebee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.868633 14358 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.869230 14358 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:49.878613 14358 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:49.880853 14349 tablet_bootstrap.cc:654] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.844672 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 0d768389115849fca4a304f575143630 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:49.890628 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d768389115849fca4a304f575143630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.899453 14351 tablet_bootstrap.cc:654] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.905913 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:49.905615 14348 consensus_queue.cc:260] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:49.906833 14302 raft_consensus.cc:2468] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:49.908327 14348 ts_tablet_manager.cc:1434] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 13:19:49.908176 14213 tablet_service.cc:1511] Processing CreateTablet for tablet c846d4120a61419aaa527e656bebee8f (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:49.908608 14191 leader_election.cc:304] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:49.909833 14359 raft_consensus.cc:2804] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.910257 14359 raft_consensus.cc:493] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.910626 14359 raft_consensus.cc:3060] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.913266 14357 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:49.920171 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c846d4120a61419aaa527e656bebee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.920348 14348 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:49.927102 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7053b6fc124e37a58aab2689df06df (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:49.929028 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7053b6fc124e37a58aab2689df06df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.943133 14357 raft_consensus.cc:493] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.943732 14357 raft_consensus.cc:515] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:49.925937 14347 raft_consensus.cc:359] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:49.955204 14144 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7053b6fc124e37a58aab2689df06df (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:49.956969 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7053b6fc124e37a58aab2689df06df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.958348 14357 leader_election.cc:290] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:49.949234 14347 raft_consensus.cc:385] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.941154 14359 raft_consensus.cc:515] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:49.968848 14347 raft_consensus.cc:740] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.972493 14291 tablet_service.cc:1511] Processing CreateTablet for tablet c01be016235a423e80a9915aa6285945 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:49.975447 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01be016235a423e80a9915aa6285945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.982542 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:49.988441 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:49.992043 14194 leader_election.cc:343] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.994364 14347 consensus_queue.cc:260] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:49.996348 14069 tablet_service.cc:1511] Processing CreateTablet for tablet c01be016235a423e80a9915aa6285945 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:50.002079 14067 tablet_service.cc:1511] Processing CreateTablet for tablet 3e7053b6fc124e37a58aab2689df06df (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:50.002595 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:50.001822 14359 leader_election.cc:290] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
W20260709 13:19:50.004976 14194 leader_election.cc:343] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:50.006008 14042 leader_election.cc:343] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.006256 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:50.007827 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:50.009330 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01be016235a423e80a9915aa6285945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.996855 14347 ts_tablet_manager.cc:1434] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.139s	user 0.007s	sys 0.000s
W20260709 13:19:50.012425 14267 leader_election.cc:343] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.015292 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:50.034533 14268 leader_election.cc:343] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.037344 14268 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:19:50.035753 14042 leader_election.cc:343] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.039569 14358 raft_consensus.cc:2749] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.040597 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:50.041253 14302 raft_consensus.cc:3060] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.042910 14218 tablet_service.cc:1511] Processing CreateTablet for tablet c01be016235a423e80a9915aa6285945 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:50.044153 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01be016235a423e80a9915aa6285945. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.050966 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:50.051682 14154 raft_consensus.cc:2468] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:50.053547 14045 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:50.054911 14357 raft_consensus.cc:2804] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.055323 14357 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.055644 14357 raft_consensus.cc:3060] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.059600 14349 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:50.060211 14349 ts_tablet_manager.cc:1403] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.009s
I20260709 13:19:50.060381 14348 tablet_bootstrap.cc:654] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.050343 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e7053b6fc124e37a58aab2689df06df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.062623 14142 tablet_service.cc:1511] Processing CreateTablet for tablet 5b15bc48cf0e44b2aaaa1401be80044a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:50.064023 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b15bc48cf0e44b2aaaa1401be80044a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.063570 14349 raft_consensus.cc:359] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.069903 14349 raft_consensus.cc:385] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.069931 14347 tablet_bootstrap.cc:492] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:50.072743 14349 raft_consensus.cc:740] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.072052 14357 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.078939 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 5b15bc48cf0e44b2aaaa1401be80044a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:50.073803 14349 consensus_queue.cc:260] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.081028 14302 raft_consensus.cc:2468] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:50.081408 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b15bc48cf0e44b2aaaa1401be80044a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.084556 14351 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:50.082499 14191 leader_election.cc:304] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:50.085119 14351 ts_tablet_manager.cc:1403] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.373s	user 0.019s	sys 0.028s
I20260709 13:19:50.085464 14359 raft_consensus.cc:2804] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.088630 14351 raft_consensus.cc:359] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.089406 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:50.094216 14357 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:50.082522 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 5b15bc48cf0e44b2aaaa1401be80044a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 13:19:50.095445 14042 leader_election.cc:343] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.089387 14351 raft_consensus.cc:385] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.096745 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b15bc48cf0e44b2aaaa1401be80044a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.096935 14351 raft_consensus.cc:740] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.100804 14351 consensus_queue.cc:260] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.112813 14066 tablet_service.cc:1511] Processing CreateTablet for tablet 1250eb4ed6ed42629983aaf3f1af0994 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:50.113641 14348 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:50.114195 14348 ts_tablet_manager.cc:1403] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.205s	user 0.014s	sys 0.007s
I20260709 13:19:50.114377 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1250eb4ed6ed42629983aaf3f1af0994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.117079 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:50.118664 14154 raft_consensus.cc:3060] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.127249 14347 tablet_bootstrap.cc:654] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.131381 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:50.133659 14043 leader_election.cc:343] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.134400 14043 leader_election.cc:304] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:50.135219 14359 raft_consensus.cc:697] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:50.136364 14357 raft_consensus.cc:2749] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.136400 14359 consensus_queue.cc:237] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:50.139947 14141 tablet_service.cc:1511] Processing CreateTablet for tablet 1250eb4ed6ed42629983aaf3f1af0994 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:50.141438 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1250eb4ed6ed42629983aaf3f1af0994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.145509 14291 tablet_service.cc:1511] Processing CreateTablet for tablet bcbdfedd963a49c1b2da5553ac8ad00f (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:50.147519 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbdfedd963a49c1b2da5553ac8ad00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.117638 14348 raft_consensus.cc:359] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.149348 14348 raft_consensus.cc:385] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.149787 14348 raft_consensus.cc:740] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.149920 14217 tablet_service.cc:1511] Processing CreateTablet for tablet 1250eb4ed6ed42629983aaf3f1af0994 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:50.151907 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1250eb4ed6ed42629983aaf3f1af0994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.152577 14349 ts_tablet_manager.cc:1434] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.092s	user 0.000s	sys 0.010s
I20260709 13:19:50.162012 14349 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:50.166054 14348 consensus_queue.cc:260] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.183418 14351 ts_tablet_manager.cc:1434] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.098s	user 0.013s	sys 0.016s
I20260709 13:19:50.184878 14351 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:50.185519 14347 tablet_bootstrap.cc:492] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:50.185586 14067 tablet_service.cc:1511] Processing CreateTablet for tablet bcbdfedd963a49c1b2da5553ac8ad00f (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:50.186226 14347 ts_tablet_manager.cc:1403] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.117s	user 0.029s	sys 0.005s
I20260709 13:19:50.187114 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbdfedd963a49c1b2da5553ac8ad00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.186712 14142 tablet_service.cc:1511] Processing CreateTablet for tablet bcbdfedd963a49c1b2da5553ac8ad00f (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:50.190408 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbdfedd963a49c1b2da5553ac8ad00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.190770 14379 raft_consensus.cc:493] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.190932 14218 tablet_service.cc:1511] Processing CreateTablet for tablet e82c5d7cc48d49fe8a64eafb263bc10a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:50.191278 14379 raft_consensus.cc:515] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.192512 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82c5d7cc48d49fe8a64eafb263bc10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.191020 14348 ts_tablet_manager.cc:1434] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.077s	user 0.002s	sys 0.006s
I20260709 13:19:50.206121 14348 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:50.207551 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:50.208246 14079 raft_consensus.cc:2468] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:50.209750 14193 leader_election.cc:304] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:50.210986 14377 raft_consensus.cc:2804] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.211465 14377 raft_consensus.cc:493] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.211370 14347 raft_consensus.cc:359] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:50.211980 14377 raft_consensus.cc:3060] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.212334 14347 raft_consensus.cc:385] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.214818 14154 raft_consensus.cc:2468] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:50.215553 14289 tablet_service.cc:1511] Processing CreateTablet for tablet e82c5d7cc48d49fe8a64eafb263bc10a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:50.217108 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82c5d7cc48d49fe8a64eafb263bc10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.218210 14045 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:50.209293 14349 tablet_bootstrap.cc:654] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.219610 14376 raft_consensus.cc:2804] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.220142 14376 raft_consensus.cc:697] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:50.221028 14376 consensus_queue.cc:237] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.223815 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:50.225538 14194 leader_election.cc:343] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.226702 14379 leader_election.cc:290] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:50.225914 14348 tablet_bootstrap.cc:654] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.212821 14347 raft_consensus.cc:740] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.237592 14377 raft_consensus.cc:515] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.249065 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:50.249788 14079 raft_consensus.cc:3060] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.251657 14348 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:50.251174 14067 tablet_service.cc:1511] Processing CreateTablet for tablet e82c5d7cc48d49fe8a64eafb263bc10a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:50.252820 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82c5d7cc48d49fe8a64eafb263bc10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.258040 14348 ts_tablet_manager.cc:1403] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.008s
I20260709 13:19:50.252249 14347 consensus_queue.cc:260] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:50.260479 14351 tablet_bootstrap.cc:654] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.260926 13976 catalog_manager.cc:5697] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.263140 14348 raft_consensus.cc:359] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.267645 14348 raft_consensus.cc:385] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.267983 14348 raft_consensus.cc:740] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.271503 14349 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:50.271963 14347 ts_tablet_manager.cc:1434] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.001s
I20260709 13:19:50.272430 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:50.266363 13975 catalog_manager.cc:5697] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.273537 14348 consensus_queue.cc:260] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:19:50.274063 14194 leader_election.cc:343] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.270123 14377 leader_election.cc:290] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:50.282675 14349 ts_tablet_manager.cc:1403] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.007s
I20260709 13:19:50.283362 14141 tablet_service.cc:1511] Processing CreateTablet for tablet b1f9248d01a9496b9d1574466dc66d43 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:50.283576 14217 tablet_service.cc:1511] Processing CreateTablet for tablet b1f9248d01a9496b9d1574466dc66d43 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:50.285028 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f9248d01a9496b9d1574466dc66d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.286850 14348 ts_tablet_manager.cc:1434] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:19:50.286577 14349 raft_consensus.cc:359] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.287390 14349 raft_consensus.cc:385] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.287703 14349 raft_consensus.cc:740] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.288519 14349 consensus_queue.cc:260] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.289119 14347 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:50.285032 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f9248d01a9496b9d1574466dc66d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.291371 14349 ts_tablet_manager.cc:1434] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:50.292346 14079 raft_consensus.cc:2468] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:50.292683 14349 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:50.294206 14193 leader_election.cc:304] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:50.295593 14377 raft_consensus.cc:2804] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.296566 14377 raft_consensus.cc:697] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:50.297567 14377 consensus_queue.cc:237] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.302409 14067 tablet_service.cc:1511] Processing CreateTablet for tablet 3208eb99cabe427fa25a3cf07cafc865 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:50.305706 14349 tablet_bootstrap.cc:654] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.302647 14348 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:50.307132 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3208eb99cabe427fa25a3cf07cafc865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.307631 14142 tablet_service.cc:1511] Processing CreateTablet for tablet 3208eb99cabe427fa25a3cf07cafc865 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:50.318619 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3208eb99cabe427fa25a3cf07cafc865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.324730 14066 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2459c85ae6463580c794485b524d70 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:50.326330 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2459c85ae6463580c794485b524d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.312572 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 3208eb99cabe427fa25a3cf07cafc865 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:50.333261 14356 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.333874 14356 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.334352 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3208eb99cabe427fa25a3cf07cafc865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.337296 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:50.337627 14356 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:50.338371 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2459c85ae6463580c794485b524d70 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:50.339661 14348 tablet_bootstrap.cc:654] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:50.340296 14119 leader_election.cc:343] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.341514 14291 tablet_service.cc:1511] Processing CreateTablet for tablet b1f9248d01a9496b9d1574466dc66d43 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:50.345121 14347 tablet_bootstrap.cc:654] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.345619 14351 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:50.339707 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2459c85ae6463580c794485b524d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.351655 14351 ts_tablet_manager.cc:1403] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.167s	user 0.003s	sys 0.018s
I20260709 13:19:50.355183 14351 raft_consensus.cc:359] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.355954 14351 raft_consensus.cc:385] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.356258 14351 raft_consensus.cc:740] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.357093 14351 consensus_queue.cc:260] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.360921 14351 ts_tablet_manager.cc:1434] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:50.362079 14351 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:50.362658 14144 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2459c85ae6463580c794485b524d70 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:50.364154 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2459c85ae6463580c794485b524d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.368379 14351 tablet_bootstrap.cc:654] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.369395 14377 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.370025 14377 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.373451 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:50.375159 14193 leader_election.cc:343] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.377795 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:50.378579 14154 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:50.380121 14194 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:50.380342 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f9248d01a9496b9d1574466dc66d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.381146 14359 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.383653 14359 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.384130 14359 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.385480 14213 tablet_service.cc:1511] Processing CreateTablet for tablet bfe20916a56c44f6b30d4b2e7e7b3154 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:50.385602 14288 tablet_service.cc:1511] Processing CreateTablet for tablet bfe20916a56c44f6b30d4b2e7e7b3154 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:50.386900 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe20916a56c44f6b30d4b2e7e7b3154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.387748 14066 tablet_service.cc:1511] Processing CreateTablet for tablet bfe20916a56c44f6b30d4b2e7e7b3154 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:50.389057 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe20916a56c44f6b30d4b2e7e7b3154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.394228 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe20916a56c44f6b30d4b2e7e7b3154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.382068 14377 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:50.408720 14349 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:50.409385 14349 ts_tablet_manager.cc:1403] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.117s	user 0.003s	sys 0.011s
I20260709 13:19:50.411728 14141 tablet_service.cc:1511] Processing CreateTablet for tablet 1c886c57f4374a5891c9aa1df562c6d2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:50.437083 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 1c886c57f4374a5891c9aa1df562c6d2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:50.439155 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c886c57f4374a5891c9aa1df562c6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.438840 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 1c886c57f4374a5891c9aa1df562c6d2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:50.440852 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c886c57f4374a5891c9aa1df562c6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.449906 14069 tablet_service.cc:1511] Processing CreateTablet for tablet dba6d1f5edf24d9bb71332e66e60ff47 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:50.451128 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c886c57f4374a5891c9aa1df562c6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.451915 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba6d1f5edf24d9bb71332e66e60ff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.413021 14349 raft_consensus.cc:359] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.462814 14359 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.465628 14349 raft_consensus.cc:385] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.478447 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:50.478492 14376 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.479732 14376 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.482295 14376 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:50.483587 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:50.483856 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:50.484443 14302 raft_consensus.cc:2468] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
W20260709 13:19:50.485232 14045 leader_election.cc:343] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:50.482085 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:50.485833 14042 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:50.486796 14376 raft_consensus.cc:2804] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.487221 14376 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.487666 14376 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.490798 14347 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:50.491585 14347 ts_tablet_manager.cc:1403] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.218s	user 0.007s	sys 0.006s
I20260709 13:19:50.474285 14349 raft_consensus.cc:740] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.508533 14142 tablet_service.cc:1511] Processing CreateTablet for tablet dba6d1f5edf24d9bb71332e66e60ff47 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:50.510340 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba6d1f5edf24d9bb71332e66e60ff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.514726 14215 tablet_service.cc:1511] Processing CreateTablet for tablet dba6d1f5edf24d9bb71332e66e60ff47 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:50.516628 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba6d1f5edf24d9bb71332e66e60ff47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.531116 14154 raft_consensus.cc:3060] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.538102 14348 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:50.538883 14348 ts_tablet_manager.cc:1403] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.237s	user 0.017s	sys 0.036s
I20260709 13:19:50.542124 14359 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:50.542529 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:50.543376 14153 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.545009 14358 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.545739 14358 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.559887 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:50.559765 14347 raft_consensus.cc:359] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.560802 14347 raft_consensus.cc:385] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.561170 14347 raft_consensus.cc:740] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.563308 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:50.563585 14347 consensus_queue.cc:260] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.564244 14228 raft_consensus.cc:2393] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:50.566071 14347 ts_tablet_manager.cc:1434] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.074s	user 0.002s	sys 0.018s
I20260709 13:19:50.566056 14118 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:50.567374 14347 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:50.572264 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:50.572934 14351 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:50.573225 14152 raft_consensus.cc:2393] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:50.573787 14351 ts_tablet_manager.cc:1403] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.212s	user 0.044s	sys 0.056s
I20260709 13:19:50.575187 14268 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:50.576861 14358 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:50.577800 14358 raft_consensus.cc:3060] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.582666 14349 consensus_queue.cc:260] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.586661 14347 tablet_bootstrap.cc:654] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.598081 14079 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.602070 14153 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:50.606117 14079 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:50.637542 14357 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.612227 14359 consensus_queue.cc:1048] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:50.638077 14356 raft_consensus.cc:2749] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.638906 14194 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:50.638079 14357 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.615779 14358 raft_consensus.cc:2749] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.640093 14067 tablet_service.cc:1511] Processing CreateTablet for tablet 111880dc525744b486e22a9921476257 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:50.618505 14348 raft_consensus.cc:359] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.641213 14348 raft_consensus.cc:385] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.641561 14348 raft_consensus.cc:740] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.641860 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111880dc525744b486e22a9921476257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.642436 14348 consensus_queue.cc:260] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.644418 14359 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.645037 14359 raft_consensus.cc:697] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:50.644876 14348 ts_tablet_manager.cc:1434] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.001s
I20260709 13:19:50.648665 14348 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:50.645352 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:50.649585 14218 tablet_service.cc:1511] Processing CreateTablet for tablet d3c80f2afcca4b789590b8d372a3b3a5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:50.650161 14152 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:50.651026 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c80f2afcca4b789590b8d372a3b3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.651302 14292 tablet_service.cc:1511] Processing CreateTablet for tablet d3c80f2afcca4b789590b8d372a3b3a5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:50.651742 14045 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:50.652738 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c80f2afcca4b789590b8d372a3b3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.654076 14359 consensus_queue.cc:237] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.655334 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:50.654083 14357 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:50.656615 14347 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:50.658604 14347 ts_tablet_manager.cc:1403] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.014s
W20260709 13:19:50.636700 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 61649.7us
I20260709 13:19:50.607206 14351 raft_consensus.cc:359] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.661212 14351 raft_consensus.cc:385] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.661513 14348 tablet_bootstrap.cc:654] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.661636 14351 raft_consensus.cc:740] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.662611 14351 consensus_queue.cc:260] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.640663 14358 raft_consensus.cc:493] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.616487 14376 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.666155 14358 raft_consensus.cc:515] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.667852 14376 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:50.657255 14357 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:50.629837 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 111880dc525744b486e22a9921476257 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:50.671023 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111880dc525744b486e22a9921476257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.665199 14351 ts_tablet_manager.cc:1434] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.002s
I20260709 13:19:50.672820 14351 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:50.673615 14357 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.674028 14357 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.674758 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:50.675426 14302 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.675467 14358 leader_election.cc:290] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:50.676357 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:50.677031 14079 raft_consensus.cc:2468] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:50.677899 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:50.636545 14397 raft_consensus.cc:493] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.678390 14267 leader_election.cc:304] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:50.678929 13977 catalog_manager.cc:5697] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.680970 14397 raft_consensus.cc:515] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:50.683977 14358 raft_consensus.cc:2804] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.686335 14358 raft_consensus.cc:493] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.686861 14358 raft_consensus.cc:3060] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.676831 14347 raft_consensus.cc:359] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.692188 14347 raft_consensus.cc:385] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.695825 14347 raft_consensus.cc:740] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.695065 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:50.697919 14302 raft_consensus.cc:2468] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:50.699123 14042 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:50.700106 14359 consensus_queue.cc:1048] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.702600 14376 raft_consensus.cc:2804] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.703198 14376 raft_consensus.cc:697] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:50.704095 14376 consensus_queue.cc:237] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.705189 14349 ts_tablet_manager.cc:1434] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.295s	user 0.008s	sys 0.005s
I20260709 13:19:50.706801 14349 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:50.714241 14348 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:50.714901 14348 ts_tablet_manager.cc:1403] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.007s
I20260709 13:19:50.715797 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:50.717777 14117 leader_election.cc:304] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:50.696244 14351 tablet_bootstrap.cc:654] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.680346 14153 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.721037 14359 consensus_queue.cc:1048] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:50.724386 14142 tablet_service.cc:1511] Processing CreateTablet for tablet 111880dc525744b486e22a9921476257 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:50.745407 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:50.746331 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 111880dc525744b486e22a9921476257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.743965 14291 tablet_service.cc:1511] Processing CreateTablet for tablet a32ffa9a52c4465a98b4615f03092c27 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:50.725363 14397 leader_election.cc:290] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:50.725781 14069 tablet_service.cc:1511] Processing CreateTablet for tablet d3c80f2afcca4b789590b8d372a3b3a5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:50.729388 14356 raft_consensus.cc:2749] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:50.748363 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32ffa9a52c4465a98b4615f03092c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.750388 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3c80f2afcca4b789590b8d372a3b3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.742511 14141 tablet_service.cc:1511] Processing CreateTablet for tablet a32ffa9a52c4465a98b4615f03092c27 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:50.755008 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32ffa9a52c4465a98b4615f03092c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.757625 13977 catalog_manager.cc:5697] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.739724 14216 tablet_service.cc:1511] Processing CreateTablet for tablet a32ffa9a52c4465a98b4615f03092c27 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:50.746297 14228 raft_consensus.cc:2468] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:50.760542 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32ffa9a52c4465a98b4615f03092c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.756584 14351 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:50.734336 14348 raft_consensus.cc:359] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.765895 14348 raft_consensus.cc:385] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.766429 14348 raft_consensus.cc:740] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.767433 14348 consensus_queue.cc:260] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.765949 14351 ts_tablet_manager.cc:1403] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.004s
I20260709 13:19:50.705134 14347 consensus_queue.cc:260] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.783341 14347 ts_tablet_manager.cc:1434] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 13:19:50.783495 14399 consensus_queue.cc:1048] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:50.784468 14347 tablet_bootstrap.cc:492] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:50.792187 14348 ts_tablet_manager.cc:1434] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.003s
I20260709 13:19:50.797201 14351 raft_consensus.cc:359] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.798427 14351 raft_consensus.cc:385] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.798739 14351 raft_consensus.cc:740] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.799559 14351 consensus_queue.cc:260] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.801597 14358 raft_consensus.cc:515] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.804901 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:50.805636 14228 raft_consensus.cc:3060] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.808365 14349 tablet_bootstrap.cc:654] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.812750 14348 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:50.815853 14228 raft_consensus.cc:2468] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:50.817191 14347 tablet_bootstrap.cc:654] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.817456 14266 leader_election.cc:304] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:50.818569 14395 raft_consensus.cc:2804] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.819222 14066 tablet_service.cc:1511] Processing CreateTablet for tablet 1dca71eb8ab145ae99370ac00979d5e3 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:50.821054 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dca71eb8ab145ae99370ac00979d5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.826416 14153 raft_consensus.cc:2468] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:50.737251 14357 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:50.845175 14399 consensus_queue.cc:1048] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.870117 14395 raft_consensus.cc:697] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:50.890864 14144 tablet_service.cc:1511] Processing CreateTablet for tablet 1dca71eb8ab145ae99370ac00979d5e3 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:50.892467 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dca71eb8ab145ae99370ac00979d5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.893998 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:50.894285 14357 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:50.894704 14079 raft_consensus.cc:3060] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.898813 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:50.889079 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 1dca71eb8ab145ae99370ac00979d5e3 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:50.900023 14358 leader_election.cc:290] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:50.900589 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dca71eb8ab145ae99370ac00979d5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.904336 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:50.905025 14153 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.917716 14291 tablet_service.cc:1511] Processing CreateTablet for tablet c144f8c18cd84075a92d25a0250bb9e6 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:50.919198 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c144f8c18cd84075a92d25a0250bb9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.910938 14351 ts_tablet_manager.cc:1434] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.137s	user 0.013s	sys 0.013s
I20260709 13:19:50.926540 14079 raft_consensus.cc:2468] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:50.926287 14395 consensus_queue.cc:237] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.929100 14348 tablet_bootstrap.cc:654] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.934688 14347 tablet_bootstrap.cc:492] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:50.937611 14152 raft_consensus.cc:3060] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.940568 14218 tablet_service.cc:1511] Processing CreateTablet for tablet f971376cf118457b9be1708b9bee92f5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:50.942081 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f971376cf118457b9be1708b9bee92f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.945825 13974 catalog_manager.cc:5697] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.950739 14142 tablet_service.cc:1511] Processing CreateTablet for tablet c144f8c18cd84075a92d25a0250bb9e6 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:50.952613 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c144f8c18cd84075a92d25a0250bb9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.958621 14347 ts_tablet_manager.cc:1403] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.017s
I20260709 13:19:50.964383 14349 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:50.965014 14349 ts_tablet_manager.cc:1403] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.258s	user 0.024s	sys 0.044s
I20260709 13:19:50.965947 14351 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:50.945811 14069 tablet_service.cc:1511] Processing CreateTablet for tablet c144f8c18cd84075a92d25a0250bb9e6 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:50.971891 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c144f8c18cd84075a92d25a0250bb9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.973695 14292 tablet_service.cc:1511] Processing CreateTablet for tablet f971376cf118457b9be1708b9bee92f5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:50.973089 14349 raft_consensus.cc:359] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.975167 14349 raft_consensus.cc:385] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.975646 14349 raft_consensus.cc:740] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.976549 14349 consensus_queue.cc:260] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:50.979046 14349 ts_tablet_manager.cc:1434] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:19:50.975358 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f971376cf118457b9be1708b9bee92f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.992601 14066 tablet_service.cc:1511] Processing CreateTablet for tablet f971376cf118457b9be1708b9bee92f5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:50.994159 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f971376cf118457b9be1708b9bee92f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.981868 14153 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:19:50.989850 14358 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.997921 14358 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.018249 14045 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:51.019595 14376 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:51.020123 14376 raft_consensus.cc:697] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:51.021142 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:51.020985 14376 consensus_queue.cc:237] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.021922 14228 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:51.023444 14351 tablet_bootstrap.cc:654] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.023852 14266 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:51.024982 14416 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.025530 14416 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.025837 14349 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:51.026028 14416 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.028446 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:51.030001 14079 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:51.019783 14358 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:51.030861 14358 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.031327 14358 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:50.979553 14347 raft_consensus.cc:359] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:51.046711 14416 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.053994 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:51.054699 14228 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.059367 14358 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:51.061977 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:51.062399 14228 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:51.063612 14266 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:51.065173 14358 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.066015 14358 raft_consensus.cc:697] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
W20260709 13:19:51.067258 14267 leader_election.cc:343] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.066910 14358 consensus_queue.cc:237] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.037523 14347 raft_consensus.cc:385] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.068087 14347 raft_consensus.cc:740] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.067909 14218 tablet_service.cc:1511] Processing CreateTablet for tablet a2ed8864f59448b2a69c2bcddd26a98d (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:51.079701 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ed8864f59448b2a69c2bcddd26a98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.069612 14141 tablet_service.cc:1511] Processing CreateTablet for tablet a2ed8864f59448b2a69c2bcddd26a98d (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:51.071095 14289 tablet_service.cc:1511] Processing CreateTablet for tablet a2ed8864f59448b2a69c2bcddd26a98d (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:51.072647 14416 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:51.072894 14413 consensus_queue.cc:1048] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.091492 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ed8864f59448b2a69c2bcddd26a98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.073786 14397 raft_consensus.cc:493] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.092154 14397 raft_consensus.cc:515] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:51.075539 14067 tablet_service.cc:1511] Processing CreateTablet for tablet ef7edac8cddd4927a4d0c73332149e41 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:51.075707 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:51.097014 14079 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.080857 14349 tablet_bootstrap.cc:654] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.104733 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7edac8cddd4927a4d0c73332149e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.107163 14347 consensus_queue.cc:260] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:51.112373 14347 ts_tablet_manager.cc:1434] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.000s
I20260709 13:19:51.113575 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:51.121457 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ed8864f59448b2a69c2bcddd26a98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.105759 14397 leader_election.cc:290] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:51.121874 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:51.142771 14119 leader_election.cc:304] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:51.144467 14079 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:51.145005 14077 raft_consensus.cc:1240] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:51.147076 14411 consensus_queue.cc:1059] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.147886 14411 consensus_queue.cc:1243] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer ff2956d2be4d4ef98fdc5dc75bceff81 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:19:51.148412 14411 raft_consensus.cc:3055] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:51.148737 14411 raft_consensus.cc:740] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:51.153026 14142 tablet_service.cc:1511] Processing CreateTablet for tablet ef7edac8cddd4927a4d0c73332149e41 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:51.154975 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7edac8cddd4927a4d0c73332149e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.165879 14351 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:51.170236 14351 ts_tablet_manager.cc:1403] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.205s	user 0.012s	sys 0.007s
I20260709 13:19:51.172433 14153 raft_consensus.cc:1240] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:51.172619 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:51.175215 14218 tablet_service.cc:1511] Processing CreateTablet for tablet ef7edac8cddd4927a4d0c73332149e41 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:51.176592 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7edac8cddd4927a4d0c73332149e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.175238 14351 raft_consensus.cc:359] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.178398 14351 raft_consensus.cc:385] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.178707 14351 raft_consensus.cc:740] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.156035 14411 consensus_queue.cc:260] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.179364 14347 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:51.179697 14413 consensus_queue.cc:1059] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:51.189277 14268 leader_election.cc:343] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.190157 14268 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:51.192341 14411 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:51.193684 14428 raft_consensus.cc:2749] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.200413 13977 catalog_manager.cc:5697] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.185715 14351 consensus_queue.cc:260] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.198566 13976 catalog_manager.cc:5697] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.213569 14069 tablet_service.cc:1511] Processing CreateTablet for tablet 120b27990187463c8945db388e219f76 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:51.214934 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120b27990187463c8945db388e219f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.219050 14351 ts_tablet_manager.cc:1434] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 13:19:51.206508 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 120b27990187463c8945db388e219f76 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:51.207250 14349 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:51.220813 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120b27990187463c8945db388e219f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.222398 14351 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:51.209409 14347 tablet_bootstrap.cc:654] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.210063 14348 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:51.231307 14356 raft_consensus.cc:2749] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:51.230713 14141 tablet_service.cc:1511] Processing CreateTablet for tablet 120b27990187463c8945db388e219f76 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:51.227515 14349 ts_tablet_manager.cc:1403] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.211s	user 0.023s	sys 0.003s
I20260709 13:19:51.242843 14397 raft_consensus.cc:493] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.245467 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120b27990187463c8945db388e219f76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.250706 14397 raft_consensus.cc:515] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:51.252884 14397 leader_election.cc:290] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:51.252629 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 0217d8525e174f758cfd48c0a04a7caf (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:51.253973 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0217d8525e174f758cfd48c0a04a7caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.254568 14377 raft_consensus.cc:493] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.255049 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb8dec8f80469e908bba7053af18a1" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:51.255224 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb8dec8f80469e908bba7053af18a1" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:51.256675 14377 raft_consensus.cc:515] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:19:51.270751 14118 leader_election.cc:343] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.271641 14117 leader_election.cc:343] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.272096 14117 leader_election.cc:304] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:51.273336 14397 raft_consensus.cc:2749] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.274129 13973 catalog_manager.cc:5697] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.275691 14377 leader_election.cc:290] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:51.277944 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:51.279954 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:51.281574 14193 leader_election.cc:343] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.289310 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 6d03691b876d4eeb969dcd24d00ddfa2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:51.291344 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d03691b876d4eeb969dcd24d00ddfa2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:51.293788 14191 leader_election.cc:343] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.294193 14141 tablet_service.cc:1511] Processing CreateTablet for tablet 6d03691b876d4eeb969dcd24d00ddfa2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:51.295511 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d03691b876d4eeb969dcd24d00ddfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.296674 14142 tablet_service.cc:1511] Processing CreateTablet for tablet 5a072b7409604f1eae201822e47a6088 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:51.297911 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a072b7409604f1eae201822e47a6088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.283344 14292 tablet_service.cc:1511] Processing CreateTablet for tablet 0217d8525e174f758cfd48c0a04a7caf (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:51.299355 14292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0217d8525e174f758cfd48c0a04a7caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.297089 14191 leader_election.cc:304] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:51.302564 14377 raft_consensus.cc:2749] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.281369 14349 raft_consensus.cc:359] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.306921 14349 raft_consensus.cc:385] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.307430 14349 raft_consensus.cc:740] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.308702 14349 consensus_queue.cc:260] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.311815 14218 tablet_service.cc:1511] Processing CreateTablet for tablet 5a072b7409604f1eae201822e47a6088 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:51.314091 14067 tablet_service.cc:1511] Processing CreateTablet for tablet 0217d8525e174f758cfd48c0a04a7caf (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:51.339804 14351 tablet_bootstrap.cc:654] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.340131 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0217d8525e174f758cfd48c0a04a7caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.318135 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 40e2f1ef94db448c8f64eafba0ddb66a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:51.341177 14217 tablet_service.cc:1511] Processing CreateTablet for tablet e920394df0034e98ab19842b8206bbb5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:51.318204 14066 tablet_service.cc:1511] Processing CreateTablet for tablet 5a072b7409604f1eae201822e47a6088 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:51.340131 14218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a072b7409604f1eae201822e47a6088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.343078 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a072b7409604f1eae201822e47a6088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.343276 14288 tablet_service.cc:1511] Processing CreateTablet for tablet e920394df0034e98ab19842b8206bbb5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:51.322747 14065 tablet_service.cc:1511] Processing CreateTablet for tablet 40e2f1ef94db448c8f64eafba0ddb66a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:51.346599 14065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e2f1ef94db448c8f64eafba0ddb66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.346807 14064 tablet_service.cc:1511] Processing CreateTablet for tablet 9b85e799338444779dcc24b7b8ee9a1e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:51.347911 14141 tablet_service.cc:1511] Processing CreateTablet for tablet 9b85e799338444779dcc24b7b8ee9a1e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:51.323151 14144 tablet_service.cc:1511] Processing CreateTablet for tablet 40e2f1ef94db448c8f64eafba0ddb66a (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:51.349561 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b85e799338444779dcc24b7b8ee9a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.256377 14348 ts_tablet_manager.cc:1403] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.444s	user 0.041s	sys 0.012s
I20260709 13:19:51.323520 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 6d03691b876d4eeb969dcd24d00ddfa2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:51.327044 14215 tablet_service.cc:1511] Processing CreateTablet for tablet c56ca0f27ffe4236ba41dc9e1e765cf4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:51.355315 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56ca0f27ffe4236ba41dc9e1e765cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.328085 14399 consensus_queue.cc:1048] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.359237 14287 tablet_service.cc:1511] Processing CreateTablet for tablet bd3dbbe44a364ffb8dfefce3315273ad (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:51.359436 14213 tablet_service.cc:1511] Processing CreateTablet for tablet 9b85e799338444779dcc24b7b8ee9a1e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:51.360792 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b85e799338444779dcc24b7b8ee9a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.330911 14290 tablet_service.cc:1511] Processing CreateTablet for tablet c56ca0f27ffe4236ba41dc9e1e765cf4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:51.361956 14063 tablet_service.cc:1511] Processing CreateTablet for tablet bd3dbbe44a364ffb8dfefce3315273ad (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:51.363420 14063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3dbbe44a364ffb8dfefce3315273ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.333726 14428 consensus_queue.cc:1048] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.335357 14068 tablet_service.cc:1511] Processing CreateTablet for tablet c56ca0f27ffe4236ba41dc9e1e765cf4 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:51.365041 14068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56ca0f27ffe4236ba41dc9e1e765cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.367190 14357 consensus_queue.cc:1048] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.337796 14142 tablet_service.cc:1511] Processing CreateTablet for tablet e920394df0034e98ab19842b8206bbb5 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:51.370956 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e920394df0034e98ab19842b8206bbb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.342267 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e2f1ef94db448c8f64eafba0ddb66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.378438 14348 raft_consensus.cc:359] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.379268 14348 raft_consensus.cc:385] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.379575 14348 raft_consensus.cc:740] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.382591 14143 tablet_service.cc:1511] Processing CreateTablet for tablet bd3dbbe44a364ffb8dfefce3315273ad (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:51.384447 14143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3dbbe44a364ffb8dfefce3315273ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.393842 14348 consensus_queue.cc:260] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.407361 14349 ts_tablet_manager.cc:1434] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.162s	user 0.008s	sys 0.000s
I20260709 13:19:51.408959 14349 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:51.408669 14214 tablet_service.cc:1511] Processing CreateTablet for tablet 81c21d80fe34435a9dc4b1435f136941 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:51.409943 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e920394df0034e98ab19842b8206bbb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.410733 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c21d80fe34435a9dc4b1435f136941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.413929 14217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e920394df0034e98ab19842b8206bbb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.414240 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3dbbe44a364ffb8dfefce3315273ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.416242 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56ca0f27ffe4236ba41dc9e1e765cf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.413929 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40e2f1ef94db448c8f64eafba0ddb66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.421939 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d03691b876d4eeb969dcd24d00ddfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.397400 14348 ts_tablet_manager.cc:1434] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
I20260709 13:19:51.442716 14348 tablet_bootstrap.cc:492] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:51.446027 14064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b85e799338444779dcc24b7b8ee9a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.479714 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 81c21d80fe34435a9dc4b1435f136941 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:51.480983 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c21d80fe34435a9dc4b1435f136941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.485991 14348 tablet_bootstrap.cc:654] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.487841 14349 tablet_bootstrap.cc:654] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:51.519142 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:51.519414 14347 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:51.520013 14347 ts_tablet_manager.cc:1403] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.341s	user 0.042s	sys 0.058s
I20260709 13:19:51.537060 14142 tablet_service.cc:1511] Processing CreateTablet for tablet b06e3182ee5d4798b9145b000d822462 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:51.538393 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06e3182ee5d4798b9145b000d822462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.543879 14154 raft_consensus.cc:1275] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:51.543900 14215 tablet_service.cc:1511] Processing CreateTablet for tablet b06e3182ee5d4798b9145b000d822462 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:51.545310 14351 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:51.545542 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06e3182ee5d4798b9145b000d822462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.545913 14351 ts_tablet_manager.cc:1403] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.324s	user 0.015s	sys 0.009s
I20260709 13:19:51.544613 14395 consensus_queue.cc:1048] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:51.548230 14395 consensus_queue.cc:1048] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.567251 14357 consensus_queue.cc:1048] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:19:51.599164 14349 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:51.599749 14349 ts_tablet_manager.cc:1403] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.009s
I20260709 13:19:51.608498 14228 raft_consensus.cc:1275] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:19:51.608951 14228 pending_rounds.cc:85] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: Aborting all ops after (but not including) 0
I20260709 13:19:51.609195 14228 pending_rounds.cc:107] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:19:51.619067 14228 raft_consensus.cc:2889] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.619354 14063 tablet_service.cc:1511] Processing CreateTablet for tablet 81c21d80fe34435a9dc4b1435f136941 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:51.620764 14063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c21d80fe34435a9dc4b1435f136941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.620982 14348 tablet_bootstrap.cc:492] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:51.621517 14348 ts_tablet_manager.cc:1403] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.179s	user 0.019s	sys 0.012s
I20260709 13:19:51.621294 14440 consensus_queue.cc:1048] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.622246 14428 consensus_queue.cc:1048] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:51.595932 14045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 45514.1us
I20260709 13:19:51.611584 14288 tablet_service.cc:1511] Processing CreateTablet for tablet b06e3182ee5d4798b9145b000d822462 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:51.613368 14216 tablet_service.cc:1511] Processing CreateTablet for tablet a36d26da58624e63adb52d3539d9bf33 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:51.617656 14349 raft_consensus.cc:359] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:51.627594 14349 raft_consensus.cc:385] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.628043 14349 raft_consensus.cc:740] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.555787 14347 raft_consensus.cc:359] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:51.549336 14351 raft_consensus.cc:359] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.641294 14348 raft_consensus.cc:359] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:51.642550 14348 raft_consensus.cc:385] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.642928 14348 raft_consensus.cc:740] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.643376 14351 raft_consensus.cc:385] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.643750 14351 raft_consensus.cc:740] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.644524 14351 consensus_queue.cc:260] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.646196 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36d26da58624e63adb52d3539d9bf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.648919 14349 consensus_queue.cc:260] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:51.653385 14348 consensus_queue.cc:260] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:51.655758 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06e3182ee5d4798b9145b000d822462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.656376 14064 tablet_service.cc:1511] Processing CreateTablet for tablet a36d26da58624e63adb52d3539d9bf33 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:51.660866 14291 tablet_service.cc:1511] Processing CreateTablet for tablet fcd37714ddc243ad88669511b6e6b4d2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:51.662504 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd37714ddc243ad88669511b6e6b4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.638188 14347 raft_consensus.cc:385] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.651028 14399 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.673512 14349 ts_tablet_manager.cc:1434] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.003s
I20260709 13:19:51.675225 14349 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:51.682539 14348 ts_tablet_manager.cc:1434] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:19:51.685572 14348 tablet_bootstrap.cc:492] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:51.682103 14064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36d26da58624e63adb52d3539d9bf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.669736 14347 raft_consensus.cc:740] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.698069 14347 consensus_queue.cc:260] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:51.700632 14347 ts_tablet_manager.cc:1434] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.180s	user 0.018s	sys 0.014s
I20260709 13:19:51.702575 14065 tablet_service.cc:1511] Processing CreateTablet for tablet fcd37714ddc243ad88669511b6e6b4d2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:51.704051 14065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd37714ddc243ad88669511b6e6b4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.704826 14347 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:51.697974 14351 ts_tablet_manager.cc:1434] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.152s	user 0.009s	sys 0.000s
I20260709 13:19:51.714468 14351 tablet_bootstrap.cc:492] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:51.714865 14347 tablet_bootstrap.cc:654] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.716560 14291 tablet_service.cc:1511] Processing CreateTablet for tablet 2412bd2aec3744b69d4fa16d6b96ed3d (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:51.719204 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2412bd2aec3744b69d4fa16d6b96ed3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.724040 14349 tablet_bootstrap.cc:654] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.729938 14144 tablet_service.cc:1511] Processing CreateTablet for tablet a36d26da58624e63adb52d3539d9bf33 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:51.719336 14440 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.733954 14440 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:51.685256 14399 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.746325 14440 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:51.772264 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:51.773109 14301 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:51.775799 14214 tablet_service.cc:1511] Processing CreateTablet for tablet 2412bd2aec3744b69d4fa16d6b96ed3d (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:51.776150 14066 tablet_service.cc:1511] Processing CreateTablet for tablet 2412bd2aec3744b69d4fa16d6b96ed3d (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:51.776669 14351 tablet_bootstrap.cc:654] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.777190 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2412bd2aec3744b69d4fa16d6b96ed3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.771175 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:51.778009 14154 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:51.785503 14216 tablet_service.cc:1511] Processing CreateTablet for tablet cb22a4f3e09e401296389c126d11edc0 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:51.790201 14067 tablet_service.cc:1511] Processing CreateTablet for tablet 70960d884ffe4de7a2aad3cf1a1c687e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:51.791584 14067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70960d884ffe4de7a2aad3cf1a1c687e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.758746 14143 tablet_service.cc:1511] Processing CreateTablet for tablet fcd37714ddc243ad88669511b6e6b4d2 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:51.770298 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36d26da58624e63adb52d3539d9bf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.799574 14349 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:51.800228 14349 ts_tablet_manager.cc:1403] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.011s
I20260709 13:19:51.804096 14287 tablet_service.cc:1511] Processing CreateTablet for tablet cb22a4f3e09e401296389c126d11edc0 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:51.803473 14349 raft_consensus.cc:359] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.810861 14042 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:51.810488 14349 raft_consensus.cc:385] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.813341 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:51.814076 14349 raft_consensus.cc:740] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.815085 14376 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.815518 14376 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.815851 14376 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.816588 14142 tablet_service.cc:1511] Processing CreateTablet for tablet cb22a4f3e09e401296389c126d11edc0 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:51.813786 14143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd37714ddc243ad88669511b6e6b4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.817826 14395 raft_consensus.cc:493] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.818020 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb22a4f3e09e401296389c126d11edc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.818392 14395 raft_consensus.cc:515] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.820537 14395 leader_election.cc:290] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:51.820719 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:51.821481 14228 raft_consensus.cc:2468] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:51.812674 14348 tablet_bootstrap.cc:654] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.794428 14399 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:51.777204 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2412bd2aec3744b69d4fa16d6b96ed3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.825150 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb22a4f3e09e401296389c126d11edc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.825695 14349 consensus_queue.cc:260] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.835089 14043 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:51.835304 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:51.835762 14045 leader_election.cc:343] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.835948 14228 raft_consensus.cc:2468] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:51.838924 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:51.839360 14141 tablet_service.cc:1511] Processing CreateTablet for tablet 70960d884ffe4de7a2aad3cf1a1c687e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:51.839654 14077 raft_consensus.cc:2468] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:51.840627 14141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70960d884ffe4de7a2aad3cf1a1c687e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.841585 14267 leader_election.cc:304] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:51.827154 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb22a4f3e09e401296389c126d11edc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.842206 14215 tablet_service.cc:1511] Processing CreateTablet for tablet 70960d884ffe4de7a2aad3cf1a1c687e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:51.843221 14395 raft_consensus.cc:2804] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.846138 14215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70960d884ffe4de7a2aad3cf1a1c687e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.846227 14395 raft_consensus.cc:493] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.846517 14347 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:51.846746 14395 raft_consensus.cc:3060] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.847008 14347 ts_tablet_manager.cc:1403] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.019s
I20260709 13:19:51.850037 14347 raft_consensus.cc:359] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.850749 14347 raft_consensus.cc:385] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.851011 14347 raft_consensus.cc:740] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.852650 14357 raft_consensus.cc:2804] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.853097 14357 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.854085 14357 raft_consensus.cc:3060] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.871387 14288 tablet_service.cc:1511] Processing CreateTablet for tablet 944276202aa94d11a0203aa2291a9692 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:51.872792 14349 ts_tablet_manager.cc:1434] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.007s
I20260709 13:19:51.875250 14066 tablet_service.cc:1511] Processing CreateTablet for tablet 944276202aa94d11a0203aa2291a9692 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:51.875831 14216 tablet_service.cc:1511] Processing CreateTablet for tablet a8f3cee515a2410aaf0a7767f0d6587e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:51.876299 14349 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:51.876495 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944276202aa94d11a0203aa2291a9692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.876955 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f3cee515a2410aaf0a7767f0d6587e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.873010 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944276202aa94d11a0203aa2291a9692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.872023 14347 consensus_queue.cc:260] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.885254 14397 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.885793 14397 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.891531 14349 tablet_bootstrap.cc:654] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.897018 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:51.893922 14397 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:51.895330 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:51.898182 14228 raft_consensus.cc:2468] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:51.899613 14118 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:51.900758 14397 raft_consensus.cc:2804] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.901221 14397 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.901635 14397 raft_consensus.cc:3060] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.902400 14395 raft_consensus.cc:515] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:51.905495 14395 leader_election.cc:290] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:51.905826 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:51.906448 14228 raft_consensus.cc:3060] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.907080 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:51.907997 14079 raft_consensus.cc:3060] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.875113 14351 tablet_bootstrap.cc:492] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:51.913007 14351 ts_tablet_manager.cc:1403] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.000s
I20260709 13:19:51.922582 14376 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:51.925024 14376 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:51.927150 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:51.927866 14301 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.933648 14351 raft_consensus.cc:359] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:51.934640 14351 raft_consensus.cc:385] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.934934 14351 raft_consensus.cc:740] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.938267 14357 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:51.939656 14069 tablet_service.cc:1511] Processing CreateTablet for tablet a8f3cee515a2410aaf0a7767f0d6587e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:51.941154 14291 tablet_service.cc:1511] Processing CreateTablet for tablet a8f3cee515a2410aaf0a7767f0d6587e (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:51.944303 14291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f3cee515a2410aaf0a7767f0d6587e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.945076 14077 raft_consensus.cc:2393] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:51.876163 14142 tablet_service.cc:1511] Processing CreateTablet for tablet 944276202aa94d11a0203aa2291a9692 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:51.946985 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 944276202aa94d11a0203aa2291a9692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.944324 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8f3cee515a2410aaf0a7767f0d6587e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.952416 14351 consensus_queue.cc:260] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:51.953115 14079 raft_consensus.cc:2468] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:51.956735 14214 tablet_service.cc:1511] Processing CreateTablet for tablet fad1a0487508442287b6c802b75bc409 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:51.959228 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:51.959936 14226 raft_consensus.cc:3060] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.960196 14357 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:51.953325 14228 raft_consensus.cc:2468] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:51.954017 14301 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:51.958290 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad1a0487508442287b6c802b75bc409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.973201 14351 ts_tablet_manager.cc:1434] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:19:51.973770 14290 tablet_service.cc:1511] Processing CreateTablet for tablet fad1a0487508442287b6c802b75bc409 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:51.974395 14351 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:51.975129 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad1a0487508442287b6c802b75bc409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.977564 14267 leader_election.cc:304] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:51.986054 14395 raft_consensus.cc:2804] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.998442 14068 tablet_service.cc:1511] Processing CreateTablet for tablet 4be55c8ee09443479786b8bf51188b81 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:51.999897 14068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be55c8ee09443479786b8bf51188b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:51.999501 14397 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.002692 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 4be55c8ee09443479786b8bf51188b81 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:52.002918 14289 tablet_service.cc:1511] Processing CreateTablet for tablet 03bef24cb5de488fa1610fa18979e0bb (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:52.003989 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be55c8ee09443479786b8bf51188b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.004180 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bef24cb5de488fa1610fa18979e0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.006453 14347 ts_tablet_manager.cc:1434] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.159s	user 0.009s	sys 0.000s
I20260709 13:19:52.007531 14347 tablet_bootstrap.cc:492] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:51.992305 14042 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:52.011842 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:52.012809 14079 raft_consensus.cc:2393] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:52.013653 14395 raft_consensus.cc:697] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:52.014936 14376 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.015507 14376 raft_consensus.cc:697] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:52.016062 14348 tablet_bootstrap.cc:492] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:52.016352 14376 consensus_queue.cc:237] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.014600 14395 consensus_queue.cc:237] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.016693 14348 ts_tablet_manager.cc:1403] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.332s	user 0.007s	sys 0.020s
I20260709 13:19:52.022497 14348 raft_consensus.cc:359] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.026587 14348 raft_consensus.cc:385] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.026907 14348 raft_consensus.cc:740] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.027254 14351 tablet_bootstrap.cc:654] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.027725 14348 consensus_queue.cc:260] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.037169 14397 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:19:51.995904 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 95121us
I20260709 13:19:52.058069 14226 raft_consensus.cc:2468] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:52.059885 14349 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:52.060508 14043 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:52.058265 14069 tablet_service.cc:1511] Processing CreateTablet for tablet 03bef24cb5de488fa1610fa18979e0bb (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:52.061589 14357 raft_consensus.cc:2804] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.062233 14357 raft_consensus.cc:697] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:52.062732 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bef24cb5de488fa1610fa18979e0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.063073 14347 tablet_bootstrap.cc:654] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.063099 14357 consensus_queue.cc:237] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.060518 14349 ts_tablet_manager.cc:1403] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.184s	user 0.019s	sys 0.014s
I20260709 13:19:52.069015 14348 ts_tablet_manager.cc:1434] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:19:52.078112 14348 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:52.086669 14416 raft_consensus.cc:493] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.087505 14416 raft_consensus.cc:515] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.088265 14351 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.088694 14351 ts_tablet_manager.cc:1403] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.115s	user 0.005s	sys 0.009s
I20260709 13:19:52.091816 14351 raft_consensus.cc:359] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.092548 14351 raft_consensus.cc:385] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.092787 14351 raft_consensus.cc:740] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.095459 14351 consensus_queue.cc:260] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.091496 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:52.110196 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:52.109604 13975 catalog_manager.cc:5697] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.110966 14154 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.111667 14144 tablet_service.cc:1511] Processing CreateTablet for tablet 03bef24cb5de488fa1610fa18979e0bb (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:52.109709 14143 tablet_service.cc:1511] Processing CreateTablet for tablet fad1a0487508442287b6c802b75bc409 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:52.112524 14216 tablet_service.cc:1511] Processing CreateTablet for tablet 50a70b817b674bd197cdb804bcf25840 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:52.110580 14142 tablet_service.cc:1511] Processing CreateTablet for tablet 4be55c8ee09443479786b8bf51188b81 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:52.113723 14216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a70b817b674bd197cdb804bcf25840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.112843 14144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bef24cb5de488fa1610fa18979e0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.121023 14226 raft_consensus.cc:2393] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:52.123327 14416 leader_election.cc:290] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:52.124643 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0da4aaa5c4c88adc94081e83baaab" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:52.126933 14266 leader_election.cc:343] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.125067 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0da4aaa5c4c88adc94081e83baaab" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:52.129662 14268 leader_election.cc:343] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.130311 14268 leader_election.cc:304] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:52.132272 14416 raft_consensus.cc:2749] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.138872 14349 raft_consensus.cc:359] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.148312 14349 raft_consensus.cc:385] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.148842 14349 raft_consensus.cc:740] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.150043 14349 consensus_queue.cc:260] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.152555 14349 ts_tablet_manager.cc:1434] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.084s	user 0.001s	sys 0.005s
I20260709 13:19:52.153149 14416 raft_consensus.cc:493] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.154217 14349 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:52.153977 14416 raft_consensus.cc:515] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.155555 14069 tablet_service.cc:1511] Processing CreateTablet for tablet 50a70b817b674bd197cdb804bcf25840 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:52.156450 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:52.156896 14069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a70b817b674bd197cdb804bcf25840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.157362 14152 raft_consensus.cc:2393] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:19:52.158000 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb8dec8f80469e908bba7053af18a1" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:52.158937 14153 raft_consensus.cc:2468] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:52.160794 14268 leader_election.cc:304] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:52.162055 14118 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:52.163228 14397 raft_consensus.cc:2749] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.146214 14351 ts_tablet_manager.cc:1434] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:19:52.162110 14395 raft_consensus.cc:2804] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.164799 14395 raft_consensus.cc:493] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.143679 13977 catalog_manager.cc:5697] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.165275 14395 raft_consensus.cc:3060] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.165477 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb8dec8f80469e908bba7053af18a1" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:52.166409 14226 raft_consensus.cc:2468] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:52.165256 14416 leader_election.cc:290] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:52.171505 14351 tablet_bootstrap.cc:492] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.168324 14154 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:52.186252 14347 tablet_bootstrap.cc:492] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:52.187108 14347 ts_tablet_manager.cc:1403] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.029s
W20260709 13:19:52.188915 13961 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 82002.2us
I20260709 13:19:52.191020 14347 raft_consensus.cc:359] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.191812 14143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad1a0487508442287b6c802b75bc409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.191980 14347 raft_consensus.cc:385] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.192497 14347 raft_consensus.cc:740] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.193699 14351 tablet_bootstrap.cc:654] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.194010 14142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be55c8ee09443479786b8bf51188b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.194996 14347 consensus_queue.cc:260] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.200644 14348 tablet_bootstrap.cc:654] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.179872 14395 raft_consensus.cc:515] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.209045 14395 leader_election.cc:290] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:52.209991 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb8dec8f80469e908bba7053af18a1" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:52.212348 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb8dec8f80469e908bba7053af18a1" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:52.213011 14226 raft_consensus.cc:3060] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.219321 14349 tablet_bootstrap.cc:654] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.219182 14290 tablet_service.cc:1511] Processing CreateTablet for tablet 50a70b817b674bd197cdb804bcf25840 (DEFAULT_TABLE table=test-workload [id=4fb22e848fa5432c806a00069598f698]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:52.220651 14290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a70b817b674bd197cdb804bcf25840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:52.224560 14347 ts_tablet_manager.cc:1434] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 13:19:52.225776 14347 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:52.210682 14154 raft_consensus.cc:3060] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.235419 14347 tablet_bootstrap.cc:654] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.243126 14226 raft_consensus.cc:2468] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:52.245466 14266 leader_election.cc:304] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:52.246408 14349 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:52.247092 14349 ts_tablet_manager.cc:1403] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.002s
I20260709 13:19:52.250250 14416 raft_consensus.cc:2804] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.250928 14416 raft_consensus.cc:697] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:52.250775 14349 raft_consensus.cc:359] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.251567 14349 raft_consensus.cc:385] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.251878 14349 raft_consensus.cc:740] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.251950 14416 consensus_queue.cc:237] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.252815 14349 consensus_queue.cc:260] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.255323 14349 ts_tablet_manager.cc:1434] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:52.256583 14349 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:52.261718 14351 tablet_bootstrap.cc:492] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.262109 14154 raft_consensus.cc:2468] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:52.262334 14351 ts_tablet_manager.cc:1403] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.005s
I20260709 13:19:52.264360 14348 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:52.264904 14348 ts_tablet_manager.cc:1403] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.012s
I20260709 13:19:52.267732 14351 raft_consensus.cc:359] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.268508 14351 raft_consensus.cc:385] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.268791 14351 raft_consensus.cc:740] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.269686 14351 consensus_queue.cc:260] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.271556 14349 tablet_bootstrap.cc:654] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.276942 14351 ts_tablet_manager.cc:1434] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:19:52.276403 14348 raft_consensus.cc:359] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.278273 14348 raft_consensus.cc:385] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.278339 14351 tablet_bootstrap.cc:492] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.278816 14348 raft_consensus.cc:740] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.280117 14347 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:52.279770 14348 consensus_queue.cc:260] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.280123 14349 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:52.280699 14347 ts_tablet_manager.cc:1403] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.004s
I20260709 13:19:52.281288 14349 ts_tablet_manager.cc:1403] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.002s
I20260709 13:19:52.282748 14348 ts_tablet_manager.cc:1434] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:19:52.283926 14348 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:52.284091 14347 raft_consensus.cc:359] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.284859 14347 raft_consensus.cc:385] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.284602 14349 raft_consensus.cc:359] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.285254 14351 tablet_bootstrap.cc:654] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.285585 14349 raft_consensus.cc:385] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.286046 14349 raft_consensus.cc:740] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.285243 14347 raft_consensus.cc:740] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.286988 14349 consensus_queue.cc:260] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.291739 14349 ts_tablet_manager.cc:1434] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:19:52.292893 14349 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:52.294759 14348 tablet_bootstrap.cc:654] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.299944 14349 tablet_bootstrap.cc:654] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.290701 14347 consensus_queue.cc:260] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.306725 14347 ts_tablet_manager.cc:1434] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:19:52.307816 14347 tablet_bootstrap.cc:492] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:52.314200 14351 tablet_bootstrap.cc:492] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.314790 14351 ts_tablet_manager.cc:1403] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.003s
I20260709 13:19:52.319056 14351 raft_consensus.cc:359] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.319813 14351 raft_consensus.cc:385] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.320080 14351 raft_consensus.cc:740] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.323645 14397 raft_consensus.cc:493] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.323858 14351 consensus_queue.cc:260] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.324234 14397 raft_consensus.cc:515] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.326447 14397 leader_election.cc:290] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:52.326860 14347 tablet_bootstrap.cc:654] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.328642 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0da4aaa5c4c88adc94081e83baaab" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:52.329088 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0da4aaa5c4c88adc94081e83baaab" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:52.329386 14226 raft_consensus.cc:2468] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:52.329785 14301 raft_consensus.cc:2468] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:52.330844 14118 leader_election.cc:304] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:52.331707 14397 raft_consensus.cc:2804] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.332072 14397 raft_consensus.cc:493] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.332392 14397 raft_consensus.cc:3060] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.332459 13976 catalog_manager.cc:5697] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.334728 14416 raft_consensus.cc:493] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.335274 14416 raft_consensus.cc:515] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.340122 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138f6cda3ff43d2bce4723559454144" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:52.340360 14397 raft_consensus.cc:515] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.341650 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138f6cda3ff43d2bce4723559454144" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:52.341933 14266 leader_election.cc:343] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.342685 14079 raft_consensus.cc:2468] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:52.345116 14351 ts_tablet_manager.cc:1434] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:19:52.344755 14267 leader_election.cc:304] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:52.346088 14428 raft_consensus.cc:2804] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.346452 14428 raft_consensus.cc:493] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.346679 14351 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.346781 14428 raft_consensus.cc:3060] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.351327 14416 leader_election.cc:290] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:52.353979 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0da4aaa5c4c88adc94081e83baaab" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:52.354749 14226 raft_consensus.cc:3060] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.354831 14348 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:52.355669 14348 ts_tablet_manager.cc:1403] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.001s
I20260709 13:19:52.360741 14397 leader_election.cc:290] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:52.361954 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0da4aaa5c4c88adc94081e83baaab" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:52.365798 14301 raft_consensus.cc:3060] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.366389 14348 raft_consensus.cc:359] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.367225 14348 raft_consensus.cc:385] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.367532 14348 raft_consensus.cc:740] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.369696 13977 catalog_manager.cc:5697] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.370864 14348 consensus_queue.cc:260] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.369796 14226 raft_consensus.cc:2468] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:52.360400 14428 raft_consensus.cc:515] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.374444 14118 leader_election.cc:304] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:52.375330 14454 raft_consensus.cc:2804] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.376503 14454 raft_consensus.cc:697] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:52.377413 14454 consensus_queue.cc:237] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.378796 14348 ts_tablet_manager.cc:1434] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 13:19:52.379722 14348 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:52.380404 14376 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.381031 14376 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.381752 14449 raft_consensus.cc:493] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.382236 14449 raft_consensus.cc:515] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.383464 14376 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:52.384545 14449 leader_election.cc:290] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:52.385244 14301 raft_consensus.cc:2468] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:52.386124 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:52.388123 14079 raft_consensus.cc:2468] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:52.389817 14193 leader_election.cc:304] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:52.390306 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138f6cda3ff43d2bce4723559454144" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:52.386953 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:52.390965 14449 raft_consensus.cc:2804] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.391167 14153 raft_consensus.cc:2468] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:52.391477 14449 raft_consensus.cc:493] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.390962 14079 raft_consensus.cc:3060] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.392108 14449 raft_consensus.cc:3060] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.387069 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:52.387319 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138f6cda3ff43d2bce4723559454144" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:52.393400 13976 catalog_manager.cc:5697] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:52.395092 14266 leader_election.cc:343] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:52.395783 14045 leader_election.cc:343] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.386610 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:52.391440 14428 leader_election.cc:290] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:52.399380 14348 tablet_bootstrap.cc:654] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.404088 14449 raft_consensus.cc:515] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:19:52.401677 14043 leader_election.cc:343] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.405190 14043 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:52.401070 14079 raft_consensus.cc:2468] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:52.407321 14267 leader_election.cc:304] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:52.410575 14347 tablet_bootstrap.cc:492] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:52.411278 14347 ts_tablet_manager.cc:1403] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.000s
I20260709 13:19:52.411448 14349 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:52.411962 14349 ts_tablet_manager.cc:1403] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.119s	user 0.030s	sys 0.031s
I20260709 13:19:52.412627 14348 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:52.412794 14376 raft_consensus.cc:2749] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.413734 14428 raft_consensus.cc:2804] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.414245 14428 raft_consensus.cc:697] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:52.415016 14349 raft_consensus.cc:359] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.415387 14347 raft_consensus.cc:359] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.416152 14347 raft_consensus.cc:385] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.416597 14347 raft_consensus.cc:740] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.417585 14347 consensus_queue.cc:260] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.415066 14428 consensus_queue.cc:237] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.418987 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:52.419762 14154 raft_consensus.cc:3060] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.420205 14347 ts_tablet_manager.cc:1434] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:52.421343 14347 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:52.413322 14348 ts_tablet_manager.cc:1403] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.007s
I20260709 13:19:52.428072 14347 tablet_bootstrap.cc:654] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.428333 14154 raft_consensus.cc:2468] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:52.427951 14348 raft_consensus.cc:359] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.404719 14351 tablet_bootstrap.cc:654] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.429333 14348 raft_consensus.cc:385] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.416095 14349 raft_consensus.cc:385] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.429809 14194 leader_election.cc:304] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:52.430388 14349 raft_consensus.cc:740] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.430940 14448 raft_consensus.cc:2804] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.431205 14349 consensus_queue.cc:260] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.432175 14449 leader_election.cc:290] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:52.433212 14448 raft_consensus.cc:697] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:52.434855 14349 ts_tablet_manager.cc:1434] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:19:52.434590 14448 consensus_queue.cc:237] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.436317 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:52.437291 14079 raft_consensus.cc:3060] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.439608 14351 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.440168 14351 ts_tablet_manager.cc:1403] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.003s
I20260709 13:19:52.443181 14351 raft_consensus.cc:359] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.443953 14351 raft_consensus.cc:385] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.444247 14351 raft_consensus.cc:740] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.446715 14079 raft_consensus.cc:2468] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:52.446952 14376 consensus_queue.cc:1048] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.429816 14348 raft_consensus.cc:740] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.449225 14348 consensus_queue.cc:260] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.447793 14351 consensus_queue.cc:260] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.449862 14347 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:52.454083 14347 ts_tablet_manager.cc:1403] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.006s
I20260709 13:19:52.457115 14347 raft_consensus.cc:359] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.459937 14347 raft_consensus.cc:385] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.460387 14347 raft_consensus.cc:740] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.459750 13973 catalog_manager.cc:5697] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.459494 14351 ts_tablet_manager.cc:1434] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:19:52.462308 14351 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.463056 14348 ts_tablet_manager.cc:1434] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:19:52.441319 14349 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:52.461241 14347 consensus_queue.cc:260] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.471702 14347 ts_tablet_manager.cc:1434] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:19:52.472795 14347 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:52.480438 14349 tablet_bootstrap.cc:654] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.484257 14347 tablet_bootstrap.cc:654] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.486234 14351 tablet_bootstrap.cc:654] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.489885 14348 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:52.502748 14376 consensus_queue.cc:1048] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:52.514513 14397 raft_consensus.cc:493] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.515130 14397 raft_consensus.cc:515] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.515362 13973 catalog_manager.cc:5697] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.517544 14351 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.518376 14351 ts_tablet_manager.cc:1403] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.011s
I20260709 13:19:52.519598 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:52.534499 14351 raft_consensus.cc:359] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.520467 14226 raft_consensus.cc:2468] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:52.535305 14351 raft_consensus.cc:385] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.535624 14351 raft_consensus.cc:740] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.537941 14118 leader_election.cc:304] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:52.539278 14347 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:52.540503 14348 tablet_bootstrap.cc:654] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.540637 14454 raft_consensus.cc:2804] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.540982 14347 ts_tablet_manager.cc:1403] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.011s
I20260709 13:19:52.541128 14454 raft_consensus.cc:493] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.541559 14454 raft_consensus.cc:3060] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.557835 14351 consensus_queue.cc:260] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.560055 14347 raft_consensus.cc:359] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.560943 14347 raft_consensus.cc:385] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.561241 14347 raft_consensus.cc:740] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.561265 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:52.562072 14347 consensus_queue.cc:260] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.563095 14351 ts_tablet_manager.cc:1434] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
W20260709 13:19:52.563962 14117 leader_election.cc:343] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.564805 14397 leader_election.cc:290] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:52.566850 14347 ts_tablet_manager.cc:1434] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:19:52.567989 14347 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:52.569965 14399 consensus_queue.cc:1048] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.572485 14454 raft_consensus.cc:515] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.577680 14351 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.582232 14416 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.583822 14416 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.589510 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:52.582304 14428 consensus_queue.cc:1048] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:52.588343 14416 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:52.593986 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:52.597271 14267 leader_election.cc:343] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:52.602043 14268 leader_election.cc:343] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.602517 14351 tablet_bootstrap.cc:654] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:52.603012 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:52.604223 14268 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:52.605054 14416 raft_consensus.cc:2749] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.617280 14376 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.618141 14376 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.621206 14376 leader_election.cc:290] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:52.621917 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:52.622782 14302 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:52.624419 14351 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.624590 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:52.625073 14351 ts_tablet_manager.cc:1403] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 13:19:52.625384 14153 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:52.625775 14349 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:52.626317 14349 ts_tablet_manager.cc:1403] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.185s	user 0.012s	sys 0.011s
I20260709 13:19:52.628399 14351 raft_consensus.cc:359] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.628809 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:52.629510 14227 raft_consensus.cc:3060] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.629212 14351 raft_consensus.cc:385] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.631263 14351 raft_consensus.cc:740] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.632288 14351 consensus_queue.cc:260] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.638324 14349 raft_consensus.cc:359] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.639232 14349 raft_consensus.cc:385] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.639492 14349 raft_consensus.cc:740] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.639748 14351 ts_tablet_manager.cc:1434] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:19:52.640185 14349 consensus_queue.cc:260] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.640865 14351 tablet_bootstrap.cc:492] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.642598 14454 leader_election.cc:290] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:52.644364 14349 ts_tablet_manager.cc:1434] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:19:52.645558 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:52.645895 14349 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:52.656945 14351 tablet_bootstrap.cc:654] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:52.662567 14117 leader_election.cc:343] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.664703 14416 consensus_queue.cc:1048] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.680461 14349 tablet_bootstrap.cc:654] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.682982 14448 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.683840 14448 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.691869 14448 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:52.727742 14348 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:52.728307 14348 ts_tablet_manager.cc:1403] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.249s	user 0.025s	sys 0.015s
I20260709 13:19:52.741575 14347 tablet_bootstrap.cc:654] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.710134 14227 raft_consensus.cc:2468] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:52.749205 14351 tablet_bootstrap.cc:492] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.749905 14351 ts_tablet_manager.cc:1403] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.014s
I20260709 13:19:52.752295 14348 raft_consensus.cc:359] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.752882 14348 raft_consensus.cc:385] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.753084 14348 raft_consensus.cc:740] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.753804 14348 consensus_queue.cc:260] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.760512 14349 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:52.761173 14349 ts_tablet_manager.cc:1403] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.020s
I20260709 13:19:52.761442 14348 ts_tablet_manager.cc:1434] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:19:52.762531 14348 tablet_bootstrap.cc:492] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:52.768415 14395 consensus_queue.cc:1048] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:52.793557 14351 raft_consensus.cc:359] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.796267 14351 raft_consensus.cc:385] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.796593 14351 raft_consensus.cc:740] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.806529 14479 raft_consensus.cc:493] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.806800 14351 consensus_queue.cc:260] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.807176 14479 raft_consensus.cc:515] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.808975 14351 ts_tablet_manager.cc:1434] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:19:52.810058 14351 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.810415 14479 leader_election.cc:290] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:52.813318 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:52.627406 14045 leader_election.cc:304] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:52.814085 14302 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
W20260709 13:19:52.814872 14045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 187558us
I20260709 13:19:52.814967 14357 raft_consensus.cc:2804] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.815464 14357 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.815834 14357 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.816187 14191 leader_election.cc:304] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
W20260709 13:19:52.816601 14042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 183303us
I20260709 13:19:52.817379 14448 raft_consensus.cc:2804] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.817798 14448 raft_consensus.cc:493] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.818167 14448 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.819494 14349 raft_consensus.cc:359] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.820267 14349 raft_consensus.cc:385] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.820549 14349 raft_consensus.cc:740] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.821775 14349 consensus_queue.cc:260] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.828315 14351 tablet_bootstrap.cc:654] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.839664 14349 ts_tablet_manager.cc:1434] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 13:19:52.842486 14349 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:52.845625 14395 consensus_queue.cc:1048] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.846227 14357 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.850924 14348 tablet_bootstrap.cc:654] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.856189 14351 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.856168 14448 raft_consensus.cc:515] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.857065 14351 ts_tablet_manager.cc:1403] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.018s
I20260709 13:19:52.860759 14351 raft_consensus.cc:359] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.861497 14351 raft_consensus.cc:385] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.861770 14351 raft_consensus.cc:740] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.862494 14347 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:52.862627 14351 consensus_queue.cc:260] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.866218 14351 ts_tablet_manager.cc:1434] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:52.867295 14351 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.868616 14347 ts_tablet_manager.cc:1403] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.301s	user 0.019s	sys 0.005s
I20260709 13:19:52.871930 14347 raft_consensus.cc:359] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.872735 14347 raft_consensus.cc:385] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.873014 14347 raft_consensus.cc:740] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.874331 14357 leader_election.cc:290] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:52.876030 14351 tablet_bootstrap.cc:654] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.877786 14349 tablet_bootstrap.cc:654] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.878697 14448 leader_election.cc:290] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:52.879606 14347 consensus_queue.cc:260] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:52.883775 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:52.884739 14302 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.882536 14347 ts_tablet_manager.cc:1434] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:52.888840 14347 tablet_bootstrap.cc:492] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:52.895385 14347 tablet_bootstrap.cc:654] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.896049 14228 raft_consensus.cc:3060] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.895984 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:52.901831 14074 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.908658 14302 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:52.912631 14191 leader_election.cc:304] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:52.912885 14348 tablet_bootstrap.cc:492] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:52.913604 14448 raft_consensus.cc:2804] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.914207 14448 raft_consensus.cc:697] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:52.914984 14448 consensus_queue.cc:237] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.915412 14074 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:52.917856 14416 consensus_queue.cc:1048] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.922333 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:52.923038 14079 raft_consensus.cc:2468] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:52.928704 14348 ts_tablet_manager.cc:1403] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.166s	user 0.013s	sys 0.014s
I20260709 13:19:52.932487 14449 raft_consensus.cc:493] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.933086 14449 raft_consensus.cc:515] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.941851 14479 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.942404 14479 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.944726 14479 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:52.946767 14347 tablet_bootstrap.cc:492] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:52.947273 14347 ts_tablet_manager.cc:1403] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 13:19:52.948793 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:52.949342 14348 raft_consensus.cc:359] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.950129 14348 raft_consensus.cc:385] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.950398 14348 raft_consensus.cc:740] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.951167 14348 consensus_queue.cc:260] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.951952 14449 leader_election.cc:290] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:52.953543 14348 ts_tablet_manager.cc:1434] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 13:19:52.953951 14349 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:52.954460 14349 ts_tablet_manager.cc:1403] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.112s	user 0.021s	sys 0.011s
I20260709 13:19:52.954561 14348 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:52.956331 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:52.958019 14191 leader_election.cc:343] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.960717 14351 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:52.961270 14351 ts_tablet_manager.cc:1403] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.009s
I20260709 13:19:52.961938 14348 tablet_bootstrap.cc:654] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.964294 14351 raft_consensus.cc:359] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.965238 14351 raft_consensus.cc:385] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.965626 14351 raft_consensus.cc:740] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.966557 14351 consensus_queue.cc:260] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:52.968838 14349 raft_consensus.cc:359] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.969689 14349 raft_consensus.cc:385] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.969981 14349 raft_consensus.cc:740] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.970715 14349 consensus_queue.cc:260] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:52.971838 14454 consensus_queue.cc:1048] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.973381 14349 ts_tablet_manager.cc:1434] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.000s
I20260709 13:19:52.974855 14349 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:52.979658 14347 raft_consensus.cc:359] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:52.980430 14347 raft_consensus.cc:385] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.980715 14347 raft_consensus.cc:740] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.983716 14351 ts_tablet_manager.cc:1434] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:19:52.990929 14351 tablet_bootstrap.cc:492] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:52.990854 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:52.991616 14077 raft_consensus.cc:2376] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1. Re-sending same reply.
I20260709 13:19:52.993755 14118 leader_election.cc:304] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:52.997969 14351 tablet_bootstrap.cc:654] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.987754 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:52.999099 14151 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.973474 14395 consensus_queue.cc:1048] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:19:52.970948 14193 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:53.010737 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:53.012451 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:53.187958 14449 raft_consensus.cc:2804] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.188670 14449 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.189085 14449 raft_consensus.cc:3060] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.020506 14151 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:52.986657 14349 tablet_bootstrap.cc:654] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.014261 14397 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.022516 14399 consensus_queue.cc:1048] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.008396 14475 raft_consensus.cc:2804] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.102885 14514 consensus_queue.cc:1048] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.117669 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:53.202703 14475 raft_consensus.cc:697] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:53.202879 14302 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.125898 14515 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.981386 14347 consensus_queue.cc:260] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.166991 14448 consensus_queue.cc:1048] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.180632 14348 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:53.183429 14351 tablet_bootstrap.cc:492] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:53.014341 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:53.195225 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 224351us
I20260709 13:19:53.204627 14348 ts_tablet_manager.cc:1403] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.250s	user 0.040s	sys 0.053s
I20260709 13:19:53.198230 14397 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.213477 14397 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:53.202541 14449 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:19:53.119380 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 146819us
I20260709 13:19:53.195690 14045 leader_election.cc:304] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:53.204780 14351 ts_tablet_manager.cc:1403] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.214s	user 0.015s	sys 0.002s
I20260709 13:19:53.203583 14515 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.211421 14149 raft_consensus.cc:2468] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:53.301680 14302 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:53.293570 13977 catalog_manager.cc:5697] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.301832 14448 consensus_queue.cc:1048] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.286464 14348 raft_consensus.cc:359] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.305514 14348 raft_consensus.cc:385] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.305845 14513 raft_consensus.cc:2804] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.289791 14347 ts_tablet_manager.cc:1434] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.342s	user 0.013s	sys 0.022s
I20260709 13:19:53.306591 14513 raft_consensus.cc:697] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:53.203802 14475 consensus_queue.cc:237] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
W20260709 13:19:53.277309 14194 leader_election.cc:343] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.307559 14513 consensus_queue.cc:237] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:19:53.308719 14045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 113152us
I20260709 13:19:53.310773 14515 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:53.309514 14428 raft_consensus.cc:493] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.320549 14428 raft_consensus.cc:515] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.322957 14428 leader_election.cc:290] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:53.313784 14347 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:53.313972 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:53.305848 14348 raft_consensus.cc:740] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.221801 14150 raft_consensus.cc:2468] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:53.324556 14348 consensus_queue.cc:260] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.273504 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:53.316227 14193 leader_election.cc:343] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.328502 14193 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:53.316785 14351 raft_consensus.cc:359] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.331763 14351 raft_consensus.cc:385] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.298260 14349 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:53.324257 14301 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:53.276131 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:53.329234 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:53.332134 14351 raft_consensus.cc:740] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.324342 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:53.331950 14479 raft_consensus.cc:2749] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.354911 14349 ts_tablet_manager.cc:1403] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.380s	user 0.030s	sys 0.012s
I20260709 13:19:53.356325 14227 raft_consensus.cc:2393] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:19:53.361361 14351 consensus_queue.cc:260] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.356966 14077 raft_consensus.cc:2468] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:53.372498 14348 ts_tablet_manager.cc:1434] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.167s	user 0.012s	sys 0.002s
I20260709 13:19:53.373965 14348 tablet_bootstrap.cc:492] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:53.376227 14349 raft_consensus.cc:359] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.343931 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:53.377055 14349 raft_consensus.cc:385] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.378671 14228 raft_consensus.cc:2393] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:53.383886 14349 raft_consensus.cc:740] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.363526 14513 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.384203 14119 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:53.387655 14475 raft_consensus.cc:2804] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.388006 14266 leader_election.cc:304] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:53.388320 14475 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.388970 14475 raft_consensus.cc:3060] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.389978 14042 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:53.391361 14515 raft_consensus.cc:2804] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.391784 14515 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.385836 14349 consensus_queue.cc:260] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.395248 14194 leader_election.cc:304] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:53.392135 14515 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.399389 14527 raft_consensus.cc:2804] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.399811 14527 raft_consensus.cc:493] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.400178 14527 raft_consensus.cc:3060] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.404932 14347 tablet_bootstrap.cc:654] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.407014 14395 raft_consensus.cc:3060] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.410983 14527 raft_consensus.cc:515] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.419495 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:53.420228 14151 raft_consensus.cc:3060] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.421219 14475 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.423390 14475 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:53.430234 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:53.431208 14228 raft_consensus.cc:2393] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:53.435201 14151 raft_consensus.cc:2468] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:53.436513 14194 leader_election.cc:304] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:53.437912 14351 ts_tablet_manager.cc:1434] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.124s	user 0.011s	sys 0.009s
I20260709 13:19:53.439857 14351 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:53.440327 14527 leader_election.cc:290] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:53.443164 14349 ts_tablet_manager.cc:1434] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.003s
I20260709 13:19:53.441642 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:53.393617 14150 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:53.446816 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:53.448766 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:53.449774 14073 raft_consensus.cc:3060] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.449381 14515 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.442066 14479 raft_consensus.cc:2804] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.455370 14119 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:53.446022 14349 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:53.457108 14348 tablet_bootstrap.cc:654] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.416975 14513 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.455670 14351 tablet_bootstrap.cc:654] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:53.457383 14191 leader_election.cc:343] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.460140 14479 raft_consensus.cc:697] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:53.463420 14449 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:53.463052 14479 consensus_queue.cc:237] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.466287 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:53.466959 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:53.468196 14073 raft_consensus.cc:2468] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:53.457351 14527 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.468485 14349 tablet_bootstrap.cc:654] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.471688 14148 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.469861 14515 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:53.456496 14395 raft_consensus.cc:2749] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.470539 14301 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.457635 14475 raft_consensus.cc:2749] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.481170 14193 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:53.481750 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:53.487291 14045 leader_election.cc:343] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.488257 14449 raft_consensus.cc:2804] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.489100 14449 raft_consensus.cc:697] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:53.494335 14449 consensus_queue.cc:237] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.485750 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:53.501269 14513 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:53.477042 14527 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.504091 14347 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:53.507184 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:53.508293 14347 ts_tablet_manager.cc:1403] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.195s	user 0.016s	sys 0.000s
I20260709 13:19:53.510134 14226 raft_consensus.cc:2468] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:53.513902 14043 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:53.514899 14527 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:53.515618 14513 raft_consensus.cc:2804] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.515930 14301 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:53.516206 14513 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.516770 14151 raft_consensus.cc:2393] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:19:53.516708 14513 raft_consensus.cc:3060] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.518630 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:53.520375 14191 leader_election.cc:343] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.522377 14347 raft_consensus.cc:359] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.523165 14347 raft_consensus.cc:385] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.523463 14347 raft_consensus.cc:740] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.523689 14042 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:53.524206 14347 consensus_queue.cc:260] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.524677 14376 raft_consensus.cc:2804] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.525293 14376 raft_consensus.cc:697] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:53.525650 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:53.526248 14376 consensus_queue.cc:237] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.528378 14347 ts_tablet_manager.cc:1434] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:53.529557 14347 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
W20260709 13:19:53.529804 14193 leader_election.cc:343] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.530258 14193 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:53.531064 14527 raft_consensus.cc:2749] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.536202 14347 tablet_bootstrap.cc:654] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.518759 14348 tablet_bootstrap.cc:492] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:53.537995 14348 ts_tablet_manager.cc:1403] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.164s	user 0.019s	sys 0.013s
I20260709 13:19:53.550313 14349 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:53.550915 14349 ts_tablet_manager.cc:1403] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.020s
I20260709 13:19:53.544977 14348 raft_consensus.cc:359] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.554275 14348 raft_consensus.cc:385] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.554625 14348 raft_consensus.cc:740] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.557080 14349 raft_consensus.cc:359] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.557389 14513 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.559019 14148 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:53.557977 14349 raft_consensus.cc:385] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.561312 14349 raft_consensus.cc:740] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.560801 14527 consensus_queue.cc:1048] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.562245 14349 consensus_queue.cc:260] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.564687 14349 ts_tablet_manager.cc:1434] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:53.558523 14348 consensus_queue.cc:260] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.562245 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:53.568583 14348 ts_tablet_manager.cc:1434] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 13:19:53.570163 14348 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:53.572911 14349 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:53.577194 14347 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:53.577824 14347 ts_tablet_manager.cc:1403] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.008s
I20260709 13:19:53.579808 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:53.580468 14226 raft_consensus.cc:3060] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.581171 14347 raft_consensus.cc:359] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:19:53.581773 14045 leader_election.cc:343] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.587090 14479 consensus_queue.cc:1048] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.581918 14347 raft_consensus.cc:385] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.591416 14347 raft_consensus.cc:740] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.613003 14347 consensus_queue.cc:260] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.601017 14516 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.615724 14516 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.618342 14516 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:53.620908 14349 tablet_bootstrap.cc:654] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.621220 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:53.625448 14042 leader_election.cc:343] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.625335 14347 ts_tablet_manager.cc:1434] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:19:53.627810 14347 tablet_bootstrap.cc:492] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:53.597185 14513 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:53.631522 13976 catalog_manager.cc:5697] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.609019 14348 tablet_bootstrap.cc:654] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.635990 13976 catalog_manager.cc:5697] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.645991 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:53.646899 14228 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:53.653697 14226 raft_consensus.cc:2468] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:53.655699 14347 tablet_bootstrap.cc:654] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.660750 14043 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:53.662824 14043 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:53.665015 14513 raft_consensus.cc:2804] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.665609 14513 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.666049 14513 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.669112 14399 raft_consensus.cc:2804] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.669737 14399 raft_consensus.cc:697] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
W20260709 13:19:53.670593 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:53.670609 14399 consensus_queue.cc:237] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.680577 13977 catalog_manager.cc:5697] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.687250 14349 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:53.687853 14349 ts_tablet_manager.cc:1403] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.011s
I20260709 13:19:53.688264 14351 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:53.689165 14351 ts_tablet_manager.cc:1403] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.250s	user 0.026s	sys 0.048s
I20260709 13:19:53.696280 14349 raft_consensus.cc:359] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.697060 14349 raft_consensus.cc:385] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.697342 14349 raft_consensus.cc:740] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.699623 14348 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:53.700285 14348 ts_tablet_manager.cc:1403] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.013s
I20260709 13:19:53.698019 14349 consensus_queue.cc:260] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.708797 14475 consensus_queue.cc:1048] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.711038 14348 raft_consensus.cc:359] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.711804 14348 raft_consensus.cc:385] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.712076 14348 raft_consensus.cc:740] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.719038 14348 consensus_queue.cc:260] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.719103 14351 raft_consensus.cc:359] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.724108 14516 raft_consensus.cc:493] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.724193 14349 ts_tablet_manager.cc:1434] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:19:53.724843 14516 raft_consensus.cc:515] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.725714 14349 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:53.727165 14516 leader_election.cc:290] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:53.731472 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:53.724318 14351 raft_consensus.cc:385] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.734011 14351 raft_consensus.cc:740] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.734901 14351 consensus_queue.cc:260] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.739465 14349 tablet_bootstrap.cc:654] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.740520 14348 ts_tablet_manager.cc:1434] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 13:19:53.742321 14351 ts_tablet_manager.cc:1434] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:19:53.743201 14351 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
W20260709 13:19:53.745604 14042 leader_election.cc:343] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.746048 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:53.749995 14348 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
W20260709 13:19:53.751560 14045 leader_election.cc:343] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.752278 14045 leader_election.cc:304] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:53.755895 14516 raft_consensus.cc:2749] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.762056 14513 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.771528 14399 consensus_queue.cc:1048] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.771871 14516 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.772435 14516 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.773401 14351 tablet_bootstrap.cc:654] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.775549 14513 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:53.777652 14516 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:53.778535 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:53.779515 14301 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.779671 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:53.780539 14302 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:53.770444 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:53.782070 14228 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.785857 14042 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:53.787451 14347 tablet_bootstrap.cc:492] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:53.788002 14347 ts_tablet_manager.cc:1403] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.161s	user 0.022s	sys 0.019s
I20260709 13:19:53.789245 14516 raft_consensus.cc:2804] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.790246 14516 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.790427 14399 consensus_queue.cc:1048] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.790743 14516 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.789639 14348 tablet_bootstrap.cc:654] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.797087 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:53.798982 14151 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:53.808123 14347 raft_consensus.cc:359] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.821319 14475 consensus_queue.cc:1048] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.823385 14448 raft_consensus.cc:493] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.829351 14347 raft_consensus.cc:385] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.838465 14347 raft_consensus.cc:740] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.845973 14347 consensus_queue.cc:260] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.848412 14347 ts_tablet_manager.cc:1434] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:19:53.848238 14228 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:53.843637 14448 raft_consensus.cc:515] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
W20260709 13:19:53.851886 14549 log.cc:927] Time spent T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:19:53.853252 14347 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:53.858273 14043 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:53.859479 14399 raft_consensus.cc:2804] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.860177 14399 raft_consensus.cc:697] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:53.861096 14399 consensus_queue.cc:237] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.864085 14448 leader_election.cc:290] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:53.873768 14351 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:53.874625 14351 ts_tablet_manager.cc:1403] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.132s	user 0.028s	sys 0.028s
I20260709 13:19:53.881346 14347 tablet_bootstrap.cc:654] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.873215 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:53.884181 14191 leader_election.cc:343] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.875258 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:53.885076 14151 raft_consensus.cc:2468] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:53.887217 14194 leader_election.cc:304] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:53.888154 14448 raft_consensus.cc:2804] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.884500 14554 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.888577 14448 raft_consensus.cc:493] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.890834 14448 raft_consensus.cc:3060] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.895417 14349 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:53.896064 14349 ts_tablet_manager.cc:1403] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.171s	user 0.016s	sys 0.002s
I20260709 13:19:53.898563 14351 raft_consensus.cc:359] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.899461 14351 raft_consensus.cc:385] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.899827 14351 raft_consensus.cc:740] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.900671 14351 consensus_queue.cc:260] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.903153 14351 ts_tablet_manager.cc:1434] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:19:53.904290 14351 tablet_bootstrap.cc:492] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:53.911032 14416 raft_consensus.cc:493] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.912039 14348 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:53.911789 14416 raft_consensus.cc:515] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.912590 14348 ts_tablet_manager.cc:1403] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.171s	user 0.017s	sys 0.012s
I20260709 13:19:53.914894 14416 leader_election.cc:290] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:53.916131 14348 raft_consensus.cc:359] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.916985 14348 raft_consensus.cc:385] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.917320 14348 raft_consensus.cc:740] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.918895 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:53.918660 13973 catalog_manager.cc:5697] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } }
I20260709 13:19:53.919786 14151 raft_consensus.cc:2393] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:53.918272 14348 consensus_queue.cc:260] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.928588 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:53.930426 14266 leader_election.cc:304] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:53.931449 14533 raft_consensus.cc:3060] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.894173 14301 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:53.937482 14448 raft_consensus.cc:515] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:53.938634 14348 ts_tablet_manager.cc:1434] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:19:53.939702 14449 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.938071 14351 tablet_bootstrap.cc:654] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.940294 14449 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:53.940738 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:53.939890 14348 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:53.943197 14516 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:53.946591 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:53.892347 14554 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.943284 14449 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:19:53.957746 14191 leader_election.cc:343] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.958797 14554 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:53.951238 14349 raft_consensus.cc:359] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:53.960376 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:53.960402 14349 raft_consensus.cc:385] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.961879 14349 raft_consensus.cc:740] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.962589 14349 consensus_queue.cc:260] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:19:53.963325 14193 leader_election.cc:343] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.963852 14193 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:53.953400 14533 raft_consensus.cc:2749] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.965374 14449 raft_consensus.cc:2749] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.966668 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:53.955660 14148 raft_consensus.cc:3060] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.968688 14348 tablet_bootstrap.cc:654] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.979266 14349 ts_tablet_manager.cc:1434] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.003s
I20260709 13:19:53.981767 14349 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:53.984953 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:53.981310 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
W20260709 13:19:53.986757 14191 leader_election.cc:343] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.987191 14301 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.978852 14449 consensus_queue.cc:1048] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:54.003356 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:54.004256 14226 raft_consensus.cc:2393] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:54.021319 14118 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:54.016875 14516 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:54.025025 14514 raft_consensus.cc:3060] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.025981 14148 raft_consensus.cc:2468] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:54.027793 14194 leader_election.cc:304] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:54.028952 14449 raft_consensus.cc:2804] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.029522 14449 raft_consensus.cc:697] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:54.030485 14449 consensus_queue.cc:237] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.032433 13973 catalog_manager.cc:5697] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.035930 13973 catalog_manager.cc:5697] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.040611 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:54.041481 14148 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.015537 14448 leader_election.cc:290] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:54.047542 14349 tablet_bootstrap.cc:654] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.045766 14514 raft_consensus.cc:2749] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.063304 14301 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
W20260709 13:19:54.072736 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4a00 after lost signal to thread 4249
W20260709 13:19:54.074244 14175 debug-util.cc:398] Leaking SignalData structure 0x7b0800230bc0 after lost signal to thread 14011
I20260709 13:19:54.074855 14348 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:54.075366 14348 ts_tablet_manager.cc:1403] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.009s
I20260709 13:19:54.072755 14351 tablet_bootstrap.cc:492] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:54.076427 14351 ts_tablet_manager.cc:1403] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.172s	user 0.029s	sys 0.016s
I20260709 13:19:54.076663 13976 catalog_manager.cc:5697] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:54.075661 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08001ce460 after lost signal to thread 14103
I20260709 13:19:54.080209 14042 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:54.081579 14347 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:54.081864 14376 raft_consensus.cc:2804] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.082149 14347 ts_tablet_manager.cc:1403] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.229s	user 0.007s	sys 0.030s
I20260709 13:19:54.082451 14376 raft_consensus.cc:697] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:54.083415 14376 consensus_queue.cc:237] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.086022 14479 consensus_queue.cc:1048] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.088204 14516 consensus_queue.cc:1048] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.089725 14351 raft_consensus.cc:359] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.090456 14351 raft_consensus.cc:385] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.090741 14351 raft_consensus.cc:740] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.091434 14351 consensus_queue.cc:260] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.094349 14479 consensus_queue.cc:1048] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.096812 14351 ts_tablet_manager.cc:1434] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:19:54.085120 14347 raft_consensus.cc:359] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.097493 14347 raft_consensus.cc:385] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.097782 14347 raft_consensus.cc:740] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.098518 14347 consensus_queue.cc:260] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.101047 14347 ts_tablet_manager.cc:1434] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.004s
W20260709 13:19:54.106611 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08000407e0 after lost signal to thread 14178
I20260709 13:19:54.097882 14351 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
W20260709 13:19:54.108158 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9d20 after lost signal to thread 14252
I20260709 13:19:54.114272 14527 consensus_queue.cc:1048] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.115754 14348 raft_consensus.cc:359] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.116536 14348 raft_consensus.cc:385] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.116833 14348 raft_consensus.cc:740] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.117574 14348 consensus_queue.cc:260] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:19:54.109413 14175 debug-util.cc:398] Leaking SignalData structure 0x7b0800225480 after lost signal to thread 14326
I20260709 13:19:54.119772 14347 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:54.126420 14348 ts_tablet_manager.cc:1434] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:19:54.128757 14351 tablet_bootstrap.cc:654] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.124854 14148 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:54.140697 14348 tablet_bootstrap.cc:492] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:54.151072 14399 consensus_queue.cc:1048] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.155288 14349 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:54.156087 14349 ts_tablet_manager.cc:1403] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.176s	user 0.009s	sys 0.010s
I20260709 13:19:54.173071 14514 raft_consensus.cc:493] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.173748 14514 raft_consensus.cc:515] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.176818 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:54.177213 14514 leader_election.cc:290] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:54.177690 14077 raft_consensus.cc:2468] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:54.177851 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:54.188030 14226 raft_consensus.cc:2468] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:54.193913 14118 leader_election.cc:304] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:54.195384 14514 raft_consensus.cc:2804] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.195806 14514 raft_consensus.cc:493] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.196141 14514 raft_consensus.cc:3060] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.196439 14349 raft_consensus.cc:359] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.199918 14347 tablet_bootstrap.cc:654] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.209452 14376 consensus_queue.cc:1048] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.211126 14348 tablet_bootstrap.cc:654] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.251011 14349 raft_consensus.cc:385] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.251334 14349 raft_consensus.cc:740] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.251967 14349 consensus_queue.cc:260] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.223501 14514 raft_consensus.cc:515] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.263629 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:54.264350 14073 raft_consensus.cc:3060] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.263921 14515 consensus_queue.cc:1048] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.267167 14349 ts_tablet_manager.cc:1434] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.111s	user 0.010s	sys 0.000s
I20260709 13:19:54.229049 13977 catalog_manager.cc:5697] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.247342 14351 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:54.269333 14351 ts_tablet_manager.cc:1403] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.172s	user 0.041s	sys 0.042s
I20260709 13:19:54.268251 14349 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:54.273391 14073 raft_consensus.cc:2468] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:54.274963 14119 leader_election.cc:304] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:54.275929 14475 raft_consensus.cc:2804] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.276446 14475 raft_consensus.cc:697] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:54.277320 14475 consensus_queue.cc:237] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.279117 14351 raft_consensus.cc:359] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.281038 14351 raft_consensus.cc:385] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.281592 14351 raft_consensus.cc:740] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.283583 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:54.282529 14349 tablet_bootstrap.cc:654] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.284272 14226 raft_consensus.cc:3060] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.284475 14351 consensus_queue.cc:260] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.287760 14351 ts_tablet_manager.cc:1434] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:19:54.288882 14351 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:54.282826 13977 catalog_manager.cc:5697] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.289598 14514 leader_election.cc:290] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:54.290567 14348 tablet_bootstrap.cc:492] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:54.291118 14348 ts_tablet_manager.cc:1403] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.163s	user 0.012s	sys 0.000s
I20260709 13:19:54.293447 14226 raft_consensus.cc:2468] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:54.296134 14347 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:54.296696 14347 ts_tablet_manager.cc:1403] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.177s	user 0.007s	sys 0.010s
I20260709 13:19:54.299661 14347 raft_consensus.cc:359] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.300218 14351 tablet_bootstrap.cc:654] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.300369 14347 raft_consensus.cc:385] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.301855 14347 raft_consensus.cc:740] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.302604 14347 consensus_queue.cc:260] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.305088 14347 ts_tablet_manager.cc:1434] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:19:54.307667 14348 raft_consensus.cc:359] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.308442 14348 raft_consensus.cc:385] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.308718 14348 raft_consensus.cc:740] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.309409 14348 consensus_queue.cc:260] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.311000 14347 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:54.317274 14348 ts_tablet_manager.cc:1434] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:19:54.320950 14347 tablet_bootstrap.cc:654] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.323793 14348 tablet_bootstrap.cc:492] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:54.335865 14516 consensus_queue.cc:1048] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.336288 14348 tablet_bootstrap.cc:654] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.352083 14533 raft_consensus.cc:493] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.353554 14533 raft_consensus.cc:515] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.356460 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:54.356892 14533 leader_election.cc:290] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:54.357151 14073 raft_consensus.cc:2468] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:54.358398 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:54.358580 14267 leader_election.cc:304] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:54.359153 14151 raft_consensus.cc:2468] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:54.359407 14416 raft_consensus.cc:2804] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.359982 14416 raft_consensus.cc:493] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.360399 14416 raft_consensus.cc:3060] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.362095 14351 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:54.362607 14351 ts_tablet_manager.cc:1403] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.015s
I20260709 13:19:54.372361 14349 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:54.373083 14349 ts_tablet_manager.cc:1403] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.014s
I20260709 13:19:54.379458 14527 raft_consensus.cc:493] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.382591 14527 raft_consensus.cc:515] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.384694 14527 leader_election.cc:290] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:54.386255 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:54.393775 14194 leader_election.cc:343] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.400677 14347 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:54.401315 14347 ts_tablet_manager.cc:1403] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.007s
I20260709 13:19:54.402750 14416 raft_consensus.cc:515] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.404999 14416 leader_election.cc:290] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:54.405719 14351 raft_consensus.cc:359] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.406293 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:54.405279 14349 raft_consensus.cc:359] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.404373 14347 raft_consensus.cc:359] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.407665 14349 raft_consensus.cc:385] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.407833 14347 raft_consensus.cc:385] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.406525 14351 raft_consensus.cc:385] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.408336 14351 raft_consensus.cc:740] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.407886 14349 raft_consensus.cc:740] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.408262 14347 raft_consensus.cc:740] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.411463 14347 consensus_queue.cc:260] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.406956 14073 raft_consensus.cc:3060] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.416772 13973 catalog_manager.cc:5697] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.419188 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:54.419873 14149 raft_consensus.cc:3060] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.409446 14351 consensus_queue.cc:260] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.420732 14349 consensus_queue.cc:260] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.423506 14347 ts_tablet_manager.cc:1434] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 13:19:54.423807 14351 ts_tablet_manager.cc:1434] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:19:54.425177 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:54.426990 14351 tablet_bootstrap.cc:492] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:54.428469 14349 ts_tablet_manager.cc:1434] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:19:54.434895 14351 tablet_bootstrap.cc:654] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.438902 14347 tablet_bootstrap.cc:492] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:54.448866 14149 raft_consensus.cc:2468] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:54.451188 14073 raft_consensus.cc:2468] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:54.451930 14348 tablet_bootstrap.cc:492] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:54.452481 14348 ts_tablet_manager.cc:1403] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.003s
I20260709 13:19:54.454198 14347 tablet_bootstrap.cc:654] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.455372 14348 raft_consensus.cc:359] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.456032 14267 leader_election.cc:304] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:54.458009 14301 raft_consensus.cc:3060] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.458179 14416 raft_consensus.cc:2804] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.458716 14416 raft_consensus.cc:697] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:54.459589 14416 consensus_queue.cc:237] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.461992 14349 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:54.474565 14376 consensus_queue.cc:1048] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:54.477085 14191 leader_election.cc:343] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.477669 14191 leader_election.cc:304] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:54.456076 14348 raft_consensus.cc:385] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.478516 14348 raft_consensus.cc:740] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.479425 14348 consensus_queue.cc:260] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.481180 14449 raft_consensus.cc:2749] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.482600 14348 ts_tablet_manager.cc:1434] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:19:54.484827 14348 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:54.487444 14516 consensus_queue.cc:1048] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.509994 14349 tablet_bootstrap.cc:654] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.527623 14351 tablet_bootstrap.cc:492] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:54.528157 14351 ts_tablet_manager.cc:1403] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.002s
I20260709 13:19:54.529940 14527 consensus_queue.cc:1048] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.530793 14376 consensus_queue.cc:1048] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.529155 13974 catalog_manager.cc:5697] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.539057 14351 raft_consensus.cc:359] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.539883 14351 raft_consensus.cc:385] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.540170 14351 raft_consensus.cc:740] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.542647 14351 consensus_queue.cc:260] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.548877 14527 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.549664 14347 tablet_bootstrap.cc:492] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:54.549398 14527 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.550177 14347 ts_tablet_manager.cc:1403] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.008s
I20260709 13:19:54.551649 14527 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:54.554179 14516 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.554371 14347 raft_consensus.cc:359] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.554740 14516 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.555178 14347 raft_consensus.cc:385] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.555480 14347 raft_consensus.cc:740] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.556315 14347 consensus_queue.cc:260] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.558202 14351 ts_tablet_manager.cc:1434] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 13:19:54.558817 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:54.559046 14475 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.559307 14351 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:54.559474 14228 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:54.560034 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:54.560808 14527 consensus_queue.cc:1048] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.561980 14043 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:54.563771 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:54.564440 14073 raft_consensus.cc:2468] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:54.565388 14376 raft_consensus.cc:2804] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.565842 14376 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.566131 14193 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:54.559572 14475 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.567081 14449 raft_consensus.cc:2804] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.567473 14449 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.567505 14149 raft_consensus.cc:2468] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:54.567950 14449 raft_consensus.cc:3060] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.568743 14475 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:54.569586 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:54.570286 14073 raft_consensus.cc:2468] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:54.582872 14348 tablet_bootstrap.cc:654] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.574319 14347 ts_tablet_manager.cc:1434] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:19:54.562207 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:54.589752 14347 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:54.566181 14376 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.561733 14516 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:54.591881 14119 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:54.592917 14475 raft_consensus.cc:2804] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.593302 14475 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.595429 14475 raft_consensus.cc:3060] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.604262 14351 tablet_bootstrap.cc:654] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.588619 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:54.612210 14376 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.590500 14301 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:54.619046 14581 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.619562 14581 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.624898 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:54.625607 14226 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:54.626906 14266 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:54.627830 14416 raft_consensus.cc:2804] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.628222 14416 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.628551 14416 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.629720 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:54.630573 14073 raft_consensus.cc:2393] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:54.635223 14349 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:54.636024 14349 ts_tablet_manager.cc:1403] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.174s	user 0.013s	sys 0.010s
I20260709 13:19:54.650748 14349 raft_consensus.cc:359] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.642401 14581 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:54.651640 14349 raft_consensus.cc:385] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.654531 14416 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.659009 14554 raft_consensus.cc:493] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.659621 14554 raft_consensus.cc:515] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.661595 14416 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:54.661715 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:54.662619 14073 raft_consensus.cc:2393] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:54.663661 14348 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:54.664219 14348 ts_tablet_manager.cc:1403] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.180s	user 0.017s	sys 0.003s
I20260709 13:19:54.667469 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:54.668193 14227 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.668274 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:54.668947 14226 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:54.641786 14475 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.672374 14449 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.674028 14349 raft_consensus.cc:740] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.673836 14228 raft_consensus.cc:2393] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:54.676520 14118 leader_election.cc:304] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:54.677551 14514 raft_consensus.cc:2804] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.677963 14514 raft_consensus.cc:493] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.678289 14514 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.687674 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:54.687988 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:54.688925 14300 raft_consensus.cc:2393] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:19:54.690397 14042 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:54.691761 14516 raft_consensus.cc:2749] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.694617 14449 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:54.697790 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:54.698529 14077 raft_consensus.cc:3060] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.699640 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:54.701785 14347 tablet_bootstrap.cc:654] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.701149 14376 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:54.704022 14475 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:54.707016 14554 leader_election.cc:290] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:54.707173 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:54.708002 14228 raft_consensus.cc:2393] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:54.708210 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:54.708870 14299 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:54.710007 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:54.710811 14149 raft_consensus.cc:2393] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:19:54.712185 14118 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:54.714573 14554 raft_consensus.cc:2749] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.722057 14349 consensus_queue.cc:260] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.732314 14077 raft_consensus.cc:2468] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:54.732139 14348 raft_consensus.cc:359] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.734103 14347 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:54.744609 14348 raft_consensus.cc:385] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.744891 14347 ts_tablet_manager.cc:1403] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.005s
I20260709 13:19:54.744946 14348 raft_consensus.cc:740] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.750378 14348 consensus_queue.cc:260] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.753161 14348 ts_tablet_manager.cc:1434] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.004s
I20260709 13:19:54.753971 14227 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:54.756235 14347 raft_consensus.cc:359] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.757113 14347 raft_consensus.cc:385] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.757397 14266 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:54.758716 14416 raft_consensus.cc:2804] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.759421 14416 raft_consensus.cc:697] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:54.760278 14416 consensus_queue.cc:237] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.761548 14554 consensus_queue.cc:1048] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.734736 14349 ts_tablet_manager.cc:1434] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.098s	user 0.005s	sys 0.003s
I20260709 13:19:54.736819 14514 raft_consensus.cc:515] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.766098 14349 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:54.767925 14514 leader_election.cc:290] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
W20260709 13:19:54.741122 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:54.742637 14193 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:54.771364 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:54.772064 14300 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.772279 14479 raft_consensus.cc:2804] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.772781 14479 raft_consensus.cc:697] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:54.774001 14479 consensus_queue.cc:237] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:54.758729 14348 tablet_bootstrap.cc:492] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:54.776140 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:54.776844 14227 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.786410 14351 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:54.787158 14351 ts_tablet_manager.cc:1403] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.228s	user 0.033s	sys 0.007s
I20260709 13:19:54.757468 14347 raft_consensus.cc:740] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.792577 14300 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:54.794169 14117 leader_election.cc:304] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:54.794930 14348 tablet_bootstrap.cc:654] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.795255 14514 raft_consensus.cc:2804] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.795771 14514 raft_consensus.cc:697] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:54.796684 14514 consensus_queue.cc:237] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.796880 14347 consensus_queue.cc:260] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.801457 14227 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:54.801754 14349 tablet_bootstrap.cc:654] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.803766 14347 ts_tablet_manager.cc:1434] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:19:54.816299 14347 tablet_bootstrap.cc:492] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:54.801959 14351 raft_consensus.cc:359] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.822330 14351 raft_consensus.cc:385] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.822690 14351 raft_consensus.cc:740] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.823362 14351 consensus_queue.cc:260] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.823171 13977 catalog_manager.cc:5697] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.826562 14351 ts_tablet_manager.cc:1434] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:19:54.827955 14351 tablet_bootstrap.cc:492] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:54.849220 14376 raft_consensus.cc:493] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.860338 14348 tablet_bootstrap.cc:492] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:54.861169 14348 ts_tablet_manager.cc:1403] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.000s
I20260709 13:19:54.864639 14475 consensus_queue.cc:1048] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.865206 14348 raft_consensus.cc:359] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.865896 14348 raft_consensus.cc:385] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.866181 14348 raft_consensus.cc:740] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.866886 14348 consensus_queue.cc:260] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:54.870507 14527 raft_consensus.cc:493] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.871079 14527 raft_consensus.cc:515] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:54.862319 14376 raft_consensus.cc:515] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.875942 14376 leader_election.cc:290] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:54.877170 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:54.877471 14527 leader_election.cc:290] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:54.877955 14150 raft_consensus.cc:2468] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:54.879343 14045 leader_election.cc:304] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:54.880267 14376 raft_consensus.cc:2804] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.880712 14348 ts_tablet_manager.cc:1434] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:19:54.880705 14376 raft_consensus.cc:493] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.882042 14376 raft_consensus.cc:3060] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.872524 13973 catalog_manager.cc:5697] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.887491 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:54.888819 14351 tablet_bootstrap.cc:654] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:54.889571 14193 leader_election.cc:343] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.904271 14348 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:54.895357 13976 catalog_manager.cc:5697] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.893838 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:54.925872 14300 raft_consensus.cc:2468] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:54.927740 14191 leader_election.cc:304] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:54.928613 14527 raft_consensus.cc:2804] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.929188 14527 raft_consensus.cc:493] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.929988 14527 raft_consensus.cc:3060] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.931617 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:54.952363 14347 tablet_bootstrap.cc:654] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:54.967200 14042 leader_election.cc:343] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.982625 14416 consensus_queue.cc:1048] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.992561 14348 tablet_bootstrap.cc:654] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.992910 14376 raft_consensus.cc:515] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:54.996670 14376 leader_election.cc:290] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:54.998227 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:54.999269 14149 raft_consensus.cc:3060] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.002089 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:55.005805 14347 tablet_bootstrap.cc:492] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:55.006433 14347 ts_tablet_manager.cc:1403] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.190s	user 0.013s	sys 0.008s
I20260709 13:19:55.008591 14527 raft_consensus.cc:515] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.015864 14527 leader_election.cc:290] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:55.017143 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
W20260709 13:19:55.013270 14042 leader_election.cc:343] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.017889 14300 raft_consensus.cc:3060] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.018882 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:55.019757 14149 raft_consensus.cc:2468] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:55.009519 14347 raft_consensus.cc:359] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.020640 14347 raft_consensus.cc:385] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.021026 14347 raft_consensus.cc:740] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.020877 14045 leader_election.cc:304] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
W20260709 13:19:55.021708 14193 leader_election.cc:343] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.022392 14376 raft_consensus.cc:2804] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.022972 14376 raft_consensus.cc:697] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:55.024070 14376 consensus_queue.cc:237] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.030143 14527 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.030809 14527 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.034011 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:55.035372 14527 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:55.037340 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:55.037890 14300 raft_consensus.cc:2468] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:55.038224 14299 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:55.030112 14348 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:55.039597 14348 ts_tablet_manager.cc:1403] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.007s
I20260709 13:19:55.039743 14191 leader_election.cc:304] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:55.041004 14191 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:55.041719 14479 raft_consensus.cc:2804] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.042246 14479 raft_consensus.cc:697] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:55.042734 14449 raft_consensus.cc:2804] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.043596 14533 consensus_queue.cc:1048] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.043138 14449 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.044914 14449 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.045611 14349 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:55.046101 14349 ts_tablet_manager.cc:1403] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.280s	user 0.021s	sys 0.010s
I20260709 13:19:55.043123 14479 consensus_queue.cc:237] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.049978 14349 raft_consensus.cc:359] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.050665 14349 raft_consensus.cc:385] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.050925 14349 raft_consensus.cc:740] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.051599 14349 consensus_queue.cc:260] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.062301 14349 ts_tablet_manager.cc:1434] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:19:55.065028 14349 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:55.071523 14349 tablet_bootstrap.cc:654] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.074291 13977 catalog_manager.cc:5697] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.077270 14351 tablet_bootstrap.cc:492] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:55.078058 14351 ts_tablet_manager.cc:1403] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.250s	user 0.030s	sys 0.041s
I20260709 13:19:55.059358 14449 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.084925 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:55.086958 14449 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:55.088125 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:55.088481 14348 raft_consensus.cc:359] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.088840 14299 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.089227 14348 raft_consensus.cc:385] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.089568 14348 raft_consensus.cc:740] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.090067 14347 consensus_queue.cc:260] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.091117 14149 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:55.090399 14348 consensus_queue.cc:260] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.093703 14351 raft_consensus.cc:359] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.096015 14348 ts_tablet_manager.cc:1434] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:19:55.097638 14348 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:55.097705 14299 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:55.096580 14351 raft_consensus.cc:385] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.099189 14351 raft_consensus.cc:740] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.099390 14191 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:55.100128 14351 consensus_queue.cc:260] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.104835 14479 raft_consensus.cc:2804] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.105472 14479 raft_consensus.cc:697] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:55.106330 14479 consensus_queue.cc:237] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.119513 14347 ts_tablet_manager.cc:1434] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.002s
I20260709 13:19:55.123853 14347 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:55.127044 14581 raft_consensus.cc:493] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.128132 14581 raft_consensus.cc:515] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.130534 14581 leader_election.cc:290] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:55.133809 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:55.134733 14149 raft_consensus.cc:2393] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:55.135648 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:55.136505 14348 tablet_bootstrap.cc:654] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.139386 14268 leader_election.cc:304] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:55.142371 14351 ts_tablet_manager.cc:1434] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.001s
I20260709 13:19:55.143788 14351 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:55.148012 13974 catalog_manager.cc:5697] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.141852 14581 raft_consensus.cc:3060] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.151201 14351 tablet_bootstrap.cc:654] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.163586 13973 catalog_manager.cc:5697] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.169893 14581 raft_consensus.cc:2749] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.180040 14349 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:55.180830 14349 ts_tablet_manager.cc:1403] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.028s
I20260709 13:19:55.182150 14527 consensus_queue.cc:1048] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:55.205194 14581 consensus_queue.cc:1048] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.206352 14347 tablet_bootstrap.cc:654] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.210021 14348 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:55.210675 14348 ts_tablet_manager.cc:1403] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.005s
I20260709 13:19:55.213923 14348 raft_consensus.cc:359] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.214809 14348 raft_consensus.cc:385] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.215170 14348 raft_consensus.cc:740] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.214397 14351 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:55.216614 14348 consensus_queue.cc:260] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.219069 14348 ts_tablet_manager.cc:1434] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:55.217149 14351 ts_tablet_manager.cc:1403] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.013s
I20260709 13:19:55.223024 14351 raft_consensus.cc:359] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.223805 14351 raft_consensus.cc:385] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.224067 14351 raft_consensus.cc:740] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.222661 14349 raft_consensus.cc:359] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.225600 14349 raft_consensus.cc:385] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.225934 14349 raft_consensus.cc:740] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.226452 14581 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.227255 14581 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.229863 14581 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:55.232825 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:55.233073 14351 consensus_queue.cc:260] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:19:55.234925 14268 leader_election.cc:343] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.235423 14351 ts_tablet_manager.cc:1434] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:19:55.236446 14351 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:55.236389 14479 consensus_queue.cc:1048] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.243726 14347 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:55.243981 14351 tablet_bootstrap.cc:654] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.244330 14347 ts_tablet_manager.cc:1403] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.000s
I20260709 13:19:55.229136 14349 consensus_queue.cc:260] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.247603 14527 raft_consensus.cc:493] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.247437 14347 raft_consensus.cc:359] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.248258 14347 raft_consensus.cc:385] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.248615 14347 raft_consensus.cc:740] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.248153 14527 raft_consensus.cc:515] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.249771 14347 consensus_queue.cc:260] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.252089 14347 ts_tablet_manager.cc:1434] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:55.252516 14527 leader_election.cc:290] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:55.255405 14347 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:55.257594 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:55.261745 14347 tablet_bootstrap.cc:654] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:55.261848 14194 leader_election.cc:343] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.272755 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:55.272789 14416 consensus_queue.cc:1048] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.278440 14527 raft_consensus.cc:493] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.287173 14527 raft_consensus.cc:515] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.289475 14527 leader_election.cc:290] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:55.295020 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:55.296672 14191 leader_election.cc:343] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.279690 14348 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:55.280256 14601 consensus_queue.cc:1048] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.278481 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:55.307484 14349 ts_tablet_manager.cc:1434] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 13:19:55.309042 14349 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
W20260709 13:19:55.309854 14191 leader_election.cc:343] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.310362 14191 leader_election.cc:304] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:55.311653 14527 raft_consensus.cc:2749] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:55.332341 14267 leader_election.cc:343] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.332913 14267 leader_election.cc:304] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:55.333410 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:55.335376 14193 leader_election.cc:343] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.336001 14193 leader_election.cc:304] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:55.338922 14348 tablet_bootstrap.cc:654] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.341943 14416 raft_consensus.cc:2749] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.346614 14479 raft_consensus.cc:2749] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.351053 14347 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:55.351636 14347 ts_tablet_manager.cc:1403] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.012s
I20260709 13:19:55.354516 14347 raft_consensus.cc:359] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.355219 14347 raft_consensus.cc:385] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.355490 14347 raft_consensus.cc:740] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.356508 14514 consensus_queue.cc:1048] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.361935 14347 consensus_queue.cc:260] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.364903 14347 ts_tablet_manager.cc:1434] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:55.371064 14347 tablet_bootstrap.cc:492] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:55.371147 14601 raft_consensus.cc:493] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.371995 14348 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:55.371783 14601 raft_consensus.cc:515] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.372539 14348 ts_tablet_manager.cc:1403] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.003s
I20260709 13:19:55.373580 14515 raft_consensus.cc:493] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.374254 14515 raft_consensus.cc:515] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.375859 14348 raft_consensus.cc:359] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.376694 14348 raft_consensus.cc:385] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.377015 14348 raft_consensus.cc:740] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.378038 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:55.378995 14347 tablet_bootstrap.cc:654] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.378940 14149 raft_consensus.cc:2468] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:55.378882 14348 consensus_queue.cc:260] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.381526 14045 leader_election.cc:304] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:55.382485 14376 raft_consensus.cc:2804] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.382889 14376 raft_consensus.cc:493] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.383134 14348 ts_tablet_manager.cc:1434] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:19:55.383253 14376 raft_consensus.cc:3060] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.384341 14348 tablet_bootstrap.cc:492] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:55.399571 14348 tablet_bootstrap.cc:654] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.411516 14601 leader_election.cc:290] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:55.412618 14515 leader_election.cc:290] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:55.414119 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:55.415447 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:55.416489 14227 raft_consensus.cc:2468] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:55.443668 14515 raft_consensus.cc:493] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.444456 14515 raft_consensus.cc:515] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.447355 14515 leader_election.cc:290] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:55.453492 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:55.454671 14300 raft_consensus.cc:2393] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:55.456100 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:55.459870 14042 leader_election.cc:304] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:55.461786 14399 raft_consensus.cc:3060] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.465759 14527 consensus_queue.cc:1048] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.468984 14475 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.469604 14475 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.472939 14475 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:55.474471 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:55.476478 14119 leader_election.cc:343] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.477387 14515 consensus_queue.cc:1048] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.482821 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:55.483666 14300 raft_consensus.cc:2468] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:55.484966 14117 leader_election.cc:304] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:55.488421 14475 raft_consensus.cc:2804] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.489099 14475 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.489686 14475 raft_consensus.cc:3060] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:55.495577 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 55089.7us
I20260709 13:19:55.496919 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:55.498064 14228 raft_consensus.cc:2468] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:55.502321 14348 tablet_bootstrap.cc:492] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:55.503123 14348 ts_tablet_manager.cc:1403] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.021s
I20260709 13:19:55.505254 14376 raft_consensus.cc:515] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.508419 14073 raft_consensus.cc:2393] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:55.521214 14348 raft_consensus.cc:359] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.522059 14348 raft_consensus.cc:385] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.522338 14348 raft_consensus.cc:740] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.530794 14399 raft_consensus.cc:2749] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.521188 14118 leader_election.cc:304] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:55.541275 14348 consensus_queue.cc:260] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.543217 14376 leader_election.cc:290] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:55.546635 14351 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:55.555986 14351 ts_tablet_manager.cc:1403] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.320s	user 0.072s	sys 0.106s
I20260709 13:19:55.557691 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:55.549754 14349 tablet_bootstrap.cc:654] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.550294 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:55.559518 14228 raft_consensus.cc:3060] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.563549 14351 raft_consensus.cc:359] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.557896 14601 raft_consensus.cc:2804] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.564792 14351 raft_consensus.cc:385] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.564339 14479 consensus_queue.cc:1048] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.565730 14348 ts_tablet_manager.cc:1434] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:19:55.572189 14348 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:55.566298 14351 raft_consensus.cc:740] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.565536 14601 raft_consensus.cc:493] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.573870 14351 consensus_queue.cc:260] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.590121 14601 raft_consensus.cc:3060] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.554673 14475 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.595427 14399 consensus_queue.cc:1048] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.598794 14347 tablet_bootstrap.cc:492] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:55.599390 14347 ts_tablet_manager.cc:1403] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.229s	user 0.077s	sys 0.094s
I20260709 13:19:55.602550 14347 raft_consensus.cc:359] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.603345 14347 raft_consensus.cc:385] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.603649 14347 raft_consensus.cc:740] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.604390 14347 consensus_queue.cc:260] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.605485 14351 ts_tablet_manager.cc:1434] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:19:55.606755 14351 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:55.609927 14348 tablet_bootstrap.cc:654] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.606793 14347 ts_tablet_manager.cc:1434] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:55.614037 14347 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:55.636615 14151 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.644534 14533 raft_consensus.cc:493] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.667867 14601 raft_consensus.cc:515] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.669162 14150 raft_consensus.cc:2393] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:19:55.681627 14475 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:55.683274 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:55.684010 14300 raft_consensus.cc:3060] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.645301 14533 raft_consensus.cc:515] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.688947 14347 tablet_bootstrap.cc:654] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.688880 14533 leader_election.cc:290] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:55.690081 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:55.690828 14227 raft_consensus.cc:2468] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:55.699515 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:55.699879 14449 consensus_queue.cc:1048] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:55.705118 14267 leader_election.cc:343] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.696429 14448 raft_consensus.cc:493] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.706059 14448 raft_consensus.cc:515] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.706684 14348 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:55.707255 14348 ts_tablet_manager.cc:1403] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.135s	user 0.032s	sys 0.028s
I20260709 13:19:55.708307 14448 leader_election.cc:290] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:55.710749 14348 raft_consensus.cc:359] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.712147 14348 raft_consensus.cc:385] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.712514 14348 raft_consensus.cc:740] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.713763 14348 consensus_queue.cc:260] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.714351 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:55.714686 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7edac8cddd4927a4d0c73332149e41" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:55.715828 14119 leader_election.cc:343] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.716562 14266 leader_election.cc:304] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:19:55.716805 14193 leader_election.cc:343] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.719859 14601 leader_election.cc:290] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:55.720706 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:55.721590 14073 raft_consensus.cc:2393] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:55.722546 14349 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:55.723075 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:55.724020 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7edac8cddd4927a4d0c73332149e41" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:55.723073 14349 ts_tablet_manager.cc:1403] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.414s	user 0.031s	sys 0.010s
I20260709 13:19:55.725018 14581 raft_consensus.cc:2804] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.725481 14581 raft_consensus.cc:493] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.725831 14581 raft_consensus.cc:3060] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:55.725898 14194 leader_election.cc:343] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.726531 14194 leader_election.cc:304] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:55.727811 14449 consensus_queue.cc:1048] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.728768 14448 raft_consensus.cc:2749] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.727867 14349 raft_consensus.cc:359] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.729712 14349 raft_consensus.cc:385] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.730270 14349 raft_consensus.cc:740] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.729660 14601 raft_consensus.cc:493] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.731168 14118 leader_election.cc:304] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:55.732306 14475 raft_consensus.cc:2749] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.734612 14581 raft_consensus.cc:515] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.732038 14349 consensus_queue.cc:260] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.731127 14601 raft_consensus.cc:515] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.737639 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:55.738292 14348 ts_tablet_manager.cc:1434] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:19:55.738360 14227 raft_consensus.cc:3060] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.739688 14349 ts_tablet_manager.cc:1434] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:19:55.740746 14349 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:55.738651 14228 raft_consensus.cc:2468] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:55.743856 14351 tablet_bootstrap.cc:654] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.729226 14300 raft_consensus.cc:2468] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:55.749953 14348 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:55.755435 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:55.756309 14299 raft_consensus.cc:2468] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:55.758340 14117 leader_election.cc:304] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:55.759366 14475 raft_consensus.cc:2804] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.759774 14475 raft_consensus.cc:493] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.760147 14475 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.744733 14601 leader_election.cc:290] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:55.768525 14043 leader_election.cc:304] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:55.771121 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:55.771812 14073 raft_consensus.cc:3060] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.771894 14117 leader_election.cc:304] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:55.773353 14514 raft_consensus.cc:2804] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.773705 14376 raft_consensus.cc:2804] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.773999 14514 raft_consensus.cc:697] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:55.774209 14376 raft_consensus.cc:697] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:55.774904 14376 consensus_queue.cc:237] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.774905 14514 consensus_queue.cc:237] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:55.767432 14581 leader_election.cc:290] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:55.783392 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:55.806396 14228 raft_consensus.cc:2468] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:55.848532 14227 raft_consensus.cc:2468] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:55.813083 14475 raft_consensus.cc:515] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:55.851179 14266 leader_election.cc:304] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:55.851732 14475 leader_election.cc:290] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:55.852154 14533 raft_consensus.cc:2804] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.852687 14533 raft_consensus.cc:697] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:55.852866 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:55.853538 14299 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.853564 14533 consensus_queue.cc:237] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:55.860244 14348 tablet_bootstrap.cc:654] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.850472 14073 raft_consensus.cc:2468] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:55.902961 14347 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:55.903524 14347 ts_tablet_manager.cc:1403] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.290s	user 0.017s	sys 0.008s
I20260709 13:19:55.907768 14347 raft_consensus.cc:359] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.908735 14347 raft_consensus.cc:385] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.909027 14347 raft_consensus.cc:740] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.909834 14347 consensus_queue.cc:260] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:55.915329 14349 tablet_bootstrap.cc:654] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.922400 14347 ts_tablet_manager.cc:1434] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:19:55.931456 14351 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:55.932010 14351 ts_tablet_manager.cc:1403] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.326s	user 0.038s	sys 0.031s
I20260709 13:19:55.932133 14347 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:55.940392 14299 raft_consensus.cc:2468] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:55.941798 14117 leader_election.cc:304] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:55.944024 14554 raft_consensus.cc:2804] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.901098 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:55.949091 14227 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.932047 13973 catalog_manager.cc:5697] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.019295 14351 raft_consensus.cc:359] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.024061 14351 raft_consensus.cc:385] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.023015 14349 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:56.024894 14349 ts_tablet_manager.cc:1403] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.284s	user 0.013s	sys 0.005s
I20260709 13:19:55.953714 14554 raft_consensus.cc:697] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:56.029156 14554 consensus_queue.cc:237] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.030568 14349 raft_consensus.cc:359] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.020284 14348 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:56.032119 14348 ts_tablet_manager.cc:1403] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.286s	user 0.014s	sys 0.002s
I20260709 13:19:56.032575 14347 tablet_bootstrap.cc:654] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.034680 14227 raft_consensus.cc:2468] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:55.951666 13974 catalog_manager.cc:5697] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.036427 13976 catalog_manager.cc:5697] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.037664 14348 raft_consensus.cc:359] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.038599 14348 raft_consensus.cc:385] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.040477 14348 raft_consensus.cc:740] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.042620 14348 consensus_queue.cc:260] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.039013 14349 raft_consensus.cc:385] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.031354 14351 raft_consensus.cc:740] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.046059 14349 raft_consensus.cc:740] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.060961 14349 consensus_queue.cc:260] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.060174 14351 consensus_queue.cc:260] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.065610 14351 ts_tablet_manager.cc:1434] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.133s	user 0.007s	sys 0.015s
I20260709 13:19:56.066684 14351 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:56.069798 14449 raft_consensus.cc:493] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.070817 14348 ts_tablet_manager.cc:1434] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:19:56.071496 14449 raft_consensus.cc:515] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.072940 14348 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:56.074846 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:56.076566 14191 leader_election.cc:343] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:56.078759 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:56.083343 14348 tablet_bootstrap.cc:654] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.085786 14349 ts_tablet_manager.cc:1434] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.002s
I20260709 13:19:56.087144 14349 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:56.092406 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:56.095945 14193 leader_election.cc:343] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.096544 14193 leader_election.cc:304] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:56.097594 14640 raft_consensus.cc:2749] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.089330 14449 leader_election.cc:290] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:56.110072 14348 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:56.110671 14348 ts_tablet_manager.cc:1403] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.019s
I20260709 13:19:56.113616 14348 raft_consensus.cc:359] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.114353 14348 raft_consensus.cc:385] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.114614 14348 raft_consensus.cc:740] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.117079 14347 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:56.118274 14347 ts_tablet_manager.cc:1403] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.193s	user 0.034s	sys 0.013s
I20260709 13:19:56.118142 14348 consensus_queue.cc:260] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.121125 14349 tablet_bootstrap.cc:654] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.124526 14348 ts_tablet_manager.cc:1434] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:19:56.125780 14348 tablet_bootstrap.cc:492] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:56.122138 14347 raft_consensus.cc:359] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.126938 14347 raft_consensus.cc:385] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.127236 14347 raft_consensus.cc:740] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.128284 14347 consensus_queue.cc:260] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.130646 14351 tablet_bootstrap.cc:654] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.133658 14348 tablet_bootstrap.cc:654] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.134685 14347 ts_tablet_manager.cc:1434] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:19:56.135538 14347 tablet_bootstrap.cc:492] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:56.142894 14347 tablet_bootstrap.cc:654] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.143756 14351 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:56.144297 14351 ts_tablet_manager.cc:1403] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.078s	user 0.004s	sys 0.007s
I20260709 13:19:56.146035 14348 tablet_bootstrap.cc:492] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:56.148406 14348 ts_tablet_manager.cc:1403] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.007s
I20260709 13:19:56.146889 14349 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:56.147384 14351 raft_consensus.cc:359] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.150089 14351 raft_consensus.cc:385] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.150235 14349 ts_tablet_manager.cc:1403] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.004s
I20260709 13:19:56.150413 14351 raft_consensus.cc:740] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.151201 14351 consensus_queue.cc:260] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.155241 14347 tablet_bootstrap.cc:492] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:56.155870 14347 ts_tablet_manager.cc:1403] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:19:56.161561 14348 raft_consensus.cc:359] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.162362 14348 raft_consensus.cc:385] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.162643 14348 raft_consensus.cc:740] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.164559 14349 raft_consensus.cc:359] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.165792 14349 raft_consensus.cc:385] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.166265 14349 raft_consensus.cc:740] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.163373 14348 consensus_queue.cc:260] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.167374 14349 consensus_queue.cc:260] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.169266 14348 ts_tablet_manager.cc:1434] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:19:56.171921 14348 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:56.173628 14349 ts_tablet_manager.cc:1434] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:19:56.174769 14349 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:56.169093 14347 raft_consensus.cc:359] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.182106 14347 raft_consensus.cc:385] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.182330 14351 ts_tablet_manager.cc:1434] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260709 13:19:56.182479 14347 raft_consensus.cc:740] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.183084 14348 tablet_bootstrap.cc:654] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.183646 14347 consensus_queue.cc:260] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.184532 14416 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.185200 14416 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.186614 14347 ts_tablet_manager.cc:1434] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:19:56.188059 14416 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:56.193948 14347 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:56.200168 14348 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:56.200757 14348 ts_tablet_manager.cc:1403] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.001s
I20260709 13:19:56.203611 14348 raft_consensus.cc:359] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.204335 14348 raft_consensus.cc:385] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.204618 14348 raft_consensus.cc:740] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.205384 14348 consensus_queue.cc:260] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.206393 14349 tablet_bootstrap.cc:654] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.209995 14347 tablet_bootstrap.cc:654] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.183890 14351 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:56.189359 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:56.189878 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:56.212090 14149 raft_consensus.cc:2468] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:56.191782 14533 raft_consensus.cc:493] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.212821 14533 raft_consensus.cc:515] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.214349 14348 ts_tablet_manager.cc:1434] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.008s
I20260709 13:19:56.215549 14348 tablet_bootstrap.cc:492] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:56.215904 14533 leader_election.cc:290] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:19:56.216157 14267 leader_election.cc:343] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.217852 14351 tablet_bootstrap.cc:654] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.218022 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:56.218712 14227 raft_consensus.cc:2468] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:56.220999 14266 leader_election.cc:304] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:56.222131 14348 tablet_bootstrap.cc:654] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.221911 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:56.225116 13973 catalog_manager.cc:5697] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.227525 14268 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:56.228847 14416 raft_consensus.cc:2804] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.229226 14416 raft_consensus.cc:493] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.229600 14416 raft_consensus.cc:3060] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.237790 14348 tablet_bootstrap.cc:492] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:56.238349 14348 ts_tablet_manager.cc:1403] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:19:56.241415 14351 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:56.241279 14348 raft_consensus.cc:359] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.242041 14351 ts_tablet_manager.cc:1403] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.006s
I20260709 13:19:56.242079 14348 raft_consensus.cc:385] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.242560 14348 raft_consensus.cc:740] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.243505 14348 consensus_queue.cc:260] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
W20260709 13:19:56.244139 14267 leader_election.cc:343] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.244596 14581 raft_consensus.cc:2804] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.244982 14581 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.245342 14581 raft_consensus.cc:3060] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.245250 14351 raft_consensus.cc:359] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.246163 14351 raft_consensus.cc:385] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.246477 14351 raft_consensus.cc:740] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.247329 14351 consensus_queue.cc:260] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.245704 14416 raft_consensus.cc:515] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.251060 14351 ts_tablet_manager.cc:1434] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:56.253724 14641 raft_consensus.cc:493] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.254221 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:56.254344 14641 raft_consensus.cc:515] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.254974 14227 raft_consensus.cc:3060] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.256029 14348 ts_tablet_manager.cc:1434] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:19:56.254514 14581 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.257863 14348 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:56.258929 14351 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:56.262281 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7edac8cddd4927a4d0c73332149e41" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:56.263005 14228 raft_consensus.cc:2468] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:56.264323 14118 leader_election.cc:304] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:56.265394 14554 raft_consensus.cc:2804] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.265915 14554 raft_consensus.cc:493] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.266368 14554 raft_consensus.cc:3060] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.256914 14641 leader_election.cc:290] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:56.269374 14640 raft_consensus.cc:493] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.280139 14640 raft_consensus.cc:515] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.281098 14554 raft_consensus.cc:515] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.284518 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7edac8cddd4927a4d0c73332149e41" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:56.284793 14640 leader_election.cc:290] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:56.285318 14077 raft_consensus.cc:2468] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:56.285742 14533 raft_consensus.cc:493] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.298448 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:56.294344 14533 raft_consensus.cc:515] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.303119 14475 consensus_queue.cc:1048] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.305954 14077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:56.305979 14194 leader_election.cc:343] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.308786 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:56.316771 14266 leader_election.cc:343] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.318395 14077 raft_consensus.cc:3060] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.320026 14349 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:56.320722 14349 ts_tablet_manager.cc:1403] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.010s
I20260709 13:19:56.320653 14416 leader_election.cc:290] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:19:56.322042 14193 leader_election.cc:343] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.324339 14581 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:56.324754 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:56.326960 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:56.328739 14351 tablet_bootstrap.cc:654] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.346072 14533 leader_election.cc:290] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:19:56.346716 14267 leader_election.cc:343] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.347342 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:56.348119 14150 raft_consensus.cc:3060] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.329173 14193 leader_election.cc:304] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:56.350438 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:56.352487 14479 raft_consensus.cc:2749] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:56.352843 14267 leader_election.cc:343] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.353365 14267 leader_election.cc:304] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:56.354823 14533 raft_consensus.cc:2749] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.358384 14554 leader_election.cc:290] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:56.358939 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7edac8cddd4927a4d0c73332149e41" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:56.359483 14076 raft_consensus.cc:3060] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.367621 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7edac8cddd4927a4d0c73332149e41" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:56.368315 14228 raft_consensus.cc:3060] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.383621 14376 consensus_queue.cc:1048] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.389134 14515 consensus_queue.cc:1048] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.362495 14227 raft_consensus.cc:2468] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:56.387831 14664 raft_consensus.cc:493] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.420029 14533 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.420607 14533 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.419802 14416 consensus_queue.cc:1048] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.422874 14347 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:56.423317 14347 ts_tablet_manager.cc:1403] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.230s	user 0.034s	sys 0.027s
I20260709 13:19:56.429911 14533 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:56.430843 14663 consensus_queue.cc:1048] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.431667 14348 tablet_bootstrap.cc:654] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:56.433616 14267 leader_election.cc:343] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.434610 14349 raft_consensus.cc:359] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.435304 14349 raft_consensus.cc:385] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.435549 14349 raft_consensus.cc:740] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.436157 14349 consensus_queue.cc:260] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.408975 14641 raft_consensus.cc:493] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.444164 14349 ts_tablet_manager.cc:1434] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 13:19:56.440376 14076 raft_consensus.cc:2468] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:56.445744 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:56.446321 14266 leader_election.cc:304] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:56.447742 14228 raft_consensus.cc:2468] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:56.450809 14416 raft_consensus.cc:2804] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.451442 14416 raft_consensus.cc:697] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:56.452237 14416 consensus_queue.cc:237] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.433648 14514 consensus_queue.cc:1048] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:19:56.415737 14664 raft_consensus.cc:515] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.457535 14664 leader_election.cc:290] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:56.458716 14351 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:56.459494 14351 ts_tablet_manager.cc:1403] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.201s	user 0.018s	sys 0.000s
I20260709 13:19:56.459609 14119 leader_election.cc:304] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:56.460124 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e920394df0034e98ab19842b8206bbb5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:56.463011 14349 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:56.465595 14347 raft_consensus.cc:359] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.470398 14347 raft_consensus.cc:385] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.470816 14347 raft_consensus.cc:740] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.468367 14581 raft_consensus.cc:493] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.448817 14641 raft_consensus.cc:515] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.473418 14347 consensus_queue.cc:260] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.467197 14514 raft_consensus.cc:2804] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.462136 14150 raft_consensus.cc:2468] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
W20260709 13:19:56.468730 14267 leader_election.cc:343] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.493613 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:56.477656 14581 raft_consensus.cc:515] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.487869 14351 raft_consensus.cc:359] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.496855 14351 raft_consensus.cc:385] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.497161 14351 raft_consensus.cc:740] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.497928 14351 consensus_queue.cc:260] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.499176 14301 raft_consensus.cc:2468] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:56.500128 14351 ts_tablet_manager.cc:1434] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:19:56.501103 14351 tablet_bootstrap.cc:492] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
W20260709 13:19:56.501439 14268 leader_election.cc:343] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.491909 14641 leader_election.cc:290] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:56.461781 14475 consensus_queue.cc:1048] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:19:56.495813 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e920394df0034e98ab19842b8206bbb5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:56.469502 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:56.502753 14268 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:56.519881 14376 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.516960 14117 leader_election.cc:304] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:56.506265 14581 leader_election.cc:290] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:56.520442 14376 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.511382 14514 raft_consensus.cc:697] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:56.517544 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:56.546072 14376 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:56.531023 14416 raft_consensus.cc:2804] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.564087 14347 ts_tablet_manager.cc:1434] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.141s	user 0.014s	sys 0.009s
I20260709 13:19:56.565830 14347 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:56.575054 14351 tablet_bootstrap.cc:654] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.554141 14150 raft_consensus.cc:2468] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
W20260709 13:19:56.559048 14268 leader_election.cc:343] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.558422 14416 raft_consensus.cc:697] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:56.583395 14475 raft_consensus.cc:2804] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.592657 14348 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:56.593317 14348 ts_tablet_manager.cc:1403] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.336s	user 0.026s	sys 0.019s
I20260709 13:19:56.593837 14640 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:56.574156 14266 leader_election.cc:343] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:56.601765 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 88569.4us
I20260709 13:19:56.615684 14349 tablet_bootstrap.cc:654] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.621933 14416 consensus_queue.cc:237] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:56.635346 14475 raft_consensus.cc:493] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.636134 14475 raft_consensus.cc:3060] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.594415 14640 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.618561 14266 leader_election.cc:304] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
W20260709 13:19:56.652451 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 81500.1us
I20260709 13:19:56.657629 14581 raft_consensus.cc:2749] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.576107 14514 consensus_queue.cc:237] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:56.595510 14268 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:19:56.666684 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 109778us
I20260709 13:19:56.667061 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:56.668474 14268 leader_election.cc:304] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:56.637776 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:56.673316 13977 catalog_manager.cc:5697] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.686772 14348 raft_consensus.cc:359] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.695618 14348 raft_consensus.cc:385] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.696112 14348 raft_consensus.cc:740] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.678303 14151 raft_consensus.cc:2393] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:19:56.681849 14663 raft_consensus.cc:2804] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.680243 14640 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:19:56.702890 14666 log.cc:927] Time spent T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d: Append to log took a long time: real 0.167s	user 0.004s	sys 0.000s
I20260709 13:19:56.704545 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:56.697118 14348 consensus_queue.cc:260] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.676514 14479 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.678404 14533 raft_consensus.cc:2749] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.711385 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:56.729918 14479 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.736903 14150 raft_consensus.cc:2468] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
W20260709 13:19:56.714226 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 88801.5us
I20260709 13:19:56.745187 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:56.747565 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:56.748272 14300 raft_consensus.cc:2468] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:56.713503 14663 raft_consensus.cc:493] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.755414 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:56.764345 14663 raft_consensus.cc:3060] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.782863 14347 tablet_bootstrap.cc:654] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.783605 14191 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:56.784461 14479 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:56.785123 14479 raft_consensus.cc:2804] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.785542 14479 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.785961 14479 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.789333 14194 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:56.836591 14348 ts_tablet_manager.cc:1434] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.243s	user 0.015s	sys 0.004s
I20260709 13:19:56.838654 14348 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:56.834829 14640 raft_consensus.cc:2804] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:56.831660 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 53700.6us
I20260709 13:19:56.853950 14349 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:56.854130 14351 tablet_bootstrap.cc:492] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
W20260709 13:19:56.834486 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 142000us
I20260709 13:19:56.856479 14351 ts_tablet_manager.cc:1403] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.356s	user 0.018s	sys 0.023s
I20260709 13:19:56.856273 14349 ts_tablet_manager.cc:1403] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.409s	user 0.014s	sys 0.016s
I20260709 13:19:56.863020 14663 raft_consensus.cc:515] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.864907 14348 tablet_bootstrap.cc:654] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.866539 14663 leader_election.cc:290] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:56.848927 14640 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.885288 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
W20260709 13:19:56.891661 14193 leader_election.cc:343] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.897714 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:56.899235 14479 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:19:56.902554 14193 leader_election.cc:343] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.903784 14479 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:56.904366 14349 raft_consensus.cc:359] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:56.905372 14349 raft_consensus.cc:385] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.905768 14349 raft_consensus.cc:740] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.906543 14349 consensus_queue.cc:260] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:19:56.907296 14118 leader_election.cc:343] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.910262 14349 ts_tablet_manager.cc:1434] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:19:56.896924 14351 raft_consensus.cc:359] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.911365 14351 raft_consensus.cc:385] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.912297 14349 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:56.911805 14351 raft_consensus.cc:740] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.883688 14640 raft_consensus.cc:3060] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.928309 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:56.929759 14042 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:56.931386 14697 raft_consensus.cc:3060] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:56.910380 14045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 55858.8us
I20260709 13:19:56.947660 14351 consensus_queue.cc:260] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.962143 14351 ts_tablet_manager.cc:1434] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.001s
I20260709 13:19:56.942204 14475 raft_consensus.cc:515] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:56.945998 14641 consensus_queue.cc:1048] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:19:56.974954 14149 raft_consensus.cc:2393] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:19:56.982075 14475 leader_election.cc:290] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:56.983892 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:56.984742 14228 raft_consensus.cc:3060] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:56.985564 14266 leader_election.cc:343] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.988152 14349 tablet_bootstrap.cc:654] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.991698 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:56.993862 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:56.993883 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:56.995950 14347 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:57.015602 14347 ts_tablet_manager.cc:1403] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.450s	user 0.024s	sys 0.022s
W20260709 13:19:57.018253 14042 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 86730.6us
I20260709 13:19:57.012921 14228 raft_consensus.cc:2468] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:57.020561 14297 raft_consensus.cc:2393] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:19:57.019404 14301 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.054883 14351 tablet_bootstrap.cc:492] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
W20260709 13:19:57.067675 14193 leader_election.cc:343] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.084100 14301 raft_consensus.cc:2468] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:57.092804 14191 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:57.094552 14348 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:57.095136 14348 ts_tablet_manager.cc:1403] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.258s	user 0.056s	sys 0.017s
I20260709 13:19:57.101847 14682 raft_consensus.cc:2804] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.102507 14682 raft_consensus.cc:697] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:57.102749 14077 raft_consensus.cc:3060] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.103462 14682 consensus_queue.cc:237] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.105530 14118 leader_election.cc:304] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:57.106449 14674 raft_consensus.cc:2804] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.107124 14674 raft_consensus.cc:697] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:57.105150 14347 raft_consensus.cc:359] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.108258 14347 raft_consensus.cc:385] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.108527 14347 raft_consensus.cc:740] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.107894 13973 catalog_manager.cc:5697] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.109130 14347 consensus_queue.cc:260] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.109612 14674 consensus_queue.cc:237] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:57.121554 14702 consensus_queue.cc:1048] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.126361 14697 raft_consensus.cc:2749] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.135986 14640 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.137480 14349 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:57.138151 14349 ts_tablet_manager.cc:1403] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.226s	user 0.021s	sys 0.012s
I20260709 13:19:57.139495 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
W20260709 13:19:57.141206 14193 leader_election.cc:343] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.142138 14349 raft_consensus.cc:359] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.142911 14349 raft_consensus.cc:385] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.143189 14349 raft_consensus.cc:740] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.143987 14349 consensus_queue.cc:260] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.144923 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:57.148217 14149 raft_consensus.cc:3060] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.150132 14702 consensus_queue.cc:1048] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.161134 14347 ts_tablet_manager.cc:1434] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.145s	user 0.008s	sys 0.000s
I20260709 13:19:57.163074 14677 raft_consensus.cc:493] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.163702 14677 raft_consensus.cc:515] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.165366 14347 tablet_bootstrap.cc:492] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:57.169505 14349 ts_tablet_manager.cc:1434] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:19:57.170787 14349 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:57.145023 14640 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:57.187201 14689 consensus_queue.cc:1048] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:57.191845 14149 raft_consensus.cc:2468] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:57.195035 14194 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:57.197921 14449 raft_consensus.cc:2804] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.198549 14449 raft_consensus.cc:697] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:57.144927 14266 leader_election.cc:304] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:57.201550 14674 consensus_queue.cc:1048] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:57.216013 14689 raft_consensus.cc:2749] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.216240 14449 consensus_queue.cc:237] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.230803 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:57.235312 14222 raft_consensus.cc:2468] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:57.237298 14118 leader_election.cc:304] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:57.228293 14348 raft_consensus.cc:359] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.239569 14348 raft_consensus.cc:385] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.220368 14347 tablet_bootstrap.cc:654] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.229183 14351 tablet_bootstrap.cc:654] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.241142 14674 raft_consensus.cc:2804] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.241737 14674 raft_consensus.cc:493] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.240051 14348 raft_consensus.cc:740] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.242157 14674 raft_consensus.cc:3060] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.244328 14348 consensus_queue.cc:260] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.243182 14679 consensus_queue.cc:1048] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:19:57.232537 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:57.233892 14677 leader_election.cc:290] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:19:57.260592 14119 leader_election.cc:343] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.261796 14701 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.262382 14701 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.268173 14701 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:57.268699 14349 tablet_bootstrap.cc:654] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.270143 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:57.282733 14674 raft_consensus.cc:515] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.284981 14674 leader_election.cc:290] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:19:57.219508 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 74128.7us
I20260709 13:19:57.291065 14348 ts_tablet_manager.cc:1434] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.196s	user 0.006s	sys 0.002s
I20260709 13:19:57.291409 14662 consensus_queue.cc:1048] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.292198 14348 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
W20260709 13:19:57.294346 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:57.293403 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:57.296766 14222 raft_consensus.cc:3060] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.308449 14348 tablet_bootstrap.cc:654] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.313723 13976 catalog_manager.cc:5697] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.327978 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:57.310539 14222 raft_consensus.cc:2468] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:57.343081 14118 leader_election.cc:304] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:57.352298 13973 catalog_manager.cc:5697] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:57.359051 14119 leader_election.cc:343] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.360651 14674 raft_consensus.cc:2804] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.368913 14674 raft_consensus.cc:697] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:57.371644 14674 consensus_queue.cc:237] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.383018 13977 catalog_manager.cc:5697] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.388274 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:57.389303 14301 raft_consensus.cc:2393] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:57.406107 14351 tablet_bootstrap.cc:492] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:57.406728 14351 ts_tablet_manager.cc:1403] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.352s	user 0.029s	sys 0.029s
I20260709 13:19:57.419458 14347 tablet_bootstrap.cc:492] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:57.420032 14347 ts_tablet_manager.cc:1403] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.255s	user 0.019s	sys 0.014s
I20260709 13:19:57.429093 14042 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:57.430326 14697 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.445467 14349 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:57.446436 14349 ts_tablet_manager.cc:1403] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.276s	user 0.012s	sys 0.011s
I20260709 13:19:57.453284 14349 raft_consensus.cc:359] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.454057 14349 raft_consensus.cc:385] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.454326 14349 raft_consensus.cc:740] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.454988 14349 consensus_queue.cc:260] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.457144 14349 ts_tablet_manager.cc:1434] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:19:57.458694 14351 raft_consensus.cc:359] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:57.459568 14351 raft_consensus.cc:385] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.459869 14351 raft_consensus.cc:740] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.461035 14351 consensus_queue.cc:260] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:57.464402 14349 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:57.468255 14351 ts_tablet_manager.cc:1434] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:19:57.473822 14351 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:57.491173 14351 tablet_bootstrap.cc:654] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.492599 14349 tablet_bootstrap.cc:654] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.498185 14347 raft_consensus.cc:359] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:57.499030 14347 raft_consensus.cc:385] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.499313 14347 raft_consensus.cc:740] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.499997 14347 consensus_queue.cc:260] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:57.506356 14697 raft_consensus.cc:2749] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.513535 14348 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:57.514389 14348 ts_tablet_manager.cc:1403] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.222s	user 0.023s	sys 0.024s
I20260709 13:19:57.519433 14347 ts_tablet_manager.cc:1434] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 13:19:57.519511 14348 raft_consensus.cc:359] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.522998 14348 raft_consensus.cc:385] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.523276 14348 raft_consensus.cc:740] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.524056 14416 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.524712 14416 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.526991 14416 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:57.528581 14349 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:57.529282 14349 ts_tablet_manager.cc:1403] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.003s
I20260709 13:19:57.529366 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:57.524125 14348 consensus_queue.cc:260] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:19:57.531112 14267 leader_election.cc:343] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.537097 14347 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:57.538722 14349 raft_consensus.cc:359] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.539526 14349 raft_consensus.cc:385] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.539660 14348 ts_tablet_manager.cc:1434] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 13:19:57.539822 14349 raft_consensus.cc:740] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.540843 14348 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:57.542729 14349 consensus_queue.cc:260] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.545382 14349 ts_tablet_manager.cc:1434] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:19:57.545181 13977 catalog_manager.cc:5697] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.552165 14347 tablet_bootstrap.cc:654] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.553210 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:57.557374 14349 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:57.564121 14349 tablet_bootstrap.cc:654] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:57.574177 14268 leader_election.cc:343] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.575068 14268 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:57.579425 14348 tablet_bootstrap.cc:654] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.580483 14703 raft_consensus.cc:2749] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.603134 14701 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.603689 14701 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.606916 14701 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:57.607641 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:57.608541 14151 raft_consensus.cc:2393] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:19:57.610239 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:57.618410 14043 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:57.624938 14701 raft_consensus.cc:3060] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.631238 14641 raft_consensus.cc:493] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.631867 14641 raft_consensus.cc:515] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:57.633309 14677 consensus_queue.cc:1048] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.635185 14641 leader_election.cc:290] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:57.637038 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e920394df0034e98ab19842b8206bbb5" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:57.637775 14228 raft_consensus.cc:2468] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:57.642516 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e920394df0034e98ab19842b8206bbb5" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:57.643687 14301 raft_consensus.cc:2468] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:57.645289 14118 leader_election.cc:304] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:57.647565 13973 catalog_manager.cc:5697] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.657239 14351 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:57.657943 14351 ts_tablet_manager.cc:1403] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.187s	user 0.007s	sys 0.011s
I20260709 13:19:57.659446 14349 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:57.660307 14349 ts_tablet_manager.cc:1403] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.114s	user 0.025s	sys 0.010s
I20260709 13:19:57.660987 14351 raft_consensus.cc:359] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.661832 14351 raft_consensus.cc:385] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.662150 14351 raft_consensus.cc:740] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.652313 14641 raft_consensus.cc:2804] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.663000 14351 consensus_queue.cc:260] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.669121 14641 raft_consensus.cc:493] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.669682 14641 raft_consensus.cc:3060] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.677477 14701 raft_consensus.cc:2749] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.682940 14641 raft_consensus.cc:515] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:57.686653 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e920394df0034e98ab19842b8206bbb5" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:57.687261 14228 raft_consensus.cc:3060] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.689846 14349 raft_consensus.cc:359] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.690734 14349 raft_consensus.cc:385] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.691049 14349 raft_consensus.cc:740] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.691404 14449 consensus_queue.cc:1048] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.692054 14349 consensus_queue.cc:260] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.695538 14349 ts_tablet_manager.cc:1434] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:19:57.697495 14349 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:57.700325 14351 ts_tablet_manager.cc:1434] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:19:57.701452 14351 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:57.704229 14349 tablet_bootstrap.cc:654] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.711372 14687 consensus_queue.cc:1048] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.717293 14449 consensus_queue.cc:1048] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.720145 14228 raft_consensus.cc:2468] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:57.730633 14118 leader_election.cc:304] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:57.731894 14677 raft_consensus.cc:2804] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.732659 14677 raft_consensus.cc:697] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:57.733970 14677 consensus_queue.cc:237] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:57.735381 14347 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:57.735719 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e920394df0034e98ab19842b8206bbb5" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:57.736420 14298 raft_consensus.cc:3060] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.723440 14348 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:57.727684 14641 leader_election.cc:290] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:57.737871 14348 ts_tablet_manager.cc:1403] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.197s	user 0.031s	sys 0.015s
I20260709 13:19:57.720145 14351 tablet_bootstrap.cc:654] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.740669 14514 consensus_queue.cc:1048] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.746739 14688 consensus_queue.cc:1048] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.757792 14688 raft_consensus.cc:493] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.740906 14348 raft_consensus.cc:359] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.759526 14348 raft_consensus.cc:385] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.759915 14348 raft_consensus.cc:740] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.760848 14348 consensus_queue.cc:260] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.735955 14347 ts_tablet_manager.cc:1403] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.199s	user 0.038s	sys 0.032s
I20260709 13:19:57.758363 14688 raft_consensus.cc:515] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.780763 14348 ts_tablet_manager.cc:1434] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:19:57.784296 14688 leader_election.cc:290] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:57.796881 14416 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.797634 14416 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.801221 14416 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:57.801577 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:57.803385 14266 leader_election.cc:343] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.797125 14349 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:57.810869 14349 ts_tablet_manager.cc:1403] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.005s
I20260709 13:19:57.810062 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:57.811838 14302 raft_consensus.cc:2468] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:57.813731 14348 tablet_bootstrap.cc:492] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:57.815342 14351 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:57.819064 14347 raft_consensus.cc:359] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.819828 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:57.828852 14351 ts_tablet_manager.cc:1403] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.014s
I20260709 13:19:57.829383 14347 raft_consensus.cc:385] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.829804 14347 raft_consensus.cc:740] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.830583 14347 consensus_queue.cc:260] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.831293 14351 raft_consensus.cc:359] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.832033 14351 raft_consensus.cc:385] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.832307 14351 raft_consensus.cc:740] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.821527 14349 raft_consensus.cc:359] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.833963 14697 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.834560 14697 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.834491 14351 consensus_queue.cc:260] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:57.833603 14349 raft_consensus.cc:385] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.835984 14349 raft_consensus.cc:740] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.836380 14641 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.838899 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:57.840252 14351 ts_tablet_manager.cc:1434] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:19:57.840001 14641 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.841363 14351 tablet_bootstrap.cc:492] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:57.841859 14697 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:57.842130 14150 raft_consensus.cc:2468] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:57.843545 14349 consensus_queue.cc:260] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.845774 14349 ts_tablet_manager.cc:1434] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:19:57.845835 14629 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.846464 14629 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:57.848899 14347 ts_tablet_manager.cc:1434] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.005s
I20260709 13:19:57.845238 14045 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:57.855873 14347 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:57.849146 13973 catalog_manager.cc:5697] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.851239 14629 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:57.851689 14191 leader_election.cc:304] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:57.862519 14349 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
W20260709 13:19:57.870801 14193 leader_election.cc:343] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.862037 14705 raft_consensus.cc:2804] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.861515 14298 raft_consensus.cc:2468] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:57.868943 14449 raft_consensus.cc:2804] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.875483 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:57.879565 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:57.881961 14449 raft_consensus.cc:493] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.884086 14449 raft_consensus.cc:3060] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.883857 14296 raft_consensus.cc:2468] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:57.878221 14705 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.889150 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:57.889930 14705 raft_consensus.cc:3060] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.890239 14296 raft_consensus.cc:2468] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:57.891391 14042 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:57.892253 14629 raft_consensus.cc:2804] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.892633 14629 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.892952 14629 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.893988 14117 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:57.895026 14674 raft_consensus.cc:2804] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.895429 14674 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.895841 14674 raft_consensus.cc:3060] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.895371 14641 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:57.877524 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:57.922530 14449 raft_consensus.cc:515] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:57.926220 14449 leader_election.cc:290] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:57.926365 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
W20260709 13:19:57.928085 14193 leader_election.cc:343] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.928814 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:57.940181 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
W20260709 13:19:57.947409 14045 leader_election.cc:343] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.955381 14347 tablet_bootstrap.cc:654] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.958472 14351 tablet_bootstrap.cc:654] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.945535 14674 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:19:57.961262 14267 leader_election.cc:343] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.961807 14267 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:57.963615 14702 raft_consensus.cc:2749] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.929854 14297 raft_consensus.cc:2468] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:57.962132 14674 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:57.979185 14348 tablet_bootstrap.cc:654] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.986765 14349 tablet_bootstrap.cc:654] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.968649 14705 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:58.010500 14078 raft_consensus.cc:2393] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:58.019582 14674 consensus_queue.cc:1048] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.020751 14629 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:19:58.040922 14043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 83839.5us
I20260709 13:19:58.058818 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:58.059530 14295 raft_consensus.cc:3060] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.061821 14347 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:58.062494 14347 ts_tablet_manager.cc:1403] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.207s	user 0.011s	sys 0.005s
I20260709 13:19:58.067510 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:58.068478 14301 raft_consensus.cc:3060] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.077520 14347 raft_consensus.cc:359] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:58.078344 14347 raft_consensus.cc:385] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.078649 14347 raft_consensus.cc:740] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.079347 14347 consensus_queue.cc:260] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:58.082966 14351 tablet_bootstrap.cc:492] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:58.084533 14351 ts_tablet_manager.cc:1403] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.243s	user 0.016s	sys 0.015s
I20260709 13:19:58.100672 14629 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:58.103499 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:58.104486 14151 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.104640 14295 raft_consensus.cc:2468] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:19:58.107456 14347 ts_tablet_manager.cc:1434] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:19:58.111572 14347 tablet_bootstrap.cc:492] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:58.120678 14349 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:58.121507 14349 ts_tablet_manager.cc:1403] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.265s	user 0.019s	sys 0.004s
I20260709 13:19:58.122838 14117 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:58.126546 14641 raft_consensus.cc:2804] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.127334 14641 raft_consensus.cc:697] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:19:58.127497 14348 tablet_bootstrap.cc:492] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:58.128059 14348 ts_tablet_manager.cc:1403] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.315s	user 0.019s	sys 0.007s
I20260709 13:19:58.128233 14641 consensus_queue.cc:237] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:58.131587 14151 raft_consensus.cc:2468] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:58.132206 14348 raft_consensus.cc:359] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.132959 14348 raft_consensus.cc:385] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.133234 14045 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:58.134176 14701 raft_consensus.cc:2804] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.134655 14701 raft_consensus.cc:697] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:58.135604 14701 consensus_queue.cc:237] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:58.133312 14348 raft_consensus.cc:740] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.124993 14349 raft_consensus.cc:359] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:58.145226 14348 consensus_queue.cc:260] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.134673 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:58.127509 14301 raft_consensus.cc:2468] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:58.151546 14705 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:58.162881 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:58.182081 14348 ts_tablet_manager.cc:1434] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:19:58.171826 14349 raft_consensus.cc:385] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.182520 14349 raft_consensus.cc:740] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.183151 14348 tablet_bootstrap.cc:492] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:58.183260 14349 consensus_queue.cc:260] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:58.178499 14073 raft_consensus.cc:3060] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.178910 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:58.163923 14351 raft_consensus.cc:359] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.185880 14351 raft_consensus.cc:385] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.186226 14351 raft_consensus.cc:740] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.186950 14351 consensus_queue.cc:260] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.190222 14351 ts_tablet_manager.cc:1434] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.003s
I20260709 13:19:58.190430 14191 leader_election.cc:304] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:58.181360 14295 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.193010 14687 raft_consensus.cc:2804] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.193542 14687 raft_consensus.cc:697] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:58.197038 14078 raft_consensus.cc:2393] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:58.189967 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:58.201545 14351 tablet_bootstrap.cc:492] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:58.203056 14299 raft_consensus.cc:2393] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:19:58.205353 14347 tablet_bootstrap.cc:654] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.194490 14687 consensus_queue.cc:237] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:58.225680 14045 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:58.228367 13976 catalog_manager.cc:5697] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.239226 14688 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.239849 14688 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.228402 14665 raft_consensus.cc:2749] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:58.243644 14736 raft_consensus.cc:493] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.244465 14682 raft_consensus.cc:493] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.244256 14736 raft_consensus.cc:515] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.244716 14514 consensus_queue.cc:1048] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.244982 14682 raft_consensus.cc:515] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.248070 14688 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:58.248207 14736 leader_election.cc:290] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:58.249341 14682 leader_election.cc:290] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:58.268381 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:58.271353 14295 raft_consensus.cc:2468] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:58.272200 14351 tablet_bootstrap.cc:654] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.272609 13973 catalog_manager.cc:5697] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.286585 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:58.295455 14348 tablet_bootstrap.cc:654] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.307005 14349 ts_tablet_manager.cc:1434] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.185s	user 0.020s	sys 0.029s
I20260709 13:19:58.308136 14349 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:58.300897 14045 leader_election.cc:304] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:58.321287 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:58.305630 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06e3182ee5d4798b9145b000d822462" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:58.324124 14299 raft_consensus.cc:2468] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:58.328768 13976 catalog_manager.cc:5697] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.327873 14191 leader_election.cc:304] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:58.338845 14687 raft_consensus.cc:2804] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.347182 14687 raft_consensus.cc:493] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.347422 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06e3182ee5d4798b9145b000d822462" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:58.347560 14687 raft_consensus.cc:3060] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:58.339051 14193 leader_election.cc:343] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.360140 14347 tablet_bootstrap.cc:492] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:58.360709 14347 ts_tablet_manager.cc:1403] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.252s	user 0.028s	sys 0.027s
I20260709 13:19:58.362668 14687 raft_consensus.cc:515] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.363730 14347 raft_consensus.cc:359] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.364446 14347 raft_consensus.cc:385] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.364959 14687 leader_election.cc:290] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:58.364712 14347 raft_consensus.cc:740] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.366060 14347 consensus_queue.cc:260] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.369947 14347 ts_tablet_manager.cc:1434] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:58.370188 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:58.371188 14347 tablet_bootstrap.cc:492] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:58.380671 14351 tablet_bootstrap.cc:492] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:58.382525 14351 ts_tablet_manager.cc:1403] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.014s
W20260709 13:19:58.387845 14194 leader_election.cc:343] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:58.391899 14194 leader_election.cc:343] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.392398 14194 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:58.393591 14682 raft_consensus.cc:2749] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:58.394331 14701 raft_consensus.cc:2749] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:58.398995 14347 tablet_bootstrap.cc:654] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.410724 14349 tablet_bootstrap.cc:654] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.410737 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06e3182ee5d4798b9145b000d822462" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:58.411586 14295 raft_consensus.cc:3060] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.416227 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06e3182ee5d4798b9145b000d822462" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:58.416923 14148 raft_consensus.cc:3060] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.427330 14148 raft_consensus.cc:2468] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:58.427395 14514 consensus_queue.cc:1048] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.427770 14351 raft_consensus.cc:359] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.431583 14351 raft_consensus.cc:385] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.432008 14351 raft_consensus.cc:740] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.431790 14514 consensus_queue.cc:1048] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:58.432947 14351 consensus_queue.cc:260] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.435164 14351 ts_tablet_manager.cc:1434] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:19:58.436208 14351 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:58.443701 14701 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.444442 14701 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:58.447182 14701 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:58.447664 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:58.449150 14043 leader_election.cc:343] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.449191 14194 leader_election.cc:304] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:58.474462 14688 raft_consensus.cc:2804] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.475081 14688 raft_consensus.cc:697] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:58.475950 14688 consensus_queue.cc:237] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.477923 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:58.478693 14301 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:58.461257 14349 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:58.479998 14349 ts_tablet_manager.cc:1403] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.172s	user 0.005s	sys 0.011s
I20260709 13:19:58.484411 14349 raft_consensus.cc:359] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.485153 14349 raft_consensus.cc:385] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.485412 14349 raft_consensus.cc:740] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.487835 14351 tablet_bootstrap.cc:654] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.494211 14349 consensus_queue.cc:260] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.507067 14042 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:19:58.510845 14665 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.513316 14665 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.513731 14665 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.468030 14295 raft_consensus.cc:2468] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:58.522472 14349 ts_tablet_manager.cc:1434] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 13:19:58.539074 14348 tablet_bootstrap.cc:492] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:58.539901 14348 ts_tablet_manager.cc:1403] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.357s	user 0.035s	sys 0.014s
I20260709 13:19:58.560428 14349 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:58.561291 14665 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:58.594087 14748 raft_consensus.cc:493] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.603443 14748 raft_consensus.cc:515] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.605199 14665 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:58.612875 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:58.613667 14301 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.624337 13976 catalog_manager.cc:5697] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.636533 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:58.648039 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:58.651646 14629 consensus_queue.cc:1048] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.653945 14514 consensus_queue.cc:1048] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.657146 14748 leader_election.cc:290] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:19:58.659595 14045 leader_election.cc:343] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.661762 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:58.668004 14043 leader_election.cc:343] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.625469 14348 raft_consensus.cc:359] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.674957 14348 raft_consensus.cc:385] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.675320 14348 raft_consensus.cc:740] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.680042 14349 tablet_bootstrap.cc:654] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.681780 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:58.682191 14043 leader_election.cc:304] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:58.683933 14348 consensus_queue.cc:260] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.682555 14301 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:58.688426 14351 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:58.689224 14351 ts_tablet_manager.cc:1403] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.253s	user 0.013s	sys 0.009s
I20260709 13:19:58.689965 14042 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:58.692636 14348 ts_tablet_manager.cc:1434] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.152s	user 0.010s	sys 0.001s
I20260709 13:19:58.693403 14347 tablet_bootstrap.cc:492] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:58.693900 14348 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:58.694074 14347 ts_tablet_manager.cc:1403] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.323s	user 0.081s	sys 0.118s
I20260709 13:19:58.705550 14665 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.707374 14347 raft_consensus.cc:359] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.708460 14347 raft_consensus.cc:385] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.709447 14347 raft_consensus.cc:740] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.710381 14347 consensus_queue.cc:260] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.713315 14347 ts_tablet_manager.cc:1434] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:19:58.713550 14665 raft_consensus.cc:697] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:58.714622 14665 consensus_queue.cc:237] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:58.721284 14738 consensus_queue.cc:1048] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.729413 14347 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:58.699761 14748 raft_consensus.cc:2749] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:58.720789 14043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 52834us
W20260709 13:19:58.739396 14043 leader_election.cc:343] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.743988 14687 raft_consensus.cc:493] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.744716 14687 raft_consensus.cc:515] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.768527 14641 consensus_queue.cc:1048] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:19:58.763795 14193 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:58.775271 14348 tablet_bootstrap.cc:654] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.776404 14449 consensus_queue.cc:1048] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:58.776975 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22a4f3e09e401296389c126d11edc0" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:58.777665 14151 raft_consensus.cc:2468] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:58.777951 14347 tablet_bootstrap.cc:654] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.778779 14687 leader_election.cc:290] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:58.779317 14194 leader_election.cc:304] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:58.781000 14687 raft_consensus.cc:2804] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.781399 14687 raft_consensus.cc:493] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.781774 14687 raft_consensus.cc:3060] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.787132 14351 raft_consensus.cc:359] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.788158 14351 raft_consensus.cc:385] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.788473 14351 raft_consensus.cc:740] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.794057 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22a4f3e09e401296389c126d11edc0" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:58.795066 14301 raft_consensus.cc:2468] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:58.796271 14351 consensus_queue.cc:260] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.810762 14687 raft_consensus.cc:515] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.856456 14351 ts_tablet_manager.cc:1434] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.167s	user 0.006s	sys 0.002s
I20260709 13:19:58.859933 14351 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:58.878479 14349 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:58.879882 14349 ts_tablet_manager.cc:1403] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.320s	user 0.028s	sys 0.010s
I20260709 13:19:58.887344 14687 leader_election.cc:290] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:19:58.890523 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22a4f3e09e401296389c126d11edc0" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:58.891304 14148 raft_consensus.cc:3060] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.894145 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22a4f3e09e401296389c126d11edc0" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:19:58.894814 14301 raft_consensus.cc:3060] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.905717 14349 raft_consensus.cc:359] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.922191 14349 raft_consensus.cc:385] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.922482 14349 raft_consensus.cc:740] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.922838 14301 raft_consensus.cc:2468] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:58.923237 14349 consensus_queue.cc:260] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.924073 14191 leader_election.cc:304] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:58.924921 14688 raft_consensus.cc:2804] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.925407 14688 raft_consensus.cc:697] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:58.915760 14347 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:58.926496 14347 ts_tablet_manager.cc:1403] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.197s	user 0.020s	sys 0.021s
I20260709 13:19:58.926352 14688 consensus_queue.cc:237] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:58.918622 14348 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:58.930013 14348 ts_tablet_manager.cc:1403] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.236s	user 0.030s	sys 0.012s
I20260709 13:19:58.929322 14347 raft_consensus.cc:359] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.934106 14347 raft_consensus.cc:385] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.934471 14347 raft_consensus.cc:740] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.935241 14347 consensus_queue.cc:260] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.921007 14148 raft_consensus.cc:2468] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:58.946173 14351 tablet_bootstrap.cc:654] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.948354 14349 ts_tablet_manager.cc:1434] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:19:58.949527 14349 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:58.951999 13976 catalog_manager.cc:5697] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.932823 14348 raft_consensus.cc:359] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:58.953802 14348 raft_consensus.cc:385] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.954139 14348 raft_consensus.cc:740] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.954550 14665 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.954828 14348 consensus_queue.cc:260] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:58.955170 14665 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.956403 14348 ts_tablet_manager.cc:1434] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.001s
I20260709 13:19:58.960386 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:58.961110 14225 raft_consensus.cc:2468] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:58.961452 14347 ts_tablet_manager.cc:1434] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 13:19:58.962606 14665 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:58.962599 14043 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:58.964056 14665 raft_consensus.cc:2804] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.964434 14665 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.965371 14665 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.966754 14349 tablet_bootstrap.cc:654] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.972548 14348 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:58.976078 14347 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:58.977355 14665 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:58.990142 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
W20260709 13:19:58.991961 14045 leader_election.cc:343] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.000793 14347 tablet_bootstrap.cc:654] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.005693 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:19:59.007035 14045 leader_election.cc:343] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.008210 14682 consensus_queue.cc:1048] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:59.011123 14682 consensus_queue.cc:1048] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.014456 13975 catalog_manager.cc:5697] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.018401 14665 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:59.023634 14682 raft_consensus.cc:493] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.025841 14682 raft_consensus.cc:515] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.028601 14682 leader_election.cc:290] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.030272 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:59.031036 14151 raft_consensus.cc:2468] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:59.031708 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:19:59.032644 14194 leader_election.cc:304] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:59.036659 14225 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.032868 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:59.035187 14349 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:59.038062 14073 raft_consensus.cc:2468] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:59.038524 14349 ts_tablet_manager.cc:1403] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.014s
I20260709 13:19:59.040552 14682 raft_consensus.cc:2804] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:59.041047 14682 raft_consensus.cc:493] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.041407 14682 raft_consensus.cc:3060] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.050237 14348 tablet_bootstrap.cc:654] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.066007 14225 raft_consensus.cc:2468] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:59.067309 14043 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:19:59.069762 14665 raft_consensus.cc:2804] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:59.071049 14665 raft_consensus.cc:697] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:59.071892 14665 consensus_queue.cc:237] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.061403 14349 raft_consensus.cc:359] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.082427 14347 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:59.083045 14347 ts_tablet_manager.cc:1403] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.107s	user 0.016s	sys 0.008s
I20260709 13:19:59.077131 14349 raft_consensus.cc:385] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.086733 14349 raft_consensus.cc:740] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.087664 14349 consensus_queue.cc:260] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.091015 14349 ts_tablet_manager.cc:1434] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:19:59.094734 14349 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:59.095561 14351 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:59.096115 14351 ts_tablet_manager.cc:1403] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.003s
I20260709 13:19:59.096489 14347 raft_consensus.cc:359] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.097401 14347 raft_consensus.cc:385] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.107865 14347 raft_consensus.cc:740] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.108736 14347 consensus_queue.cc:260] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.101889 14349 tablet_bootstrap.cc:654] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.100847 14682 raft_consensus.cc:515] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.115706 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:59.116590 14078 raft_consensus.cc:3060] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.120379 14347 ts_tablet_manager.cc:1434] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.003s
I20260709 13:19:59.121498 14347 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:59.130539 14736 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.131148 14736 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.131845 14347 tablet_bootstrap.cc:654] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.135558 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:19:59.137291 14042 leader_election.cc:343] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.144268 14347 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:59.144886 14347 ts_tablet_manager.cc:1403] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:19:59.133293 14736 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.149338 14078 raft_consensus.cc:2468] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:59.149215 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:59.107316 14348 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:59.103085 14351 raft_consensus.cc:359] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.151335 14351 raft_consensus.cc:385] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.151378 14348 ts_tablet_manager.cc:1403] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.179s	user 0.013s	sys 0.002s
I20260709 13:19:59.151788 14351 raft_consensus.cc:740] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.155592 14348 raft_consensus.cc:359] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.156457 14348 raft_consensus.cc:385] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.156723 14348 raft_consensus.cc:740] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.152045 13977 catalog_manager.cc:5697] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.157971 14351 consensus_queue.cc:260] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.159818 14682 leader_election.cc:290] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.147611 14347 raft_consensus.cc:359] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.160751 14347 raft_consensus.cc:385] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.160739 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:59.161298 14347 raft_consensus.cc:740] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.161556 14151 raft_consensus.cc:3060] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.157378 14348 consensus_queue.cc:260] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.162268 14347 consensus_queue.cc:260] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.163304 14148 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:59.164597 14347 ts_tablet_manager.cc:1434] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:19:59.165760 14347 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:59.166356 14045 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:59.167549 14748 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:59.167944 14748 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.168274 14748 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.172896 14347 tablet_bootstrap.cc:654] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.174196 14416 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.174789 14193 leader_election.cc:304] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:59.175760 14682 raft_consensus.cc:2804] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:59.176280 14682 raft_consensus.cc:697] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:19:59.174714 14416 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.182772 14682 consensus_queue.cc:237] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.183358 14348 ts_tablet_manager.cc:1434] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:19:59.184808 14348 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:59.184710 14416 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:59.188809 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:59.211973 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:19:59.215857 14266 leader_election.cc:343] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.212939 14351 ts_tablet_manager.cc:1434] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.117s	user 0.011s	sys 0.006s
W20260709 13:19:59.224906 14267 leader_election.cc:343] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.243548 14351 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:59.244629 14151 raft_consensus.cc:2468] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:19:59.249977 14225 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.279142 14349 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:59.284238 14349 ts_tablet_manager.cc:1403] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.190s	user 0.021s	sys 0.006s
I20260709 13:19:59.248425 14748 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.238256 14267 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:19:59.289835 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 75083.9us
I20260709 13:19:59.290547 14416 raft_consensus.cc:2749] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:59.296833 14349 raft_consensus.cc:359] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.297657 14349 raft_consensus.cc:385] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.297981 14349 raft_consensus.cc:740] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.298647 14349 consensus_queue.cc:260] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.307462 14701 consensus_queue.cc:1048] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.313115 14349 ts_tablet_manager.cc:1434] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:19:59.314338 14349 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:59.315785 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
W20260709 13:19:59.317164 14042 leader_election.cc:343] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.317832 14347 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:59.318408 14347 ts_tablet_manager.cc:1403] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.027s
I20260709 13:19:59.320639 14349 tablet_bootstrap.cc:654] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.326956 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:59.327555 14348 tablet_bootstrap.cc:654] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.327631 14148 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.333232 13973 catalog_manager.cc:5697] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.339265 14148 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:19:59.314576 14748 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.344197 14748 consensus_queue.cc:1048] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.321597 14351 tablet_bootstrap.cc:654] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.321239 14347 raft_consensus.cc:359] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.346413 14347 raft_consensus.cc:385] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.346743 14347 raft_consensus.cc:740] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.347478 14347 consensus_queue.cc:260] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.369509 14349 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:59.370157 14349 ts_tablet_manager.cc:1403] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.002s
I20260709 13:19:59.371738 14045 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:19:59.372702 14351 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:19:59.373253 14351 ts_tablet_manager.cc:1403] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.009s
I20260709 13:19:59.376156 14351 raft_consensus.cc:359] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.376860 14351 raft_consensus.cc:385] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.377141 14351 raft_consensus.cc:740] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.379930 14349 raft_consensus.cc:359] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.380722 14349 raft_consensus.cc:385] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.380977 14349 raft_consensus.cc:740] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.381580 14351 consensus_queue.cc:260] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.381580 14349 consensus_queue.cc:260] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.382692 14688 consensus_queue.cc:1048] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.384022 14351 ts_tablet_manager.cc:1434] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:19:59.384341 14349 ts_tablet_manager.cc:1434] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:19:59.385046 14351 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:19:59.385267 14349 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:59.387181 14347 ts_tablet_manager.cc:1434] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.002s
I20260709 13:19:59.388129 14705 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:59.388662 14705 raft_consensus.cc:697] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:19:59.389597 14705 consensus_queue.cc:237] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.405063 14351 tablet_bootstrap.cc:654] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.407624 14349 tablet_bootstrap.cc:654] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.436437 14347 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:59.438656 14349 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:59.439386 14349 ts_tablet_manager.cc:1403] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.002s
I20260709 13:19:59.442868 14688 consensus_queue.cc:1048] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:59.442992 14349 raft_consensus.cc:359] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.444041 14349 raft_consensus.cc:385] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.444582 14349 raft_consensus.cc:740] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.445379 14349 consensus_queue.cc:260] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.448277 14349 ts_tablet_manager.cc:1434] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:59.453577 14349 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:59.454326 14347 tablet_bootstrap.cc:654] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.460085 14349 tablet_bootstrap.cc:654] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.480137 14348 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:59.480875 14348 ts_tablet_manager.cc:1403] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.296s	user 0.025s	sys 0.006s
I20260709 13:19:59.489562 14348 raft_consensus.cc:359] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.490556 14348 raft_consensus.cc:385] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.491109 14348 raft_consensus.cc:740] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.491453 13975 catalog_manager.cc:5697] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.496496 14349 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:59.497123 14349 ts_tablet_manager.cc:1403] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.044s	user 0.028s	sys 0.008s
I20260709 13:19:59.500149 14349 raft_consensus.cc:359] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.500873 14349 raft_consensus.cc:385] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.501168 14349 raft_consensus.cc:740] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.502912 14349 consensus_queue.cc:260] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.504532 14349 ts_tablet_manager.cc:1434] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:19:59.501761 14348 consensus_queue.cc:260] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.508849 14701 consensus_queue.cc:1048] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.515791 14347 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:59.516386 14347 ts_tablet_manager.cc:1403] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.002s
I20260709 13:19:59.524248 14347 raft_consensus.cc:359] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.524978 14347 raft_consensus.cc:385] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.525236 14347 raft_consensus.cc:740] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.527757 14347 consensus_queue.cc:260] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.527288 14348 ts_tablet_manager.cc:1434] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:19:59.529625 14348 tablet_bootstrap.cc:492] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:59.539196 14349 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:59.553638 14347 ts_tablet_manager.cc:1434] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 13:19:59.556640 14347 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:59.557360 14349 tablet_bootstrap.cc:654] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.560817 14348 tablet_bootstrap.cc:654] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.566774 14702 raft_consensus.cc:493] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.567539 14347 tablet_bootstrap.cc:654] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.566968 14349 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:59.567474 14702 raft_consensus.cc:515] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.568441 14349 ts_tablet_manager.cc:1403] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.002s
I20260709 13:19:59.573170 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:59.574069 14078 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:59.574391 14348 tablet_bootstrap.cc:492] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:59.574995 14348 ts_tablet_manager.cc:1403] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.000s
I20260709 13:19:59.576562 14778 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.577190 14778 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.578111 14348 raft_consensus.cc:359] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:59.578920 14348 raft_consensus.cc:385] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.579232 14348 raft_consensus.cc:740] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.579933 14267 leader_election.cc:304] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:59.580788 14778 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:59.580679 14349 raft_consensus.cc:359] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.581821 14078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:59.581899 14416 raft_consensus.cc:2804] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:59.583778 14416 raft_consensus.cc:493] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.583940 14349 raft_consensus.cc:385] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.584263 14416 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.584362 14349 raft_consensus.cc:740] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.585706 14348 consensus_queue.cc:260] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:59.582883 14702 leader_election.cc:290] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.585273 14349 consensus_queue.cc:260] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.589380 14348 ts_tablet_manager.cc:1434] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:19:59.589178 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:59.590372 14347 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:59.590242 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:59.591146 14148 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:59.592027 14349 ts_tablet_manager.cc:1434] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:19:59.592866 14347 ts_tablet_manager.cc:1403] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 13:19:59.593040 14349 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:19:59.590404 14348 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d: Bootstrap starting.
I20260709 13:19:59.593346 14078 raft_consensus.cc:3060] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.591068 14118 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:59.598665 14514 raft_consensus.cc:2749] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:59.596930 14347 raft_consensus.cc:359] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.607577 14347 raft_consensus.cc:385] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.607992 14347 raft_consensus.cc:740] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.608500 14148 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.609777 14348 tablet_bootstrap.cc:654] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.608950 14349 tablet_bootstrap.cc:654] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.608763 14347 consensus_queue.cc:260] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.614372 14347 ts_tablet_manager.cc:1434] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:19:59.615355 14347 tablet_bootstrap.cc:492] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16: Bootstrap starting.
I20260709 13:19:59.622921 14347 tablet_bootstrap.cc:654] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.624475 14416 raft_consensus.cc:515] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.633347 14347 tablet_bootstrap.cc:492] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16: No bootstrap required, opened a new log
I20260709 13:19:59.634078 14347 ts_tablet_manager.cc:1403] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:19:59.639441 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:19:59.639842 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:19:59.640285 14150 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.640472 14073 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.640899 14347 raft_consensus.cc:359] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:59.642194 14347 raft_consensus.cc:385] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.642638 14347 raft_consensus.cc:740] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.643710 14347 consensus_queue.cc:260] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:19:59.647969 14347 ts_tablet_manager.cc:1434] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:19:59.649266 14150 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:59.650601 14268 leader_election.cc:304] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:19:59.655228 14781 raft_consensus.cc:2804] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:59.658281 14416 leader_election.cc:290] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.661196 14349 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: No bootstrap required, opened a new log
I20260709 13:19:59.666357 14348 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d: No bootstrap required, opened a new log
I20260709 13:19:59.666721 14349 ts_tablet_manager.cc:1403] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.002s
I20260709 13:19:59.669863 14349 raft_consensus.cc:359] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.670590 14349 raft_consensus.cc:385] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.666805 14348 ts_tablet_manager.cc:1403] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d: Time spent bootstrapping tablet: real 0.077s	user 0.003s	sys 0.014s
I20260709 13:19:59.670851 14349 raft_consensus.cc:740] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.671766 14349 consensus_queue.cc:260] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.674242 14349 ts_tablet_manager.cc:1434] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:19:59.674280 14348 raft_consensus.cc:359] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.675065 14348 raft_consensus.cc:385] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.675455 14348 raft_consensus.cc:740] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.676468 14348 consensus_queue.cc:260] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.659404 14781 raft_consensus.cc:697] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:19:59.677873 14781 consensus_queue.cc:237] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.682770 14348 ts_tablet_manager.cc:1434] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:19:59.713382 14705 consensus_queue.cc:1048] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:59.729920 14784 consensus_queue.cc:1048] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:59.733003 14736 raft_consensus.cc:493] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.732307 14702 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.734009 14736 raft_consensus.cc:515] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:19:59.734630 14702 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.739071 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:59.743283 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:59.745177 14150 raft_consensus.cc:2393] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:19:59.748220 14268 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:19:59.749300 14806 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.749155 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:19:59.749820 14736 leader_election.cc:290] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:19:59.749962 14806 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:19:59.751219 14043 leader_election.cc:343] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.754730 14806 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.756592 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:59.757352 14079 raft_consensus.cc:2468] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:19:59.759872 14267 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:19:59.756069 14806 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.768169 14778 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.768841 14778 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.769955 14416 raft_consensus.cc:2804] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:59.770506 14416 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.770958 14416 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.773463 14778 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:59.774204 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:19:59.776556 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:59.778401 14073 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:19:59.798110 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:19:59.798897 14153 raft_consensus.cc:2468] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:19:59.775118 14079 raft_consensus.cc:2468] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:19:59.832201 14449 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.833030 14449 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:19:59.807192 14702 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.813920 14688 consensus_queue.cc:1048] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:19:59.853720 14449 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:19:59.854662 14416 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:19:59.856271 14301 raft_consensus.cc:2393] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:19:59.862919 14416 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:19:59.860014 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:19:59.865768 14302 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
I20260709 13:19:59.935313 14191 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:19:59.939623 14119 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
W20260709 13:19:59.966454 14808 log.cc:927] Time spent T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:19:59.969631 14784 raft_consensus.cc:2804] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:59.970970 14784 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.971547 14784 raft_consensus.cc:3060] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.966563 14778 raft_consensus.cc:2804] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:59.978207 14778 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.978845 14778 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.989705 14351 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:20:00.003319 14665 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.996809 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:00.025699 14781 raft_consensus.cc:493] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.026087 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:00.026933 14074 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.026541 14781 raft_consensus.cc:515] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:00.033070 14781 leader_election.cc:290] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:00.033705 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:00.042268 14351 ts_tablet_manager.cc:1403] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.657s	user 0.079s	sys 0.112s
I20260709 13:20:00.004612 14665 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:00.048321 14665 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:00.048414 14079 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 0.
W20260709 13:20:00.144891 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 184247us
W20260709 13:20:00.120594 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 168926us
W20260709 13:20:00.153403 14078 consensus_meta.cc:287] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent flushing consensus metadata: real 0.559s	user 0.002s	sys 0.022s
I20260709 13:20:00.210244 14702 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.211357 14702 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:00.225821 14045 leader_election.cc:304] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:00.198941 14074 raft_consensus.cc:2468] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:00.234653 14351 raft_consensus.cc:359] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:00.235739 14351 raft_consensus.cc:385] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:00.236164 14351 raft_consensus.cc:740] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.237043 14351 consensus_queue.cc:260] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:00.235903 14806 raft_consensus.cc:2749] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:00.262699 14665 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.274132 14045 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 79550.8us
I20260709 13:20:00.277657 14677 raft_consensus.cc:493] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.278317 14701 raft_consensus.cc:2804] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:00.278887 14701 raft_consensus.cc:493] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.278640 14677 raft_consensus.cc:515] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:00.279347 14701 raft_consensus.cc:3060] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.280169 14812 consensus_queue.cc:1048] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:00.265518 14665 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:00.281708 14677 leader_election.cc:290] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
W20260709 13:20:00.263451 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 48841.9us
I20260709 13:20:00.283826 14665 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:00.285635 14267 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:00.287002 14416 raft_consensus.cc:2804] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:00.293368 14416 raft_consensus.cc:697] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:00.324353 14416 consensus_queue.cc:237] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:00.338562 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:00.339426 14351 ts_tablet_manager.cc:1434] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.296s	user 0.010s	sys 0.002s
I20260709 13:20:00.342497 14784 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:00.344878 14351 tablet_bootstrap.cc:492] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:20:00.364619 14702 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:00.399077 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 78656.9us
I20260709 13:20:00.405617 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:00.406388 14295 raft_consensus.cc:2468] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 0.
I20260709 13:20:00.411027 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:00.422125 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:00.423182 14295 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 0.
I20260709 13:20:00.434525 14079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:00.435421 14079 raft_consensus.cc:2468] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 0.
I20260709 13:20:00.440037 14117 leader_election.cc:304] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:00.448693 14736 raft_consensus.cc:493] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:00.449748 14736 raft_consensus.cc:515] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:00.454118 14816 raft_consensus.cc:2804] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:00.454754 14816 raft_consensus.cc:493] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.455241 14816 raft_consensus.cc:3060] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.464382 14267 leader_election.cc:304] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:00.468242 14806 raft_consensus.cc:2804] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:00.378738 14778 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:00.481484 14736 leader_election.cc:290] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:00.482422 14784 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:00.479259 14814 consensus_queue.cc:1048] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:20:00.484330 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:00.485221 14228 raft_consensus.cc:2393] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:20:00.485812 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:00.488875 14351 tablet_bootstrap.cc:654] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:00.478154 14806 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.490881 14806 raft_consensus.cc:3060] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.495553 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:00.496333 14073 raft_consensus.cc:3060] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.503989 14148 raft_consensus.cc:2393] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:20:00.505285 14701 raft_consensus.cc:515] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:00.528313 14816 raft_consensus.cc:515] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:00.535547 14702 consensus_queue.cc:1048] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:00.539469 14073 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:20:00.541774 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:00.543630 14152 raft_consensus.cc:2393] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 1: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
W20260709 13:20:00.548343 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 231308us
I20260709 13:20:00.549998 14778 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:00.544647 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:00.554301 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
W20260709 13:20:00.555078 14118 leader_election.cc:343] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:00.555323 14074 raft_consensus.cc:2393] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 1: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:00.557902 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:00.563969 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:00.570683 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:00.571659 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:00.572443 14301 raft_consensus.cc:3060] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.544214 13975 catalog_manager.cc:5697] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:00.572701 14119 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:00.574229 14829 raft_consensus.cc:2749] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:00.579067 14193 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:00.580571 14784 raft_consensus.cc:2804] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:00.581142 14784 raft_consensus.cc:697] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:00.582234 14784 consensus_queue.cc:237] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:00.585245 14301 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
W20260709 13:20:00.600137 14043 leader_election.cc:343] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:00.621698 14806 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:00.644054 14806 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:00.647383 14827 raft_consensus.cc:493] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.648128 14827 raft_consensus.cc:515] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:00.650837 14827 leader_election.cc:290] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:00.653342 14816 leader_election.cc:290] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:00.651877 14701 leader_election.cc:290] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:00.658109 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:00.671311 14351 tablet_bootstrap.cc:492] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:20:00.671996 14351 ts_tablet_manager.cc:1403] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.331s	user 0.017s	sys 0.006s
I20260709 13:20:00.673991 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:00.675022 14074 raft_consensus.cc:3060] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.675323 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:00.676113 14302 raft_consensus.cc:3060] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.677708 14076 raft_consensus.cc:2393] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 1: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
W20260709 13:20:00.685627 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 62580.5us
I20260709 13:20:00.703179 14351 raft_consensus.cc:359] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:00.704025 14351 raft_consensus.cc:385] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:00.718796 14351 raft_consensus.cc:740] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.716487 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:00.719866 14154 raft_consensus.cc:3060] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.735347 14074 raft_consensus.cc:2468] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:00.734747 14351 consensus_queue.cc:260] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:00.736220 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:00.737510 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:00.692557 14299 raft_consensus.cc:2393] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 1: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:00.739799 14042 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:00.742627 14736 raft_consensus.cc:2764] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:20:00.742792 14351 ts_tablet_manager.cc:1434] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:20:00.744665 14831 consensus_queue.cc:1048] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:00.747367 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:00.751452 14302 raft_consensus.cc:2468] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:00.753928 14117 leader_election.cc:304] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:00.755554 14514 raft_consensus.cc:2804] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:00.756466 14514 raft_consensus.cc:697] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:00.758100 14514 consensus_queue.cc:237] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:00.762959 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:00.764696 14228 raft_consensus.cc:3060] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.772545 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
W20260709 13:20:00.769184 14266 leader_election.cc:343] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:00.773751 14266 leader_election.cc:304] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:00.775388 14814 raft_consensus.cc:2749] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:00.773900 14222 raft_consensus.cc:3060] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:00.773025 14351 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8: Bootstrap starting.
I20260709 13:20:00.781654 14042 leader_election.cc:304] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:00.784181 14042 leader_election.cc:304] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:00.788970 14267 leader_election.cc:304] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:00.790081 14814 raft_consensus.cc:2804] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:00.790606 14814 raft_consensus.cc:697] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:00.791589 14814 consensus_queue.cc:237] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:00.792100 14705 raft_consensus.cc:2749] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:00.785367 14831 raft_consensus.cc:2749] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:00.801537 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 52605.9us
I20260709 13:20:00.817466 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:00.832252 14222 raft_consensus.cc:2468] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:00.834438 14154 raft_consensus.cc:2468] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:20:00.835026 13977 catalog_manager.cc:5697] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:00.867237 14045 leader_election.cc:304] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:00.839697 14702 consensus_queue.cc:1048] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:00.825258 14194 leader_election.cc:304] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:00.868299 14665 raft_consensus.cc:2804] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:00.869273 14665 raft_consensus.cc:697] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
W20260709 13:20:00.869629 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 44470.9us
I20260709 13:20:00.870565 14665 consensus_queue.cc:237] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:00.827538 14266 leader_election.cc:343] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:00.848322 14351 tablet_bootstrap.cc:654] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:00.852417 14025 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:00.864488 14228 raft_consensus.cc:2468] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
W20260709 13:20:00.877414 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 49905.5us
W20260709 13:20:00.878679 14266 leader_election.cc:343] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:00.885346 14842 raft_consensus.cc:2749] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:00.879901 14781 consensus_queue.cc:1048] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:20:01.022352 14351 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8: No bootstrap required, opened a new log
I20260709 13:20:01.022967 14351 ts_tablet_manager.cc:1403] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8: Time spent bootstrapping tablet: real 0.256s	user 0.015s	sys 0.012s
I20260709 13:20:01.033012 14351 raft_consensus.cc:359] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:01.037022 14351 raft_consensus.cc:385] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.037333 14351 raft_consensus.cc:740] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.038228 14351 consensus_queue.cc:260] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:01.040169 14351 ts_tablet_manager.cc:1434] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:20:01.055135 13976 catalog_manager.cc:5697] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.057384 13976 catalog_manager.cc:5697] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } }
I20260709 13:20:01.115343 13977 catalog_manager.cc:5697] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 1 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.133124 13975 catalog_manager.cc:5697] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.168282 14842 consensus_queue.cc:1048] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:01.173943 14827 consensus_queue.cc:1048] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:01.251668 14224 raft_consensus.cc:3060] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.262208 14781 consensus_queue.cc:1048] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:01.283582 14702 consensus_queue.cc:1048] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:01.303020 14514 consensus_queue.cc:1048] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:01.309916 14701 consensus_queue.cc:1048] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:01.368029 14778 consensus_queue.cc:1048] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:01.382241 14665 consensus_queue.cc:1048] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:01.432627 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 43708.3us
I20260709 13:20:02.110056  4246 tablet_server.cc:179] TabletServer@127.4.37.129:0 shutting down...
W20260709 13:20:02.130657 14267 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:20:02.147338 14267 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.158236 14119 consensus_peers.cc:597] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.167825 14267 consensus_peers.cc:597] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.168707 14267 consensus_peers.cc:597] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.188292 14267 consensus_peers.cc:597] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.188292 14193 consensus_peers.cc:597] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.216070 14267 consensus_peers.cc:597] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.218832 14193 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.222368  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:02.223548  4246 tablet_replica.cc:333] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.224792  4246 raft_consensus.cc:2243] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.225466  4246 raft_consensus.cc:2272] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.231251  4246 tablet_replica.cc:333] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.232221  4246 raft_consensus.cc:2243] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.233078  4246 raft_consensus.cc:2272] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.237442  4246 tablet_replica.cc:333] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.238622  4246 raft_consensus.cc:2243] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.239311  4246 raft_consensus.cc:2272] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.239326 14267 consensus_peers.cc:597] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.242700  4246 tablet_replica.cc:333] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.243955  4246 raft_consensus.cc:2243] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.244951  4246 raft_consensus.cc:2272] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.248896  4246 tablet_replica.cc:333] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.250710  4246 raft_consensus.cc:2243] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.251767  4246 raft_consensus.cc:2272] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.252022 14193 consensus_peers.cc:597] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.255677  4246 tablet_replica.cc:333] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.256716  4246 raft_consensus.cc:2243] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.257874  4246 raft_consensus.cc:2272] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.260478 14193 consensus_peers.cc:597] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.261379  4246 tablet_replica.cc:333] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.262154  4246 raft_consensus.cc:2243] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.262826  4246 raft_consensus.cc:2272] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.267691  4246 tablet_replica.cc:333] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.268750  4246 raft_consensus.cc:2243] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.276396  4246 raft_consensus.cc:2272] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.279402  4246 tablet_replica.cc:333] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
W20260709 13:20:02.292819 14193 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.293684 14119 consensus_peers.cc:597] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.296065  4246 raft_consensus.cc:2243] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.296876  4246 raft_consensus.cc:2272] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.298249 14193 consensus_peers.cc:597] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.300134  4246 tablet_replica.cc:333] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.301023  4246 raft_consensus.cc:2243] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.301600  4246 raft_consensus.cc:2272] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.304653  4246 tablet_replica.cc:333] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.305689  4246 raft_consensus.cc:2243] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.306352  4246 raft_consensus.cc:2272] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.310601  4246 tablet_replica.cc:333] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.312021  4246 raft_consensus.cc:2243] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.312736  4246 raft_consensus.cc:2272] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.313082 14119 consensus_peers.cc:597] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.316388  4246 tablet_replica.cc:333] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
W20260709 13:20:02.317041 14119 consensus_peers.cc:597] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.317355  4246 raft_consensus.cc:2243] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.318046  4246 raft_consensus.cc:2272] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.320371  4246 tablet_replica.cc:333] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.321038  4246 raft_consensus.cc:2243] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.321590  4246 raft_consensus.cc:2272] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.324323  4246 tablet_replica.cc:333] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.325430  4246 raft_consensus.cc:2243] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.326035  4246 raft_consensus.cc:2272] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.329813  4246 tablet_replica.cc:333] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.330632  4246 raft_consensus.cc:2243] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.331264  4246 raft_consensus.cc:2272] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.335039  4246 tablet_replica.cc:333] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.335872  4246 raft_consensus.cc:2243] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.336901  4246 raft_consensus.cc:2272] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.340077  4246 tablet_replica.cc:333] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.340909  4246 raft_consensus.cc:2243] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:02.341012 14267 consensus_peers.cc:597] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.342226  4246 raft_consensus.cc:2272] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.346030  4246 tablet_replica.cc:333] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.347007  4246 raft_consensus.cc:2243] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:02.347316 14119 consensus_peers.cc:597] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.347618  4246 raft_consensus.cc:2272] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.350782  4246 tablet_replica.cc:333] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.351723  4246 raft_consensus.cc:2243] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.352286  4246 raft_consensus.cc:2272] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.355139  4246 tablet_replica.cc:333] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.355963  4246 raft_consensus.cc:2243] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.356532  4246 raft_consensus.cc:2272] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.359506  4246 tablet_replica.cc:333] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.360139  4246 raft_consensus.cc:2243] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.360611  4246 raft_consensus.cc:2272] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.362964  4246 tablet_replica.cc:333] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.363586  4246 raft_consensus.cc:2243] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.364091  4246 raft_consensus.cc:2272] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.366411  4246 tablet_replica.cc:333] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.366986  4246 raft_consensus.cc:2243] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.367435  4246 raft_consensus.cc:2272] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.369743  4246 tablet_replica.cc:333] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.370365  4246 raft_consensus.cc:2243] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.370903  4246 raft_consensus.cc:2272] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.374692  4246 tablet_replica.cc:333] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.375401  4246 raft_consensus.cc:2243] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.376577  4246 raft_consensus.cc:2272] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.379287  4246 tablet_replica.cc:333] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.380163  4246 raft_consensus.cc:2243] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.381340  4246 raft_consensus.cc:2272] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.384162  4246 tablet_replica.cc:333] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.385202  4246 raft_consensus.cc:2243] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.385900  4246 raft_consensus.cc:2272] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.388545  4246 tablet_replica.cc:333] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
W20260709 13:20:02.388919 14193 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.389350  4246 raft_consensus.cc:2243] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.389962  4246 raft_consensus.cc:2272] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.393105  4246 tablet_replica.cc:333] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.394049  4246 raft_consensus.cc:2243] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.395174  4246 raft_consensus.cc:2272] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.398483  4246 tablet_replica.cc:333] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.399186  4246 raft_consensus.cc:2243] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.400431  4246 raft_consensus.cc:2272] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.407922  4246 tablet_replica.cc:333] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.408778  4246 raft_consensus.cc:2243] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.410404  4246 raft_consensus.cc:2272] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.414135  4246 tablet_replica.cc:333] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.415082  4246 raft_consensus.cc:2243] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.416182  4246 raft_consensus.cc:2272] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.419632  4246 tablet_replica.cc:333] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.420578  4246 raft_consensus.cc:2243] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.421216  4246 raft_consensus.cc:2272] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.424685  4246 tablet_replica.cc:333] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.425657  4246 raft_consensus.cc:2243] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.426558  4246 raft_consensus.cc:2272] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.426717 14267 consensus_peers.cc:597] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.430912  4246 tablet_replica.cc:333] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.431824  4246 raft_consensus.cc:2243] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:02.432590 14193 consensus_peers.cc:597] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.433054  4246 raft_consensus.cc:2272] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.433362 14267 consensus_peers.cc:597] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.437851  4246 tablet_replica.cc:333] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
W20260709 13:20:02.433966 14193 consensus_peers.cc:597] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.438813  4246 raft_consensus.cc:2243] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.440301  4246 raft_consensus.cc:2272] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.445475  4246 tablet_replica.cc:333] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.446292  4246 raft_consensus.cc:2243] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.447448  4246 raft_consensus.cc:2272] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.449810 14193 consensus_peers.cc:597] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.450497  4246 tablet_replica.cc:333] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.451195  4246 raft_consensus.cc:2243] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.451818  4246 raft_consensus.cc:2272] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.454311  4246 tablet_replica.cc:333] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.455134  4246 raft_consensus.cc:2243] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.455765  4246 raft_consensus.cc:2272] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.458616  4246 tablet_replica.cc:333] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.459225  4246 raft_consensus.cc:2243] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.459769  4246 raft_consensus.cc:2272] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.463200  4246 tablet_replica.cc:333] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.463801  4246 raft_consensus.cc:2243] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.464383  4246 raft_consensus.cc:2272] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.466737  4246 tablet_replica.cc:333] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.467484  4246 raft_consensus.cc:2243] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.468526  4246 raft_consensus.cc:2272] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.471767  4246 tablet_replica.cc:333] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.472357  4246 raft_consensus.cc:2243] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.473284  4246 raft_consensus.cc:2272] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.476007  4246 tablet_replica.cc:333] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: stopping tablet replica
I20260709 13:20:02.476780  4246 raft_consensus.cc:2243] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.477789  4246 raft_consensus.cc:2272] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.506408 14193 consensus_peers.cc:597] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.556272 14267 consensus_peers.cc:597] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.586534  4246 tablet_server.cc:196] TabletServer@127.4.37.129:0 shutdown complete.
W20260709 13:20:02.592195 14267 consensus_peers.cc:597] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.642249 14267 consensus_peers.cc:597] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.706674  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:02.718904 14877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:02.724012 14876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:02.762874  4246 server_base.cc:1061] running on GCE node
W20260709 13:20:02.764766 14879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:02.769131  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:02.769554  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:02.769837  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603202769815 us; error 0 us; skew 500 ppm
I20260709 13:20:02.770701  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:02.786247  4246 webserver.cc:533] Webserver started at http://127.4.37.129:41223/ using document root <none> and password file <none>
I20260709 13:20:02.787061  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:02.787320  4246 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:20:02.800319  4246 fs_manager.cc:714] Time spent opening directory manager: real 0.012s	user 0.009s	sys 0.004s
I20260709 13:20:02.821285 14885 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:02.822526  4246 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:20:02.822965  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
format_stamp: "Formatted at 2026-07-09 13:19:48 on dist-test-slave-jk05"
I20260709 13:20:02.824222  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:02.968758  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:02.971609  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:03.006891  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:03.025355 14894 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:20:03.296022 14866 raft_consensus.cc:493] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.297021 14866 raft_consensus.cc:515] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.300468 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:03.309968 14866 leader_election.cc:290] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:03.322207 14119 leader_election.cc:336] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.322865 14119 leader_election.cc:304] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.323693 14866 raft_consensus.cc:2749] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:03.339015 14827 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.339742 14827 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.343546 14887 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.344154 14887 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:03.353350 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:20:03.355851 14193 leader_election.cc:336] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.356657 14193 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.358770 14827 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.359643 14870 raft_consensus.cc:2749] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:03.360227 14887 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.359649 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:20:03.366485 14267 leader_election.cc:336] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.367090 14267 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.368469 14887 raft_consensus.cc:2749] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:03.377899 14866 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.378634 14866 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.383467 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:03.384292 14224 raft_consensus.cc:2468] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:03.385632 14118 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.386616 14873 raft_consensus.cc:2804] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.387028 14873 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.387357 14873 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.397712 14866 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:03.400960 14873 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.402194 14827 raft_consensus.cc:493] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.402814 14827 raft_consensus.cc:515] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.405472 14827 leader_election.cc:290] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.407294 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.410015  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:20:03.410455  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.391s	user 0.012s	sys 0.004s
I20260709 13:20:03.410842  4246 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:20:03.421954 14894 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:03.438445 14827 raft_consensus.cc:493] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.441216 14827 raft_consensus.cc:515] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.444013 14827 leader_election.cc:290] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:03.448330 14193 leader_election.cc:336] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.450606 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.454813 14416 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.455530 14416 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.469677 14416 leader_election.cc:290] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.471297 14193 leader_election.cc:304] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.471549 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.473798 14842 raft_consensus.cc:2749] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:03.474745 14866 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.475515 14866 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.479570 14778 raft_consensus.cc:493] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.480269 14778 raft_consensus.cc:515] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.482666 14778 leader_election.cc:290] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:03.485005 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:03.486019 14222 raft_consensus.cc:2468] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:03.488984 14118 leader_election.cc:304] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.490240 14778 raft_consensus.cc:2804] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.490770 14778 raft_consensus.cc:493] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.491238 14778 raft_consensus.cc:3060] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.482618 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:03.504783 14416 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.505892 14416 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.510382 14416 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.511386 14866 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:03.519621 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.522761 14154 raft_consensus.cc:2468] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
W20260709 13:20:03.521899 14193 leader_election.cc:336] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.524865 14268 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.525897 14416 raft_consensus.cc:2804] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.526391 14416 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.526901 14416 raft_consensus.cc:3060] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.524828 14873 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:03.526401 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:03.539724 14866 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.567495 14866 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.544972 14887 raft_consensus.cc:493] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.552987 14778 raft_consensus.cc:515] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.568674 14887 raft_consensus.cc:515] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:03.555330 14267 leader_election.cc:336] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.570088 14267 leader_election.cc:304] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.556610 14822 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.571017 14887 leader_election.cc:290] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.571208 14886 raft_consensus.cc:2749] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:03.573647 14866 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.575930 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.577001 14778 leader_election.cc:290] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:03.577517 14151 raft_consensus.cc:2468] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:03.577772 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:03.578506 14295 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:03.580092 14117 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.580156 14268 leader_election.cc:304] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.581076 14886 raft_consensus.cc:2804] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.571026 14822 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.581707 14886 raft_consensus.cc:493] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.582325 14886 raft_consensus.cc:3060] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.583827 14822 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.584690 14224 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.591701 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:03.592562 14228 raft_consensus.cc:3060] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.593997 14866 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.595033 14866 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.595705 14866 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.598902 14842 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.599553 14842 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:03.601800 14842 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.602685 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:03.603456 14302 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:20:03.604803 14191 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:03.607081 14842 raft_consensus.cc:2804] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.607568 14842 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.608019 14842 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.525318 14193 leader_election.cc:304] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.610133 14870 raft_consensus.cc:2749] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:03.610368 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 88497.8us
I20260709 13:20:03.615506 14228 raft_consensus.cc:2468] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:03.616946 14118 leader_election.cc:304] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.625911 14416 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.614326 14896 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.635377 14896 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.637830 14894 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.638912 14894 tablet_bootstrap.cc:492] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:03.639567 14894 ts_tablet_manager.cc:1403] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.218s	user 0.055s	sys 0.040s
I20260709 13:20:03.650188 14416 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.625156 14873 raft_consensus.cc:2804] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:20:03.664528 14267 leader_election.cc:336] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.647845 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.669831 14814 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.678215 14224 raft_consensus.cc:2468] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:03.680418 14866 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.675282 14814 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.684203 14778 raft_consensus.cc:493] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.684840 14778 raft_consensus.cc:515] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.685223 14814 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.686823 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.687202 14778 leader_election.cc:290] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:03.689795 14842 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:03.668408 14896 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.689698 14897 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.675889 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:03.691690 14152 raft_consensus.cc:3060] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.692178 14842 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.679334 14886 raft_consensus.cc:515] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.697355 14886 leader_election.cc:290] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.700521 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:03.701184 14151 raft_consensus.cc:3060] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:03.704192 14193 leader_election.cc:336] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.701179 14894 raft_consensus.cc:359] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:03.704742 14193 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.705796 14894 raft_consensus.cc:740] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.705166 14842 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.706785 14842 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:03.708810 14866 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.710107 14842 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:03.711123 14193 leader_election.cc:336] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.691596 14897 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.716727 14151 raft_consensus.cc:2468] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:03.717522 14897 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.718251 14268 leader_election.cc:304] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.720063 14814 raft_consensus.cc:2804] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:03.720800 14814 raft_consensus.cc:697] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:03.721771 14814 consensus_queue.cc:237] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.723467 14152 raft_consensus.cc:2468] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:03.724781 14268 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.714758 14896 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.706784 14894 consensus_queue.cc:260] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:03.732766 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:03.726817 14886 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.737908 14886 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.733752 14898 raft_consensus.cc:2804] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:03.741204 14898 raft_consensus.cc:697] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:03.739320 14302 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:03.743516 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:03.744266 14224 raft_consensus.cc:2468] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:03.732638 14778 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.745573 14778 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:03.735522 14267 leader_election.cc:336] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.727589 14842 raft_consensus.cc:2749] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:03.750159 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:03.750972 14302 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:03.746464 14193 leader_election.cc:336] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:03.746814 14267 leader_election.cc:336] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:03.752857 14193 leader_election.cc:336] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.747191 14118 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.732683 14866 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
W20260709 13:20:03.734535 14119 leader_election.cc:336] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.757890 14897 raft_consensus.cc:2804] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:03.742326 14898 consensus_queue.cc:237] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.758895 14866 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.762022 14866 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.734211 14896 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.758530 14897 raft_consensus.cc:697] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
W20260709 13:20:03.767655 14267 leader_election.cc:336] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.773803 14267 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.775434 14899 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.775543 14900 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.776144 14886 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.776055 14899 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:03.778690 14899 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:03.779835 14267 leader_election.cc:336] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.780432 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.781175 14152 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:03.783293 14268 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.784832 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:03.785046 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:03.785472 14117 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.785821 14298 raft_consensus.cc:2468] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:03.785863 14299 raft_consensus.cc:2468] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:03.787093 14866 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.787607 14866 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.787772 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:03.788035 14866 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.788693 14886 raft_consensus.cc:2749] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:03.800357 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:03.801028 14301 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.802206 14302 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
W20260709 13:20:03.811553 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 77581.3us
I20260709 13:20:03.804970 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:03.789405 14886 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:03.808122 14267 leader_election.cc:336] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.776266 14900 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:03.818718 14267 leader_election.cc:336] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.769124 14778 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.767268 14119 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.770961 14873 raft_consensus.cc:697] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:03.815325 14301 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:03.816390 14842 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.818053 14886 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.816170 14897 consensus_queue.cc:237] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:03.773269 14896 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:03.821131 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:03.833178 14228 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:03.833478 14117 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.833480 14295 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:03.834687 14117 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.834889 14901 raft_consensus.cc:2804] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.835348 14901 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.835664 14901 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.835577 14117 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.830600 14778 raft_consensus.cc:2749] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:03.829754 14842 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:03.838377 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 105356us
I20260709 13:20:03.838896 14896 raft_consensus.cc:2804] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.839577 14900 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.830749 14886 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.839597 14778 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:03.823653 14298 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:20:03.844640 14894 ts_tablet_manager.cc:1434] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.203s	user 0.012s	sys 0.020s
I20260709 13:20:03.847397 14894 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:03.844321 14191 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.850592 14266 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.843464 14896 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.854228 14896 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:03.843677 14119 leader_election.cc:336] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:03.856994 14267 leader_election.cc:336] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.872550 13975 catalog_manager.cc:5697] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 2 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:03.848230 14778 raft_consensus.cc:697] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:03.848220 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.850128 14900 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
W20260709 13:20:03.903478 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 67970.7us
W20260709 13:20:03.906833 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 151639us
I20260709 13:20:03.907812 14118 leader_election.cc:304] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.904731 14117 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.878484 14827 raft_consensus.cc:2804] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:20:03.878652 14119 leader_election.cc:336] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.872941 14903 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.918648 14907 raft_consensus.cc:2804] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.878288 14842 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.884359 14152 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:03.923347 14191 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:03.878405 14866 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.882138 14900 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.922983 14903 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.936234 14268 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:03.935851 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 91952.5us
I20260709 13:20:03.925148 14907 raft_consensus.cc:493] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.879372 14778 consensus_queue.cc:237] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.939358 14903 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.951599 14896 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:03.881928 14873 consensus_queue.cc:237] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:03.930109 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 51478.4us
I20260709 13:20:03.947849 14897 raft_consensus.cc:2804] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.951036 14900 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.945132 14898 raft_consensus.cc:2804] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.956595 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:03.939401 14910 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:03.978279 14151 raft_consensus.cc:2468] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:20:03.951126 14907 raft_consensus.cc:3060] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.985692 14896 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.986869 14866 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:03.961659 14898 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.962361 14897 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.991999 14194 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:03.979084 14910 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:03.983145 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:04.003130 14912 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:04.003743 14912 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.006325 14896 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:04.007099 14896 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:04.007781 14119 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.008598 14119 leader_election.cc:336] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.006379 14267 leader_election.cc:336] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:03.994472 14898 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.996399 14897 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.009137 14896 leader_election.cc:290] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:04.016098 14119 leader_election.cc:336] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.018759 14119 leader_election.cc:336] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.018796 14152 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:03.982661 14901 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.022433 14886 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.024554 14886 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.999123 14822 raft_consensus.cc:2804] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:04.026026 14822 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:04.026402 14822 raft_consensus.cc:3060] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.031492 14268 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:04.032183 14119 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.032953 14119 leader_election.cc:336] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.033030 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:04.033912 14152 raft_consensus.cc:2393] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 2: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:20:04.035017 14912 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:03.999195 14910 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.035369 14899 raft_consensus.cc:2804] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:04.035816 14899 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:04.036217 14899 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.038628 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:04.039671 14152 raft_consensus.cc:2468] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:20:04.041122 14194 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:04.024545 14901 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:04.044298 14898 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:04.041988 14267 leader_election.cc:336] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.052054 14267 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.053071 14886 raft_consensus.cc:2749] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:04.047518 14119 leader_election.cc:336] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.068977 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 145683us
W20260709 13:20:04.109615 14119 leader_election.cc:336] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.116695 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 61723.8us
W20260709 13:20:04.117312 14119 leader_election.cc:336] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.117938 14119 leader_election.cc:336] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.118069 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:04.118446 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:04.118952 14301 raft_consensus.cc:2393] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 2: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:04.120460 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:04.121114 14302 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:04.121227 14119 leader_election.cc:336] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.122474 14119 leader_election.cc:336] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.118479 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:04.124796 14295 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
W20260709 13:20:04.111522 14193 leader_election.cc:336] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.069948 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 161029us
I20260709 13:20:04.086145 14911 raft_consensus.cc:2804] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:04.113840 14903 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:04.049998 14827 raft_consensus.cc:697] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:04.126842 14298 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.141297 14901 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
W20260709 13:20:04.143872 14119 leader_election.cc:336] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.146232 14903 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:04.134624 14911 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:04.117220 14822 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.122460 14898 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:04.155674 14119 leader_election.cc:336] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.147418 14302 raft_consensus.cc:2468] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:04.138298 14117 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.161666 14901 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.167783 14901 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:04.157567 14911 raft_consensus.cc:3060] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.170956 14822 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:04.178969 14901 raft_consensus.cc:2749] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:04.182648 14119 leader_election.cc:336] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.184517 14899 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.187441 14117 leader_election.cc:304] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.193624 14298 raft_consensus.cc:2468] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:04.193758 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:04.195992 14894 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.127978 14910 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:04.198675 14899 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:04.199077 14910 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:04.197296 14894 tablet_bootstrap.cc:492] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:04.200475 14894 ts_tablet_manager.cc:1403] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.353s	user 0.019s	sys 0.004s
I20260709 13:20:04.202030 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:04.202651 14151 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.208907 14117 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.181095 14907 raft_consensus.cc:515] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.211823 14827 consensus_queue.cc:237] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:04.214373 14921 raft_consensus.cc:2804] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:04.215021 14921 raft_consensus.cc:697] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:04.215906 14921 consensus_queue.cc:237] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.217116 14151 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:04.210036 14901 raft_consensus.cc:2804] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:04.218458 14901 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:04.218806 14268 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:04.218855 14901 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.219974 14897 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.221257 14152 raft_consensus.cc:2393] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 2: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:20:04.221771 14907 leader_election.cc:290] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:04.223004 14899 raft_consensus.cc:2804] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:04.223548 14899 raft_consensus.cc:697] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:04.224403 14899 consensus_queue.cc:237] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.216208 14911 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:04.225796 14119 leader_election.cc:336] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.229579 14117 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.240666 14914 raft_consensus.cc:2804] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:04.241271 14914 raft_consensus.cc:697] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:04.242720  4246 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:20:04.242275 14914 consensus_queue.cc:237] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.246443  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.836s	user 0.373s	sys 0.025s
I20260709 13:20:04.247208 14894 raft_consensus.cc:359] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.248088 14894 raft_consensus.cc:740] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.250523 14894 consensus_queue.cc:260] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.255000 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:04.255911 14151 raft_consensus.cc:3060] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.257556 14894 ts_tablet_manager.cc:1434] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:20:04.262117 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:04.263005 14298 raft_consensus.cc:2393] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 2: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:04.267786 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:04.274950 14222 raft_consensus.cc:2393] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 2: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
W20260709 13:20:04.276790 14193 leader_election.cc:336] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.280643 14151 raft_consensus.cc:2468] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:04.293274 14901 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.306524 14151 raft_consensus.cc:1275] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:04.312296 14154 raft_consensus.cc:1275] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:04.314723 14194 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:04.316555 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:04.317281 14228 raft_consensus.cc:2393] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 2: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:20:04.320461 14814 consensus_queue.cc:1048] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:04.313622 14898 consensus_queue.cc:1048] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:20:04.330708 14911 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:04.331905 14927 raft_consensus.cc:2804] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:04.332453 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:04.333148 14298 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.334355 14901 leader_election.cc:290] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:04.338709 14897 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:04.339679 14894 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
W20260709 13:20:04.341102 14119 leader_election.cc:336] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.343722 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:04.344971 14302 raft_consensus.cc:2393] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 2: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:04.351070 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:04.352082 14227 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:04.358072 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:04.359030 14227 raft_consensus.cc:3060] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.361090 14118 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.371726 14118 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:04.374938 14267 leader_election.cc:336] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.377096 14866 raft_consensus.cc:3060] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.390654 14927 raft_consensus.cc:697] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:04.391686 14927 consensus_queue.cc:237] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.383919 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:04.399142 13973 catalog_manager.cc:5697] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:04.407550 14298 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:04.409020 14117 leader_election.cc:304] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:04.413609 14119 leader_election.cc:336] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.414180 14119 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:04.423511 14267 leader_election.cc:336] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.424361 14267 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.425618 14918 raft_consensus.cc:2749] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:04.427246 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 55611.1us
I20260709 13:20:04.434615 14228 raft_consensus.cc:1275] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:04.434662 14873 raft_consensus.cc:2804] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:20:04.449213 14119 consensus_peers.cc:597] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.424086 14909 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:20:04.450304 14267 leader_election.cc:336] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.454039 14267 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.451975 14928 raft_consensus.cc:2749] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:04.453931 14909 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:04.459049 14909 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:04.450644 14873 raft_consensus.cc:697] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:04.460899 14873 consensus_queue.cc:237] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:04.456323 14899 raft_consensus.cc:2749] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:04.462868 14267 consensus_peers.cc:597] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.463440 14267 consensus_peers.cc:597] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.483847 13973 catalog_manager.cc:5697] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 2 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:04.490185 13973 catalog_manager.cc:5697] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 2 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:04.477166 14227 raft_consensus.cc:2468] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:04.483897 14866 raft_consensus.cc:2749] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:04.518116 14193 leader_election.cc:336] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:04.519214 14193 leader_election.cc:336] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.519642 14193 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:04.521927 14193 leader_election.cc:336] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.523027 14822 raft_consensus.cc:2749] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:04.542999 14193 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:04.546010 14148 raft_consensus.cc:2468] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:04.546916 14299 raft_consensus.cc:1275] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:04.548683 14909 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.551766 14901 consensus_queue.cc:1048] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:04.556022 14118 leader_election.cc:304] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.570019 14228 raft_consensus.cc:1275] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:04.578356 14194 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:04.580120 14119 consensus_peers.cc:597] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.587819 14896 raft_consensus.cc:2804] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:04.591406 14778 consensus_queue.cc:1048] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:04.575353 14909 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:04.587112 14910 raft_consensus.cc:2804] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:04.604242 14910 raft_consensus.cc:697] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:04.614639 14910 consensus_queue.cc:237] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.602859 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:04.621004 14227 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:04.596966 14896 raft_consensus.cc:697] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:04.623862 14896 consensus_queue.cc:237] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:04.596056 14873 consensus_queue.cc:1048] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 13:20:04.643991 14119 consensus_peers.cc:597] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.644999 14119 leader_election.cc:336] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:04.648845 14894 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:20:04.650933 14119 consensus_peers.cc:597] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:04.651240 14894 tablet_bootstrap.cc:492] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:04.652407 14894 ts_tablet_manager.cc:1403] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.313s	user 0.024s	sys 0.022s
I20260709 13:20:04.656085 14894 raft_consensus.cc:359] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:04.658299 14119 consensus_peers.cc:597] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.661954 14894 raft_consensus.cc:740] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.663205 14894 consensus_queue.cc:260] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:04.666579 14298 raft_consensus.cc:1275] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:04.668464 14227 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:04.670444 14901 consensus_queue.cc:1048] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:04.671100 14118 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:04.671967 14901 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:04.672560 14901 raft_consensus.cc:697] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:04.677989 14894 ts_tablet_manager.cc:1434] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:20:04.679052 14894 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:04.685523 14302 raft_consensus.cc:1275] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:04.724161 14302 raft_consensus.cc:1275] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:04.696384 14909 consensus_queue.cc:1048] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:20:04.726895 14911 consensus_queue.cc:1048] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:04.694317 14901 consensus_queue.cc:237] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:04.732513 14267 consensus_peers.cc:597] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.746382 14193 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.750993 14193 consensus_peers.cc:597] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.754796 13973 catalog_manager.cc:5697] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } }
I20260709 13:20:04.743808 13975 catalog_manager.cc:5697] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:04.759820 13975 catalog_manager.cc:5697] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } }
I20260709 13:20:04.763324 13975 catalog_manager.cc:5697] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.768414 13975 catalog_manager.cc:5697] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:04.796479 14944 log.cc:927] Time spent T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:20:04.880388 14119 consensus_peers.cc:597] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.898553 14193 consensus_peers.cc:597] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.898828 14267 consensus_peers.cc:597] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.911424 14193 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.912107 14193 consensus_peers.cc:597] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:04.917254 14152 raft_consensus.cc:1275] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:04.936770 14267 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.937409 14267 consensus_peers.cc:597] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:04.937938 14267 consensus_peers.cc:597] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.938364 14267 consensus_peers.cc:597] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.938768 14951 log.cc:927] Time spent T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:20:04.938786 14267 consensus_peers.cc:597] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:04.964462 14894 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.965014 14814 consensus_queue.cc:1048] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:20:04.971336 14894 tablet_bootstrap.cc:492] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:04.972220 14894 ts_tablet_manager.cc:1403] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.293s	user 0.028s	sys 0.021s
W20260709 13:20:04.974912 14119 consensus_peers.cc:597] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.979116 14193 consensus_peers.cc:597] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.989852 14193 consensus_peers.cc:597] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:04.981940 14953 log.cc:927] Time spent T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:20:04.988368 14267 consensus_peers.cc:597] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:04.992735 14894 raft_consensus.cc:359] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:04.990741 14193 consensus_peers.cc:597] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:04.996565 14894 raft_consensus.cc:740] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.997385 14894 consensus_queue.cc:260] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:05.023550 14267 consensus_peers.cc:597] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:05.025763 14148 raft_consensus.cc:1275] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:05.029372 14904 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.030000 14904 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:05.032509 14911 consensus_queue.cc:1048] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:05.034960 14295 raft_consensus.cc:1275] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:05.038412 14904 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:05.042035 13976 catalog_manager.cc:5697] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:05.045586 14267 consensus_peers.cc:597] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:05.054883 14894 ts_tablet_manager.cc:1434] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.002s
W20260709 13:20:05.060214 14119 consensus_peers.cc:597] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:05.044435 13976 catalog_manager.cc:5697] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:05.072016 14267 consensus_peers.cc:597] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:05.067395 14894 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
W20260709 13:20:05.061167 14193 consensus_peers.cc:597] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:05.077284 13976 catalog_manager.cc:5697] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:05.079348 13976 catalog_manager.cc:5697] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 1 to 2, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:05.066896 14873 consensus_queue.cc:1048] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 13:20:05.110435 14119 consensus_peers.cc:597] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:05.111011 14119 consensus_peers.cc:597] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:05.112533 14222 raft_consensus.cc:1275] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:05.118257 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:20:05.128394 14193 consensus_peers.cc:597] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:05.137549 14866 consensus_queue.cc:1048] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:05.138533 14193 consensus_peers.cc:597] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:05.154976 14193 consensus_peers.cc:597] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:05.173614 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:20:05.176808 14267 consensus_peers.cc:597] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:05.177016 14119 consensus_peers.cc:597] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:05.181710 14889 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:05.183264 14904 raft_consensus.cc:2749] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:05.186371 14148 raft_consensus.cc:1275] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:05.193626 13976 catalog_manager.cc:5697] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:05.215916 14267 consensus_peers.cc:597] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:05.221133 14193 consensus_peers.cc:597] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:05.226890 14894 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.227969 14894 tablet_bootstrap.cc:492] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.228677 14894 ts_tablet_manager.cc:1403] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.162s	user 0.022s	sys 0.005s
I20260709 13:20:05.228961 14925 consensus_queue.cc:1048] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:05.231675 14894 raft_consensus.cc:359] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:05.232488 14894 raft_consensus.cc:740] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.233202 14894 consensus_queue.cc:260] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:05.235281 14894 ts_tablet_manager.cc:1434] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:05.236119 14894 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.256512 14894 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.257807 14894 tablet_bootstrap.cc:492] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.258790 14894 ts_tablet_manager.cc:1403] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 13:20:05.262228 14894 raft_consensus.cc:359] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.262934 14894 raft_consensus.cc:740] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.263790 14894 consensus_queue.cc:260] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.266481 14894 ts_tablet_manager.cc:1434] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:05.267266 14894 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.283885 14227 raft_consensus.cc:1275] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:20:05.299527 14119 consensus_peers.cc:597] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:05.314833 14909 consensus_queue.cc:1048] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:05.355597 14119 consensus_peers.cc:597] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:05.366125 14894 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.367249 14894 tablet_bootstrap.cc:492] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.368369 14894 ts_tablet_manager.cc:1403] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.101s	user 0.034s	sys 0.039s
I20260709 13:20:05.371250 14894 raft_consensus.cc:359] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:05.371955 14894 raft_consensus.cc:740] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.372872 14894 consensus_queue.cc:260] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:05.380848 14894 ts_tablet_manager.cc:1434] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:20:05.381803 14894 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.476118 14894 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.477113 14894 tablet_bootstrap.cc:492] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.477811 14894 ts_tablet_manager.cc:1403] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.096s	user 0.020s	sys 0.040s
I20260709 13:20:05.480831 14894 raft_consensus.cc:359] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.481674 14894 raft_consensus.cc:740] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.482617 14894 consensus_queue.cc:260] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.486416 14894 ts_tablet_manager.cc:1434] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:20:05.488246 14894 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.507335 14894 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.508440 14894 tablet_bootstrap.cc:492] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.509338 14894 ts_tablet_manager.cc:1403] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:20:05.513896 14894 raft_consensus.cc:359] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.516533 14894 raft_consensus.cc:740] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.518328 14894 consensus_queue.cc:260] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.520879 14894 ts_tablet_manager.cc:1434] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:20:05.527423 14894 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.572562 14894 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.573952 14894 tablet_bootstrap.cc:492] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.574867 14894 ts_tablet_manager.cc:1403] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.000s
I20260709 13:20:05.606014 14894 raft_consensus.cc:359] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:05.607934 14894 raft_consensus.cc:740] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.615284 14894 consensus_queue.cc:260] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:05.618633 14894 ts_tablet_manager.cc:1434] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:20:05.620086 14894 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.692776 14894 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.694046 14894 tablet_bootstrap.cc:492] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.694759 14894 ts_tablet_manager.cc:1403] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.003s
I20260709 13:20:05.697510 14894 raft_consensus.cc:359] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:05.698251 14894 raft_consensus.cc:740] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.703739 14894 consensus_queue.cc:260] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:05.706028 14894 ts_tablet_manager.cc:1434] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:20:05.706861 14894 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.766479 14894 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.767585 14894 tablet_bootstrap.cc:492] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.770705 14894 ts_tablet_manager.cc:1403] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.004s
I20260709 13:20:05.775482 14894 raft_consensus.cc:359] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:05.776487 14894 raft_consensus.cc:740] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.777493 14894 consensus_queue.cc:260] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:05.783852 14894 ts_tablet_manager.cc:1434] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:20:05.785809 14894 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.809993 14928 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.810813 14928 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:05.819861 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:05.820574 14152 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:05.821277 14928 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:05.822450 14268 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:05.823549 14928 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:05.824002 14928 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.824424 14928 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:05.827474 14894 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.828961 14894 tablet_bootstrap.cc:492] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.829949 14894 ts_tablet_manager.cc:1403] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.002s
I20260709 13:20:05.833719 14894 raft_consensus.cc:359] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:05.834872 14894 raft_consensus.cc:740] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
W20260709 13:20:05.835903 14267 leader_election.cc:336] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:05.837760 14894 consensus_queue.cc:260] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:05.841060 14894 ts_tablet_manager.cc:1434] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:20:05.842391 14894 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.843448 14928 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:05.852057 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:05.852806 14152 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:05.858119 14267 leader_election.cc:336] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:05.894968 14894 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:05.897665 14894 tablet_bootstrap.cc:492] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:05.898501 14894 ts_tablet_manager.cc:1403] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.009s
I20260709 13:20:05.899583 14928 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:05.904759  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:33687
I20260709 13:20:05.904855 15030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:33687 every 8 connection(s)
I20260709 13:20:05.901598 14152 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:05.902348 14894 raft_consensus.cc:359] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.907430 14894 raft_consensus.cc:740] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:05.908253 14894 consensus_queue.cc:260] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.910806 14894 ts_tablet_manager.cc:1434] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:20:05.912019 14894 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:05.922871 14268 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:05.927587 14887 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:05.974964 14904 raft_consensus.cc:493] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.975518 14904 raft_consensus.cc:515] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:05.978579 14904 leader_election.cc:290] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:05.981493 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:05.983777 14887 raft_consensus.cc:697] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:05.985877 14887 consensus_queue.cc:237] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.043632 13975 catalog_manager.cc:5697] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.050348 14894 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.051571 14894 tablet_bootstrap.cc:492] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.052368 14894 ts_tablet_manager.cc:1403] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.141s	user 0.041s	sys 0.034s
I20260709 13:20:06.060880 14894 raft_consensus.cc:359] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.061707 14894 raft_consensus.cc:740] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.062486 14894 consensus_queue.cc:260] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.067157 15031 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44771
I20260709 13:20:06.068192 14894 ts_tablet_manager.cc:1434] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:20:06.068212 15031 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:06.069326 14894 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:06.069720 15031 heartbeater.cc:507] Master 127.4.37.190:44771 requested a full tablet report, sending...
I20260709 13:20:06.097533 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:06.099509 14891 leader_election.cc:304] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:06.100474 14904 raft_consensus.cc:2749] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:06.120260 14998 raft_consensus.cc:3060] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.141601 13976 ts_manager.cc:194] Re-registered known tserver with Master: ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:06.145788 14894 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.146927 14894 tablet_bootstrap.cc:492] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.147750 14894 ts_tablet_manager.cc:1403] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.079s	user 0.039s	sys 0.016s
I20260709 13:20:06.150959 14894 raft_consensus.cc:359] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:06.151680 14894 raft_consensus.cc:740] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.152863 14894 consensus_queue.cc:260] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:06.155819 14894 ts_tablet_manager.cc:1434] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:06.156728 14894 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:06.189867 14894 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.192062 14894 tablet_bootstrap.cc:492] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.193138 14894 ts_tablet_manager.cc:1403] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.012s
I20260709 13:20:06.201993 14894 raft_consensus.cc:359] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:06.202600 14894 raft_consensus.cc:740] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.203238 14894 consensus_queue.cc:260] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:06.205554 14894 ts_tablet_manager.cc:1434] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:06.206367 14894 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:06.211210 13976 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50236
I20260709 13:20:06.217281 15031 heartbeater.cc:499] Master 127.4.37.190:44771 was elected leader, sending a full tablet report...
I20260709 13:20:06.226941 14894 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.228592 14894 tablet_bootstrap.cc:492] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.229655 14894 ts_tablet_manager.cc:1403] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 13:20:06.239068 14894 raft_consensus.cc:359] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.240077 14894 raft_consensus.cc:740] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.241079 14894 consensus_queue.cc:260] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.250950 14894 ts_tablet_manager.cc:1434] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:20:06.251857 14894 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:06.252846 14998 raft_consensus.cc:3060] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.271401 14999 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.275857 14894 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.277009 14894 tablet_bootstrap.cc:492] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.277900 14894 ts_tablet_manager.cc:1403] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.003s
I20260709 13:20:06.280813 14894 raft_consensus.cc:359] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:06.281590 14894 raft_consensus.cc:740] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.282483 14894 consensus_queue.cc:260] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:06.285250 14894 ts_tablet_manager.cc:1434] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:20:06.286182 14894 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:06.308660 14996 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.326457 14997 raft_consensus.cc:3060] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.361752 14995 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.387655 14894 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.394852 14894 tablet_bootstrap.cc:492] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
W20260709 13:20:06.392410 14267 consensus_peers.cc:597] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:06.402699 14894 ts_tablet_manager.cc:1403] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.117s	user 0.034s	sys 0.045s
I20260709 13:20:06.407480 14894 raft_consensus.cc:359] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.408211 14894 raft_consensus.cc:740] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.409000 14894 consensus_queue.cc:260] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.411898 14894 ts_tablet_manager.cc:1434] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:20:06.413003 14894 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:06.441458 14894 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.442893 14894 tablet_bootstrap.cc:492] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.449242 14894 ts_tablet_manager.cc:1403] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.007s
I20260709 13:20:06.453488 14894 raft_consensus.cc:359] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.454545 14894 raft_consensus.cc:740] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.455622 14894 consensus_queue.cc:260] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.459007 14894 ts_tablet_manager.cc:1434] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:06.460186 14894 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:06.469112 14827 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.470655 14827 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:06.473148 14827 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:06.474694 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:06.475580 14152 raft_consensus.cc:1275] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:06.476658 14999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:06.477370 14999 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:20:06.477279 15039 consensus_queue.cc:1048] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:06.478873 14193 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:06.475630 14295 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:06.481727 14827 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:06.482164 14827 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.482491 14827 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.487540 14999 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:06.558929 14827 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:06.572283 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:06.572925 14295 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.581296 14907 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.581915 14907 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.584399 14907 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:06.585790 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:06.586526 14995 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:06.587033 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:06.587685 14302 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:06.587942 14119 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:06.589366 14907 raft_consensus.cc:2804] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:06.589809 14907 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.590716 14907 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.600061 14295 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:06.605000 14191 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:06.612038 15063 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:06.642951 15063 raft_consensus.cc:697] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:06.641731 14827 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:06.689240 15063 consensus_queue.cc:237] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:06.702826 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:06.704841 14998 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.712483 14894 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.721406 14894 tablet_bootstrap.cc:492] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.723738 14894 ts_tablet_manager.cc:1403] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.264s	user 0.025s	sys 0.010s
I20260709 13:20:06.718890 14998 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
W20260709 13:20:06.747804 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 115972us
I20260709 13:20:06.730316 14894 raft_consensus.cc:359] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.748814 14894 raft_consensus.cc:740] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.749836 14894 consensus_queue.cc:260] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.755219 14894 ts_tablet_manager.cc:1434] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:20:06.756188 14894 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:06.725288 14907 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.766847 14907 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:06.772023 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:06.774955 14993 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.788793 13973 catalog_manager.cc:5697] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.792192 14999 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:06.808954 14267 consensus_peers.cc:597] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:06.812417 14993 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:06.825958 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:06.829511 14302 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.837384 14119 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:06.838994 15071 raft_consensus.cc:2804] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:06.839712 15071 raft_consensus.cc:697] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:06.840692 15071 consensus_queue.cc:237] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:06.841485 14193 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:06.870514 14302 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:06.876937 14894 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.878058 14894 tablet_bootstrap.cc:492] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.881029 14894 ts_tablet_manager.cc:1403] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.125s	user 0.021s	sys 0.021s
I20260709 13:20:06.888895 14894 raft_consensus.cc:359] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.893965 14894 raft_consensus.cc:740] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.895488 14894 consensus_queue.cc:260] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:06.865747 13976 catalog_manager.cc:5697] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 1 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.898936 14894 ts_tablet_manager.cc:1434] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:20:06.900090 14894 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
W20260709 13:20:06.904870 14119 consensus_peers.cc:597] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:06.933353 14894 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:06.934639 14894 tablet_bootstrap.cc:492] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:06.935443 14894 ts_tablet_manager.cc:1403] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.000s
I20260709 13:20:06.967711 14894 raft_consensus.cc:359] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:06.968593 14894 raft_consensus.cc:740] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.969494 14894 consensus_queue.cc:260] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:06.980417 14894 ts_tablet_manager.cc:1434] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:20:06.985131 14894 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.014380 14894 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.015544 14894 tablet_bootstrap.cc:492] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.016485 14894 ts_tablet_manager.cc:1403] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.008s
I20260709 13:20:07.020502 14894 raft_consensus.cc:359] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.021371 14894 raft_consensus.cc:740] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.022203 14894 consensus_queue.cc:260] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.032637 14894 ts_tablet_manager.cc:1434] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:20:07.035563 14894 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.054708 14894 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.055529 14894 tablet_bootstrap.cc:492] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.056193 14894 ts_tablet_manager.cc:1403] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:20:07.058486 14894 raft_consensus.cc:359] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:07.059192 14894 raft_consensus.cc:740] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.059875 14894 consensus_queue.cc:260] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:07.061910 14894 ts_tablet_manager.cc:1434] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:20:07.065038 14894 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.080401 14894 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.081476 14894 tablet_bootstrap.cc:492] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.082188 14894 ts_tablet_manager.cc:1403] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:20:07.084694 14894 raft_consensus.cc:359] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:07.085296 14894 raft_consensus.cc:740] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.086035 14894 consensus_queue.cc:260] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:07.088116 14894 ts_tablet_manager.cc:1434] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:07.089545 14894 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.106484 14894 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.107508 14894 tablet_bootstrap.cc:492] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.108237 14894 ts_tablet_manager.cc:1403] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:20:07.111049 14894 raft_consensus.cc:359] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:07.111840 14894 raft_consensus.cc:740] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.112545 14894 consensus_queue.cc:260] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:07.114964 14894 ts_tablet_manager.cc:1434] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:07.116393 14894 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
W20260709 13:20:07.128068 14267 consensus_peers.cc:597] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:07.143427 14894 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.144467 14894 tablet_bootstrap.cc:492] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.145138 14894 ts_tablet_manager.cc:1403] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
W20260709 13:20:07.146625 14193 consensus_peers.cc:597] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:07.147722 14894 raft_consensus.cc:359] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:07.148279 14894 raft_consensus.cc:740] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.148952 14894 consensus_queue.cc:260] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:07.150671 14894 ts_tablet_manager.cc:1434] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:20:07.151772 14894 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.203907 14298 raft_consensus.cc:1275] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:07.212373 15063 consensus_queue.cc:1048] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:20:07.227361 14999 raft_consensus.cc:1275] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:07.251127 15072 consensus_queue.cc:1048] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:20:07.265441 14119 consensus_peers.cc:597] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:07.266819 14193 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:07.276068 14119 consensus_peers.cc:597] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:07.287010 14894 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.291440 14894 tablet_bootstrap.cc:492] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.292176 14894 ts_tablet_manager.cc:1403] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.141s	user 0.042s	sys 0.068s
I20260709 13:20:07.296075 14894 raft_consensus.cc:359] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.296814 14894 raft_consensus.cc:740] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.297582 14894 consensus_queue.cc:260] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.299382 14894 ts_tablet_manager.cc:1434] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:20:07.300215 14894 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.301477 14998 raft_consensus.cc:1275] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:07.316205 14907 consensus_queue.cc:1048] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:07.431836 14998 raft_consensus.cc:3060] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:07.454887 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 74337.8us
W20260709 13:20:07.465023 14193 consensus_peers.cc:597] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:07.483085 14894 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.492022 14996 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.513588 14894 tablet_bootstrap.cc:492] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.517055 14894 ts_tablet_manager.cc:1403] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.217s	user 0.053s	sys 0.055s
I20260709 13:20:07.528052 14894 raft_consensus.cc:359] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:07.533501 14267 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:07.534432 14894 raft_consensus.cc:740] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.535491 14894 consensus_queue.cc:260] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:07.537992 14894 ts_tablet_manager.cc:1434] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
W20260709 13:20:07.538554 14267 consensus_peers.cc:597] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:07.544392 14267 consensus_peers.cc:597] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:07.544914 14894 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.593364 14894 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.594628 14894 tablet_bootstrap.cc:492] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.595433 14894 ts_tablet_manager.cc:1403] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.003s
I20260709 13:20:07.599180 14894 raft_consensus.cc:359] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:07.601091 14302 raft_consensus.cc:1275] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:07.601047 14894 raft_consensus.cc:740] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.602636 14894 consensus_queue.cc:260] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:07.606473 14894 ts_tablet_manager.cc:1434] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:20:07.608788 14894 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
W20260709 13:20:07.609331 14193 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:07.615548 14907 consensus_queue.cc:1048] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:07.652271 14193 consensus_peers.cc:597] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:07.661587 14894 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.662569 14894 tablet_bootstrap.cc:492] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.663249 14894 ts_tablet_manager.cc:1403] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.000s
I20260709 13:20:07.666118 14894 raft_consensus.cc:359] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:07.666906 14894 raft_consensus.cc:740] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.667956 14894 consensus_queue.cc:260] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:07.671749 14894 ts_tablet_manager.cc:1434] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:07.675294 14894 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.718072 14894 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.719125 14894 tablet_bootstrap.cc:492] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.719645 14996 raft_consensus.cc:3060] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:07.719872 14894 ts_tablet_manager.cc:1403] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.006s
I20260709 13:20:07.723136 14894 raft_consensus.cc:359] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:07.723927 14894 raft_consensus.cc:740] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.724738 14894 consensus_queue.cc:260] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:07.753605 14119 consensus_peers.cc:597] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:07.755084 14894 ts_tablet_manager.cc:1434] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:20:07.756197 14894 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.795413 14894 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.796806 14894 tablet_bootstrap.cc:492] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.799003 14894 ts_tablet_manager.cc:1403] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.008s
I20260709 13:20:07.802089 14894 raft_consensus.cc:359] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.802992 14894 raft_consensus.cc:740] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.803778 14894 consensus_queue.cc:260] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.806646 14894 ts_tablet_manager.cc:1434] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:20:07.816051 14894 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.854391 14894 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.855423 14894 tablet_bootstrap.cc:492] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.856834 14894 ts_tablet_manager.cc:1403] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.011s
I20260709 13:20:07.860558 14894 raft_consensus.cc:359] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.861505 14894 raft_consensus.cc:740] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.862505 14894 consensus_queue.cc:260] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.865383 14894 ts_tablet_manager.cc:1434] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:07.866362 14894 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.918365 14894 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:07.919418 14894 tablet_bootstrap.cc:492] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:07.920245 14894 ts_tablet_manager.cc:1403] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.017s
I20260709 13:20:07.923161 14894 raft_consensus.cc:359] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.923939 14894 raft_consensus.cc:740] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.924678 14894 consensus_queue.cc:260] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:07.937106 14894 ts_tablet_manager.cc:1434] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:20:07.939528 14894 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:07.975162 14996 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:07.997793 14894 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:08.010128 14894 tablet_bootstrap.cc:492] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:08.010953 14894 ts_tablet_manager.cc:1403] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.016s
I20260709 13:20:08.013795 14894 raft_consensus.cc:359] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:08.014715 14894 raft_consensus.cc:740] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.015466 14894 consensus_queue.cc:260] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:08.022917 14894 ts_tablet_manager.cc:1434] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:20:08.024384 14894 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:08.054798 14894 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:08.055850 14894 tablet_bootstrap.cc:492] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:08.056540 14894 ts_tablet_manager.cc:1403] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.007s
I20260709 13:20:08.059551 14894 raft_consensus.cc:359] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:08.060320 14894 raft_consensus.cc:740] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.061044 14894 consensus_queue.cc:260] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:08.063596 14894 ts_tablet_manager.cc:1434] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:08.065398 14894 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:08.082779 14894 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:08.083807 14894 tablet_bootstrap.cc:492] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:08.084517 14894 ts_tablet_manager.cc:1403] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:20:08.089607 14894 raft_consensus.cc:359] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:08.090372 14894 raft_consensus.cc:740] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.091095 14894 consensus_queue.cc:260] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:08.094305 14894 ts_tablet_manager.cc:1434] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:20:08.098875 14894 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:08.158921 14894 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:08.160125 14894 tablet_bootstrap.cc:492] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:08.160962 14894 ts_tablet_manager.cc:1403] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.010s
I20260709 13:20:08.164489 14894 raft_consensus.cc:359] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:08.165343 14894 raft_consensus.cc:740] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.166329 14894 consensus_queue.cc:260] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:08.175778 14894 ts_tablet_manager.cc:1434] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 13:20:08.176992 14894 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:08.194648 14894 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:08.195724 14894 tablet_bootstrap.cc:492] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:08.196460 14894 ts_tablet_manager.cc:1403] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:20:08.198734 14894 raft_consensus.cc:359] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:08.199307 14894 raft_consensus.cc:740] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.199949 14894 consensus_queue.cc:260] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:08.201870 14894 ts_tablet_manager.cc:1434] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:20:08.205777 14894 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:08.245049 14894 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:08.250689 14894 tablet_bootstrap.cc:492] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:08.251750 14894 ts_tablet_manager.cc:1403] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.046s	user 0.029s	sys 0.012s
I20260709 13:20:08.262166 14894 raft_consensus.cc:359] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:08.262986 14894 raft_consensus.cc:740] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.263770 14894 consensus_queue.cc:260] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:08.266130 14894 ts_tablet_manager.cc:1434] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:20:08.267083 14894 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:08.298475 14998 raft_consensus.cc:3060] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.300400 14894 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:08.301566 14894 tablet_bootstrap.cc:492] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:08.302548 14894 ts_tablet_manager.cc:1403] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.012s
I20260709 13:20:08.307971 14894 raft_consensus.cc:359] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:08.310149 14894 raft_consensus.cc:740] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.310920 14894 consensus_queue.cc:260] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:08.316864 14894 ts_tablet_manager.cc:1434] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:20:08.330662 14994 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:08.379863 14894 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap starting.
I20260709 13:20:08.438594 14894 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:08.439780 14894 tablet_bootstrap.cc:492] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Bootstrap complete.
I20260709 13:20:08.440544 14894 ts_tablet_manager.cc:1403] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.010s
I20260709 13:20:08.443420 14894 raft_consensus.cc:359] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:08.444135 14894 raft_consensus.cc:740] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.446139 14894 consensus_queue.cc:260] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:08.448067 14894 ts_tablet_manager.cc:1434] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:08.712379 14994 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:09.374958 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 81703.2us
W20260709 13:20:09.464748 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 89665.2us
W20260709 13:20:09.480724 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 56461.3us
W20260709 13:20:09.549402 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 68218.5us
W20260709 13:20:10.200345 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08000f85a0 after lost signal to thread 4249
W20260709 13:20:10.202386 14323 debug-util.cc:398] Leaking SignalData structure 0x7b080017c5c0 after lost signal to thread 14011
W20260709 13:20:10.204617 14323 debug-util.cc:398] Leaking SignalData structure 0x7b080019ea20 after lost signal to thread 14178
W20260709 13:20:10.207288 14323 debug-util.cc:398] Leaking SignalData structure 0x7b0800177240 after lost signal to thread 14252
W20260709 13:20:10.210108 14323 debug-util.cc:398] Leaking SignalData structure 0x7b080025cf80 after lost signal to thread 14326
W20260709 13:20:10.225462 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08003be800 after lost signal to thread 15030
W20260709 13:20:12.541744 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 173568us
W20260709 13:20:12.732800 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 165160us
W20260709 13:20:12.796576 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 62054.7us
W20260709 13:20:12.813009 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 78518.5us
W20260709 13:20:12.866521 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 458881us
W20260709 13:20:13.042724 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 94960.6us
W20260709 13:20:13.048189 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 89030.5us
W20260709 13:20:13.537107  4251 debug-util.cc:398] Leaking SignalData structure 0x7b080036a0e0 after lost signal to thread 14191
W20260709 13:20:13.794662 14175 debug-util.cc:398] Leaking SignalData structure 0x7b080011a8e0 after lost signal to thread 4249
W20260709 13:20:13.796492 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08002909c0 after lost signal to thread 14011
W20260709 13:20:13.798249 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2100 after lost signal to thread 14178
W20260709 13:20:13.799676 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08000f11e0 after lost signal to thread 14252
W20260709 13:20:13.801155 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08002ebbe0 after lost signal to thread 14326
W20260709 13:20:13.802820 14175 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa280 after lost signal to thread 15030
I20260709 13:20:16.074759  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:16.212738 14149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2"
dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
mode: GRACEFUL
new_leader_uuid: "4db315fd9fb94434a179b03f5b4c083d"
 from {username='slave'} at 127.0.0.1:56766
I20260709 13:20:16.213795 14149 raft_consensus.cc:606] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Received request to transfer leadership to TS 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:20:16.242797 14228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
mode: GRACEFUL
new_leader_uuid: "4db315fd9fb94434a179b03f5b4c083d"
 from {username='slave'} at 127.0.0.1:33014
I20260709 13:20:16.243479 14228 raft_consensus.cc:606] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Received request to transfer leadership to TS 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:20:16.246205 14228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:33014
I20260709 13:20:16.246846 14228 raft_consensus.cc:606] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:16.250185 14228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:33014
I20260709 13:20:16.250875 14228 raft_consensus.cc:606] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:16.269579 14300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:41570
I20260709 13:20:16.270148 14300 raft_consensus.cc:606] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:16.273031 14300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:41570
I20260709 13:20:16.273743 14300 raft_consensus.cc:606] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:16.275004  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:16.277297  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:16.386967 15193 raft_consensus.cc:993] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16: : Instructing follower 4db315fd9fb94434a179b03f5b4c083d to start an election
I20260709 13:20:16.387600 15193 raft_consensus.cc:1081] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Signalling peer 4db315fd9fb94434a179b03f5b4c083d to start an election
I20260709 13:20:16.390270 14299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
 from {username='slave'} at 127.0.0.1:52770
I20260709 13:20:16.390933 14299 raft_consensus.cc:493] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.391337 14299 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.409221 14299 raft_consensus.cc:515] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:16.416586 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:16.417503 14149 raft_consensus.cc:3055] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:16.417855 14149 raft_consensus.cc:740] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:16.418931 14149 consensus_queue.cc:260] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:16.420290 14149 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.422067 14299 leader_election.cc:290] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:16.423331 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:16.423998 14224 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.429382 14149 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:16.430418 14224 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:16.431631 14268 leader_election.cc:304] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:16.432802 15202 raft_consensus.cc:2804] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:16.433493 15202 raft_consensus.cc:697] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:16.434662 15202 consensus_queue.cc:237] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:16.452021 13974 catalog_manager.cc:5697] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 2, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 2 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.480221 15179 raft_consensus.cc:993] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:16.480904 15203 raft_consensus.cc:1081] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:16.483088 14998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58208
I20260709 13:20:16.483722 14998 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.484081 14998 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.498569 14998 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.506709 15179 raft_consensus.cc:993] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8: : Instructing follower 4db315fd9fb94434a179b03f5b4c083d to start an election
I20260709 13:20:16.507287 15179 raft_consensus.cc:1081] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Signalling peer 4db315fd9fb94434a179b03f5b4c083d to start an election
I20260709 13:20:16.508811 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:16.509459 14224 raft_consensus.cc:3055] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:16.509773 14224 raft_consensus.cc:740] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:16.510562 14224 consensus_queue.cc:260] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.511453 14224 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.513566 14299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
 from {username='slave'} at 127.0.0.1:52784
I20260709 13:20:16.514209 14299 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.514565 14299 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.515239 14998 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:16.516479 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:16.517095 14300 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.523557 14299 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:16.526566 14299 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:16.528476 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:16.529289 14228 raft_consensus.cc:3055] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:16.532159 14228 raft_consensus.cc:740] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:16.534096 14300 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:16.535900 14888 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:16.536681 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:16.537385 14149 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.534896 14228 consensus_queue.cc:260] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:16.543550 14228 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.547269 14224 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:16.557215 15214 raft_consensus.cc:2804] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:16.565034 14228 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:16.569348 14149 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:16.570979 14266 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:16.570086 15214 raft_consensus.cc:697] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:16.575654 15197 raft_consensus.cc:2804] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:16.578004 15197 raft_consensus.cc:697] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:16.577540 15214 consensus_queue.cc:237] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.579273 15197 consensus_queue.cc:237] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:16.611615 13974 catalog_manager.cc:5697] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 2 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.613940 13976 catalog_manager.cc:5697] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 2 to 3, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.732733 15203 raft_consensus.cc:993] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:16.733716 15203 raft_consensus.cc:1081] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:16.737090 15197 raft_consensus.cc:993] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:16.737505 15197 raft_consensus.cc:1081] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:16.739929 14998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58208
I20260709 13:20:16.740063 14997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58206
I20260709 13:20:16.740586 14998 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.744346 14998 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.744248 14997 raft_consensus.cc:493] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.745048 14997 raft_consensus.cc:3060] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.756796 14997 raft_consensus.cc:515] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.756901 14998 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.759919 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:16.760687 14228 raft_consensus.cc:3060] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.763422 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:16.765568 14224 raft_consensus.cc:3055] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:16.765980 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:16.766101 14224 raft_consensus.cc:740] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:16.766160 14998 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:16.766664 14299 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.767390 14224 consensus_queue.cc:260] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.772099 14224 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.774490 14299 raft_consensus.cc:2468] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:16.777141 14888 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:16.778216 15214 raft_consensus.cc:2804] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:16.778712 15214 raft_consensus.cc:697] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:16.779628 15214 consensus_queue.cc:237] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.790843 14997 leader_election.cc:290] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:16.793051 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:16.794297 14300 raft_consensus.cc:3055] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:16.794626 14300 raft_consensus.cc:740] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:16.796217 14300 consensus_queue.cc:260] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.797773 14300 raft_consensus.cc:3060] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.787575 14228 raft_consensus.cc:2468] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:16.805568 14889 leader_election.cc:304] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:16.806573 14224 raft_consensus.cc:2468] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:16.806742 15215 raft_consensus.cc:2804] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:16.806856 14300 raft_consensus.cc:2468] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:16.809907 15215 raft_consensus.cc:697] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:16.810833 15215 consensus_queue.cc:237] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:16.812084 13976 catalog_manager.cc:5697] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.844645 13976 catalog_manager.cc:5697] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.858230 15197 raft_consensus.cc:993] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:16.858979 15177 raft_consensus.cc:1081] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:16.861344 14997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58206
I20260709 13:20:16.862048 14997 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.862434 14997 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.874606 14997 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:16.877593 14997 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:16.878319 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:16.879230 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:16.889991 14148 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.889864 14300 raft_consensus.cc:3055] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:16.890683 14300 raft_consensus.cc:740] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:16.891496 14300 consensus_queue.cc:260] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:16.893240 14300 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.899859 14148 raft_consensus.cc:2468] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:16.901516 14300 raft_consensus.cc:2468] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:16.901798 14891 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:16.902778 15215 raft_consensus.cc:2804] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:16.903339 15215 raft_consensus.cc:697] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:16.904376 15215 consensus_queue.cc:237] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:16.918079 13976 catalog_manager.cc:5697] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.968699 14224 raft_consensus.cc:1275] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:16.969895 14148 raft_consensus.cc:1275] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:16.971573 15177 consensus_queue.cc:1048] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:16.972327 15197 consensus_queue.cc:1048] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.001354 14228 raft_consensus.cc:1275] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.003610 15177 consensus_queue.cc:1048] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.039458 14149 raft_consensus.cc:1275] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.041771 15202 consensus_queue.cc:1048] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:17.066190 14299 raft_consensus.cc:1275] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:17.068049 15215 consensus_queue.cc:1048] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:17.095204 14228 raft_consensus.cc:1275] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:17.097268 15219 consensus_queue.cc:1048] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:17.223716 14300 raft_consensus.cc:1275] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.225317 15219 consensus_queue.cc:1048] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.263494 14224 raft_consensus.cc:1275] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.264969 15215 consensus_queue.cc:1048] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.278441  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.290470 14149 raft_consensus.cc:1275] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.294603 15219 consensus_queue.cc:1048] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.306227 14228 raft_consensus.cc:1275] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.312160 15219 consensus_queue.cc:1048] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.334991 14299 raft_consensus.cc:1275] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.337288 15215 consensus_queue.cc:1048] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:20:17.356112  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.362268 14300 raft_consensus.cc:1275] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.363937 15219 consensus_queue.cc:1048] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.444845 14300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:41570
I20260709 13:20:17.445488 14300 raft_consensus.cc:606] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:17.451541 14299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:41570
I20260709 13:20:17.452219 14299 raft_consensus.cc:606] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:17.455941 14224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a072b7409604f1eae201822e47a6088"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:33014
I20260709 13:20:17.456828 14224 raft_consensus.cc:606] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:17.460713 14148 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33"
dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:56766
I20260709 13:20:17.461380 14148 raft_consensus.cc:606] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:17.466249 14228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:33014
I20260709 13:20:17.466840 14228 raft_consensus.cc:606] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:17.470009 14228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:33014
I20260709 13:20:17.470652 14228 raft_consensus.cc:606] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:17.472091  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:17.474025  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:17.582494 15202 raft_consensus.cc:993] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.583058 15202 raft_consensus.cc:1081] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.584713 14998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58206
I20260709 13:20:17.585263 14998 raft_consensus.cc:493] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.585688 14998 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.594792 14998 raft_consensus.cc:515] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:17.596998 14998 leader_election.cc:290] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:17.598541 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:17.599241 14148 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.599805 15174 raft_consensus.cc:993] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.600378 15174 raft_consensus.cc:1081] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.601966 14997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58208
I20260709 13:20:17.602350 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:17.602525 14997 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.602941 14300 raft_consensus.cc:3055] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.603018 14997 raft_consensus.cc:3060] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.603304 14300 raft_consensus.cc:740] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:17.604228 14300 consensus_queue.cc:260] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:17.605504 14300 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.607900 14148 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.609480 14891 leader_election.cc:304] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:17.610353 15219 raft_consensus.cc:2804] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.610841 15219 raft_consensus.cc:697] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:17.611693 15219 consensus_queue.cc:237] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:17.612418 14300 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.612202 14997 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:17.615403 14997 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:17.616251 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:17.616896 14228 raft_consensus.cc:3055] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.617228 14228 raft_consensus.cc:740] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:17.618098 14228 consensus_queue.cc:260] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:17.619320 14228 raft_consensus.cc:3060] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.625973 14228 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.625582 13974 catalog_manager.cc:5697] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.626828 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:17.627538 14300 raft_consensus.cc:3060] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.627810 14889 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:17.629146 15219 raft_consensus.cc:2804] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.629750 15219 raft_consensus.cc:697] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:17.630690 15219 consensus_queue.cc:237] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:17.635512 14300 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.664958 13974 catalog_manager.cc:5697] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.781548 15203 raft_consensus.cc:993] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.782147 15203 raft_consensus.cc:1081] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.783923 14997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a072b7409604f1eae201822e47a6088"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58208
I20260709 13:20:17.784611 14997 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.785782 14997 raft_consensus.cc:3060] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.801702 15227 raft_consensus.cc:993] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.802423 15202 raft_consensus.cc:1081] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.802206 14997 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:17.804131 14997 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:17.804375 14992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58206
I20260709 13:20:17.805042 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:17.805318 14992 raft_consensus.cc:493] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.805701 14149 raft_consensus.cc:3060] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.805819 14992 raft_consensus.cc:3060] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.805533 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:17.806660 14228 raft_consensus.cc:3055] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.806936 14228 raft_consensus.cc:740] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:17.807710 14228 consensus_queue.cc:260] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:17.808534 14228 raft_consensus.cc:3060] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.814231 14149 raft_consensus.cc:2468] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.814740 14992 raft_consensus.cc:515] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:17.817957 14992 leader_election.cc:290] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:17.818111 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:17.818887 14224 raft_consensus.cc:3060] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.819290 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:17.819896 14299 raft_consensus.cc:3055] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.820194 14299 raft_consensus.cc:740] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:17.820968 14299 consensus_queue.cc:260] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:17.822108 14299 raft_consensus.cc:3060] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.817958 14891 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:17.826453 15215 raft_consensus.cc:2804] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.826990 15215 raft_consensus.cc:697] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:17.827863 15215 consensus_queue.cc:237] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:17.828641 14228 raft_consensus.cc:2468] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.830576 14299 raft_consensus.cc:2468] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.828518 14224 raft_consensus.cc:2468] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.831859 14888 leader_election.cc:304] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:17.832984 15219 raft_consensus.cc:2804] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.833545 15219 raft_consensus.cc:697] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:17.834602 15219 consensus_queue.cc:237] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:17.843307 13973 catalog_manager.cc:5697] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.859886 13973 catalog_manager.cc:5697] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.871980 15160 raft_consensus.cc:993] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.872553 15128 raft_consensus.cc:1081] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.874599 14992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58190
I20260709 13:20:17.875399 14992 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.875705 14992 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:17.881055 14992 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:17.883348 14992 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:17.884050 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:17.884303 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:17.884707 14149 raft_consensus.cc:3055] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:17.884899 14224 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:17.885048 14149 raft_consensus.cc:740] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:17.885874 14149 consensus_queue.cc:260] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:17.886932 14149 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:17.895805 14224 raft_consensus.cc:2468] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:17.895936 14149 raft_consensus.cc:2468] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:17.897342 14889 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:17.898265 15219 raft_consensus.cc:2804] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:17.898770 15219 raft_consensus.cc:697] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:17.899710 15219 consensus_queue.cc:237] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:17.910952 13973 catalog_manager.cc:5697] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 2 to 3, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.975157 15203 raft_consensus.cc:993] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.975871 15203 raft_consensus.cc:1081] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:17.978533 14992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58208
I20260709 13:20:17.979439 14992 raft_consensus.cc:493] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.979861 14992 raft_consensus.cc:3060] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.987195 14992 raft_consensus.cc:515] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:17.989241 14992 leader_election.cc:290] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:17.990272 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:17.990762 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:17.991124 14224 raft_consensus.cc:3055] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.991505 14224 raft_consensus.cc:740] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:17.991554 14299 raft_consensus.cc:3060] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.992273 14224 consensus_queue.cc:260] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:17.994062 14224 raft_consensus.cc:3060] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.997225 14299 raft_consensus.cc:2468] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:17.998653 14888 leader_election.cc:304] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:17.999574 15219 raft_consensus.cc:2804] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.999644 14224 raft_consensus.cc:2468] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:18.001000 15219 raft_consensus.cc:697] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:18.002130 14149 raft_consensus.cc:1275] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.001943 15219 consensus_queue.cc:237] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:18.003767 15214 consensus_queue.cc:1048] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.015401 13973 catalog_manager.cc:5697] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:18.028851 14299 raft_consensus.cc:1275] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.030439 15214 consensus_queue.cc:1048] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.081300 14299 raft_consensus.cc:1275] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.082029 14224 raft_consensus.cc:1275] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.083608 15219 consensus_queue.cc:1048] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.084052 15214 consensus_queue.cc:1048] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.277561 14299 raft_consensus.cc:1275] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.279458 15214 consensus_queue.cc:1048] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.293193 14224 raft_consensus.cc:1275] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.295681 15214 consensus_queue.cc:1048] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:20:18.358362 14149 raft_consensus.cc:1275] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.359771 15214 consensus_queue.cc:1048] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.370811 14228 raft_consensus.cc:1275] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.372225 15215 consensus_queue.cc:1048] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.424013 14295 raft_consensus.cc:1275] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.425478 15215 consensus_queue.cc:1048] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.439888 14228 raft_consensus.cc:1275] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.441638 15214 consensus_queue.cc:1048] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.448386 14224 raft_consensus.cc:1275] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:18.450556 15254 consensus_queue.cc:1048] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:18.464586 14149 raft_consensus.cc:1275] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:18.466264 15214 consensus_queue.cc:1048] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:18.475800  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:18.555263  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:18.615031 14149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a"
dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:56766
I20260709 13:20:18.615685 14149 raft_consensus.cc:606] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:18.620012 14149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "944276202aa94d11a0203aa2291a9692"
dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:56766
I20260709 13:20:18.620646 14149 raft_consensus.cc:606] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:18.624233 14149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96745973797345908d4d9937507add14"
dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:56766
I20260709 13:20:18.624876 14149 raft_consensus.cc:606] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:18.628198 14149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d"
dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
mode: GRACEFUL
new_leader_uuid: "4db315fd9fb94434a179b03f5b4c083d"
 from {username='slave'} at 127.0.0.1:56766
I20260709 13:20:18.628639 14149 raft_consensus.cc:606] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Received request to transfer leadership to TS 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:20:18.629774  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:20:18.631628  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:18.746343 15128 raft_consensus.cc:993] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:18.746948 15193 raft_consensus.cc:1081] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:18.748692 14992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96745973797345908d4d9937507add14"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58190
I20260709 13:20:18.749306 14992 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:18.749780 14992 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:18.756294 14992 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:18.758520 14992 leader_election.cc:290] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:18.759483 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:18.759495 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:18.760397 14300 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:18.760491 14149 raft_consensus.cc:3055] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:18.760987 14149 raft_consensus.cc:740] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:18.761695 14149 consensus_queue.cc:260] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:18.762635 14149 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:18.766155 14300 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:18.767422 14888 leader_election.cc:304] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:18.768203 14149 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:18.768657 15254 raft_consensus.cc:2804] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:18.769155 15254 raft_consensus.cc:697] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:18.770100 15254 consensus_queue.cc:237] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:18.783416 13973 catalog_manager.cc:5697] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 2 to 3, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:18.821588 15128 raft_consensus.cc:993] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16: : Instructing follower 4db315fd9fb94434a179b03f5b4c083d to start an election
I20260709 13:20:18.822068 15128 raft_consensus.cc:1081] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Signalling peer 4db315fd9fb94434a179b03f5b4c083d to start an election
I20260709 13:20:18.823679 14300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
 from {username='slave'} at 127.0.0.1:52770
I20260709 13:20:18.824226 14300 raft_consensus.cc:493] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:18.824553 14300 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:18.832103 14300 raft_consensus.cc:515] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:18.834367 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:18.834381 14300 leader_election.cc:290] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:18.835083 14149 raft_consensus.cc:3055] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:18.835511 14149 raft_consensus.cc:740] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:18.836299 14149 consensus_queue.cc:260] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:18.838008 14149 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:18.841264 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:18.842017 14224 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:18.853928 14224 raft_consensus.cc:2468] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:18.854982 14266 leader_election.cc:304] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:18.855783 15177 raft_consensus.cc:2804] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:18.856232 15177 raft_consensus.cc:697] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:18.856956 15177 consensus_queue.cc:237] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:18.859203 14149 raft_consensus.cc:2468] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:18.867036 13973 catalog_manager.cc:5697] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 2, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 2 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:18.924937 15193 raft_consensus.cc:993] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:18.925474 15269 raft_consensus.cc:1081] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:18.927759 14997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58190
I20260709 13:20:18.928377 14997 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:18.928834 14997 raft_consensus.cc:3060] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:18.938205 14997 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:18.939858 14997 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:18.941071 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:18.941490 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:18.942135 14300 raft_consensus.cc:3060] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:18.942988 14149 raft_consensus.cc:3055] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:18.943382 14149 raft_consensus.cc:740] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:18.944305 14149 consensus_queue.cc:260] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:18.945569 14149 raft_consensus.cc:3060] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:18.950615 14300 raft_consensus.cc:2468] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:18.952268 14888 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:18.953161 14149 raft_consensus.cc:2468] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:18.953312 15219 raft_consensus.cc:2804] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:18.953953 15219 raft_consensus.cc:697] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:18.955590 15219 consensus_queue.cc:237] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:18.969280 13973 catalog_manager.cc:5697] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:19.003646 15193 raft_consensus.cc:993] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:19.004123 15193 raft_consensus.cc:1081] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:19.005683 14997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "944276202aa94d11a0203aa2291a9692"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58190
I20260709 13:20:19.006210 14997 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:19.006497 14997 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:19.012250 14997 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:19.013942 14997 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:19.014876 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:19.015583 14300 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:19.015604 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:19.016312 14149 raft_consensus.cc:3055] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:19.016636 14149 raft_consensus.cc:740] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:19.017470 14149 consensus_queue.cc:260] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:19.018718 14149 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:19.023046 14300 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:19.024360 14888 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:19.025311 15219 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:19.025838 15219 raft_consensus.cc:697] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:19.026774 15219 consensus_queue.cc:237] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:19.027595 14149 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:19.044742 13973 catalog_manager.cc:5697] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 2 to 3, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:19.239473 14300 raft_consensus.cc:1275] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:19.241618 15219 consensus_queue.cc:1048] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:19.253849 14148 raft_consensus.cc:1275] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:19.257359 15214 consensus_queue.cc:1048] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:19.415481 14300 raft_consensus.cc:1275] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:19.417555 15219 consensus_queue.cc:1048] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:19.427816 14295 raft_consensus.cc:1275] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:19.431376 15214 consensus_queue.cc:1048] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:19.434154 14149 raft_consensus.cc:1275] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:19.436152 15227 consensus_queue.cc:1048] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:19.444453 14224 raft_consensus.cc:1275] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:19.446762 15177 consensus_queue.cc:1048] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:19.447104 14148 raft_consensus.cc:1275] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:19.448848 15219 consensus_queue.cc:1048] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:19.494576 14151 raft_consensus.cc:1275] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:19.506975 15291 consensus_queue.cc:1048] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:19.552564 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 68483.6us
W20260709 13:20:19.610293 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 62926.3us
I20260709 13:20:19.645836  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:19.783524  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:19.829805 14299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
mode: GRACEFUL
new_leader_uuid: "86cbe005f1b04a3c99562111b01847e8"
 from {username='slave'} at 127.0.0.1:41570
I20260709 13:20:19.830423 14299 raft_consensus.cc:606] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Received request to transfer leadership to TS 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:19.831768  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:19.833494  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:20.047485 15296 raft_consensus.cc:993] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d: : Instructing follower 86cbe005f1b04a3c99562111b01847e8 to start an election
I20260709 13:20:20.048036 15202 raft_consensus.cc:1081] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Signalling peer 86cbe005f1b04a3c99562111b01847e8 to start an election
I20260709 13:20:20.049623 14228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
 from {username='slave'} at 127.0.0.1:35194
I20260709 13:20:20.050143 14228 raft_consensus.cc:493] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:20.050446 14228 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:20.056357 14228 raft_consensus.cc:515] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:20.058753 14228 leader_election.cc:290] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:20.060021 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:20.060021 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:20.061110 14148 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:20.061046 14300 raft_consensus.cc:3055] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:20.061611 14300 raft_consensus.cc:740] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:20.062427 14300 consensus_queue.cc:260] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:20.063970 14300 raft_consensus.cc:3060] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:20.068419 14148 raft_consensus.cc:2468] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:20.069796 14194 leader_election.cc:304] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:20.070647 15174 raft_consensus.cc:2804] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:20.071306 15174 raft_consensus.cc:697] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:20.072103 15174 consensus_queue.cc:237] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:20.076333 14300 raft_consensus.cc:2468] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:20.082175 13973 catalog_manager.cc:5697] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 2 to 3, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.586539 14149 raft_consensus.cc:1275] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:20.588792 15304 consensus_queue.cc:1048] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:20.640511 14295 raft_consensus.cc:1275] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:20.642361 15303 consensus_queue.cc:1048] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:20:20.834661  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:20.929920  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:20.971091 14222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
mode: GRACEFUL
new_leader_uuid: "4db315fd9fb94434a179b03f5b4c083d"
 from {username='slave'} at 127.0.0.1:33014
I20260709 13:20:20.971843 14222 raft_consensus.cc:606] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Received request to transfer leadership to TS 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:20:20.974012  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:20.975893  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:21.327286 15303 raft_consensus.cc:993] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8: : Instructing follower 4db315fd9fb94434a179b03f5b4c083d to start an election
I20260709 13:20:21.335769 15303 raft_consensus.cc:1081] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Signalling peer 4db315fd9fb94434a179b03f5b4c083d to start an election
W20260709 13:20:21.554468 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 227989us
I20260709 13:20:21.832145 14295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
 from {username='slave'} at 127.0.0.1:52784
I20260709 13:20:21.833072 14295 raft_consensus.cc:493] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:21.833491 14295 raft_consensus.cc:3060] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:21.862272 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 56011us
I20260709 13:20:22.318704 15332 raft_consensus.cc:493] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:22.319633 15332 raft_consensus.cc:515] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:22.322870 15332 leader_election.cc:290] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:22.332239 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:22.455848  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:22.614112 15330 raft_consensus.cc:493] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:22.615008 15330 raft_consensus.cc:515] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:22.618711 15330 leader_election.cc:290] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:22.619451 15330 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:22.620124 15330 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:22.623229 15330 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:22.623808 15330 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:22.624436 15330 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:22.627437 15330 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:22.637374 15330 raft_consensus.cc:493] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:22.698993 15330 raft_consensus.cc:515] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:22.728717 15330 leader_election.cc:290] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:22.734869 15330 raft_consensus.cc:493] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:22.787549 15330 raft_consensus.cc:515] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:22.837453 15330 leader_election.cc:290] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:22.838832 15330 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:22.839547 15330 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:22.914539 15330 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:22.915226 15330 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:22.915942 15330 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:22.918475 15330 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.292927 15227 raft_consensus.cc:493] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.294144 15227 raft_consensus.cc:515] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
W20260709 13:20:23.295537 14295 consensus_meta.cc:287] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d: Time spent flushing consensus metadata: real 1.462s	user 0.014s	sys 0.015s
I20260709 13:20:23.296790 14295 raft_consensus.cc:515] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.298099 15227 leader_election.cc:290] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.300379 14223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59352 (request call id 84) took 1074 ms. Trace:
I20260709 13:20:23.311049 15334 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.311326 14295 leader_election.cc:290] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.312004 14295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52784 (request call id 610) took 1516 ms. Trace:
I20260709 13:20:23.312357 14295 rpcz_store.cc:276] 0709 13:20:21.808342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:21.831980 (+ 23638us) service_pool.cc:224] Handling call
0709 13:20:23.311909 (+1479929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.305217 14223 rpcz_store.cc:276] 0709 13:20:22.226332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.297825 (+1071493us) service_pool.cc:224] Handling call
0709 13:20:23.298441 (+   616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.298826 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.298857 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.298906 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:20:23.298942 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.300158 (+  1216us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.300312 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.313000 15334 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.311208 14228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35190 (request call id 664) took 1454 ms. Trace:
I20260709 13:20:23.319435 15334 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.315539 14228 rpcz_store.cc:276] 0709 13:20:21.856475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.057588 (+201113us) service_pool.cc:224] Handling call
0709 13:20:22.058631 (+  1043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.310469 (+1251838us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b2c00033f08. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d203c291 00007fc1d20570ca 00007fc1d3d854ad 00007fc1d3d8be1b 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:20:23.310573 (+   104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.310723 (+   150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.310774 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:20:23.310810 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.310879 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.311004 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673757056}
I20260709 13:20:23.331251 15311 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.332655 15311 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.337476 15330 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.338795 15330 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:23.381678 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08000556c0 after lost signal to thread 4249
I20260709 13:20:23.510370 14149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44576 (request call id 65) took 1209 ms. Trace:
I20260709 13:20:23.510623 15311 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.511003 14149 rpcz_store.cc:276] 0709 13:20:22.300651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.506656 (+1206005us) service_pool.cc:224] Handling call
0709 13:20:23.506959 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.507142 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.507166 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.507200 (+    34us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:20:23.507219 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.507287 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.510262 (+  2975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.511533 15311 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.513254 15311 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.517818 15227 raft_consensus.cc:493] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.518479 15227 raft_consensus.cc:515] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.521313 15338 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.398936 15334 raft_consensus.cc:493] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.525942 15317 raft_consensus.cc:493] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.526149 15334 raft_consensus.cc:515] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.526676 15317 raft_consensus.cc:515] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.531337 15311 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.532188 15227 leader_election.cc:290] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.534274 15334 leader_election.cc:290] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.520023 15330 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.535434 15334 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.536402 15334 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.537133 15330 raft_consensus.cc:493] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.537813 15330 raft_consensus.cc:515] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:23.539889 15334 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.540707 15335 raft_consensus.cc:493] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.540974 15337 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.532470 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.533303 15227 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.546787 15337 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.547129 15227 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.523547 15338 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.550283 15337 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.551251 15335 raft_consensus.cc:515] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.532521 15311 raft_consensus.cc:493] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.553895 14149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40648 (request call id 717) took 1696 ms. Trace:
I20260709 13:20:23.553680 15311 raft_consensus.cc:515] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.554795 15335 leader_election.cc:290] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.555712 15317 leader_election.cc:290] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.556627 15338 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:23.554292 14149 rpcz_store.cc:276] 0709 13:20:21.857309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.553020 (+1695711us) service_pool.cc:224] Handling call
0709 13:20:23.553327 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.553537 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.553565 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.553616 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:20:23.553649 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.553723 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.553839 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.559033 15334 raft_consensus.cc:493] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.543807 15330 leader_election.cc:290] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.557542 15227 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.557236 15317 raft_consensus.cc:493] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.546177 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.559322 15311 leader_election.cc:290] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:23.559859 15337 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.565851 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.566833 15338 raft_consensus.cc:493] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.567479 15338 raft_consensus.cc:515] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.567672 15337 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:23.570050 15337 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.574111 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.576028 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.576152 15227 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.576841 15227 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.565295 15317 raft_consensus.cc:515] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.584619 15338 leader_election.cc:290] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.585048 14999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:23.583045 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.587379 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:23.590034 15317 leader_election.cc:290] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.590819 15336 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.591408 15336 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:23.580881 15227 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.595508 15330 raft_consensus.cc:493] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.596125 15330 raft_consensus.cc:515] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.597137 15341 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.598400 15336 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.598004 15341 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.601584 15317 raft_consensus.cc:493] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.601850 14224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59352 (request call id 85) took 1374 ms. Trace:
I20260709 13:20:23.581760 15334 raft_consensus.cc:515] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.602408 15317 raft_consensus.cc:515] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.598522 15330 leader_election.cc:290] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.594934 15339 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.605278 15339 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.601526 15227 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.606003 15323 raft_consensus.cc:493] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.605800 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:23.606406 15227 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.606637 15323 raft_consensus.cc:515] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.608690 15227 leader_election.cc:290] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.612592 15339 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:23.602376 14224 rpcz_store.cc:276] 0709 13:20:22.226974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.600603 (+1373629us) service_pool.cc:224] Handling call
0709 13:20:23.601045 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.601271 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.601308 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.601366 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:20:23.601409 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.601502 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.601652 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.620306 15319 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.627822 15335 raft_consensus.cc:493] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.614130 14227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59352 (request call id 86) took 1386 ms. Trace:
I20260709 13:20:23.614286 15334 leader_election.cc:290] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.630311 15334 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.630997 15334 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.596357 15340 raft_consensus.cc:493] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.632936 15340 raft_consensus.cc:515] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.635811 15340 leader_election.cc:290] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.609288 15227 raft_consensus.cc:493] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.631814 15339 raft_consensus.cc:493] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.631495 15335 raft_consensus.cc:515] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.621218 15319 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.644604 15335 leader_election.cc:290] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.613634 15341 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.645601 15341 raft_consensus.cc:493] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.630061 14227 rpcz_store.cc:276] 0709 13:20:22.227338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.613132 (+1385794us) service_pool.cc:224] Handling call
0709 13:20:23.613517 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.613704 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.613732 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.613775 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:20:23.613803 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.613857 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.613957 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.646365 15322 raft_consensus.cc:493] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.646879 14222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35190 (request call id 665) took 1423 ms. Trace:
I20260709 13:20:23.631846 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:20:23.670141 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 69259.1us
W20260709 13:20:23.670945 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 47835us
I20260709 13:20:23.659276 14222 rpcz_store.cc:276] 0709 13:20:22.223493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.646017 (+1422524us) service_pool.cc:224] Handling call
0709 13:20:23.646359 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.646533 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.646586 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.646626 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:20:23.646654 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.646713 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.646825 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:23.658468 15334 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.676707 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.676856 15348 raft_consensus.cc:493] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.677325 15334 raft_consensus.cc:493] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.677645 15348 raft_consensus.cc:515] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.646438 15319 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.677910 15334 raft_consensus.cc:515] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.678349 15344 raft_consensus.cc:493] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.679452 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:23.680037 15344 raft_consensus.cc:515] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.680562 15334 leader_election.cc:290] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.648485 15335 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.648492 15341 raft_consensus.cc:515] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.681241 15335 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.682911 15341 leader_election.cc:290] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.683173 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e920394df0034e98ab19842b8206bbb5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.658111 15227 raft_consensus.cc:515] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.683748 15335 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:23.683881 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.684511 14220 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:23.684654 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.680719 14152 raft_consensus.cc:3060] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.685451 15227 leader_election.cc:290] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.658149 15337 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.667867 15322 raft_consensus.cc:515] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.686203 15337 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:23.687459 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06e3182ee5d4798b9145b000d822462" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.688310 15337 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.688580 15322 leader_election.cc:290] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.666667 15339 raft_consensus.cc:515] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.682598 15344 leader_election.cc:290] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.678084 15317 leader_election.cc:290] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.691401 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:20:23.694073 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 45647.6us
I20260709 13:20:23.608700 15323 leader_election.cc:290] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.680343 15348 leader_election.cc:290] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.716852 14152 raft_consensus.cc:2468] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:23.696169 15337 raft_consensus.cc:493] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.741955 15339 leader_election.cc:290] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.742219 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.720825 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.744020 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.747445 15310 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.748119 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.748344 15310 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.748901 14151 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:23.748661 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0da4aaa5c4c88adc94081e83baaab" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.748368 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.746508 15319 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.756951 15319 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.757947 15337 raft_consensus.cc:515] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.758350 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.738663 15342 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.759794 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.760365 15346 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.759785 15342 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:23.760846 14249 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3cc0 after lost signal to thread 4249
W20260709 13:20:23.762470 14249 debug-util.cc:398] Leaking SignalData structure 0x7b0800390b40 after lost signal to thread 14011
W20260709 13:20:23.764115 14249 debug-util.cc:398] Leaking SignalData structure 0x7b080011d9c0 after lost signal to thread 14178
I20260709 13:20:23.760951 15346 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:23.750963 15310 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.759690 15319 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:23.775249 14249 debug-util.cc:398] Leaking SignalData structure 0x7b080029f8e0 after lost signal to thread 14252
I20260709 13:20:23.752401 15340 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.787336 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.792932 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59352 (request call id 83) took 1558 ms. Trace:
I20260709 13:20:23.790007 15344 raft_consensus.cc:493] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.794256 15342 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.795224 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.795327 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:23.795799 15337 leader_election.cc:290] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:23.796115 14998 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:23.797919 15319 raft_consensus.cc:493] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.798265 15227 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.798650 15322 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.798898 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.799253 15322 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.800459 15337 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.798923 15227 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.801636 15334 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.801316 15337 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.802146 15334 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.803407 15227 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.803799 15337 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.803979 15227 raft_consensus.cc:493] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.798025 15341 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.804318 15334 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.812732 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:20:23.818521 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 103176us
I20260709 13:20:23.810804 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.794323 15344 raft_consensus.cc:515] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.826532 14219 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:23.826923 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:23.827281 15322 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:23.828203 15344 leader_election.cc:290] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.798697 15319 raft_consensus.cc:515] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.810842 15341 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.829918 15214 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.830669 15349 raft_consensus.cc:493] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:23.830545 15214 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.831228 15319 leader_election.cc:290] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:23.831401 15227 raft_consensus.cc:515] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.831830 15341 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:23.830567 15346 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.783583 15310 raft_consensus.cc:493] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.793586 14225 rpcz_store.cc:276] 0709 13:20:22.224308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.506015 (+1281707us) service_pool.cc:224] Handling call
0709 13:20:23.506551 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:23.765164 (+258613us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b2c000a4c68. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d203c291 00007fc1d20570ca 00007fc1d3d854ad 00007fc1d3d8be1b 00007fc1d3d8b83e 00007fc1d8d50419 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2
0709 13:20:23.765334 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.765378 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:23.769888 (+  4510us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:20:23.775774 (+  5886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.782361 (+  6587us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.782606 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579492224}
I20260709 13:20:23.851287 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.854538 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.832729 15214 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:23.850754 14249 debug-util.cc:398] Leaking SignalData structure 0x7b08000d89a0 after lost signal to thread 14326
I20260709 13:20:23.790053 15317 raft_consensus.cc:493] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:23.852610 14118 leader_election.cc:304] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:23.831853 15319 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.852203 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138f6cda3ff43d2bce4723559454144" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.864647 15310 raft_consensus.cc:515] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:23.868830 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.831266 15349 raft_consensus.cc:515] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:23.888990 14997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:23.890545 15319 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:23.856899 15340 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:23.873601 15214 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
W20260709 13:20:23.867247 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 81123.1us
I20260709 13:20:23.874246 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.881958 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.886951 15353 raft_consensus.cc:493] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:23.887097 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.888465 15355 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.902117 15214 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.863116 15346 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:23.883502 15227 leader_election.cc:290] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:23.893321 15319 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:20:24.013453 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 163207us
I20260709 13:20:24.015818 15319 raft_consensus.cc:493] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.016708 15319 raft_consensus.cc:515] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.019198 15319 leader_election.cc:290] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.019781 15319 raft_consensus.cc:493] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
W20260709 13:20:23.936769 14249 debug-util.cc:398] Leaking SignalData structure 0x7b080020ba40 after lost signal to thread 15030
I20260709 13:20:24.015413 15346 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.020813 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.022724 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:23.937315 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:23.895736 15317 raft_consensus.cc:515] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:23.938423 15353 raft_consensus.cc:515] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:23.890609 15349 leader_election.cc:290] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.025483 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb8dec8f80469e908bba7053af18a1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.025941 14997 raft_consensus.cc:2468] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:23.904610 14300 raft_consensus.cc:2393] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 2: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:24.026788 15353 leader_election.cc:290] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.022791 15346 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.003017 15360 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.028522 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.028770 15360 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.030012 14998 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:20:24.020354 15319 raft_consensus.cc:515] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.030171 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.003875 15356 raft_consensus.cc:493] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.030958 14995 raft_consensus.cc:2468] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 1.
I20260709 13:20:24.031415 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:23.903797 15338 raft_consensus.cc:2804] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:20:24.005833 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 75230.8us
I20260709 13:20:24.026830 15317 leader_election.cc:290] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.032927 14998 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:24.032341 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.007122 15310 leader_election.cc:290] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.015072 15214 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
W20260709 13:20:24.010767 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 158429us
I20260709 13:20:24.035557 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.037587 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.039394 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.040122 15360 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.040616 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.013731 15355 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.040176 15319 leader_election.cc:290] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.042928 14992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.043708 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.044402 14995 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:24.045631 14990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.046079 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.046965 14990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.002612 15351 raft_consensus.cc:493] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.020013 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.051307 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.052258 15351 raft_consensus.cc:515] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:24.034265 14268 leader_election.cc:304] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:24.056563 14268 leader_election.cc:304] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:24.004747 15358 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.059760 15358 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.062335 15358 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.063325 15227 raft_consensus.cc:2804] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:20:24.063696 14323 debug-util.cc:398] Leaking SignalData structure 0x7b080039d840 after lost signal to thread 14011
I20260709 13:20:24.063917 15227 raft_consensus.cc:697] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.065042 15296 raft_consensus.cc:2804] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:20:24.065357 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08000f4400 after lost signal to thread 14178
I20260709 13:20:24.065310 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.065884 15296 raft_consensus.cc:493] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:24.066425 15296 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.067579 14193 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:24.068598 15358 raft_consensus.cc:493] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.069614 15310 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.070273 15310 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.072461 15310 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.073560 14267 leader_election.cc:304] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:24.075459 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.069248 15358 raft_consensus.cc:515] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.066257 14996 raft_consensus.cc:2468] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:24.065182 15227 consensus_queue.cc:237] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:24.083774 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.084158 15358 leader_election.cc:290] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.089330 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.090561 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.091197 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.077360 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.085148 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.092832 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.093084 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.094105 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138f6cda3ff43d2bce4723559454144" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.094331 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.047794 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.048465 14990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.095935 15323 raft_consensus.cc:2804] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.096014 14990 raft_consensus.cc:2468] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:24.097636 14990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.098320 14990 raft_consensus.cc:2468] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:24.099063 14147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22a4f3e09e401296389c126d11edc0" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.099924 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.096558 15323 raft_consensus.cc:493] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.101477 15323 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:24.103557 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 99450.1us
I20260709 13:20:24.107349 14267 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.096552 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.108952 14991 raft_consensus.cc:2468] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 1.
I20260709 13:20:24.109229 15322 raft_consensus.cc:2749] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.052714 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.111383 14267 leader_election.cc:304] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.111934 14993 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:24.112389 15322 raft_consensus.cc:2749] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.053510 14992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.113266 14992 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:24.113339 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.049232 14999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.048683 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.031381 15356 raft_consensus.cc:515] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.118132 15356 leader_election.cc:290] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.058987 15338 raft_consensus.cc:493] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.034289 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.118865 15338 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.120321 15296 raft_consensus.cc:515] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.014079 15363 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.079157 14994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58206 (request call id 457) took 2005 ms. Trace:
I20260709 13:20:24.122148 15363 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.122309 14994 rpcz_store.cc:276] 0709 13:20:22.074114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.081595 (+  7481us) service_pool.cc:224] Handling call
0709 13:20:24.073104 (+1991509us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b5400051d28. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d8cb5aa1 00007fc1d8d30ebc 00007fc1d8d6608c 00007fc1d8d5093b 00007fc1d8d503d2 00007fc1d22c7bd4 00007fc1d22c7b62 00007fc1d22c7a91 00007fc1d22c7a0c 00007fc1d22c6cc2 00007fc1d20c748c
0709 13:20:24.073248 (+   144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.078522 (+  5274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.078556 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.078619 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:20:24.078653 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.078734 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.078927 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8612224}
W20260709 13:20:24.123945 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08000f8820 after lost signal to thread 14252
W20260709 13:20:24.125253 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3e40 after lost signal to thread 14326
I20260709 13:20:24.125324 14118 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:24.126456 15336 raft_consensus.cc:2804] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:20:24.126693 14323 debug-util.cc:398] Leaking SignalData structure 0x7b080030f6e0 after lost signal to thread 15030
I20260709 13:20:24.126888 15336 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.081122 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.081481 15331 raft_consensus.cc:493] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.082126 15346 raft_consensus.cc:493] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.127421 15336 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.127653 14154 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:24.127782 15346 raft_consensus.cc:515] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.078899 15361 raft_consensus.cc:2804] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.129681 15361 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.130101 15361 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.130182 15346 leader_election.cc:290] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.127696 15331 raft_consensus.cc:515] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.133057 15331 leader_election.cc:290] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.105383 15351 leader_election.cc:290] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
W20260709 13:20:24.127085 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08000d91e0 after lost signal to thread 15031
W20260709 13:20:24.107894 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 433227us
I20260709 13:20:24.135125 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.135445 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.135809 14300 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:24.136154 14297 raft_consensus.cc:2468] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:24.058552 15355 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.137583 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.138684 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.138955 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.139397 14220 raft_consensus.cc:2468] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:20:24.140672 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be55c8ee09443479786b8bf51188b81" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.140901 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.141002 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.141986 14227 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:20:24.142616 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.144029 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.144336 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.145273 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.145874 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.145445 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.146301 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.145922 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.151443 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.142676 15363 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.144088 14119 leader_election.cc:304] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.155602 15330 raft_consensus.cc:2749] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.157245 14119 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.158221 15330 raft_consensus.cc:2749] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.079746 14193 leader_election.cc:304] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
W20260709 13:20:24.162950 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 83284.7us
I20260709 13:20:24.163744 14193 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.165242 14193 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.166452 15296 leader_election.cc:290] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.167443 15335 raft_consensus.cc:2804] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.167912 15335 raft_consensus.cc:493] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.168295 15335 raft_consensus.cc:3060] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.169299 14889 leader_election.cc:304] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:24.171700 14267 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.011636 15340 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.175473 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:24.175776 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.176196 14148 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.176100 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.181143 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7edac8cddd4927a4d0c73332149e41" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.185344 15363 raft_consensus.cc:493] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.185672 14219 raft_consensus.cc:2468] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 1.
I20260709 13:20:24.186151 15363 raft_consensus.cc:515] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.175480 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.187712 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.188632 15363 leader_election.cc:290] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.177023 15351 raft_consensus.cc:2749] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.190320 15363 raft_consensus.cc:493] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.191468 15363 raft_consensus.cc:515] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.170650 15336 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:24.195909 14150 raft_consensus.cc:1240] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:24.196899 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.199662 14148 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:24.205596 14146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dca71eb8ab145ae99370ac00979d5e3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.190510 15360 raft_consensus.cc:2804] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.206657 15359 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.194087 15323 raft_consensus.cc:515] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.207067 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.199930 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.201139 14147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.206967 15360 raft_consensus.cc:493] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.201519 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.202600 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b85e799338444779dcc24b7b8ee9a1e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.203009 15336 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.193508 15337 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:24.223414 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.205588 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.224246 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.206137 14145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef7edac8cddd4927a4d0c73332149e41" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.207567 14152 raft_consensus.cc:1240] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Rejecting Update request from peer ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:24.193941 15363 leader_election.cc:290] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.210852 15359 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.207541 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.214679 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
W20260709 13:20:24.194687 14888 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.37.132:46307 timed out after 1.764s (SENT) [suppressed 301 similar messages]
I20260709 13:20:24.217902 15360 raft_consensus.cc:3060] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.228575 15335 raft_consensus.cc:515] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.230073 14225 raft_consensus.cc:1240] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:24.233402 15335 leader_election.cc:290] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.235136 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.235061 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.236231 15338 raft_consensus.cc:515] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:24.237669 14154 raft_consensus.cc:1240] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:24.241830 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.242187 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.243095 14300 raft_consensus.cc:2393] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 3: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:24.243460 15338 leader_election.cc:290] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.244338 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:24.244815 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.219269 14889 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
W20260709 13:20:24.220709 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 49093.6us
I20260709 13:20:24.221158 15227 raft_consensus.cc:2804] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:24.245949 15363 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.246233 15227 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.221336 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.246503 15363 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.246750 14267 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.246783 15227 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.240649 15361 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.247743 15340 raft_consensus.cc:2749] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.221787 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:24.248768 14224 raft_consensus.cc:2393] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 2: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:20:24.247016 15363 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.189114 14119 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
W20260709 13:20:24.249940 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 60904.7us
I20260709 13:20:24.250651 14119 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.251789 14267 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.247035 14219 raft_consensus.cc:3055] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.223543 15337 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.212119 15323 leader_election.cc:290] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.252763 14219 raft_consensus.cc:740] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:24.252856 15340 raft_consensus.cc:2804] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:24.253427 15340 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.253886 15340 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.253767 14219 consensus_queue.cc:260] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:24.255208 14219 raft_consensus.cc:3060] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.252878 15337 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.259706 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.250456 14220 raft_consensus.cc:1240] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 1. Current term is 2. Ops: []
W20260709 13:20:24.261548 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 51835.8us
I20260709 13:20:24.261690 15336 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:24.262244 15336 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.262357 14296 raft_consensus.cc:1240] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Rejecting Update request from peer ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:24.262751 15336 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.265560 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.266901 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.267261 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.268321 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.268723 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.269704 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.270165 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.271449 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.271629 15361 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.271770 15336 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.271446 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.273583 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.272133 14267 leader_election.cc:304] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:24.274664 15359 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.277343 14889 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.277889 15323 raft_consensus.cc:2804] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.278378 15323 raft_consensus.cc:493] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.278831 15323 raft_consensus.cc:3060] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.281891 15362 raft_consensus.cc:2749] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.284559 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.284862 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e920394df0034e98ab19842b8206bbb5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.285786 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.286198 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.286410 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.288061 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.288923 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06e3182ee5d4798b9145b000d822462" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.289064 14268 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.290269 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.291271 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.290289 15296 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:24.292272 15296 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:24.292145 15345 consensus_queue.cc:1059] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:24.292896 15296 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.293679 15311 raft_consensus.cc:2804] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.294257 15311 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.295076 15311 raft_consensus.cc:3060] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.222040 14891 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.298524 14268 leader_election.cc:304] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:24.299419 15322 raft_consensus.cc:2804] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:24.299961 15322 raft_consensus.cc:697] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.300184 15317 raft_consensus.cc:3055] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:24.300664 15317 raft_consensus.cc:740] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.301890 15362 raft_consensus.cc:2749] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.260790 15360 raft_consensus.cc:515] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.302385 15296 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.302942 15317 consensus_queue.cc:260] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:24.304222 15317 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.304522 15296 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.304590 15360 leader_election.cc:290] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.306231 15336 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.305734 15322 consensus_queue.cc:237] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.299779 15345 consensus_queue.cc:1059] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:24.310159 15345 raft_consensus.cc:3055] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:24.310689 15345 raft_consensus.cc:740] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.311568 15345 consensus_queue.cc:260] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:24.308827 13973 catalog_manager.cc:5697] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 2 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:24.312865 15345 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:24.321574 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 127012us
I20260709 13:20:24.312852 14889 leader_election.cc:304] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:24.321290 14267 leader_election.cc:304] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
W20260709 13:20:24.321269 14891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 101556us
I20260709 13:20:24.323266 14891 leader_election.cc:304] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.324893 14267 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.333133 14267 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:24.353672 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f9248d01a9496b9d1574466dc66d43" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.353957 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:24.362313  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:24.364290 15319 consensus_queue.cc:1059] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:24.362071 14117 leader_election.cc:304] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.366595 14117 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:24.367352 14891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 44169.3us
I20260709 13:20:24.368577 15323 raft_consensus.cc:515] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.369602 15214 raft_consensus.cc:2749] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.369787 15336 raft_consensus.cc:2749] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.370594 15330 raft_consensus.cc:2749] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.375061 15311 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.369081 14117 leader_election.cc:304] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.376777 14997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.377377 15339 raft_consensus.cc:2749] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.378122 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.378610 14117 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:24.378937 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.379316 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.318463 15363 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.380489 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.380764 14117 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:24.381976 15363 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.382174 15342 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:24.382704 15342 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:24.383111 15342 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.384526 14999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.385277 14999 raft_consensus.cc:2468] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:24.385002 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.386440 14992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.368906 14891 leader_election.cc:304] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.387650 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.388402 14891 leader_election.cc:304] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.389971 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.390487 15346 raft_consensus.cc:2749] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.391219 15294 raft_consensus.cc:2804] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:24.391350 14997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.391683 15294 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:24.392212 15294 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.343690 15344 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:24.392889 15344 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.393283 15344 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.393996 14221 raft_consensus.cc:2393] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 2: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:20:24.343448 15341 raft_consensus.cc:2804] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:24.394508 15341 raft_consensus.cc:493] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.394981 15341 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.289296 15227 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.396490 15342 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.397646 15227 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.340377 15296 raft_consensus.cc:2804] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.399269 15296 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:24.399668 15296 raft_consensus.cc:3060] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.399809 15342 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.343209 15356 raft_consensus.cc:2804] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.400700 15356 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.401069 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:24.401048 15356 raft_consensus.cc:3060] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.405772 14891 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.408126 14891 leader_election.cc:304] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.409217 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.409402 15347 raft_consensus.cc:2749] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.411079 15347 raft_consensus.cc:2749] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.411577 15310 raft_consensus.cc:3055] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:24.412030 15310 raft_consensus.cc:740] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:24.412281 14891 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.391764 15346 raft_consensus.cc:2749] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.416865 15337 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.417183 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.417613 14219 raft_consensus.cc:2468] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:24.421088 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.421838 14994 raft_consensus.cc:3060] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.424925 14891 leader_election.cc:304] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.427762 14148 raft_consensus.cc:1240] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:24.426426 15347 raft_consensus.cc:2749] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.435115 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.436995 15361 consensus_queue.cc:1059] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:24.438172 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.438464 15361 raft_consensus.cc:3055] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.439184 15361 raft_consensus.cc:740] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:24.439670 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.440518 15361 consensus_queue.cc:260] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.437263 14119 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.442344 15338 raft_consensus.cc:2749] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:24.443421 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 60127.5us
I20260709 13:20:24.422941 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.444360 14994 raft_consensus.cc:2468] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:24.444589 15361 raft_consensus.cc:3060] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.452819 15311 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:24.446796 15340 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.462882 15323 leader_election.cc:290] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.464679 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:24.466655 15337 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.468293 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9c5f286ddb4582a67c471c4f1bdc67" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.468806 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.445643 14119 leader_election.cc:304] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.451606 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.469815 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.412847 15310 consensus_queue.cc:260] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.470486 15296 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.449674 15347 raft_consensus.cc:2749] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.459007 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:24.471626 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.469916 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:20:24.471948 15355 consensus_queue.cc:1175] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ce90f8e60d79487db7509ae191b95a16" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:24.470780 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22a4f3e09e401296389c126d11edc0" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.475167 15296 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.444994 14117 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.476425 15342 raft_consensus.cc:2804] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:24.476850 15342 raft_consensus.cc:493] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:24.477285 15342 raft_consensus.cc:3060] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.477341 15311 raft_consensus.cc:2749] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.471623 15310 raft_consensus.cc:3060] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.485366 15342 raft_consensus.cc:515] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.470780 14119 leader_election.cc:304] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.451911 14891 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.490408 15340 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.486727 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
W20260709 13:20:24.451862 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 95244.3us
I20260709 13:20:24.499356 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.499564 15356 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.503911 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.504442 15342 leader_election.cc:290] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.505803 15356 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:24.511576 14266 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.512787 15340 raft_consensus.cc:2749] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.512897 14119 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.513134 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.515353 14266 leader_election.cc:304] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.514205 15339 raft_consensus.cc:2749] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.516371 15339 raft_consensus.cc:2749] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:24.517060 14891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 65290.1us
I20260709 13:20:24.517544 15345 raft_consensus.cc:2749] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.518039 15347 raft_consensus.cc:2749] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.518262 14891 leader_election.cc:304] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.514267 14119 leader_election.cc:304] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:24.515218 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 62650.2us
I20260709 13:20:24.518734 15345 consensus_queue.cc:1059] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:24.519196 15347 raft_consensus.cc:2749] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.519650 14889 leader_election.cc:304] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.519850 14891 leader_election.cc:304] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.519912 15323 raft_consensus.cc:3055] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.523780 14119 leader_election.cc:304] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.476920 15341 raft_consensus.cc:515] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.520533 15323 raft_consensus.cc:740] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.530876 15323 consensus_queue.cc:260] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.531159 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bef24cb5de488fa1610fa18979e0bb" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.531945 14999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.532935 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:24.533617 14999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.534140 14990 raft_consensus.cc:1240] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:24.534600 14992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.534765 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.535032 15346 raft_consensus.cc:2749] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.536885 15339 raft_consensus.cc:2749] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.539345 14119 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:24.542645 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 43823.3us
I20260709 13:20:24.537849 15370 raft_consensus.cc:2749] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:24.572311 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 51420.9us
W20260709 13:20:24.588517 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 49248.1us
I20260709 13:20:24.589413 14119 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.590871 14266 leader_election.cc:304] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.598500 14266 leader_election.cc:304] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.598909 14301 raft_consensus.cc:1240] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Rejecting Update request from peer ce90f8e60d79487db7509ae191b95a16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:24.599959 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.600648 14295 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:24.541931 15323 raft_consensus.cc:3060] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.542919 15311 raft_consensus.cc:2749] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.581308 14888 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.615041 14295 raft_consensus.cc:1240] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:24.622273 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
W20260709 13:20:24.626688 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 61088.5us
I20260709 13:20:24.626927 14302 raft_consensus.cc:1240] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Rejecting Update request from peer ce90f8e60d79487db7509ae191b95a16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:24.632030 14888 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.634621 15329 raft_consensus.cc:2749] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.603387 15339 raft_consensus.cc:2749] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.603462 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e0da4aaa5c4c88adc94081e83baaab" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:24.623348 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:24.642881 14888 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.640586 14193 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.628611 15227 raft_consensus.cc:2749] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.633945 15310 raft_consensus.cc:2749] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.651160 15312 consensus_queue.cc:1059] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:20:24.651575 15294 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.651912 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.653558 14148 raft_consensus.cc:1240] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Rejecting Update request from peer ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:24.633460 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:24.655014 14888 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.641594 15347 raft_consensus.cc:2749] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.653481 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:24.662324 15294 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:24.669237 15341 leader_election.cc:290] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:24.670233 14219 raft_consensus.cc:2468] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:24.670809 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.671689 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:24.672467 15360 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.696460 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.697753 14997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.698457 14997 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.702132 14992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.703591 14992 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.671697 15344 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.706662 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c21d80fe34435a9dc4b1435f136941" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.707437 14991 raft_consensus.cc:3060] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.707492 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.659070 15354 raft_consensus.cc:2749] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.698179 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.712831 14993 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.713748 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:24.719511 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb8dec8f80469e908bba7053af18a1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.661314 14888 leader_election.cc:304] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
W20260709 13:20:24.724288 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 63040.7us
W20260709 13:20:24.692329 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 93889us
W20260709 13:20:24.688709 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 64136.9us
I20260709 13:20:24.673184 15296 raft_consensus.cc:2749] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.694949 14267 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.656037 15346 raft_consensus.cc:2749] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.726204 14266 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.725772 14888 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.730858 14266 leader_election.cc:304] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.735282 14152 raft_consensus.cc:1240] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 3. Current term is 4. Ops: []
I20260709 13:20:24.733916 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcbdfedd963a49c1b2da5553ac8ad00f" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:24.742317 14888 leader_election.cc:304] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.741295 14191 leader_election.cc:304] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.743845 14992 raft_consensus.cc:2468] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:24.741186 14118 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:24.744889 14267 leader_election.cc:304] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.745261 14888 leader_election.cc:304] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.746212 14191 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.728977 15319 raft_consensus.cc:2749] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.748548 15355 raft_consensus.cc:2749] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.749354 14145 raft_consensus.cc:1275] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.752018 15376 raft_consensus.cc:2749] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.751355 15340 raft_consensus.cc:3055] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.757100 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:24.759075 15340 raft_consensus.cc:740] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.760771 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d03691b876d4eeb969dcd24d00ddfa2" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.762060 15174 raft_consensus.cc:2749] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.745230 15346 raft_consensus.cc:2749] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.748610 15351 raft_consensus.cc:2749] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.748005 14191 leader_election.cc:304] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.775341 15375 raft_consensus.cc:2749] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.777865 14993 raft_consensus.cc:2468] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 4.
I20260709 13:20:24.769647 14293 raft_consensus.cc:2468] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:24.789091 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
W20260709 13:20:24.790941 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 60213.2us
I20260709 13:20:24.792238 14994 raft_consensus.cc:2468] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:24.791750 14991 raft_consensus.cc:2468] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:24.792716 14266 leader_election.cc:304] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.795918 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:24.783702 14997 raft_consensus.cc:2468] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:24.774257 14888 leader_election.cc:304] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.798811 14297 raft_consensus.cc:1240] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Rejecting Update request from peer ce90f8e60d79487db7509ae191b95a16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:24.799541 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
W20260709 13:20:24.800479 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 59387.1us
I20260709 13:20:24.800577 15330 raft_consensus.cc:2804] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:24.802999 14266 leader_election.cc:304] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.803382 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:24.803607 15363 raft_consensus.cc:2749] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.803673 15296 raft_consensus.cc:2749] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.818233 15351 raft_consensus.cc:2749] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.803954 15368 raft_consensus.cc:2749] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:24.804582 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 59822.8us
I20260709 13:20:24.820412 14267 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.805310 15369 raft_consensus.cc:2749] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.806161 15340 consensus_queue.cc:260] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.814500 15376 raft_consensus.cc:2749] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.806810 15355 raft_consensus.cc:2749] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.784852 15344 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:24.834453 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 90257.1us
I20260709 13:20:24.835896 15372 consensus_queue.cc:1059] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:24.808645 14888 leader_election.cc:304] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.836239 15294 consensus_queue.cc:1059] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:24.837623 15363 raft_consensus.cc:2749] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.837985 15378 raft_consensus.cc:3055] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.813136 14266 leader_election.cc:304] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.838539 15378 raft_consensus.cc:740] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:24.839634 15378 consensus_queue.cc:260] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.840153 14266 leader_election.cc:304] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.841223 15369 raft_consensus.cc:2749] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.841967 15372 raft_consensus.cc:3055] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:24.842085 15369 raft_consensus.cc:2749] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.842533 15372 raft_consensus.cc:740] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:24.844300 15372 consensus_queue.cc:260] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.821105 15330 raft_consensus.cc:697] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:24.846004 15340 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.827525 15379 raft_consensus.cc:2804] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:24.859375 15379 raft_consensus.cc:697] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.816087 15360 raft_consensus.cc:2749] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.845868 15330 consensus_queue.cc:237] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:24.844507 14266 leader_election.cc:304] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.864467 15369 raft_consensus.cc:2749] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.865080 14888 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:24.826217 14267 leader_election.cc:304] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:24.842089 14301 raft_consensus.cc:2468] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
W20260709 13:20:24.814549 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 66923.4us
I20260709 13:20:24.847540 15372 raft_consensus.cc:3060] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.868932 15355 raft_consensus.cc:2749] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.838554 14117 leader_election.cc:304] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8
W20260709 13:20:24.850848 14118 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.850591 15344 consensus_queue.cc:1059] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:24.851454 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 228145us
I20260709 13:20:24.861259 15379 consensus_queue.cc:237] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.866590 15369 raft_consensus.cc:2804] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:24.876590 14154 raft_consensus.cc:1240] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Rejecting Update request from peer ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 3. Current term is 4. Ops: []
I20260709 13:20:24.866991 14267 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.841102 15378 raft_consensus.cc:3060] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:24.870797 14888 leader_election.cc:304] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.866009 14266 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.872481 14191 leader_election.cc:304] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.881527 15355 consensus_queue.cc:1059] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:24.879061 15336 raft_consensus.cc:2804] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:24.884233 15346 raft_consensus.cc:2749] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.886368 15369 raft_consensus.cc:697] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.887179 15360 consensus_queue.cc:1059] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:24.887590 15369 consensus_queue.cc:237] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.888482 15319 raft_consensus.cc:3055] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:24.888881 15319 raft_consensus.cc:740] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:24.889833 15319 consensus_queue.cc:260] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.890481 15376 consensus_queue.cc:1048] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:24.890851 15336 raft_consensus.cc:697] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:24.891903 15336 consensus_queue.cc:237] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:24.893164 14266 leader_election.cc:304] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.891006 15319 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.894609 14266 leader_election.cc:304] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.886385 15373 consensus_queue.cc:1059] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:20:24.895372 15345 raft_consensus.cc:2749] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.895965 15375 raft_consensus.cc:2749] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.884119 15355 raft_consensus.cc:3055] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:24.916888 15355 raft_consensus.cc:740] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:24.897152 14267 leader_election.cc:304] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:24.918924 14148 raft_consensus.cc:1275] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:24.921389 14994 raft_consensus.cc:1240] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:24.921514 15375 raft_consensus.cc:2804] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:24.921929 15355 consensus_queue.cc:260] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.922897 14997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:24.923496 15355 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.924805 15375 raft_consensus.cc:697] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.925860 15375 consensus_queue.cc:237] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.927640 14998 raft_consensus.cc:1240] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:24.917277 15373 raft_consensus.cc:3055] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:24.928808 15373 raft_consensus.cc:740] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:24.899999 14191 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.930469 15351 raft_consensus.cc:2749] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.930610 14191 leader_election.cc:304] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.930156 15373 consensus_queue.cc:260] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.931942 14191 leader_election.cc:304] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.932526 15373 raft_consensus.cc:3060] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.932901 15174 raft_consensus.cc:2749] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.902706 15227 raft_consensus.cc:3055] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:24.882179 15374 raft_consensus.cc:2804] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:24.913983 14266 leader_election.cc:304] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.933331 14191 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.916332 15340 raft_consensus.cc:2749] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:24.928572 15345 consensus_queue.cc:1048] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:24.898984 15344 raft_consensus.cc:2804] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:24.935423 15174 raft_consensus.cc:2749] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.935518 14191 leader_election.cc:304] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.936185 14266 leader_election.cc:304] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.938007 14266 leader_election.cc:304] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.939744 14191 leader_election.cc:304] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:24.935715 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 50806us
I20260709 13:20:24.942987 15174 raft_consensus.cc:2804] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:24.933655 15351 raft_consensus.cc:2749] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.933655 15227 raft_consensus.cc:740] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.934842 15374 raft_consensus.cc:493] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:24.938958 15323 raft_consensus.cc:2749] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.942646 15354 raft_consensus.cc:2749] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.950393 15174 raft_consensus.cc:697] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:24.938727 15376 raft_consensus.cc:2749] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.948195 14119 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.945706 15344 raft_consensus.cc:697] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.960795 15382 raft_consensus.cc:2749] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.961100 15344 consensus_queue.cc:237] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.964058 14266 leader_election.cc:304] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:24.965781 15369 raft_consensus.cc:2749] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.969115 14119 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:24.954841 15374 raft_consensus.cc:3060] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:24.957139 15312 raft_consensus.cc:2749] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:24.942587 15322 consensus_queue.cc:1059] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:20:24.974819 15227 consensus_queue.cc:260] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:24.989897 15227 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:24.984515 15342 raft_consensus.cc:2749] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:20:24.942587 15296 consensus_queue.cc:1059] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:20:24.995338 15296 raft_consensus.cc:3055] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.995899 15296 raft_consensus.cc:740] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.996070 15322 raft_consensus.cc:3055] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:24.996594 15322 raft_consensus.cc:740] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:24.995491 15174 consensus_queue.cc:237] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:24.996863 15296 consensus_queue.cc:260] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:25.001773 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:25.006372 14998 raft_consensus.cc:3060] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.009593 14997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:25.029402 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:25.031013 15296 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.032159 14219 raft_consensus.cc:1275] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:25.034083 14224 raft_consensus.cc:1240] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Rejecting Update request from peer ce90f8e60d79487db7509ae191b95a16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:20:25.038594 14991 raft_consensus.cc:1275] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.040413 15336 consensus_queue.cc:1059] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:25.041646 15336 raft_consensus.cc:3055] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:25.041966 15336 raft_consensus.cc:740] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:25.042824 15336 consensus_queue.cc:260] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:25.042894 15340 consensus_queue.cc:1048] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:25.041977 14994 raft_consensus.cc:1240] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Rejecting Update request from peer ce90f8e60d79487db7509ae191b95a16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:20:25.045820 14998 raft_consensus.cc:2468] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:25.048568 14998 raft_consensus.cc:1240] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:25.053788 14302 raft_consensus.cc:1240] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Rejecting Update request from peer ce90f8e60d79487db7509ae191b95a16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:20:25.054911 14119 leader_election.cc:304] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:25.065095 14266 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:25.067425 14148 raft_consensus.cc:1240] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:25.063894 14995 raft_consensus.cc:1240] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:25.055217 15336 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:25.064211 15339 raft_consensus.cc:493] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:25.096196 15339 raft_consensus.cc:515] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:25.102114 14295 raft_consensus.cc:1240] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:25.106117 15339 leader_election.cc:290] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:25.066810 15338 consensus_queue.cc:1059] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:20:25.090483 15227 raft_consensus.cc:2749] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:20:25.090847 15382 raft_consensus.cc:2804] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:25.111822 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:25.107489 14219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:33014
I20260709 13:20:25.120719 14219 raft_consensus.cc:606] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:25.121186 15322 consensus_queue.cc:260] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:25.102376 15294 raft_consensus.cc:493] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:25.113169 15376 consensus_queue.cc:1048] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:20:25.135380  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:25.099086 15361 consensus_queue.cc:1059] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:20:25.133603 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ed8864f59448b2a69c2bcddd26a98d" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:25.140813 15294 raft_consensus.cc:515] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:25.163457 15294 leader_election.cc:290] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:25.118441 15337 consensus_queue.cc:1059] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:20:25.151162 15378 consensus_queue.cc:1059] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:25.155164 15374 raft_consensus.cc:515] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:25.156895 13973 catalog_manager.cc:5697] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:25.137804  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:25.165169 15322 raft_consensus.cc:3060] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.173993 15382 raft_consensus.cc:697] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:25.205587 15174 raft_consensus.cc:3055] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:25.209704 15174 raft_consensus.cc:740] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:25.204257 14118 leader_election.cc:304] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:25.182174 15378 consensus_queue.cc:1243] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Peer 4db315fd9fb94434a179b03f5b4c083d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:20:25.206215 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:25.200268 15351 consensus_queue.cc:1059] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:20:25.242764 14302 raft_consensus.cc:1240] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:25.228183 15388 consensus_queue.cc:1059] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:20:25.228864 15339 raft_consensus.cc:2749] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:25.255599 13974 catalog_manager.cc:5697] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:25.265574 13974 catalog_manager.cc:5697] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 3, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:25.274560 15391 consensus_queue.cc:1059] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:20:25.276089 15391 raft_consensus.cc:3055] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:25.276553 15391 raft_consensus.cc:740] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:25.280252 15374 leader_election.cc:290] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:25.284694 15391 consensus_queue.cc:260] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:25.286458 15391 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.256642 15351 consensus_queue.cc:1243] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer 4db315fd9fb94434a179b03f5b4c083d log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:20:25.298810 15342 raft_consensus.cc:3055] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:25.299413 15342 raft_consensus.cc:740] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:25.301620 15382 consensus_queue.cc:237] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:25.315343 14997 raft_consensus.cc:2468] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:25.292485 13976 catalog_manager.cc:5697] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 2, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:25.320452 14302 raft_consensus.cc:1240] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 3. Current term is 4. Ops: []
I20260709 13:20:25.300562 15342 consensus_queue.cc:260] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:25.329731 15337 consensus_queue.cc:1059] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:25.331080 15337 raft_consensus.cc:3055] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:25.331477 15337 raft_consensus.cc:740] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:25.332509 15337 consensus_queue.cc:260] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:25.341926 15342 raft_consensus.cc:3060] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:25.355772 14152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:25.359530 14223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b15bc48cf0e44b2aaaa1401be80044a" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:25.378619 14118 leader_election.cc:304] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:25.374405 15174 consensus_queue.cc:260] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:25.392343 14119 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:20:25.403218 14150 raft_consensus.cc:1275] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.406518 15174 raft_consensus.cc:3060] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.396385 15339 raft_consensus.cc:2749] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:25.404467 15336 raft_consensus.cc:2804] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:25.413827 15337 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:25.432583 15361 raft_consensus.cc:993] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:25.435065 14997 raft_consensus.cc:1275] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:25.439424 15335 raft_consensus.cc:3055] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:25.439957 15335 raft_consensus.cc:740] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:25.417706 15345 consensus_queue.cc:1048] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:20:25.440898 15335 consensus_queue.cc:260] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:25.444468 15335 raft_consensus.cc:3060] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.440771 14302 raft_consensus.cc:1275] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.455632 14219 raft_consensus.cc:1275] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:25.405006 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c886c57f4374a5891c9aa1df562c6d2" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:25.457711 14294 raft_consensus.cc:2393] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 3: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:20:25.453100 15296 consensus_queue.cc:1048] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:20:25.450354 14993 raft_consensus.cc:1275] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:25.451694 15336 raft_consensus.cc:697] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:25.465726 15336 consensus_queue.cc:237] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:25.469693 15361 raft_consensus.cc:1081] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:25.469837 15339 consensus_queue.cc:1048] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:25.452332 14997 raft_consensus.cc:1275] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.474390 15311 consensus_queue.cc:1048] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:25.486179 15311 consensus_queue.cc:1048] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:25.489352 14998 raft_consensus.cc:1275] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:25.495438 14191 leader_election.cc:304] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:25.499938 15174 raft_consensus.cc:2749] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:20:25.502871 14993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58208
I20260709 13:20:25.503612 14993 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:25.504032 14993 raft_consensus.cc:3060] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:25.503963 14223 raft_consensus.cc:1275] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:25.513602 15345 consensus_queue.cc:1048] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 13:20:25.584353 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 50158.8us
W20260709 13:20:25.594197 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 80622.1us
I20260709 13:20:25.619377 14150 raft_consensus.cc:1275] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:25.628908 14301 raft_consensus.cc:1275] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:25.636915 15174 consensus_queue.cc:1048] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:25.623943 14145 raft_consensus.cc:1275] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.646697 14995 raft_consensus.cc:1275] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:25.654183 15408 log.cc:927] Time spent T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:25.665181 15174 consensus_queue.cc:1048] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:25.597581 15368 consensus_queue.cc:1048] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:20:25.678355 14223 raft_consensus.cc:1275] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:25.669840 15296 consensus_queue.cc:1048] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:20:25.671041 15345 consensus_queue.cc:1048] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:20:25.693187 15227 consensus_queue.cc:1048] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:25.723459 15311 consensus_queue.cc:1048] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:25.676659 14993 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:25.840868 14997 raft_consensus.cc:1240] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:25.842161 14996 raft_consensus.cc:1275] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:20:25.845659 15403 log.cc:927] Time spent T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:20:25.854375 14993 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:20:25.856923 15412 log.cc:927] Time spent T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:20:25.884792 14225 raft_consensus.cc:1275] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:25.894110 15330 consensus_queue.cc:1048] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:25.932809 15353 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:25.959824 14302 raft_consensus.cc:3060] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:26.012326 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:26.013195 14148 raft_consensus.cc:3060] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:26.021273 14997 raft_consensus.cc:1275] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:26.022689 15174 consensus_queue.cc:1059] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:26.029731 15294 consensus_queue.cc:1048] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:26.046562 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:25.961787 15353 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:26.098062 14226 raft_consensus.cc:3055] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:26.106396 14226 raft_consensus.cc:740] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:26.117318 14226 consensus_queue.cc:260] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:26.119235 14226 raft_consensus.cc:3060] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:26.026428 15344 consensus_queue.cc:1048] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:20:26.124127 15353 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:20:26.106670 15419 log.cc:927] Time spent T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:20:26.110378 15319 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.132128 15319 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:26.115608 15312 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.134042 15312 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:26.136142 15319 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:26.137094 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.137806 14301 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 4.
W20260709 13:20:26.138255 15423 log.cc:927] Time spent T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:20:26.139393 15407 log.cc:927] Time spent T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:20:26.142617 14888 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:26.149305 14148 raft_consensus.cc:2468] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:26.157946 14226 raft_consensus.cc:2468] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:26.162441 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:26.165555 15312 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:26.166241 14220 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:26.167222 15360 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:20:26.167762 15360 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.168107 15360 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:26.186967 15312 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.187783 14994 raft_consensus.cc:1275] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:26.187613 15312 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:26.196655 14302 raft_consensus.cc:1275] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:26.197329 15312 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:26.201184 13974 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52964 (request call id 169) took 1103 ms. Trace:
W20260709 13:20:26.206447 14891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 96247.6us
I20260709 13:20:26.209602 15360 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:26.203583 13974 rpcz_store.cc:276] 0709 13:20:25.103820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.104087 (+   267us) service_pool.cc:224] Handling call
0709 13:20:26.197928 (+1093841us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:25.402892 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:25.422611 (+ 19719us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:25.422649 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:20:25.422667 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:25.423103 (+   436us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:25.423158 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:25.423187 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:20:25.423557 (+   370us) tablet.cc:701] Row locks acquired
0709 13:20:25.423583 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:20:25.423743 (+   160us) write_op.cc:270] Start()
0709 13:20:25.423864 (+   121us) write_op.cc:276] Timestamp: P: 1783603225423682 usec, L: 0
0709 13:20:25.423886 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:20:25.448850 (+ 24964us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5400a2dda0. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf5571 00007fc1d3d09520 00007fc1d3d92b42 00007fc1d3d87f67 00007fc1d3d87da4 00007fc1d77c2581 00007fc1d77c1d58 00007fc1d77c69f1 00007fc1d77c69a9 00007fc1d77c6939 00007fc1d77c6901
0709 13:20:25.449719 (+   869us) log.cc:844] Serialized 922 byte log entry
0709 13:20:25.922246 (+472527us) op_driver.cc:464] REPLICATION: finished
0709 13:20:25.952565 (+ 30319us) write_op.cc:301] APPLY: starting
0709 13:20:25.952660 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:25.961329 (+  8669us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:25.977649 (+ 16320us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:26.021487 (+ 43838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:26.061048 (+ 39561us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:20:26.069139 (+  8091us) write_op.cc:312] APPLY: finished
0709 13:20:26.137507 (+ 68368us) log.cc:844] Serialized 28 byte log entry
0709 13:20:26.137715 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:26.142569 (+  4854us) write_op.cc:454] Released schema lock
0709 13:20:26.151010 (+  8441us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":26033,"apply.run_cpu_time_us":2692,"apply.run_wall_time_us":198799,"num_ops":2,"prepare.queue_time_us":57990,"prepare.run_cpu_time_us":6121,"prepare.run_wall_time_us":73516,"replication_time_us":490542,"spinlock_wait_cycles":43465984,"threads_started":1}]]}
W20260709 13:20:26.217080 15422 log.cc:927] Time spent T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 13:20:26.220053 15360 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 5 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:26.459365 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:26.460358 14226 raft_consensus.cc:2393] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 4: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:20:26.470242 15294 consensus_queue.cc:1048] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:26.476297 15294 consensus_queue.cc:1048] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:26.483311 15340 raft_consensus.cc:493] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.483937 15340 raft_consensus.cc:515] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:26.486200 15340 leader_election.cc:290] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:26.511442 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:26.512082 14301 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:26.520514 14301 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 5.
W20260709 13:20:26.522621 15337 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:20:26.534871 15337 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.539405 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:26.535856 15337 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:26.536962 14266 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:26.546343 15340 raft_consensus.cc:2804] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:26.546779 15340 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.546720 14153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:26.547439 15340 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:26.547706 14153 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 4.
I20260709 13:20:26.550602 15337 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:26.556136 15418 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:26.555739 15340 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:26.557060 15418 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:26.558701 15340 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:26.559262 15418 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:26.559821 15418 raft_consensus.cc:493] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:26.560318 15418 raft_consensus.cc:515] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:26.562440 15418 leader_election.cc:290] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:26.562692 15360 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.563287 15360 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:26.564435 15337 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.565186 15337 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:26.568266 15337 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:26.571202 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.561136 14889 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:26.574990 15415 raft_consensus.cc:2804] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:26.575563 15415 raft_consensus.cc:697] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:26.576483 15415 consensus_queue.cc:237] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:26.580013 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:26.580751 14220 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:20:26.583153 15434 raft_consensus.cc:493] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.583866 15432 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.585489 15432 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:26.583732 15434 raft_consensus.cc:515] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:26.590024 15434 leader_election.cc:290] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:26.572288 14297 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:26.593647 15360 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:26.597805 14147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:26.598598 14147 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 4.
I20260709 13:20:26.600696 14146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:26.604843 15432 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:26.605168 14146 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:26.612277 14224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:26.613081 14224 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:26.670836 14889 leader_election.cc:304] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:26.671870 15346 raft_consensus.cc:2804] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:26.672354 15346 raft_consensus.cc:493] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:26.672734 15346 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:26.614974 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.682641 14301 raft_consensus.cc:2393] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 4: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:26.615850 14191 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
W20260709 13:20:26.683964 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 68186.2us
I20260709 13:20:26.619457 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:26.624429 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.617410 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:26.686277 14297 raft_consensus.cc:2468] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:26.624635 14220 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 4.
I20260709 13:20:26.689620 15391 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:26.690192 15391 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:26.692242 15391 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:26.631328 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:26.643199 15435 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:26.694015 14149 raft_consensus.cc:3060] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:26.694150 15435 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:26.694985 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:26.695588 14154 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:26.696518 15435 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:26.699512 14990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd37714ddc243ad88669511b6e6b4d2" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:26.701893 14991 raft_consensus.cc:2468] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 1.
I20260709 13:20:26.659760 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:26.684065 13976 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52956 (request call id 164) took 1396 ms. Trace:
I20260709 13:20:26.705730 14998 raft_consensus.cc:2468] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:26.631103 14194 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
W20260709 13:20:26.706883 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 75881.7us
I20260709 13:20:26.708899 15429 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:20:26.709352 15429 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.709764 15429 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:26.713366 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:26.714584 14151 raft_consensus.cc:2393] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 4: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:20:26.715956 15430 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:26.684116 15428 raft_consensus.cc:2804] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:26.718335 15428 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.718782 15428 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:26.719798 15346 raft_consensus.cc:515] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:26.706189 13976 rpcz_store.cc:276] 0709 13:20:25.288000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.288321 (+   321us) service_pool.cc:224] Handling call
0709 13:20:26.684000 (+1395679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:25.471714 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:25.472307 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:25.472339 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:20:25.472358 (+    19us) tablet.cc:662] Decoding operations
0709 13:20:25.472715 (+   357us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:25.472767 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:25.472799 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:20:25.472987 (+   188us) tablet.cc:701] Row locks acquired
0709 13:20:25.473007 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:20:25.473161 (+   154us) write_op.cc:270] Start()
0709 13:20:25.473274 (+   113us) write_op.cc:276] Timestamp: P: 1783603225473115 usec, L: 0
0709 13:20:25.473297 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:20:25.502075 (+ 28778us) log.cc:844] Serialized 537 byte log entry
0709 13:20:26.274917 (+772842us) op_driver.cc:464] REPLICATION: finished
0709 13:20:26.275255 (+   338us) write_op.cc:301] APPLY: starting
0709 13:20:26.275356 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:26.275459 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:26.275585 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:26.276011 (+   426us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:26.276193 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:20:26.276253 (+    60us) write_op.cc:312] APPLY: finished
0709 13:20:26.276471 (+   218us) log.cc:844] Serialized 22 byte log entry
0709 13:20:26.276654 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:26.276738 (+    84us) write_op.cc:454] Released schema lock
0709 13:20:26.276787 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:26.277144 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:26.277179 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":124338,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":121,"apply.run_cpu_time_us":1738,"apply.run_wall_time_us":1848,"num_ops":1,"prepare.queue_time_us":137933,"prepare.run_cpu_time_us":2681,"prepare.run_wall_time_us":30665,"replication_time_us":801491}]]}
I20260709 13:20:26.726233 14266 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:26.728188 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.729355 14301 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:26.732326 14117 leader_election.cc:304] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:26.725509 15435 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.734972 14191 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:26.733561 15435 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:26.738343 14226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32ffa9a52c4465a98b4615f03092c27" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:26.739264 14226 raft_consensus.cc:2393] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 4: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:26.739321 15359 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:26.739781 15359 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:26.739979 15435 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:26.740200 15359 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:26.746058 14891 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:26.752245 15363 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:26.752763 15363 raft_consensus.cc:493] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:26.753146 15363 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:26.754083 14999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:26.756264 14997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:26.757001 14997 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:26.759094 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:26.759960 14996 raft_consensus.cc:2393] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 2: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:20:26.750169 14146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:26.761570 15339 raft_consensus.cc:2804] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:26.762086 15339 raft_consensus.cc:493] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.762459 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.764218 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.765076 14302 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 4.
I20260709 13:20:26.765625 14118 leader_election.cc:304] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:26.664398  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:26.769297 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.770157 14302 raft_consensus.cc:2393] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 2: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:26.772321 14149 raft_consensus.cc:2468] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 4.
I20260709 13:20:26.778167 14154 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 5.
I20260709 13:20:26.716725 15430 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:26.808754 14891 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:26.809211 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:26.908221 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:20:26.911125 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 100731us
W20260709 13:20:26.913053 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 210861us
I20260709 13:20:26.762218 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:20:26.916214 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 150762us
I20260709 13:20:26.762486 15339 raft_consensus.cc:3060] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:26.920177 13975 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50236 (request call id 107) took 1350 ms. Trace:
I20260709 13:20:26.940294 14267 leader_election.cc:304] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:26.762754 15347 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:26.936544 13975 rpcz_store.cc:276] 0709 13:20:25.414534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.431289 (+ 16755us) service_pool.cc:224] Handling call
0709 13:20:25.469769 (+ 38480us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b5400a2d854. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d3cf6090 00007fc1d3d94f3a 00007fc1d9b4b1cc 00007fc1d9c4937e 00007fc1d810a2a4 00007fc1d810a232 00007fc1d810a161 00007fc1d810a0dc 00007fc1d8109392 00007fc1d20c748c 00007fc1d20c68c6
0709 13:20:26.764614 (+1294845us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":462805,"reported_tablets":1,"spinlock_wait_cycles":82907904}
I20260709 13:20:26.942826 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:26.947633 15345 raft_consensus.cc:2804] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:26.948241 15345 raft_consensus.cc:697] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:26.949122 15345 consensus_queue.cc:237] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:26.950136 15373 raft_consensus.cc:2749] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:26.947721 14293 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:26.968631 14225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35190 (request call id 738) took 1043 ms. Trace:
I20260709 13:20:26.952769 15347 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:26.972352 15347 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:26.984048 15322 raft_consensus.cc:2804] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:26.984716 15322 raft_consensus.cc:493] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.993211 14294 raft_consensus.cc:2393] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 2: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
W20260709 13:20:27.004273 15426 log.cc:927] Time spent T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:26.985152 15322 raft_consensus.cc:3060] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.008606 15319 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:27.004226 15337 raft_consensus.cc:493] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:27.010412 15337 raft_consensus.cc:515] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:27.016603 15430 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.017993 15346 leader_election.cc:290] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
W20260709 13:20:27.028908 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 264776us
I20260709 13:20:27.031756 14888 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:27.009478 15319 raft_consensus.cc:697] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:27.060149 14888 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:27.066744 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.067852 14302 raft_consensus.cc:2393] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 2: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
W20260709 13:20:27.071973 14891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 263275us
I20260709 13:20:27.081710 15346 raft_consensus.cc:2804] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:27.082350 15346 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.082826 15346 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.085065 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:27.086102 14995 raft_consensus.cc:2393] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 2: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:20:27.088554 15296 raft_consensus.cc:493] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.058987 15310 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:27.096676 14891 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:27.028628 15363 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:27.098222 15319 consensus_queue.cc:237] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:27.101706 15449 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.089188 15296 raft_consensus.cc:515] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.092218 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:27.103856 15310 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:27.119139 15322 raft_consensus.cc:515] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.134692 15338 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.135402 15322 leader_election.cc:290] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.135321 15338 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:27.136216 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:26.969300 14225 rpcz_store.cc:276] 0709 13:20:25.924885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.926028 (+  1143us) service_pool.cc:224] Handling call
0709 13:20:26.967526 (+1041498us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b58007cfb98. stack: 00007fc1d0c6d343 00007fc1d0c6d240 00007fc1d05fc1d4 00007fc1da33a304 00007fc1da33a299 00007fc1d0b27db1 00007fc1d0c67b71 00007fc1d0c67a22 00007fc1d9b80c09 00007fc1d8cdaee0 00007fc1d8da40ab 00007fc1d8da4131 00007fc1d8d65fc0 00007fc1d8d50929 00007fc1d8d503d2 00007fc1d22c7bd4
0709 13:20:26.967829 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.968116 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:26.968158 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.968219 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:20:26.968271 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.968359 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.968543 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2824960}
I20260709 13:20:27.137301 14293 raft_consensus.cc:2368] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 for earlier term 2. Current term is 3.
I20260709 13:20:27.125835 15359 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.136854 14221 raft_consensus.cc:3060] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.142014 15359 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.125583 14999 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 4.
I20260709 13:20:27.143747 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.145573 15296 leader_election.cc:290] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.145882 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:27.115602 15449 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.147650 15339 raft_consensus.cc:515] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:27.150604 14154 raft_consensus.cc:2368] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3.
I20260709 13:20:27.151130 15339 leader_election.cc:290] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.147642 15346 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.155119 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:27.157480 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.148403 15449 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:27.158505 14301 raft_consensus.cc:3060] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.167383 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:27.168459 14222 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:27.170029 14266 leader_election.cc:304] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:27.127090 15310 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:27.189949 14301 raft_consensus.cc:2468] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
W20260709 13:20:27.191069 14891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 66519us
I20260709 13:20:27.162421 15435 raft_consensus.cc:2749] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:27.194206 14117 leader_election.cc:304] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:27.186051 15341 raft_consensus.cc:2804] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:20:27.198556 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 261572us
I20260709 13:20:27.185129 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:27.198884 15311 raft_consensus.cc:2804] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:27.200860 15311 raft_consensus.cc:697] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:27.201802 15311 consensus_queue.cc:237] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:27.207414 14145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:27.208202 14145 raft_consensus.cc:2376] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 5. Re-sending same reply.
I20260709 13:20:27.208194 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:27.176564 15337 leader_election.cc:290] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:27.214164 14222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:27.210002 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c144f8c18cd84075a92d25a0250bb9e6" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:27.219671 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:27.220130 14991 raft_consensus.cc:3060] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.220448 14219 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 4.
I20260709 13:20:27.199499 15341 raft_consensus.cc:493] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.221544 14221 raft_consensus.cc:2468] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:27.222096 15341 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.202759 14294 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 4.
I20260709 13:20:27.194941 15338 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.223791 14266 leader_election.cc:304] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:27.236184 14891 leader_election.cc:400] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769) with higher term. Message: Invalid argument: T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3.
I20260709 13:20:27.236727 14891 leader_election.cc:403] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:27.209213 14298 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:27.241101 14117 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
W20260709 13:20:27.237466 15429 consensus_meta.cc:287] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.008s
I20260709 13:20:27.253502 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:27.233860 15322 raft_consensus.cc:2804] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:27.255595 15322 raft_consensus.cc:697] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:27.261307 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:27.261873 14998 raft_consensus.cc:2393] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 2: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
I20260709 13:20:27.263456 14889 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:27.243880 15338 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:27.265882 15338 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:27.270931 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:27.271718 15338 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.271961 14996 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:27.290534 14995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a70b817b674bd197cdb804bcf25840" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:27.291628 14995 raft_consensus.cc:3060] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.293591 15432 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:20:27.320739 15432 raft_consensus.cc:493] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.321388 15432 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:27.277859 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:27.262462 15429 raft_consensus.cc:515] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:27.279759 15428 consensus_meta.cc:287] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.002s
I20260709 13:20:27.268136 14145 raft_consensus.cc:1275] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.302731 15453 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:27.327385 15428 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.328123 15453 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:27.328720 15453 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:27.329137 14228 raft_consensus.cc:2393] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 3: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:20:27.257103 15322 consensus_queue.cc:237] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:27.318019 15459 log.cc:927] Time spent T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:20:27.319732 14991 raft_consensus.cc:2468] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:27.336066 15370 raft_consensus.cc:2749] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769) with higher term. Message: Invalid argument: T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3.
I20260709 13:20:27.336990 15429 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 5 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:27.341142 15428 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:27.355311 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 77885us
I20260709 13:20:27.358951 15355 consensus_queue.cc:1048] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.365612 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:27.378737 14998 raft_consensus.cc:2393] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 3: Already voted for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in this term.
W20260709 13:20:27.370296 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 109709us
I20260709 13:20:27.369140 14222 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
W20260709 13:20:27.380138 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 144039us
I20260709 13:20:27.361023 14154 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 4.
I20260709 13:20:27.384021 14889 leader_election.cc:304] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:20:27.384084 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:27.362308 14219 raft_consensus.cc:1275] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.363812 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:27.402189 14891 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:27.364094 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:27.387238 14995 raft_consensus.cc:2468] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
W20260709 13:20:27.377255 15294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.007s	sys 0.011s
I20260709 13:20:27.407083 14225 raft_consensus.cc:2368] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 4. Current term is 5.
I20260709 13:20:27.407646 15463 consensus_queue.cc:1048] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:27.404417 14991 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:27.403879 15347 raft_consensus.cc:2804] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.408804 15347 raft_consensus.cc:697] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
W20260709 13:20:27.405694 15294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.009s	sys 0.011s
I20260709 13:20:27.410493 15347 consensus_queue.cc:237] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.410897 14889 leader_election.cc:400] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Vote denied by peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995) with higher term. Message: Invalid argument: T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 4. Current term is 5.
I20260709 13:20:27.415908 15453 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:27.419353 14268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.032s	sys 0.054s
W20260709 13:20:27.419798 14268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.032s	sys 0.054s
W20260709 13:20:27.420126 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 732873us
I20260709 13:20:27.391333 14221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:27.392474 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:27.361913 15310 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:27.395344 15341 raft_consensus.cc:515] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.438791 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7823eaa6f143459fa2134dfd0f6aa1" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:27.441293 14299 raft_consensus.cc:2393] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 4: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:27.444586 14149 raft_consensus.cc:3060] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:27.442912 14268 leader_election.cc:304] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:27.453982 14146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad1a0487508442287b6c802b75bc409" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:27.458818 15227 raft_consensus.cc:2749] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:27.461499 14149 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 5.
I20260709 13:20:27.419821 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:27.447253 14994 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 4.
I20260709 13:20:27.441978 15363 leader_election.cc:290] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:27.419389 14991 raft_consensus.cc:2468] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 5.
I20260709 13:20:27.485525 14194 leader_election.cc:304] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:27.453274 14221 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:27.491864 14194 leader_election.cc:304] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:27.474526 15376 raft_consensus.cc:476] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:20:27.488566 15355 raft_consensus.cc:2764] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:20:27.493621 15429 raft_consensus.cc:2749] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:27.495651 15340 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.574710 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 86261.3us
I20260709 13:20:27.504196 15453 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
W20260709 13:20:27.578018 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 102513us
I20260709 13:20:27.563725 15455 raft_consensus.cc:2804] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:27.569998 15354 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
W20260709 13:20:27.610787 15027 debug-util.cc:398] Leaking SignalData structure 0x7b08001141e0 after lost signal to thread 4249
W20260709 13:20:27.612116 15027 debug-util.cc:398] Leaking SignalData structure 0x7b0800150560 after lost signal to thread 14011
W20260709 13:20:27.613718 15027 debug-util.cc:398] Leaking SignalData structure 0x7b08003459c0 after lost signal to thread 14178
W20260709 13:20:27.614221 15027 debug-util.cc:398] Leaking SignalData structure 0x7b0800394e60 after lost signal to thread 14179
I20260709 13:20:27.613561 15341 leader_election.cc:290] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.579193 15310 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:27.615363 14998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:27.591832 15455 raft_consensus.cc:697] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 5 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:27.616792 15455 consensus_queue.cc:237] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:27.617823 15027 debug-util.cc:398] Leaking SignalData structure 0x7b08003619e0 after lost signal to thread 14252
W20260709 13:20:27.619246 15027 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4660 after lost signal to thread 14326
I20260709 13:20:27.620204 14225 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 4.
W20260709 13:20:27.620784 15027 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9b40 after lost signal to thread 15030
I20260709 13:20:27.578637 15340 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.631723 15363 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:27.632364 15363 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:27.593214 15354 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:27.638872 15354 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:27.629102 15340 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.644169 15346 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:27.645025 14145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:27.646588 15363 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:27.656881 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:27.662858 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.663578 14295 raft_consensus.cc:3060] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.668473 15432 raft_consensus.cc:515] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:27.669767 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:27.670542 14991 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 4.
I20260709 13:20:27.670950 15432 leader_election.cc:290] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 5 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.673204 14889 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:20:27.676134 15346 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:27.676716 15346 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.677170 15346 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.684350 14191 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:27.686303 15428 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.687213 15428 raft_consensus.cc:697] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:27.688355 15428 consensus_queue.cc:237] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.690399 14191 leader_election.cc:400] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307) with higher term. Message: Invalid argument: T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 for earlier term 2. Current term is 3.
I20260709 13:20:27.668459 13976 catalog_manager.cc:5697] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 2 to 3, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } }
I20260709 13:20:27.690828 14191 leader_election.cc:403] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:27.691581 15354 raft_consensus.cc:2749] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307) with higher term. Message: Invalid argument: T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 for earlier term 2. Current term is 3.
I20260709 13:20:27.692050 13976 catalog_manager.cc:5697] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 2 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } }
I20260709 13:20:27.702875 14295 raft_consensus.cc:2468] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:27.725402 13976 catalog_manager.cc:5697] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } }
I20260709 13:20:27.739338 14889 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:27.741189 15450 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:27.741818 15450 raft_consensus.cc:697] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:27.742838 15450 consensus_queue.cc:237] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.756413 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01be016235a423e80a9915aa6285945" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:27.756726 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:27.757529 14228 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.757591 14225 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 4.
I20260709 13:20:27.761157 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.762110 14295 raft_consensus.cc:2393] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 in current term 3: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:20:27.762408 14191 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:27.754207 14267 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:27.772609 15296 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:20:27.773094 15296 raft_consensus.cc:493] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.773465 15296 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:27.773757 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:27.777905 15354 raft_consensus.cc:2804] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:27.778805 15354 raft_consensus.cc:697] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:27.779497 15346 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.779968 15354 consensus_queue.cc:237] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.782869 14228 raft_consensus.cc:2468] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
W20260709 13:20:27.798169 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 217559us
W20260709 13:20:27.803092 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 43790.3us
I20260709 13:20:27.824054 14193 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:27.830142 14295 raft_consensus.cc:1275] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:20:27.834318 14888 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:27.839697 15429 raft_consensus.cc:2749] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:27.854067 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:27.859572 14993 raft_consensus.cc:1275] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:27.850401 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:27.863762 14991 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:27.865391 14300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.875520 15346 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:27.882092 14301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.892763 14266 leader_election.cc:304] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:27.896996 15474 consensus_queue.cc:1048] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:20:27.905965 14117 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:27.914537 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 80329.4us
I20260709 13:20:27.894840 14221 raft_consensus.cc:1240] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Rejecting Update request from peer ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:27.919556 14149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c67d33181e414897d5de3731e98030" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:27.920737 14149 raft_consensus.cc:2368] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 4. Current term is 5.
I20260709 13:20:27.925937 15296 raft_consensus.cc:515] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.923497 14151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:27.903015 15323 raft_consensus.cc:2804] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:27.946123 14295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.947034 14295 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.901391 14296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:27.951809 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:27.954574 14228 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:27.964023 14295 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:27.922506 15463 raft_consensus.cc:2749] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:20:27.965867 14888 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:27.973047 14891 leader_election.cc:400] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Vote denied by peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769) with higher term. Message: Invalid argument: T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 4. Current term is 5.
I20260709 13:20:27.973799 14891 leader_election.cc:403] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:20:27.974665 14295 raft_consensus.cc:1275] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:27.952890 15346 consensus_queue.cc:1048] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 13:20:27.979694 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 141319us
I20260709 13:20:27.986481 14300 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 4.
I20260709 13:20:27.986361 15296 leader_election.cc:290] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 5 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:27.990374 14296 raft_consensus.cc:2368] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 4. Current term is 5.
I20260709 13:20:27.967653 15323 raft_consensus.cc:697] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:27.994491 15323 consensus_queue.cc:237] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:27.997939 15310 consensus_queue.cc:1059] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:27.998984 14145 raft_consensus.cc:1275] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:20:27.999226 15310 raft_consensus.cc:3055] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:27.999661 15310 raft_consensus.cc:740] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:28.000443 15310 consensus_queue.cc:260] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:28.003540 15310 raft_consensus.cc:3060] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.007725 15461 consensus_queue.cc:1048] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:28.010289 14228 raft_consensus.cc:2468] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 5.
I20260709 13:20:28.011585 14266 leader_election.cc:304] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:28.012710 15341 raft_consensus.cc:2804] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:28.013226 15341 raft_consensus.cc:697] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 5 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:28.014159 15341 consensus_queue.cc:237] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:28.015161 15418 consensus_queue.cc:1048] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:28.039222 14888 leader_election.cc:400] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 election: Vote denied by peer 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307) with higher term. Message: Invalid argument: T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 4. Current term is 5.
I20260709 13:20:28.057626 14996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2412bd2aec3744b69d4fa16d6b96ed3d" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:28.060310 14998 raft_consensus.cc:1275] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:20:28.071987 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 205235us
I20260709 13:20:28.038885 15370 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:28.078286 15296 consensus_queue.cc:1048] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:28.135406 15489 log.cc:927] Time spent T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:20:28.092218 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:28.112221 15370 raft_consensus.cc:697] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:28.137547 14294 raft_consensus.cc:1240] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Rejecting Update request from peer ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:28.165210 14227 raft_consensus.cc:1275] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:28.158139 15418 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:28.162726 15476 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
W20260709 13:20:28.193673 15479 log.cc:927] Time spent T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:20:28.181991 15345 consensus_queue.cc:1048] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:20:28.177124 15469 raft_consensus.cc:2749] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:28.230634 14228 raft_consensus.cc:1240] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Rejecting Update request from peer ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 4. Current term is 5. Ops: []
I20260709 13:20:28.234768 14888 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:28.262595 14221 raft_consensus.cc:1275] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:28.239655 15346 raft_consensus.cc:2749] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:28.248235 15370 consensus_queue.cc:237] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:28.188115 15418 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:28.273713 15418 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:28.243471 15363 consensus_queue.cc:1059] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:20:28.219362 15476 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:28.276573 15363 raft_consensus.cc:3055] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:20:28.276996 15363 raft_consensus.cc:740] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:28.277845 15363 consensus_queue.cc:260] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:28.278463 15476 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:28.279134 15363 raft_consensus.cc:3060] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:20:28.279296 15488 log.cc:927] Time spent T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81: Append to log took a long time: real 0.196s	user 0.004s	sys 0.002s
W20260709 13:20:28.288605 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 43670.4us
I20260709 13:20:28.301301 15340 consensus_queue.cc:1048] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.330634 14146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:28.341545  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:28.358258 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 61740.5us
I20260709 13:20:28.421658 14300 raft_consensus.cc:1240] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:28.406003 14990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" is_pre_election: true
I20260709 13:20:28.432142 14994 raft_consensus.cc:1275] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:20:28.474224 14999 raft_consensus.cc:1240] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Rejecting Update request from peer 86cbe005f1b04a3c99562111b01847e8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:28.483325 14228 raft_consensus.cc:1275] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:20:28.550810 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 64456.4us
I20260709 13:20:28.551786 14300 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "120b27990187463c8945db388e219f76"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:41570
I20260709 13:20:28.552603 14300 raft_consensus.cc:606] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:28.434330 15337 consensus_queue.cc:1059] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 13:20:28.559298 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 129532us
I20260709 13:20:28.559026 15341 consensus_queue.cc:1048] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:20:28.592979 15428 consensus_queue.cc:1059] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:28.593855 15428 consensus_queue.cc:1243] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Peer ff2956d2be4d4ef98fdc5dc75bceff81 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:20:28.588507 14991 consensus_meta.cc:287] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81: Time spent flushing consensus metadata: real 0.724s	user 0.015s	sys 0.000s
I20260709 13:20:28.595544 14991 raft_consensus.cc:2468] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 5.
I20260709 13:20:28.597179 15417 raft_consensus.cc:2749] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769) with higher term. Message: Invalid argument: T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ff2956d2be4d4ef98fdc5dc75bceff81 for earlier term 4. Current term is 5.
I20260709 13:20:28.619755 14119 leader_election.cc:304] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d
I20260709 13:20:28.620339 14148 raft_consensus.cc:1275] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:28.620726 15458 raft_consensus.cc:2804] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:28.621238 15458 raft_consensus.cc:697] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 5 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
W20260709 13:20:28.590723 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 104569us
I20260709 13:20:28.595762 15456 raft_consensus.cc:3055] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:28.632429 15456 raft_consensus.cc:740] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:28.631819 15458 consensus_queue.cc:237] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:28.633338 15456 consensus_queue.cc:260] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:28.634857 15456 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.638582 14228 raft_consensus.cc:1275] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:28.672518 14990 raft_consensus.cc:1275] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:20:28.673085 14990 pending_rounds.cc:85] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Aborting all ops after (but not including) 2
I20260709 13:20:28.673337 14990 pending_rounds.cc:107] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:20:28.673784 14990 raft_consensus.cc:2889] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.678440 14296 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:41570
I20260709 13:20:28.679244 14296 raft_consensus.cc:606] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:28.685652 15482 consensus_queue.cc:1048] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:20:28.688074 15345 consensus_queue.cc:1048] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:28.690641 15345 raft_consensus.cc:993] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:28.691228 15345 raft_consensus.cc:1081] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:28.696269 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:28.696579 14149 raft_consensus.cc:1275] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:20:28.749274 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 53234.5us
I20260709 13:20:28.749922  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 13:20:28.754985 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 55229.9us
W20260709 13:20:28.756438 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 74873.6us
I20260709 13:20:28.757893 15296 consensus_queue.cc:1048] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:20:28.761026 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 82278.6us
I20260709 13:20:28.766543 14117 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:28.772217 14299 raft_consensus.cc:1275] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:28.780915 15462 raft_consensus.cc:2749] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:28.835184 14298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:28.840415 14997 raft_consensus.cc:1275] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:28.847631 15345 consensus_queue.cc:1048] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:20:28.917203 14227 raft_consensus.cc:1275] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:20:28.917856 14227 pending_rounds.cc:85] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8: Aborting all ops after (but not including) 1
I20260709 13:20:28.918115 14227 pending_rounds.cc:107] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:20:28.918907 14227 raft_consensus.cc:2889] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.915427 14888 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:28.929867 14996 raft_consensus.cc:1275] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:20:28.930378 14996 pending_rounds.cc:85] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Aborting all ops after (but not including) 1
I20260709 13:20:28.930630 14996 pending_rounds.cc:107] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:20:28.930869 14996 raft_consensus.cc:2889] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.875860 15354 consensus_queue.cc:1048] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:20:28.940310 15503 raft_consensus.cc:2749] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:28.942339 14995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "120b27990187463c8945db388e219f76"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58206
I20260709 13:20:28.943099 14995 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.943502 14995 raft_consensus.cc:3060] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.952205  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:28.961347 15391 consensus_queue.cc:1048] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:28.996785 13976 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52956 (request call id 165) took 2241 ms. Trace:
I20260709 13:20:29.003739 14302 raft_consensus.cc:1275] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:28.988545 13974 catalog_manager.cc:5697] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 2 to 3, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } }
I20260709 13:20:29.005160 13974 catalog_manager.cc:5697] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.009045 13974 catalog_manager.cc:5697] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 3 to 4, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 4 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } }
I20260709 13:20:28.901808 15428 consensus_queue.cc:1048] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:20:29.021277 15344 consensus_queue.cc:1048] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 13:20:29.028502 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 141712us
W20260709 13:20:29.041299 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 150353us
I20260709 13:20:28.997298 13976 rpcz_store.cc:276] 0709 13:20:26.750107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.906010 (+155903us) service_pool.cc:224] Handling call
0709 13:20:28.991530 (+2085520us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:28.013861 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:28.014478 (+   617us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:28.014518 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:20:28.014536 (+    18us) tablet.cc:662] Decoding operations
0709 13:20:28.015085 (+   549us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:28.015175 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:28.015205 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:28.015552 (+   347us) tablet.cc:701] Row locks acquired
0709 13:20:28.015571 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:20:28.015715 (+   144us) write_op.cc:270] Start()
0709 13:20:28.015843 (+   128us) write_op.cc:276] Timestamp: P: 1783603228015668 usec, L: 0
0709 13:20:28.015867 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:28.016744 (+   877us) log.cc:844] Serialized 1307 byte log entry
0709 13:20:28.582171 (+565427us) op_driver.cc:464] REPLICATION: finished
0709 13:20:28.685260 (+103089us) write_op.cc:301] APPLY: starting
0709 13:20:28.685360 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:28.685546 (+   186us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:28.685685 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:28.686255 (+   570us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:28.686457 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:20:28.686510 (+    53us) write_op.cc:312] APPLY: finished
0709 13:20:28.686731 (+   221us) log.cc:844] Serialized 34 byte log entry
0709 13:20:28.686956 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:28.687208 (+   252us) write_op.cc:454] Released schema lock
0709 13:20:28.687348 (+   140us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:28.688071 (+   723us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:28.688105 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":99850,"apply.run_cpu_time_us":2621,"apply.run_wall_time_us":2621,"num_ops":3,"prepare.queue_time_us":264796,"prepare.run_cpu_time_us":32539,"prepare.run_wall_time_us":148193,"raft.queue_time_us":196313,"raft.run_cpu_time_us":28658,"raft.run_wall_time_us":173131,"replication_time_us":542945,"thread_start_us":537221,"threads_started":4,"wal-append.queue_time_us":226653}]]}
I20260709 13:20:29.033589 15355 consensus_queue.cc:1048] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 13:20:29.090615 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 201371us
I20260709 13:20:29.101531 15417 consensus_queue.cc:1048] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.192042 14995 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:29.204357 14995 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:29.205367 14996 raft_consensus.cc:1240] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:29.220511 14145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:29.221596 14145 raft_consensus.cc:3060] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.257895 15368 raft_consensus.cc:993] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:29.258587 15368 raft_consensus.cc:1081] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:29.277340 14299 raft_consensus.cc:3060] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:29.309929 14998 raft_consensus.cc:1275] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:20:29.320848 15446 consensus_queue.cc:1059] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:29.323037 14992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58206
I20260709 13:20:29.330341 14992 raft_consensus.cc:493] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.331032 14992 raft_consensus.cc:3060] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.361089 14299 raft_consensus.cc:1275] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:20:29.341282 14145 raft_consensus.cc:2468] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:29.370348 14992 raft_consensus.cc:515] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:29.371378 15446 raft_consensus.cc:3055] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:29.371814 15446 raft_consensus.cc:740] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:29.372995 15446 consensus_queue.cc:260] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:29.375645 15446 raft_consensus.cc:3060] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.374529 14891 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:29.377575 15503 raft_consensus.cc:2804] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:29.378089 15503 raft_consensus.cc:697] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:29.379032 15503 consensus_queue.cc:237] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:29.373031 14992 leader_election.cc:290] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:29.385856 14228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:29.386624 14228 raft_consensus.cc:3060] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.382628 15377 consensus_queue.cc:1048] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:20:29.402587 15474 consensus_queue.cc:1048] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:29.409103 14228 raft_consensus.cc:2468] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:29.412483 14227 raft_consensus.cc:1240] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Rejecting Update request from peer 4db315fd9fb94434a179b03f5b4c083d for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:29.418752 14889 leader_election.cc:304] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:29.406944 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:29.437855 15449 raft_consensus.cc:2804] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:29.474069 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:29.474766 14302 raft_consensus.cc:3055] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:29.475098 14302 raft_consensus.cc:740] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:29.475910 14302 consensus_queue.cc:260] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:29.509297 15344 consensus_queue.cc:1059] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:29.580812 15449 raft_consensus.cc:697] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:29.585310 15449 consensus_queue.cc:237] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:29.588544 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 62530.7us
W20260709 13:20:29.590766 14266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.609902 14293 raft_consensus.cc:2468] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:29.632046 14302 raft_consensus.cc:3060] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.664824 14302 raft_consensus.cc:2468] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 2.
I20260709 13:20:29.796454 13973 catalog_manager.cc:5697] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:29.799530 13973 catalog_manager.cc:5697] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.802103 13974 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52950 (request call id 142) took 3154 ms. Trace:
I20260709 13:20:29.805302 13973 catalog_manager.cc:5697] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.802551 13974 rpcz_store.cc:276] 0709 13:20:26.647645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.648654 (+  1009us) service_pool.cc:224] Handling call
0709 13:20:29.802039 (+3153385us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:29.155942 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:29.156728 (+   786us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:29.156775 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:20:29.156795 (+    20us) tablet.cc:662] Decoding operations
0709 13:20:29.157580 (+   785us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:29.157704 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:29.157745 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:29.158175 (+   430us) tablet.cc:701] Row locks acquired
0709 13:20:29.158200 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:20:29.158387 (+   187us) write_op.cc:270] Start()
0709 13:20:29.166460 (+  8073us) write_op.cc:276] Timestamp: P: 1783603229158337 usec, L: 0
0709 13:20:29.168889 (+  2429us) op_driver.cc:348] REPLICATION: starting
0709 13:20:29.251374 (+ 82485us) log.cc:844] Serialized 1307 byte log entry
0709 13:20:29.469969 (+218595us) op_driver.cc:464] REPLICATION: finished
0709 13:20:29.577978 (+108009us) write_op.cc:301] APPLY: starting
0709 13:20:29.578075 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:29.578210 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:29.578342 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:29.578777 (+   435us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:29.578944 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:20:29.578985 (+    41us) write_op.cc:312] APPLY: finished
0709 13:20:29.579214 (+   229us) log.cc:844] Serialized 34 byte log entry
0709 13:20:29.579391 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:29.579485 (+    94us) write_op.cc:454] Released schema lock
0709 13:20:29.579526 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":939937,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":107744,"apply.run_cpu_time_us":1886,"apply.run_wall_time_us":1886,"num_ops":3,"prepare.queue_time_us":124906,"prepare.run_cpu_time_us":4385,"prepare.run_wall_time_us":102310,"replication_time_us":300924,"thread_start_us":221708,"threads_started":2}]]}
I20260709 13:20:29.813858 13973 catalog_manager.cc:5697] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 3 to 4, leader changed from 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 4 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.841732 14297 raft_consensus.cc:1275] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.845358 15355 consensus_queue.cc:1048] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.870364 13973 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50236 (request call id 108) took 1705 ms. Trace:
I20260709 13:20:29.871232 13976 catalog_manager.cc:5697] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 3 to 5, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 5 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.874677 13976 catalog_manager.cc:5697] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } }
I20260709 13:20:29.878157 13976 catalog_manager.cc:5697] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 4 to 5, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 5 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } }
I20260709 13:20:29.882346 13976 catalog_manager.cc:5697] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 3, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } }
I20260709 13:20:29.890837 13976 catalog_manager.cc:5697] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } }
I20260709 13:20:29.873293 13973 rpcz_store.cc:276] 0709 13:20:28.164916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.165295 (+   379us) service_pool.cc:224] Handling call
0709 13:20:29.870298 (+1705003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:29.827776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:29.828329 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:29.828361 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:20:29.828381 (+    20us) tablet.cc:662] Decoding operations
0709 13:20:29.828986 (+   605us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:29.829071 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:29.829098 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:29.844550 (+ 15452us) tablet.cc:701] Row locks acquired
0709 13:20:29.844573 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:20:29.844724 (+   151us) write_op.cc:270] Start()
0709 13:20:29.844840 (+   116us) write_op.cc:276] Timestamp: P: 1783603229844676 usec, L: 0
0709 13:20:29.844862 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:20:29.853281 (+  8419us) log.cc:844] Serialized 1693 byte log entry
0709 13:20:29.855361 (+  2080us) op_driver.cc:464] REPLICATION: finished
0709 13:20:29.856211 (+   850us) write_op.cc:301] APPLY: starting
0709 13:20:29.856321 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:29.856475 (+   154us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:29.856580 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:29.857165 (+   585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:29.857345 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:20:29.857385 (+    40us) write_op.cc:312] APPLY: finished
0709 13:20:29.857626 (+   241us) log.cc:844] Serialized 40 byte log entry
0709 13:20:29.857776 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:29.857881 (+   105us) write_op.cc:454] Released schema lock
0709 13:20:29.857921 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:29.858267 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:29.858293 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":55551,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":592,"apply.run_cpu_time_us":2042,"apply.run_wall_time_us":2042,"num_ops":4,"prepare.queue_time_us":9466,"prepare.run_cpu_time_us":3317,"prepare.run_wall_time_us":25951,"replication_time_us":10353,"thread_start_us":11064,"threads_started":1}]]}
I20260709 13:20:29.899655 14145 raft_consensus.cc:1275] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.901321 15355 consensus_queue.cc:1048] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.901695 13976 catalog_manager.cc:5697] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 3, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.903436 13976 catalog_manager.cc:5697] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } }
I20260709 13:20:29.952131 13975 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52964 (request call id 170) took 1826 ms. Trace:
I20260709 13:20:29.953806  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:29.978180 14220 raft_consensus.cc:1275] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.982686 15355 consensus_queue.cc:1048] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.952698 13975 rpcz_store.cc:276] 0709 13:20:28.157022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.164740 (+  7718us) service_pool.cc:224] Handling call
0709 13:20:29.952049 (+1787309us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":11}
I20260709 13:20:29.999399 13973 catalog_manager.cc:5697] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } }
I20260709 13:20:30.001142 13973 catalog_manager.cc:5697] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:30.003522 13973 catalog_manager.cc:5697] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 3 to 5, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 5 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } }
I20260709 13:20:30.005225 13973 catalog_manager.cc:5697] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 1 to 2, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:30.083997 14294 raft_consensus.cc:1275] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:30.087298 15355 consensus_queue.cc:1048] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:30.329237 15548 log.cc:927] Time spent T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:20:30.474663 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 184048us
W20260709 13:20:30.484295 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 179989us
W20260709 13:20:30.642499 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 125614us
W20260709 13:20:30.667699 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 100260us
W20260709 13:20:30.697890 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 53806.5us
W20260709 13:20:30.768082 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 195992us
I20260709 13:20:30.797031  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:31.071487 14150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d768389115849fca4a304f575143630"
dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
mode: GRACEFUL
new_leader_uuid: "86cbe005f1b04a3c99562111b01847e8"
 from {username='slave'} at 127.0.0.1:56766
I20260709 13:20:31.072541 14150 raft_consensus.cc:606] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Received request to transfer leadership to TS 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:31.079550 14293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df"
dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
mode: GRACEFUL
new_leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:41570
I20260709 13:20:31.080318 14293 raft_consensus.cc:606] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Received request to transfer leadership to TS ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:31.085227  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:31.089047  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:31.170378 15554 raft_consensus.cc:993] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d: : Instructing follower ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:31.171063 15554 raft_consensus.cc:1081] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Signalling peer ff2956d2be4d4ef98fdc5dc75bceff81 to start an election
I20260709 13:20:31.173796 14993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
 from {username='slave'} at 127.0.0.1:58206
I20260709 13:20:31.174655 14993 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.175179 14993 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.204715 14993 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:31.216504 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:31.217448 14293 raft_consensus.cc:3055] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:31.217830 14293 raft_consensus.cc:740] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:31.219054 14293 consensus_queue.cc:260] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:31.223608 14293 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.236781 14993 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:31.239877 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:31.258949 14150 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.270707 14150 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:31.283771 14891 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 
I20260709 13:20:31.285542 15540 raft_consensus.cc:2804] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:31.286132 15540 raft_consensus.cc:697] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Becoming Leader. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:31.287281 15540 consensus_queue.cc:237] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:31.293740 14293 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff2956d2be4d4ef98fdc5dc75bceff81 in term 3.
I20260709 13:20:31.386382 15338 raft_consensus.cc:993] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16: : Instructing follower 86cbe005f1b04a3c99562111b01847e8 to start an election
I20260709 13:20:31.387228 15553 raft_consensus.cc:1081] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Signalling peer 86cbe005f1b04a3c99562111b01847e8 to start an election
I20260709 13:20:31.389075 14219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d768389115849fca4a304f575143630"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
 from {username='slave'} at 127.0.0.1:35190
I20260709 13:20:31.392148 14219 raft_consensus.cc:493] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.431711 14219 raft_consensus.cc:3060] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.431129 13976 catalog_manager.cc:5697] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 reported cstate change: term changed from 2 to 3, leader changed from 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132) to ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129). New cstate: current_term: 3 leader_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:31.460000 14219 raft_consensus.cc:515] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:31.463559 14219 leader_election.cc:290] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Requested vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:31.466017 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:31.466858 14294 raft_consensus.cc:3060] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.470543 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d768389115849fca4a304f575143630" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:31.471318 14148 raft_consensus.cc:3055] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:31.471663 14148 raft_consensus.cc:740] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:31.472615 14148 consensus_queue.cc:260] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:31.476979 14148 raft_consensus.cc:3060] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.488536 14294 raft_consensus.cc:2468] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:31.502866 14191 leader_election.cc:304] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:31.504169 15568 raft_consensus.cc:2804] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:31.504961 15568 raft_consensus.cc:697] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:31.506088 15568 consensus_queue.cc:237] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } }
I20260709 13:20:31.506599 14148 raft_consensus.cc:2468] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:31.551537 13976 catalog_manager.cc:5697] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 1 to 2, leader changed from ce90f8e60d79487db7509ae191b95a16 (127.4.37.130) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:31.833261 14150 raft_consensus.cc:1275] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.843595 15418 consensus_queue.cc:1048] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:32.010195 14148 raft_consensus.cc:1275] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:32.072780 15557 consensus_queue.cc:1048] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:32.090384  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:32.100762 14294 raft_consensus.cc:1275] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ff2956d2be4d4ef98fdc5dc75bceff81: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:32.248924 15418 consensus_queue.cc:1048] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:32.283972 14294 raft_consensus.cc:1275] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:32.311985 14891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 48592.7us
I20260709 13:20:32.333926 15557 consensus_queue.cc:1048] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:32.367182 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 48909.4us
W20260709 13:20:32.422463 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 52324.7us
W20260709 13:20:32.493665 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 70009us
W20260709 13:20:32.497861 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 74929.3us
W20260709 13:20:32.504573 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 109721us
I20260709 13:20:32.575755  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:32.590075 14891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 241230us
W20260709 13:20:32.650825 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 259444us
I20260709 13:20:32.879290 14990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a"
dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
mode: GRACEFUL
new_leader_uuid: "86cbe005f1b04a3c99562111b01847e8"
 from {username='slave'} at 127.0.0.1:56084
I20260709 13:20:32.880021 14990 raft_consensus.cc:606] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Received request to transfer leadership to TS 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:32.883893  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:32.885848  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:33.177722 15591 raft_consensus.cc:993] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: : Instructing follower 86cbe005f1b04a3c99562111b01847e8 to start an election
I20260709 13:20:33.178362 15591 raft_consensus.cc:1081] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Signalling peer 86cbe005f1b04a3c99562111b01847e8 to start an election
I20260709 13:20:33.184932 14220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a"
dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
 from {username='slave'} at 127.0.0.1:59352
I20260709 13:20:33.185570 14220 raft_consensus.cc:493] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.185974 14220 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:33.198068 14220 raft_consensus.cc:515] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:33.201563 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:33.202235 14299 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:33.207448 14220 leader_election.cc:290] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:33.212622 14299 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 4.
I20260709 13:20:33.214458 14191 leader_election.cc:304] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:33.215553 15593 raft_consensus.cc:2804] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:33.216137 15593 raft_consensus.cc:697] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 4 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:33.216272 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82c5d7cc48d49fe8a64eafb263bc10a" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81"
I20260709 13:20:33.217164 14994 raft_consensus.cc:3055] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:33.217149 15593 consensus_queue.cc:237] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:33.218005 14994 raft_consensus.cc:740] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ff2956d2be4d4ef98fdc5dc75bceff81, State: Running, Role: LEADER
I20260709 13:20:33.219255 14994 consensus_queue.cc:260] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:33.220919 14994 raft_consensus.cc:3060] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:33.252031 14994 raft_consensus.cc:2468] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 4.
I20260709 13:20:33.282704 13976 catalog_manager.cc:5697] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 3 to 4, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 4 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:33.617746 14994 raft_consensus.cc:1275] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:33.620324 15568 consensus_queue.cc:1048] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:33.629721 14297 raft_consensus.cc:1275] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:33.632845 15568 consensus_queue.cc:1048] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:20:33.845707 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 115741us
I20260709 13:20:33.887074  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:33.965258 15623 log.cc:927] Time spent T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
W20260709 13:20:34.130729 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 63424.8us
W20260709 13:20:34.151582 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 83502.3us
W20260709 13:20:34.155392 14889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 91495.6us
I20260709 13:20:34.217061  4246 tablet_server.cc:179] TabletServer@127.4.37.129:33687 shutting down...
W20260709 13:20:34.231402 14119 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:34.283001 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 47842.4us
W20260709 13:20:34.305680 14119 consensus_peers.cc:597] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.308072 14119 consensus_peers.cc:597] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.321112 14267 consensus_peers.cc:597] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.321832 14267 consensus_peers.cc:597] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.322425 14267 consensus_peers.cc:597] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.322847 14119 consensus_peers.cc:597] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.351325 14193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 88281.8us
W20260709 13:20:34.374445 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 140695us
W20260709 13:20:34.377214 14193 consensus_peers.cc:597] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.378139 14193 consensus_peers.cc:597] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.386050 14267 consensus_peers.cc:597] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.387247 14193 consensus_peers.cc:597] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.422327 14119 consensus_peers.cc:597] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.424141 14193 consensus_peers.cc:597] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:34.456612  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:34.458194  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.459897  4246 raft_consensus.cc:2243] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:34.460808  4246 raft_consensus.cc:2272] T fb7823eaa6f143459fa2134dfd0f6aa1 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.465057  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.466482  4246 raft_consensus.cc:2243] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:34.468183  4246 raft_consensus.cc:2272] T 96745973797345908d4d9937507add14 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.474103  4246 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:34.480468 14267 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:34.479506  4246 raft_consensus.cc:2243] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:34.482086  4246 raft_consensus.cc:2272] T c01be016235a423e80a9915aa6285945 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.486910  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.488736  4246 raft_consensus.cc:2243] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:34.489691  4246 raft_consensus.cc:2272] T 50a70b817b674bd197cdb804bcf25840 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.494235  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.495530  4246 raft_consensus.cc:2243] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:34.496322  4246 raft_consensus.cc:2272] T 4be55c8ee09443479786b8bf51188b81 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:34.498175 14267 consensus_peers.cc:597] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:34.500499  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.507193  4246 raft_consensus.cc:2243] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:34.508769  4246 raft_consensus.cc:2272] T a8f3cee515a2410aaf0a7767f0d6587e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.518193  4246 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:34.530756 14119 consensus_peers.cc:597] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.548779 14267 consensus_peers.cc:597] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.563576 14119 consensus_peers.cc:597] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.568619 14119 consensus_peers.cc:597] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:34.580832  4246 raft_consensus.cc:2243] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:34.581796 14193 consensus_peers.cc:597] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:34.581854  4246 raft_consensus.cc:2272] T 19c67d33181e414897d5de3731e98030 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:34.621835 14193 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.622141 14119 consensus_peers.cc:597] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.625286 14119 consensus_peers.cc:597] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.627321 14267 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.628271 14267 consensus_peers.cc:597] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.665940 14267 consensus_peers.cc:597] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.699925 14193 consensus_peers.cc:597] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.708225 14267 consensus_peers.cc:597] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:34.738173 14119 consensus_peers.cc:597] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:34.771955  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.773675  4246 raft_consensus.cc:2243] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:34.774662  4246 raft_consensus.cc:2272] T fcd37714ddc243ad88669511b6e6b4d2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.806232  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.810197  4246 raft_consensus.cc:2243] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:34.828945  4246 raft_consensus.cc:2272] T f971376cf118457b9be1708b9bee92f5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.836009  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.837072  4246 raft_consensus.cc:2243] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:34.837960  4246 raft_consensus.cc:2272] T 1dca71eb8ab145ae99370ac00979d5e3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.845546  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.846669  4246 raft_consensus.cc:2243] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:34.848124  4246 raft_consensus.cc:2272] T 40e2f1ef94db448c8f64eafba0ddb66a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.906682  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:34.909487  4246 raft_consensus.cc:2243] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:20:34.951273 14118 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 190188us
I20260709 13:20:35.040850 15618 raft_consensus.cc:493] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:35.042750 15618 raft_consensus.cc:515] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.050562 15618 leader_election.cc:290] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:35.064507  4246 raft_consensus.cc:2272] T a36d26da58624e63adb52d3539d9bf33 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.072997  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.074707 15618 raft_consensus.cc:493] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:35.075451  4246 raft_consensus.cc:2243] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.075568 15618 raft_consensus.cc:515] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.076879  4246 raft_consensus.cc:2272] T dba6d1f5edf24d9bb71332e66e60ff47 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.081956  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.083245  4246 raft_consensus.cc:2243] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.084116  4246 raft_consensus.cc:2272] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.085690 15618 leader_election.cc:290] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:35.151937  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.208228  4246 raft_consensus.cc:2243] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.209486  4246 raft_consensus.cc:2272] T d3c80f2afcca4b789590b8d372a3b3a5 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.233353  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.239382  4246 raft_consensus.cc:2243] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.236963 14297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.249683  4246 raft_consensus.cc:2272] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.251708 15648 raft_consensus.cc:493] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:35.252508 15644 raft_consensus.cc:493] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:35.252321 15648 raft_consensus.cc:515] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.253068 15644 raft_consensus.cc:515] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:35.254907 15648 leader_election.cc:290] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:35.259146 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.255836 15644 leader_election.cc:290] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:35.266119  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.267406  4246 raft_consensus.cc:2243] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.271006  4246 raft_consensus.cc:2272] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.284534 15644 raft_consensus.cc:493] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:35.285197 15644 raft_consensus.cc:515] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:35.286415  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.287387 15644 leader_election.cc:290] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:35.287595  4246 raft_consensus.cc:2243] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:20:35.288436 14193 consensus_peers.cc:597] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:35.288879  4246 raft_consensus.cc:2272] T 5a072b7409604f1eae201822e47a6088 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.307308 15540 raft_consensus.cc:493] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:35.307895 15540 raft_consensus.cc:515] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:35.308666 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.310349 15540 leader_election.cc:290] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:35.313408 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:20:35.326707 14888 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 73688us
W20260709 13:20:35.329510 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 101432us
I20260709 13:20:35.331991 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
W20260709 13:20:35.347258 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 85471.4us
I20260709 13:20:35.355748 14302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.362210 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b2459c85ae6463580c794485b524d70" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:20:35.367977 14267 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:35.379848 15667 raft_consensus.cc:493] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:35.380522 15667 raft_consensus.cc:515] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:35.381826 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "111880dc525744b486e22a9921476257" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.383502  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.384478  4246 raft_consensus.cc:2243] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.385200 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31dabf2cb78a41b3b7df2e4915051150" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.385445 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c846d4120a61419aaa527e656bebee8f" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.387496 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1250eb4ed6ed42629983aaf3f1af0994" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.387753 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70960d884ffe4de7a2aad3cf1a1c687e" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.395809 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.395803  4246 raft_consensus.cc:2272] T 81c21d80fe34435a9dc4b1435f136941 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.399981 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfe20916a56c44f6b30d4b2e7e7b3154" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.401301 15667 leader_election.cc:290] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:35.401587  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.404837  4246 raft_consensus.cc:2243] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.406361  4246 raft_consensus.cc:2272] T 03bef24cb5de488fa1610fa18979e0bb P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.410743  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.411813  4246 raft_consensus.cc:2243] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.412971  4246 raft_consensus.cc:2272] T 944276202aa94d11a0203aa2291a9692 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.417299  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.418336  4246 raft_consensus.cc:2243] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.418964  4246 raft_consensus.cc:2272] T e82c5d7cc48d49fe8a64eafb263bc10a P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.423988 14889 leader_election.cc:304] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:35.424903 15667 raft_consensus.cc:2749] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:35.425446 15618 raft_consensus.cc:493] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:35.426093 15618 raft_consensus.cc:515] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:35.428797 15618 leader_election.cc:290] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:35.432430 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138f6cda3ff43d2bce4723559454144" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.436185 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0138f6cda3ff43d2bce4723559454144" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.438272 14889 leader_election.cc:304] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:35.439560 15618 raft_consensus.cc:2749] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:35.440018 15648 raft_consensus.cc:493] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:35.440708 15648 raft_consensus.cc:515] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.443046 15648 leader_election.cc:290] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:35.444922 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.451814 14891 leader_election.cc:304] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
W20260709 13:20:35.454238 14891 raft_consensus.cc:2686] T 8b2459c85ae6463580c794485b524d70 P ff2956d2be4d4ef98fdc5dc75bceff81: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:20:35.437249  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.461210 14891 leader_election.cc:304] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.461740  4246 raft_consensus.cc:2243] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:35.462095 14891 raft_consensus.cc:2686] T 111880dc525744b486e22a9921476257 P ff2956d2be4d4ef98fdc5dc75bceff81: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:20:35.462743  4246 raft_consensus.cc:2272] T bcbdfedd963a49c1b2da5553ac8ad00f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.463867 14891 leader_election.cc:304] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.464844 15540 raft_consensus.cc:2749] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:35.472404  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.473495  4246 raft_consensus.cc:2243] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.474277  4246 raft_consensus.cc:2272] T bfe20916a56c44f6b30d4b2e7e7b3154 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.480520  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.481634  4246 raft_consensus.cc:2243] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.482728  4246 raft_consensus.cc:2272] T 3e7053b6fc124e37a58aab2689df06df P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.489475  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.491958  4246 raft_consensus.cc:2243] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.492628  4246 raft_consensus.cc:2272] T c144f8c18cd84075a92d25a0250bb9e6 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.499949 15612 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.500555 15612 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.479825 14891 leader_election.cc:304] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.502993 15612 leader_election.cc:290] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:35.503459 15667 raft_consensus.cc:2749] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:35.504220 14891 leader_election.cc:304] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.505084 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.506265 15667 raft_consensus.cc:2749] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:35.518194 14891 leader_election.cc:304] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.519080 15667 raft_consensus.cc:2749] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:35.522694 14119 leader_election.cc:336] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:35.523543 14119 leader_election.cc:304] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:35.532332 15655 raft_consensus.cc:2749] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:35.525738  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.547324  4246 raft_consensus.cc:2243] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.547757 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3dbbe44a364ffb8dfefce3315273ad" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.548413  4246 raft_consensus.cc:2272] T 2412bd2aec3744b69d4fa16d6b96ed3d P ff2956d2be4d4ef98fdc5dc75bceff81 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.552646  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.553844  4246 raft_consensus.cc:2243] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.557377 15667 raft_consensus.cc:493] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:35.558102 15667 raft_consensus.cc:515] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.560814 15667 leader_election.cc:290] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:35.564455 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.557437  4246 raft_consensus.cc:2272] T 31dabf2cb78a41b3b7df2e4915051150 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.571267 15667 raft_consensus.cc:493] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:35.572089 15667 raft_consensus.cc:515] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:35.575179  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.576457 14154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56a931d31246a4b5592ae7bb17e3c4" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.577217 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.577320 14891 leader_election.cc:304] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.578658 15540 raft_consensus.cc:2749] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:35.576930 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ffc24773ec4a9c9458d3cad9fc75ef" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.579733  4246 raft_consensus.cc:2243] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.580377  4246 raft_consensus.cc:2272] T 1250eb4ed6ed42629983aaf3f1af0994 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.575217 15667 leader_election.cc:290] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:35.596724  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.597945  4246 raft_consensus.cc:2243] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.598681  4246 raft_consensus.cc:2272] T c846d4120a61419aaa527e656bebee8f P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.599210 15667 raft_consensus.cc:493] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:35.599720 15667 raft_consensus.cc:515] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:35.601928  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.603087 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.603310 14891 leader_election.cc:304] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.604408  4246 raft_consensus.cc:2243] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.616665 15540 raft_consensus.cc:2749] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:35.605875 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54b6e843913d4557bdaf57a2c7a21aa3" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.601934 15667 leader_election.cc:290] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307)
I20260709 13:20:35.619267  4246 raft_consensus.cc:2272] T ef7edac8cddd4927a4d0c73332149e41 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.621297 14889 leader_election.cc:304] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8
I20260709 13:20:35.621650 14891 leader_election.cc:304] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.624634  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.625702 15667 raft_consensus.cc:2749] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:35.625831 15540 raft_consensus.cc:2749] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:35.628509  4246 raft_consensus.cc:2243] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.629549 15540 raft_consensus.cc:493] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 86cbe005f1b04a3c99562111b01847e8)
I20260709 13:20:35.630380 15540 raft_consensus.cc:515] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:35.633682 15540 leader_election.cc:290] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:35.634918 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.641701  4246 raft_consensus.cc:2272] T 9b85e799338444779dcc24b7b8ee9a1e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.642246 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe3a7dffcb540448cbeba5e852c5d65" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.651067  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.652088  4246 raft_consensus.cc:2243] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.666836  4246 raft_consensus.cc:2272] T 0217d8525e174f758cfd48c0a04a7caf P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.671053 15540 raft_consensus.cc:493] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce90f8e60d79487db7509ae191b95a16)
I20260709 13:20:35.671363  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.672559  4246 raft_consensus.cc:2243] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.673339  4246 raft_consensus.cc:2272] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.675681 15667 raft_consensus.cc:493] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4db315fd9fb94434a179b03f5b4c083d)
I20260709 13:20:35.676321 15667 raft_consensus.cc:515] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.678488  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.679530  4246 raft_consensus.cc:2243] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.680137  4246 raft_consensus.cc:2272] T 43ffc24773ec4a9c9458d3cad9fc75ef P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.680739 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.683933 15667 leader_election.cc:290] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:35.676302 15540 raft_consensus.cc:515] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:35.692291 15540 leader_election.cc:290] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:35.694149 14219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.697598 14891 leader_election.cc:304] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
W20260709 13:20:35.698438 14891 raft_consensus.cc:2686] T cfe3a7dffcb540448cbeba5e852c5d65 P ff2956d2be4d4ef98fdc5dc75bceff81: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:20:35.704897 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75fd8dc7cb4bdcb2456a29de8392e2" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.710214 15653 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.710901 15653 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.711310 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3208eb99cabe427fa25a3cf07cafc865" candidate_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.714447 15653 leader_election.cc:290] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:35.714931 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:35.714470 15568 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.715667 14148 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:35.716917 14268 leader_election.cc:304] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:35.717113 15568 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:35.717978 15635 raft_consensus.cc:2804] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:35.721010 15635 raft_consensus.cc:493] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.721462 15635 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:35.731352 15568 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:35.739588 14891 leader_election.cc:304] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.684567  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.749189 15667 raft_consensus.cc:2749] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:35.749791 14891 leader_election.cc:304] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff2956d2be4d4ef98fdc5dc75bceff81; no voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16
I20260709 13:20:35.750831 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.756989 15635 raft_consensus.cc:515] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.759738  4246 raft_consensus.cc:2243] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.760484  4246 raft_consensus.cc:2272] T 0138f6cda3ff43d2bce4723559454144 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.761864 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96745973797345908d4d9937507add14" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:35.762637 14148 raft_consensus.cc:3060] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:35.764011  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.765038  4246 raft_consensus.cc:2243] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.765904  4246 raft_consensus.cc:2272] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:35.769680 14891 raft_consensus.cc:2686] T 3208eb99cabe427fa25a3cf07cafc865 P ff2956d2be4d4ef98fdc5dc75bceff81: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:20:35.772612 14148 raft_consensus.cc:2468] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 4.
I20260709 13:20:35.775301 14268 leader_election.cc:304] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:35.776786 15653 raft_consensus.cc:2804] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:35.777303 15653 raft_consensus.cc:697] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:35.778344 15653 consensus_queue.cc:237] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.782015 15635 leader_election.cc:290] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:35.784217 14267 leader_election.cc:336] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:35.794576 14193 leader_election.cc:336] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:35.795183 14193 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:35.796094 15568 raft_consensus.cc:2749] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:35.799273 14267 leader_election.cc:336] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:35.801345  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.803109  4246 raft_consensus.cc:2243] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.806778  4246 raft_consensus.cc:2272] T 70960d884ffe4de7a2aad3cf1a1c687e P ff2956d2be4d4ef98fdc5dc75bceff81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.820917  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.821830  4246 raft_consensus.cc:2243] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.822538  4246 raft_consensus.cc:2272] T 54b6e843913d4557bdaf57a2c7a21aa3 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.821992 13975 catalog_manager.cc:5697] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 3 to 4, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 4 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.827291  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.829011  4246 raft_consensus.cc:2243] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.829762  4246 raft_consensus.cc:2272] T bd3dbbe44a364ffb8dfefce3315273ad P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.834266  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.835249  4246 raft_consensus.cc:2243] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.836678  4246 raft_consensus.cc:2272] T 120b27990187463c8945db388e219f76 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.840457  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.841323  4246 raft_consensus.cc:2243] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.842028  4246 raft_consensus.cc:2272] T 5d56a931d31246a4b5592ae7bb17e3c4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.845440  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.846303  4246 raft_consensus.cc:2243] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.847599  4246 raft_consensus.cc:2272] T 98da3e79bd3a47369b2c6d41e0151470 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.853379  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.854239  4246 raft_consensus.cc:2243] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.854955  4246 raft_consensus.cc:2272] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.863366  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:35.864228  4246 raft_consensus.cc:2243] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.865661  4246 raft_consensus.cc:2272] T c56ca0f27ffe4236ba41dc9e1e765cf4 P ff2956d2be4d4ef98fdc5dc75bceff81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.877846 15635 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.878541 15635 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:35.880909 15635 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:35.883656 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:35.884414 14227 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:35.885797 14266 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
W20260709 13:20:35.891147 14267 leader_election.cc:336] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:35.894008 15653 raft_consensus.cc:2804] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:35.894569 15653 raft_consensus.cc:493] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.895025 15653 raft_consensus.cc:3060] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:35.905026 15635 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.907367 15635 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.916997 14148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
W20260709 13:20:35.921569 14267 leader_election.cc:336] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:35.929672 15655 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.956633 15655 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:35.959672 15655 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:35.973397 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:35.974212 14267 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:35.974284 14293 raft_consensus.cc:2468] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:35.976097 14117 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:35.976971 15655 raft_consensus.cc:2804] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:35.977555 15655 raft_consensus.cc:493] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:35.978552 15655 raft_consensus.cc:3060] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:35.978062 15651 raft_consensus.cc:2749] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:35.979331 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 57818.1us
I20260709 13:20:35.986703 15653 raft_consensus.cc:515] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:35.976966 15635 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:36.004474 15653 leader_election.cc:290] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.005541 15568 raft_consensus.cc:493] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.009593 15568 raft_consensus.cc:515] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.009224 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8f3cee515a2410aaf0a7767f0d6587e" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:36.013135 15568 leader_election.cc:290] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.015261 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:36.012601 14227 raft_consensus.cc:3060] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:36.027606 14267 leader_election.cc:336] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:36.030646 14119 leader_election.cc:336] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:36.032692 14193 leader_election.cc:336] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.033320 14193 leader_election.cc:304] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.035980 15655 raft_consensus.cc:515] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:36.037678 15640 raft_consensus.cc:2749] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:36.043334 14227 raft_consensus.cc:2468] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:36.044759 14266 leader_election.cc:304] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.046342 15655 leader_election.cc:290] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.045984 15653 raft_consensus.cc:2804] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:36.047046 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40e2f1ef94db448c8f64eafba0ddb66a" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:36.047629 15653 raft_consensus.cc:697] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:36.047719 14293 raft_consensus.cc:3060] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.048642 15653 consensus_queue.cc:237] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:36.052100 14119 leader_election.cc:336] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.106276 14293 raft_consensus.cc:2468] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:36.107525 14117 leader_election.cc:304] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.107373 13975 catalog_manager.cc:5697] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.109309 15655 raft_consensus.cc:2804] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:36.109926 15655 raft_consensus.cc:697] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:36.110881 15655 consensus_queue.cc:237] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:36.129659 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4100 after lost signal to thread 4249
W20260709 13:20:36.131139 14323 debug-util.cc:398] Leaking SignalData structure 0x7b0800319060 after lost signal to thread 14011
W20260709 13:20:36.132706 14323 debug-util.cc:398] Leaking SignalData structure 0x7b0800324ba0 after lost signal to thread 14178
W20260709 13:20:36.142174 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd880 after lost signal to thread 14252
W20260709 13:20:36.143774 14323 debug-util.cc:398] Leaking SignalData structure 0x7b08003af740 after lost signal to thread 14326
I20260709 13:20:36.162230 13975 catalog_manager.cc:5697] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:36.165975 15653 raft_consensus.cc:493] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.166617 15653 raft_consensus.cc:515] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.171103 15653 leader_election.cc:290] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.173040 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:36.174192 14227 raft_consensus.cc:2468] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:36.176529 14266 leader_election.cc:304] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:36.179342 15635 raft_consensus.cc:2804] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:36.179656 15609 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.179955 15635 raft_consensus.cc:493] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.180588 15635 raft_consensus.cc:3060] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.180344 15609 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.182953 15609 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:20:36.184975 14267 leader_election.cc:336] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.187083 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:36.203331 14148 raft_consensus.cc:1275] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:36.207607 15635 raft_consensus.cc:515] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:36.208602 14267 consensus_peers.cc:597] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:36.209780 15554 consensus_queue.cc:1048] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:36.226883 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f971376cf118457b9be1708b9bee92f5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:36.227741 14227 raft_consensus.cc:3060] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.251011 15635 leader_election.cc:290] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:36.251384 14119 leader_election.cc:336] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.253111 14119 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.255730 15655 raft_consensus.cc:2749] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:36.262481 14267 leader_election.cc:336] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.277302 14227 raft_consensus.cc:2468] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:36.286387 14266 leader_election.cc:304] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.289752 15554 raft_consensus.cc:2804] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:36.290421 15554 raft_consensus.cc:697] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:36.291484 15554 consensus_queue.cc:237] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.318387 13976 catalog_manager.cc:5697] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:36.512622 15612 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.513370 15612 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.517336 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:36.600342 15612 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:20:36.628031 14267 consensus_peers.cc:597] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:36.634130 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 47533.9us
I20260709 13:20:36.643258 14293 raft_consensus.cc:1275] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:36.646271 15655 consensus_queue.cc:1048] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:20:36.635290 14119 leader_election.cc:336] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.654055 14119 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.664613 15640 raft_consensus.cc:493] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.672132 15640 raft_consensus.cc:515] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.675377 15640 leader_election.cc:290] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.666394 14220 raft_consensus.cc:1275] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:20:36.669727 14193 consensus_peers.cc:597] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:36.678449 15635 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.679157 15635 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:36.682456 15655 raft_consensus.cc:2749] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:20:36.685855 14119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 50590.1us
I20260709 13:20:36.693588 15645 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.694805 15645 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:36.695439 14193 leader_election.cc:336] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.696949 15554 consensus_queue.cc:1048] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:36.698644 15645 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:36.699875 15645 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.700385 15645 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.702625 15645 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:36.705236 14193 leader_election.cc:336] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:36.711066 14193 leader_election.cc:336] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.719133 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
W20260709 13:20:36.722855 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 51483.3us
W20260709 13:20:36.730865 14194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 58959.4us
I20260709 13:20:36.731817 14191 leader_election.cc:304] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.733906 15685 raft_consensus.cc:2749] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:36.734673 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:36.735386 14147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:36.736279 14147 raft_consensus.cc:2468] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:36.735540 14150 raft_consensus.cc:2468] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:36.677357 15640 raft_consensus.cc:493] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.739084 15640 raft_consensus.cc:515] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.740953 14194 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.743132 15568 raft_consensus.cc:2804] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:36.743626 15568 raft_consensus.cc:493] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.743556 14194 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.744374 15568 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:36.739702 15653 raft_consensus.cc:493] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.745957 15685 raft_consensus.cc:2804] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:36.746444 15685 raft_consensus.cc:493] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.746423 15653 raft_consensus.cc:515] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.747133 15685 raft_consensus.cc:3060] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.750924 14147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:36.755398 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:36.751180 15635 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:36.767686 14227 raft_consensus.cc:2468] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:36.767930 15651 raft_consensus.cc:493] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.770196 15651 raft_consensus.cc:515] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:36.774071 14267 consensus_peers.cc:597] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:36.753988 15653 leader_election.cc:290] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.789674 15651 leader_election.cc:290] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.792299 14266 leader_election.cc:304] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:36.780078 15645 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.795778 15645 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.796375 15640 leader_election.cc:290] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:36.797654 14119 consensus_peers.cc:597] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:36.798121 15645 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:36.798424 14119 consensus_peers.cc:597] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:36.803131 14193 leader_election.cc:336] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:36.803804 14193 leader_election.cc:336] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.804016 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:36.804649 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:36.805341 14225 raft_consensus.cc:2468] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:36.809288 14194 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.814574 15640 raft_consensus.cc:2749] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:36.815968 14266 leader_election.cc:304] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:36.817096 15653 raft_consensus.cc:2804] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:36.817553 15653 raft_consensus.cc:493] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.817927 15653 raft_consensus.cc:3060] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.818571 15635 raft_consensus.cc:2804] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:36.819041 15635 raft_consensus.cc:493] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.819414 15635 raft_consensus.cc:3060] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.813194 15685 raft_consensus.cc:515] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.826877 15568 raft_consensus.cc:515] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:36.828565 14119 consensus_peers.cc:597] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:36.828774 14267 leader_election.cc:336] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:36.832312 14267 leader_election.cc:336] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.832764 14267 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.837543 15568 leader_election.cc:290] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:36.839004 14147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a36d26da58624e63adb52d3539d9bf33" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:36.835026 15645 raft_consensus.cc:493] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.852021 15645 raft_consensus.cc:515] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.854295 15645 leader_election.cc:290] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.845176 15688 raft_consensus.cc:2749] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:36.849045 15609 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.855777 15609 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:36.842262 14147 raft_consensus.cc:3060] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:36.857699 14193 leader_election.cc:336] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.860350 15685 leader_election.cc:290] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:36.858208 15609 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.849813 15612 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.861374 15612 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
W20260709 13:20:36.867767 14119 leader_election.cc:336] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.872190 15635 raft_consensus.cc:515] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.866739 15653 raft_consensus.cc:515] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.878178 15653 leader_election.cc:290] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.880046 14147 raft_consensus.cc:2468] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 4.
W20260709 13:20:36.880817 14119 leader_election.cc:336] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:36.882445 14119 consensus_peers.cc:597] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:36.882221 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:36.884896 14220 raft_consensus.cc:3060] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.885125 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:36.885876 14227 raft_consensus.cc:2468] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 2.
I20260709 13:20:36.888177 14118 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.891166 15666 raft_consensus.cc:2804] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:36.891644 15666 raft_consensus.cc:493] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.892050 15666 raft_consensus.cc:3060] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.893240 15612 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
W20260709 13:20:36.893232 14119 consensus_peers.cc:597] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:36.898072 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba6d1f5edf24d9bb71332e66e60ff47" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:36.898744 14150 raft_consensus.cc:3060] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.900241 15612 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.901070 15612 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:36.903904 15612 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:36.905684 14193 leader_election.cc:336] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:36.909495 14193 leader_election.cc:336] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.910615 14150 raft_consensus.cc:2468] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:36.914999 15666 raft_consensus.cc:515] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.918354 14225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a072b7409604f1eae201822e47a6088" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:36.918985 14225 raft_consensus.cc:3060] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.923272 14194 leader_election.cc:304] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.925004 15685 raft_consensus.cc:2804] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:36.925904 15685 raft_consensus.cc:697] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:36.926976 15685 consensus_queue.cc:237] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.930516 14225 raft_consensus.cc:2468] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:36.932300 14118 leader_election.cc:304] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: 
W20260709 13:20:36.933912 14119 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.934765 15692 raft_consensus.cc:2804] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:36.935389 15692 raft_consensus.cc:697] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
I20260709 13:20:36.936400 15692 consensus_queue.cc:237] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.944069 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8bde50cec1487ab96a9bf5e86c8fd4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:36.945058 14293 raft_consensus.cc:2393] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 3: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:36.945616 14194 leader_election.cc:304] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:36.946609 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:36.948040 15568 raft_consensus.cc:2804] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:36.938580 14220 raft_consensus.cc:2468] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:36.948922 15568 raft_consensus.cc:697] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 4 LEADER]: Becoming Leader. State: Replica: 86cbe005f1b04a3c99562111b01847e8, State: Running, Role: LEADER
I20260709 13:20:36.952909 14227 raft_consensus.cc:1275] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:20:36.952631 14119 leader_election.cc:336] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.962093 15635 leader_election.cc:290] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:36.963639 14266 leader_election.cc:304] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:36.964466 15653 raft_consensus.cc:2804] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:36.964996 15653 raft_consensus.cc:697] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:36.921214 15666 leader_election.cc:290] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995)
I20260709 13:20:36.958747 15568 consensus_queue.cc:237] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } }
I20260709 13:20:36.967346 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3c80f2afcca4b789590b8d372a3b3a5" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:36.968087 14227 raft_consensus.cc:3060] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:36.965940 15653 consensus_queue.cc:237] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:36.958925 14267 leader_election.cc:336] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:36.983937 14227 raft_consensus.cc:2468] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:36.984083 15694 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:36.988037 15694 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:36.990908 15694 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:36.991065 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:36.991768 14293 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 3.
I20260709 13:20:36.993136 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:36.993752 14293 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 5.
I20260709 13:20:36.995118 14266 leader_election.cc:304] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:36.996469 15554 raft_consensus.cc:2804] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:36.997133 15554 raft_consensus.cc:697] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:36.998209 15554 consensus_queue.cc:237] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:36.998255 13976 catalog_manager.cc:5697] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:37.001375  4246 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:37.001502 14193 consensus_peers.cc:597] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.002226 14193 consensus_peers.cc:597] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.012009 14147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:37.012841 14147 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 5.
I20260709 13:20:37.014642 14268 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:37.015513 15693 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:20:36.965004 15635 consensus_queue.cc:1048] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:20:37.015827 14191 leader_election.cc:304] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.016237 14117 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.018249 15640 raft_consensus.cc:2749] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:37.016887 15694 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.019227 15694 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.021979 15694 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.024878 14117 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.038143 15609 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:20:37.038694 15609 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.039119 15609 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:20:37.039325 14119 consensus_peers.cc:597] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.015889 15693 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.044335 15666 raft_consensus.cc:2804] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:20:37.062914 14267 leader_election.cc:336] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:37.064152 14267 consensus_peers.cc:597] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.064721 14267 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.065197 14267 leader_election.cc:336] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:37.067092 14267 consensus_peers.cc:597] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.057361 13975 catalog_manager.cc:5697] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:37.069620 14193 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.054388 15693 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:37.052577 15653 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.062549 15666 raft_consensus.cc:493] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.086740 15666 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:37.088106 14267 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:37.089592 14267 consensus_peers.cc:597] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.090153 14267 consensus_peers.cc:597] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.090603 14267 leader_election.cc:336] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:37.080868 14191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 65110.6us
I20260709 13:20:37.102731 14191 leader_election.cc:304] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.108518 15609 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:37.115784 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 73624.5us
I20260709 13:20:37.117811 15568 raft_consensus.cc:2749] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:37.125293 14267 consensus_peers.cc:597] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.125653 14193 consensus_peers.cc:597] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.135411 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:37.114884 13974 catalog_manager.cc:5697] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 3 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.139325 15666 raft_consensus.cc:515] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:37.140875 15651 raft_consensus.cc:493] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.141616 15651 raft_consensus.cc:515] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.143339 15655 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.144048 15655 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:37.144541 15702 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.141976 15666 leader_election.cc:290] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.145083 15702 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:37.145722 14119 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.146246 15651 leader_election.cc:290] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.146411 15655 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:37.148048 15698 log.cc:927] Time spent T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:20:37.145501 15568 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.148619 15568 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.149024 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:37.081884 15653 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.150051 14227 raft_consensus.cc:2468] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
W20260709 13:20:37.150396 14119 leader_election.cc:336] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.151340 15568 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.147573 15702 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.156673 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e7053b6fc124e37a58aab2689df06df" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:37.157371 14293 raft_consensus.cc:3060] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:37.159408 14193 leader_election.cc:336] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:37.159667 14119 leader_election.cc:336] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:37.160107 14193 leader_election.cc:336] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.165766 15609 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 6 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.166074 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:37.168869 14293 raft_consensus.cc:2468] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce90f8e60d79487db7509ae191b95a16 in term 4.
I20260709 13:20:37.169548 14117 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.172232 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:37.172966 14220 raft_consensus.cc:2468] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:37.174279 15704 raft_consensus.cc:2749] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:37.181687 15653 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.186405 14117 leader_election.cc:304] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.187383 15655 raft_consensus.cc:2804] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:37.188190 15655 raft_consensus.cc:697] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 4 LEADER]: Becoming Leader. State: Replica: ce90f8e60d79487db7509ae191b95a16, State: Running, Role: LEADER
W20260709 13:20:37.188656 14267 leader_election.cc:336] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.188656 15693 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:37.189360 15655 consensus_queue.cc:237] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:37.190327 14299 raft_consensus.cc:2393] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 6: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:37.191948 15693 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 6 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:37.193512 14117 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.195231 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:37.195865 15701 raft_consensus.cc:2749] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:20:37.196432 14267 leader_election.cc:336] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.196762 14150 raft_consensus.cc:2393] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 6: Already voted for candidate ce90f8e60d79487db7509ae191b95a16 in this term.
I20260709 13:20:37.198112 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:37.198884 14220 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:37.202229 14266 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.202476 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:37.203219 14299 raft_consensus.cc:2468] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 2.
I20260709 13:20:37.205291 14266 leader_election.cc:304] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.207923 14191 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.208145 14294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:37.211406 14294 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86cbe005f1b04a3c99562111b01847e8 in term 3.
I20260709 13:20:37.212555 14266 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.215198 15694 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:37.215723 15694 raft_consensus.cc:493] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.216167 15694 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:37.217684 15568 raft_consensus.cc:2804] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:37.218194 15568 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.218523 15568 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:37.207362 15651 raft_consensus.cc:2804] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:37.221267 15651 raft_consensus.cc:493] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.221763 15651 raft_consensus.cc:3060] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:37.222925 14119 consensus_peers.cc:597] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.224988 14267 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.229802 14267 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: ce90f8e60d79487db7509ae191b95a16, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:37.230615 14119 consensus_peers.cc:597] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.232066 15689 raft_consensus.cc:2749] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:20:37.207010 15554 raft_consensus.cc:2804] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:37.233791 15554 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.234195 15554 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:37.246490 15694 raft_consensus.cc:515] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.254546 15568 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.257167 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98da3e79bd3a47369b2c6d41e0151470" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:37.258195 14227 raft_consensus.cc:3060] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:37.258369 14191 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.269481 14227 raft_consensus.cc:2468] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 4.
I20260709 13:20:37.273910 14266 leader_election.cc:304] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:37.259459 15694 leader_election.cc:290] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:37.281589 14267 leader_election.cc:336] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.282132 15635 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.299544 15635 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:37.299950 15568 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Requested vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.287385 15688 raft_consensus.cc:2804] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:37.303918 15688 raft_consensus.cc:697] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:37.305140 15688 consensus_queue.cc:237] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:37.308151 14267 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.275265 15685 raft_consensus.cc:2764] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:20:37.308755 14267 consensus_peers.cc:597] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.309185 14267 consensus_peers.cc:597] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.295001 14193 consensus_peers.cc:597] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.316506 14147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:37.319139 15554 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.322605 14299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "86cbe005f1b04a3c99562111b01847e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d"
I20260709 13:20:37.323172 15554 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:37.324208 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:37.317268 14147 raft_consensus.cc:2468] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 2.
I20260709 13:20:37.326282 14299 raft_consensus.cc:2393] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 86cbe005f1b04a3c99562111b01847e8 in current term 3: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
I20260709 13:20:37.327623 14227 raft_consensus.cc:2393] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4db315fd9fb94434a179b03f5b4c083d in current term 3: Already voted for candidate 86cbe005f1b04a3c99562111b01847e8 in this term.
I20260709 13:20:37.329182 14268 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:37.324839 13976 catalog_manager.cc:5697] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 reported cstate change: term changed from 3 to 4, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131). New cstate: current_term: 4 leader_uuid: "86cbe005f1b04a3c99562111b01847e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:37.330979 14193 consensus_peers.cc:597] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.317795 15635 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:37.342069 14267 leader_election.cc:336] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.333104 15689 raft_consensus.cc:2804] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:37.349691 15689 raft_consensus.cc:493] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff2956d2be4d4ef98fdc5dc75bceff81)
I20260709 13:20:37.350340 15689 raft_consensus.cc:3060] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:37.350826 14267 leader_election.cc:336] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.348440 15651 raft_consensus.cc:515] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.351362 14267 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d; no voters: 86cbe005f1b04a3c99562111b01847e8, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.352119 15687 raft_consensus.cc:2749] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:20:37.353892 14227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0217d8525e174f758cfd48c0a04a7caf" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:37.354545 14227 raft_consensus.cc:3060] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:37.355197 15651 leader_election.cc:290] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:37.357061 14193 leader_election.cc:336] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.357606 14193 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86cbe005f1b04a3c99562111b01847e8; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
I20260709 13:20:37.360889 14220 raft_consensus.cc:1275] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:37.362721 15666 consensus_queue.cc:1048] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:37.360988 15685 raft_consensus.cc:2749] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:20:37.373667 14227 raft_consensus.cc:2468] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:37.374800 14266 leader_election.cc:304] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:37.375873 15688 raft_consensus.cc:2804] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:20:37.376622 14267 leader_election.cc:336] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.377084 15689 raft_consensus.cc:515] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:37.378209 15688 raft_consensus.cc:697] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:37.379655 15688 consensus_queue.cc:237] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:37.380437 15689 leader_election.cc:290] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:37.381771 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120b27990187463c8945db388e219f76" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:37.382478 14150 raft_consensus.cc:3060] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:37.385001 14267 consensus_peers.cc:597] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.428804 14150 raft_consensus.cc:2468] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:37.431048 14145 raft_consensus.cc:1275] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:37.436424 14268 leader_election.cc:304] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:37.446573 15702 consensus_queue.cc:1048] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:37.448565 15653 raft_consensus.cc:2804] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:37.449656 15653 raft_consensus.cc:697] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:37.450523 15653 consensus_queue.cc:237] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
W20260709 13:20:37.461328 14119 consensus_peers.cc:597] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:37.463418 14267 leader_election.cc:336] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:37.452718 13974 catalog_manager.cc:5697] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 reported cstate change: term changed from 3 to 4, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to ce90f8e60d79487db7509ae191b95a16 (127.4.37.130). New cstate: current_term: 4 leader_uuid: "ce90f8e60d79487db7509ae191b95a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:37.476899 14193 consensus_peers.cc:597] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:37.483474 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 46699.1us
W20260709 13:20:37.498873 14119 consensus_peers.cc:597] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.502835 13976 catalog_manager.cc:5697] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.508399 14225 raft_consensus.cc:1275] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:37.504635 13976 catalog_manager.cc:5697] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.513339 15689 consensus_queue.cc:1048] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:37.523164 14150 raft_consensus.cc:1275] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Refusing update from remote peer 86cbe005f1b04a3c99562111b01847e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:37.512867 13976 catalog_manager.cc:5697] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 3 to 4, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 4 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:37.528875 14119 consensus_peers.cc:597] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.547653 15690 consensus_queue.cc:1048] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:37.559170 13976 catalog_manager.cc:5697] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 3, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 3 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:37.609572 14267 consensus_peers.cc:597] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:37.610123 14267 consensus_peers.cc:597] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:37.614638 14293 raft_consensus.cc:1275] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Refusing update from remote peer ce90f8e60d79487db7509ae191b95a16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:20:37.615844 14193 consensus_peers.cc:597] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:37.623143 15655 consensus_queue.cc:1048] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:20:37.614688 14119 consensus_peers.cc:597] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.664695 14119 consensus_peers.cc:597] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:37.680361 14225 raft_consensus.cc:1275] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:37.688241 15688 consensus_queue.cc:1048] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:37.708262 14227 raft_consensus.cc:1275] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:37.710878 15689 consensus_queue.cc:1048] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:37.718784 14193 consensus_peers.cc:597] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:37.723439 14267 consensus_peers.cc:597] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:37.854219 14267 consensus_peers.cc:597] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:37.857030 14267 consensus_peers.cc:597] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:37.890225 14220 raft_consensus.cc:1275] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:37.892426 15688 consensus_queue.cc:1048] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:20:37.962682 14267 consensus_peers.cc:597] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:38.002238  4246 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:38.067444 14267 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:38.079218 14154 raft_consensus.cc:1275] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:38.086956 15687 consensus_queue.cc:1048] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:20:38.476359 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 70418.7us
W20260709 13:20:38.854861 14267 consensus_peers.cc:597] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:39.002767  4246 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:39.037329 14119 consensus_peers.cc:597] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.085767 14267 consensus_peers.cc:597] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:39.134775 15689 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.135504 15689 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
I20260709 13:20:39.140650 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8" is_pre_election: true
I20260709 13:20:39.141475 14220 raft_consensus.cc:2468] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 3.
I20260709 13:20:39.143350 14266 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:39.144716 15726 raft_consensus.cc:2804] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:20:39.145267 15726 raft_consensus.cc:493] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.145789 15726 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:39.146752 15689 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:39.237629 14193 consensus_peers.cc:597] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.259865 14119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111) [suppressed 384 similar messages]
W20260709 13:20:39.317561 14119 consensus_peers.cc:597] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:39.364761 15655 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.365450 15655 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:39.371798 15655 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132:46307), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
W20260709 13:20:39.449127 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 65602.8us
I20260709 13:20:39.463809 15732 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:39.464527 15732 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:39.475239 15732 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
I20260709 13:20:39.377027 15726 raft_consensus.cc:515] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:39.496538 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 56254.9us
I20260709 13:20:39.505693 14150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16" is_pre_election: true
I20260709 13:20:39.506444 14150 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 6.
I20260709 13:20:39.537680 15726 leader_election.cc:290] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Requested vote from peers 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995), ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687)
I20260709 13:20:39.540853 14268 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
I20260709 13:20:39.543455 15689 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:39.544080 15689 raft_consensus.cc:493] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:39.544663 15689 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:20:39.554831 14267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:33687, user_credentials={real_user=slave}} blocked reactor thread for 64988.8us
W20260709 13:20:39.557361 14267 leader_election.cc:336] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:39.563100 14220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56ca0f27ffe4236ba41dc9e1e765cf4" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "86cbe005f1b04a3c99562111b01847e8"
I20260709 13:20:39.563969 14220 raft_consensus.cc:3060] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:39.580776 14193 consensus_peers.cc:597] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.584843 14193 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:39.586971 14293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "ce90f8e60d79487db7509ae191b95a16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4db315fd9fb94434a179b03f5b4c083d" is_pre_election: true
I20260709 13:20:39.590803 14220 raft_consensus.cc:2468] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 4.
W20260709 13:20:39.593521 14193 consensus_peers.cc:597] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:39.612715 14266 leader_election.cc:304] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, 86cbe005f1b04a3c99562111b01847e8; no voters: 
I20260709 13:20:39.616055 15736 raft_consensus.cc:2804] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:39.616976 15736 raft_consensus.cc:697] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:39.618108 15736 consensus_queue.cc:237] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } }
W20260709 13:20:39.619076 14267 consensus_peers.cc:597] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:39.626032 15689 raft_consensus.cc:515] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:39.629631 14293 raft_consensus.cc:2393] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce90f8e60d79487db7509ae191b95a16 in current term 7: Already voted for candidate 4db315fd9fb94434a179b03f5b4c083d in this term.
W20260709 13:20:39.639230 14193 consensus_peers.cc:597] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:39.647991 14145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "944276202aa94d11a0203aa2291a9692" candidate_uuid: "4db315fd9fb94434a179b03f5b4c083d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ce90f8e60d79487db7509ae191b95a16"
I20260709 13:20:39.648960 14145 raft_consensus.cc:3060] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:39.649700 15689 leader_election.cc:290] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 7 election: Requested vote from peers ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687), ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769)
W20260709 13:20:39.651204 14117 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.132:46307, user_credentials={real_user=slave}} blocked reactor thread for 58261.5us
W20260709 13:20:39.658663 14119 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
I20260709 13:20:39.659173 14119 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce90f8e60d79487db7509ae191b95a16; no voters: 4db315fd9fb94434a179b03f5b4c083d, ff2956d2be4d4ef98fdc5dc75bceff81
W20260709 13:20:39.660225 14267 consensus_peers.cc:597] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:39.660772 14267 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:39.661513 14267 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.662091 14119 consensus_peers.cc:597] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.664806 14119 consensus_peers.cc:597] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.669688 14119 consensus_peers.cc:597] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:39.671422 14119 consensus_peers.cc:597] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.662113 14267 leader_election.cc:336] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:39.673312 14267 consensus_peers.cc:597] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.680403 14267 consensus_peers.cc:597] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:39.676354 14145 raft_consensus.cc:2468] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4db315fd9fb94434a179b03f5b4c083d in term 7.
I20260709 13:20:39.684516 15734 raft_consensus.cc:2749] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:39.687008 14268 leader_election.cc:304] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4db315fd9fb94434a179b03f5b4c083d, ce90f8e60d79487db7509ae191b95a16; no voters: 
W20260709 13:20:39.688522 14267 leader_election.cc:336] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111)
W20260709 13:20:39.689659 14267 consensus_peers.cc:597] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:39.690029 15736 raft_consensus.cc:2804] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:39.690977 15736 raft_consensus.cc:697] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 7 LEADER]: Becoming Leader. State: Replica: 4db315fd9fb94434a179b03f5b4c083d, State: Running, Role: LEADER
I20260709 13:20:39.692191 15736 consensus_queue.cc:237] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } }
I20260709 13:20:39.697497 13974 catalog_manager.cc:5697] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 2 to 4, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 4 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:39.705340 14119 consensus_peers.cc:597] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.717967 14267 consensus_peers.cc:597] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.734781 14267 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:39.812786 13974 catalog_manager.cc:5697] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d reported cstate change: term changed from 5 to 7, leader changed from ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129) to 4db315fd9fb94434a179b03f5b4c083d (127.4.37.132). New cstate: current_term: 7 leader_uuid: "4db315fd9fb94434a179b03f5b4c083d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4db315fd9fb94434a179b03f5b4c083d" member_type: VOTER last_known_addr { host: "127.4.37.132" port: 46307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff2956d2be4d4ef98fdc5dc75bceff81" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 33687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:39.815455 14119 consensus_peers.cc:597] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:39.835798 14193 consensus_peers.cc:597] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:39.908358 14193 consensus_peers.cc:597] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.911499 14193 consensus_peers.cc:597] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.913932 14119 consensus_peers.cc:597] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:39.997149 14119 consensus_peers.cc:597] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:40.003458  4246 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:40.011610 14267 consensus_peers.cc:597] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:40.023972 14193 consensus_peers.cc:597] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:40.071507 14225 raft_consensus.cc:1275] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:40.073854 15728 consensus_queue.cc:1048] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86cbe005f1b04a3c99562111b01847e8" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:20:40.084481 14119 consensus_peers.cc:597] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:40.140836 14267 consensus_peers.cc:597] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:40.141506 14267 consensus_peers.cc:597] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:40.154201 14267 consensus_peers.cc:597] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:40.160032 14119 consensus_peers.cc:597] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:40.160683 14119 consensus_peers.cc:597] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:40.193499 14268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.130:42769, user_credentials={real_user=slave}} blocked reactor thread for 62596.3us
W20260709 13:20:40.194698 14267 consensus_peers.cc:597] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:40.196070 14147 raft_consensus.cc:1275] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 7 FOLLOWER]: Refusing update from remote peer 4db315fd9fb94434a179b03f5b4c083d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:20:40.202996 15736 consensus_queue.cc:1048] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce90f8e60d79487db7509ae191b95a16" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:20:40.216782 14266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32995, user_credentials={real_user=slave}} blocked reactor thread for 87328.1us
W20260709 13:20:40.249183 14267 consensus_peers.cc:597] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:40.257277 14267 consensus_peers.cc:597] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:40.277490 14193 consensus_peers.cc:597] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:40.293725 14267 consensus_peers.cc:597] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:40.329967 14267 consensus_peers.cc:597] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:40.493458 14267 consensus_peers.cc:597] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:40.560623 14267 consensus_peers.cc:597] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:40.895774 14267 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:41.004426  4246 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:41.178100 14267 consensus_peers.cc:597] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:41.424571 14119 consensus_peers.cc:597] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:41.604211 14267 consensus_peers.cc:597] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:41.656858 14193 consensus_peers.cc:597] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:41.724411 14119 consensus_peers.cc:597] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:41.751765 14193 consensus_peers.cc:597] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:41.852452 14119 consensus_peers.cc:597] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:41.869495 14267 consensus_peers.cc:597] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:41.929291 14267 consensus_peers.cc:597] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:41.967115 14193 consensus_peers.cc:597] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:41.997378 14193 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.004047 14267 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.005093  4246 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:42.028226 14119 consensus_peers.cc:597] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.030828 14119 consensus_peers.cc:597] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.116207 14119 consensus_peers.cc:597] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.155436 14267 consensus_peers.cc:597] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.190876 14267 consensus_peers.cc:597] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.217406 14193 consensus_peers.cc:597] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.237083 14119 consensus_peers.cc:597] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.242776 14267 consensus_peers.cc:597] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.245539 14267 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.264568 14119 consensus_peers.cc:597] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.293316 14193 consensus_peers.cc:597] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.375337 14119 consensus_peers.cc:597] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.409952 14267 consensus_peers.cc:597] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.414193 14193 consensus_peers.cc:597] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.417879 14267 consensus_peers.cc:597] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.429611 14193 consensus_peers.cc:597] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.433044 14267 consensus_peers.cc:597] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.437813 14267 consensus_peers.cc:597] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.479830 14267 consensus_peers.cc:597] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.511313 14267 consensus_peers.cc:597] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.525117 14119 consensus_peers.cc:597] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.539952 14267 consensus_peers.cc:597] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:42.547537 14119 consensus_peers.cc:597] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.569777 14119 consensus_peers.cc:597] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.587994 14267 consensus_peers.cc:597] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.590909 14119 consensus_peers.cc:597] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.680831 14267 consensus_peers.cc:597] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:42.763190 14193 consensus_peers.cc:597] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.844859 14193 consensus_peers.cc:597] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:42.847352 14267 consensus_peers.cc:597] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:42.992149 14267 consensus_peers.cc:597] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:43.005653  4246 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:43.018838 14267 consensus_peers.cc:597] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:43.396247 14267 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:43.760389 14267 consensus_peers.cc:597] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:43.800231 14119 consensus_peers.cc:597] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.006515  4246 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:44.128651 14193 consensus_peers.cc:597] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.160403 14193 consensus_peers.cc:597] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.160537 14119 consensus_peers.cc:597] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.286856 14119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111) [suppressed 456 similar messages]
W20260709 13:20:44.290936 14119 consensus_peers.cc:597] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.305281 14193 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.356971 14119 consensus_peers.cc:597] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:44.456780 14193 consensus_peers.cc:597] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.552001 14119 consensus_peers.cc:597] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.639384 14119 consensus_peers.cc:597] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.746205 14193 consensus_peers.cc:597] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:44.759042 14193 consensus_peers.cc:597] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.777022 14119 consensus_peers.cc:597] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.779294 14193 consensus_peers.cc:597] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.823545 14119 consensus_peers.cc:597] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.910408 14119 consensus_peers.cc:597] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:44.939178 14193 consensus_peers.cc:597] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.970856 14119 consensus_peers.cc:597] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:44.981586 14119 consensus_peers.cc:597] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.007081  4246 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 15027)
W20260709 13:20:45.054896 14119 consensus_peers.cc:597] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.059836 14119 consensus_peers.cc:597] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:45.128679 14193 consensus_peers.cc:597] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:45.187880 14267 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.188755 14267 consensus_peers.cc:597] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.189218 14267 consensus_peers.cc:597] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.189653 14267 consensus_peers.cc:597] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.190119 14267 consensus_peers.cc:597] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:45.193032 14267 consensus_peers.cc:597] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:45.193989 14267 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.220367 14267 consensus_peers.cc:597] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.236506 14267 consensus_peers.cc:597] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.270081 14267 consensus_peers.cc:597] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.349857 14267 consensus_peers.cc:597] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:45.356657 14267 consensus_peers.cc:597] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:45.411870  4246 tablet_server.cc:196] TabletServer@127.4.37.129:33687 shutdown complete.
W20260709 13:20:45.455729 14267 consensus_peers.cc:597] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:45.547287 14267 consensus_peers.cc:597] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:45.563267 14267 consensus_peers.cc:597] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:45.565361  4246 tablet_server.cc:179] TabletServer@127.4.37.130:0 shutting down...
W20260709 13:20:45.574182 14268 consensus_peers.cc:597] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.590229 14268 consensus_peers.cc:597] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.598573 14194 consensus_peers.cc:597] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.601037 14268 consensus_peers.cc:597] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.639557  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:45.640800  4246 tablet_replica.cc:333] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.642097  4246 raft_consensus.cc:2243] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.643605  4246 raft_consensus.cc:2272] T 4be55c8ee09443479786b8bf51188b81 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.646549  4246 tablet_replica.cc:333] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.647495  4246 raft_consensus.cc:2243] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.648710  4246 raft_consensus.cc:2272] T fcd37714ddc243ad88669511b6e6b4d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.651298 14194 consensus_peers.cc:597] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.652136  4246 tablet_replica.cc:333] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.652796  4246 raft_consensus.cc:2243] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.653321  4246 raft_consensus.cc:2272] T 944276202aa94d11a0203aa2291a9692 P ce90f8e60d79487db7509ae191b95a16 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.656035  4246 tablet_replica.cc:333] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.656949  4246 raft_consensus.cc:2243] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.657655  4246 raft_consensus.cc:2272] T a36d26da58624e63adb52d3539d9bf33 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.661369  4246 tablet_replica.cc:333] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.662415  4246 raft_consensus.cc:2243] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.663126  4246 raft_consensus.cc:2272] T b06e3182ee5d4798b9145b000d822462 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.666334  4246 tablet_replica.cc:333] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.667117  4246 raft_consensus.cc:2243] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.667659  4246 raft_consensus.cc:2272] T bd3dbbe44a364ffb8dfefce3315273ad P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.670303  4246 tablet_replica.cc:333] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.670966  4246 raft_consensus.cc:2243] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.671887  4246 raft_consensus.cc:2272] T 40e2f1ef94db448c8f64eafba0ddb66a P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.675069  4246 tablet_replica.cc:333] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.676048  4246 raft_consensus.cc:2243] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.677074  4246 raft_consensus.cc:2272] T e920394df0034e98ab19842b8206bbb5 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.680428  4246 tablet_replica.cc:333] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.681546  4246 raft_consensus.cc:2243] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:45.682617 14268 consensus_peers.cc:597] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.682806  4246 raft_consensus.cc:2272] T 9b85e799338444779dcc24b7b8ee9a1e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.686126  4246 tablet_replica.cc:333] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
W20260709 13:20:45.687485 14194 consensus_peers.cc:597] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.687507  4246 raft_consensus.cc:2243] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.688591  4246 raft_consensus.cc:2272] T 03bef24cb5de488fa1610fa18979e0bb P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.690594 14193 consensus_peers.cc:597] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:45.692061  4246 tablet_replica.cc:333] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.693011  4246 raft_consensus.cc:2243] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.694320  4246 raft_consensus.cc:2272] T 5a072b7409604f1eae201822e47a6088 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.697564  4246 tablet_replica.cc:333] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.698427  4246 raft_consensus.cc:2243] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.699604  4246 raft_consensus.cc:2272] T ef7edac8cddd4927a4d0c73332149e41 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.702749  4246 tablet_replica.cc:333] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.703550  4246 raft_consensus.cc:2243] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.704197  4246 raft_consensus.cc:2272] T a2ed8864f59448b2a69c2bcddd26a98d P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.707373  4246 tablet_replica.cc:333] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.708351  4246 raft_consensus.cc:2243] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.710076  4246 raft_consensus.cc:2272] T 1dca71eb8ab145ae99370ac00979d5e3 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.714224  4246 tablet_replica.cc:333] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.715337  4246 raft_consensus.cc:2243] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.716859  4246 raft_consensus.cc:2272] T c144f8c18cd84075a92d25a0250bb9e6 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.721022  4246 tablet_replica.cc:333] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.722563  4246 raft_consensus.cc:2243] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:45.723179 14194 consensus_peers.cc:597] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.723968  4246 raft_consensus.cc:2272] T 6d03691b876d4eeb969dcd24d00ddfa2 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.727423  4246 tablet_replica.cc:333] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.728399  4246 raft_consensus.cc:2243] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.729151  4246 raft_consensus.cc:2272] T 0d768389115849fca4a304f575143630 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.732833  4246 tablet_replica.cc:333] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.733839  4246 raft_consensus.cc:2243] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.734575  4246 raft_consensus.cc:2272] T 8b2459c85ae6463580c794485b524d70 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.738014  4246 tablet_replica.cc:333] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.739207  4246 raft_consensus.cc:2243] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.739890  4246 raft_consensus.cc:2272] T 70960d884ffe4de7a2aad3cf1a1c687e P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.742931  4246 tablet_replica.cc:333] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.743762  4246 raft_consensus.cc:2243] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.744417  4246 raft_consensus.cc:2272] T 43ffc24773ec4a9c9458d3cad9fc75ef P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.747449  4246 tablet_replica.cc:333] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.748186  4246 raft_consensus.cc:2243] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.749369  4246 raft_consensus.cc:2272] T 3208eb99cabe427fa25a3cf07cafc865 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.752491  4246 tablet_replica.cc:333] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.753342  4246 raft_consensus.cc:2243] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.753933  4246 raft_consensus.cc:2272] T b1f9248d01a9496b9d1574466dc66d43 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.757062  4246 tablet_replica.cc:333] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.757781  4246 raft_consensus.cc:2243] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.758736  4246 raft_consensus.cc:2272] T 86e0da4aaa5c4c88adc94081e83baaab P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.761592  4246 tablet_replica.cc:333] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.762240  4246 raft_consensus.cc:2243] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.762969  4246 raft_consensus.cc:2272] T bcbdfedd963a49c1b2da5553ac8ad00f P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.766484  4246 tablet_replica.cc:333] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.767204  4246 raft_consensus.cc:2243] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.767792  4246 raft_consensus.cc:2272] T 5c9c5f286ddb4582a67c471c4f1bdc67 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.771222  4246 tablet_replica.cc:333] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.772106  4246 raft_consensus.cc:2243] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.772814  4246 raft_consensus.cc:2272] T 111880dc525744b486e22a9921476257 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.776461  4246 tablet_replica.cc:333] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.777809  4246 raft_consensus.cc:2243] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:45.775368 14194 consensus_peers.cc:597] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.778774  4246 raft_consensus.cc:2272] T dba6d1f5edf24d9bb71332e66e60ff47 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.783373  4246 tablet_replica.cc:333] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.784499  4246 raft_consensus.cc:2243] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.785220  4246 raft_consensus.cc:2272] T 5b15bc48cf0e44b2aaaa1401be80044a P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.788645  4246 tablet_replica.cc:333] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.789582  4246 raft_consensus.cc:2243] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.790409  4246 raft_consensus.cc:2272] T fb7823eaa6f143459fa2134dfd0f6aa1 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.793640  4246 tablet_replica.cc:333] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.794449  4246 raft_consensus.cc:2243] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:20:45.795064 14268 consensus_peers.cc:597] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.795709  4246 raft_consensus.cc:2272] T 1c886c57f4374a5891c9aa1df562c6d2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.798344  4246 tablet_replica.cc:333] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.799077  4246 raft_consensus.cc:2243] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.800168  4246 raft_consensus.cc:2272] T c846d4120a61419aaa527e656bebee8f P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.803617  4246 tablet_replica.cc:333] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.804545  4246 raft_consensus.cc:2243] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.805231  4246 raft_consensus.cc:2272] T 31dabf2cb78a41b3b7df2e4915051150 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.805409 14268 consensus_peers.cc:597] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.808240  4246 tablet_replica.cc:333] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.808955  4246 raft_consensus.cc:2243] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.809551  4246 raft_consensus.cc:2272] T 1250eb4ed6ed42629983aaf3f1af0994 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.811977  4246 tablet_replica.cc:333] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.812695  4246 raft_consensus.cc:2243] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.813198  4246 raft_consensus.cc:2272] T cb22a4f3e09e401296389c126d11edc0 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.815519  4246 tablet_replica.cc:333] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.816155  4246 raft_consensus.cc:2243] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.816694  4246 raft_consensus.cc:2272] T a32ffa9a52c4465a98b4615f03092c27 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.819255  4246 tablet_replica.cc:333] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.820024  4246 raft_consensus.cc:2243] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.820565  4246 raft_consensus.cc:2272] T 96745973797345908d4d9937507add14 P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.822793 14268 consensus_peers.cc:597] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.823450  4246 tablet_replica.cc:333] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.824306  4246 raft_consensus.cc:2243] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.824810  4246 raft_consensus.cc:2272] T cfe3a7dffcb540448cbeba5e852c5d65 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.826303 14194 consensus_peers.cc:597] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.827718  4246 tablet_replica.cc:333] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.828441  4246 raft_consensus.cc:2243] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.828960  4246 raft_consensus.cc:2272] T d6eb8dec8f80469e908bba7053af18a1 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.829824 14267 consensus_peers.cc:597] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:45.831449  4246 tablet_replica.cc:333] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.832116  4246 raft_consensus.cc:2243] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.833032  4246 raft_consensus.cc:2272] T fad1a0487508442287b6c802b75bc409 P ce90f8e60d79487db7509ae191b95a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.835908  4246 tablet_replica.cc:333] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.836532  4246 raft_consensus.cc:2243] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.837199  4246 raft_consensus.cc:2272] T 120b27990187463c8945db388e219f76 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.840111  4246 tablet_replica.cc:333] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.840883  4246 raft_consensus.cc:2243] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.842141  4246 raft_consensus.cc:2272] T 5d56a931d31246a4b5592ae7bb17e3c4 P ce90f8e60d79487db7509ae191b95a16 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.843402 14268 consensus_peers.cc:597] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.844957  4246 tablet_replica.cc:333] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.845729  4246 raft_consensus.cc:2243] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:45.846225  4246 raft_consensus.cc:2272] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P ce90f8e60d79487db7509ae191b95a16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:45.849222  4246 tablet_replica.cc:333] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.849956  4246 raft_consensus.cc:2243] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.851150  4246 raft_consensus.cc:2272] T 3e7053b6fc124e37a58aab2689df06df P ce90f8e60d79487db7509ae191b95a16 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.852474 14268 consensus_peers.cc:597] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:45.853848  4246 tablet_replica.cc:333] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16: stopping tablet replica
I20260709 13:20:45.854604  4246 raft_consensus.cc:2243] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:20:45.855609  4246 raft_consensus.cc:2272] T 19c67d33181e414897d5de3731e98030 P ce90f8e60d79487db7509ae191b95a16 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:45.856860 14268 consensus_peers.cc:597] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.871434 14267 consensus_peers.cc:597] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:45.898977 14268 consensus_peers.cc:597] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.900051 14268 consensus_peers.cc:597] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.909623 14194 consensus_peers.cc:597] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.915527 14194 consensus_peers.cc:597] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.988039 14268 consensus_peers.cc:597] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:42769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:45.997671 14194 consensus_peers.cc:597] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:42769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.008322  4246 tablet_server.cc:196] TabletServer@127.4.37.130:0 shutdown complete.
W20260709 13:20:46.059058 14194 consensus_peers.cc:597] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:42769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.106752 14194 consensus_peers.cc:597] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:42769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.115093 14194 consensus_peers.cc:597] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:42769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.139168  4246 tablet_server.cc:179] TabletServer@127.4.37.131:0 shutting down...
W20260709 13:20:46.140113 14194 consensus_peers.cc:597] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 -> Peer ce90f8e60d79487db7509ae191b95a16 (127.4.37.130:42769): Couldn't send request to peer ce90f8e60d79487db7509ae191b95a16. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:42769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.141326 14267 consensus_peers.cc:597] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:46.146320 14267 consensus_peers.cc:597] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:46.148876 14267 consensus_peers.cc:597] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:46.183108 14266 consensus_peers.cc:597] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.199970 14266 consensus_peers.cc:597] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.223135 14266 consensus_peers.cc:597] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.240489  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:46.241704  4246 tablet_replica.cc:333] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.242800  4246 raft_consensus.cc:2243] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.243677  4246 raft_consensus.cc:2272] T 50a70b817b674bd197cdb804bcf25840 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.246145  4246 tablet_replica.cc:333] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.246750  4246 raft_consensus.cc:2243] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.247196  4246 raft_consensus.cc:2272] T 4be55c8ee09443479786b8bf51188b81 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.249292  4246 tablet_replica.cc:333] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.250280  4246 raft_consensus.cc:2243] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.250941  4246 raft_consensus.cc:2272] T a8f3cee515a2410aaf0a7767f0d6587e P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.253968  4246 tablet_replica.cc:333] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.254945  4246 raft_consensus.cc:2243] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.256354  4246 raft_consensus.cc:2272] T b06e3182ee5d4798b9145b000d822462 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:46.258765 14267 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:46.259948  4246 tablet_replica.cc:333] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.260819  4246 raft_consensus.cc:2243] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.261956  4246 raft_consensus.cc:2272] T a36d26da58624e63adb52d3539d9bf33 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.265170  4246 tablet_replica.cc:333] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.266104  4246 raft_consensus.cc:2243] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.266705  4246 raft_consensus.cc:2272] T e920394df0034e98ab19842b8206bbb5 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.270563  4246 tablet_replica.cc:333] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.271292  4246 raft_consensus.cc:2243] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.271915  4246 raft_consensus.cc:2272] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.274336  4246 tablet_replica.cc:333] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.274950  4246 raft_consensus.cc:2243] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.275442  4246 raft_consensus.cc:2272] T 9b85e799338444779dcc24b7b8ee9a1e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.278414  4246 tablet_replica.cc:333] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.279228  4246 raft_consensus.cc:2243] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.279816  4246 raft_consensus.cc:2272] T 81c21d80fe34435a9dc4b1435f136941 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:46.280284 14266 consensus_peers.cc:597] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.281940 14266 consensus_peers.cc:597] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.282718  4246 tablet_replica.cc:333] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.283376  4246 raft_consensus.cc:2243] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.283833  4246 raft_consensus.cc:2272] T 5a072b7409604f1eae201822e47a6088 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.286093  4246 tablet_replica.cc:333] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.286651  4246 raft_consensus.cc:2243] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.287084  4246 raft_consensus.cc:2272] T 0217d8525e174f758cfd48c0a04a7caf P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.289851  4246 tablet_replica.cc:333] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.290699  4246 raft_consensus.cc:2243] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.291474  4246 raft_consensus.cc:2272] T ef7edac8cddd4927a4d0c73332149e41 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.294616  4246 tablet_replica.cc:333] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.295317  4246 raft_consensus.cc:2243] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.295842  4246 raft_consensus.cc:2272] T 1dca71eb8ab145ae99370ac00979d5e3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.298207  4246 tablet_replica.cc:333] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.298858  4246 raft_consensus.cc:2243] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.299392  4246 raft_consensus.cc:2272] T f971376cf118457b9be1708b9bee92f5 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.301789  4246 tablet_replica.cc:333] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.302488  4246 raft_consensus.cc:2243] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.303496  4246 raft_consensus.cc:2272] T cb22a4f3e09e401296389c126d11edc0 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.305640  4246 tablet_replica.cc:333] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.306205  4246 raft_consensus.cc:2243] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.306654  4246 raft_consensus.cc:2272] T a32ffa9a52c4465a98b4615f03092c27 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.308764  4246 tablet_replica.cc:333] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.309270  4246 raft_consensus.cc:2243] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.309818  4246 raft_consensus.cc:2272] T 6d03691b876d4eeb969dcd24d00ddfa2 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.312270  4246 tablet_replica.cc:333] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.312912  4246 raft_consensus.cc:2243] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.314043  4246 raft_consensus.cc:2272] T 0d768389115849fca4a304f575143630 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.317027  4246 tablet_replica.cc:333] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.317847  4246 raft_consensus.cc:2243] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.318472  4246 raft_consensus.cc:2272] T d3c80f2afcca4b789590b8d372a3b3a5 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.321332  4246 tablet_replica.cc:333] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.322311  4246 raft_consensus.cc:2243] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.323462  4246 raft_consensus.cc:2272] T 70960d884ffe4de7a2aad3cf1a1c687e P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.326695  4246 tablet_replica.cc:333] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.327479  4246 raft_consensus.cc:2243] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:46.327548 14266 consensus_peers.cc:597] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.328634  4246 raft_consensus.cc:2272] T 43ffc24773ec4a9c9458d3cad9fc75ef P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.331653  4246 tablet_replica.cc:333] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.332442  4246 raft_consensus.cc:2243] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.332985  4246 raft_consensus.cc:2272] T 0138f6cda3ff43d2bce4723559454144 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.336319  4246 tablet_replica.cc:333] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.337128  4246 raft_consensus.cc:2243] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.337723  4246 raft_consensus.cc:2272] T 3208eb99cabe427fa25a3cf07cafc865 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.340111  4246 tablet_replica.cc:333] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.340705  4246 raft_consensus.cc:2243] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.341886  4246 raft_consensus.cc:2272] T a2ed8864f59448b2a69c2bcddd26a98d P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.344091  4246 tablet_replica.cc:333] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.344908  4246 raft_consensus.cc:2243] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.346017  4246 raft_consensus.cc:2272] T e82c5d7cc48d49fe8a64eafb263bc10a P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.348435  4246 tablet_replica.cc:333] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.349195  4246 raft_consensus.cc:2243] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.350274  4246 raft_consensus.cc:2272] T dba6d1f5edf24d9bb71332e66e60ff47 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.352336  4246 tablet_replica.cc:333] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.352952  4246 raft_consensus.cc:2243] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.353812  4246 raft_consensus.cc:2272] T 5b15bc48cf0e44b2aaaa1401be80044a P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.356356  4246 tablet_replica.cc:333] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.356942  4246 raft_consensus.cc:2243] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.358085  4246 raft_consensus.cc:2272] T bfe20916a56c44f6b30d4b2e7e7b3154 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.360666  4246 tablet_replica.cc:333] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.361188  4246 raft_consensus.cc:2243] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.362007  4246 raft_consensus.cc:2272] T fb7823eaa6f143459fa2134dfd0f6aa1 P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.364187  4246 tablet_replica.cc:333] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.364763  4246 raft_consensus.cc:2243] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.365278  4246 raft_consensus.cc:2272] T 1c886c57f4374a5891c9aa1df562c6d2 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.367798  4246 tablet_replica.cc:333] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.368495  4246 raft_consensus.cc:2243] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.369040  4246 raft_consensus.cc:2272] T c846d4120a61419aaa527e656bebee8f P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.371068  4246 tablet_replica.cc:333] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.371672  4246 raft_consensus.cc:2243] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.372154  4246 raft_consensus.cc:2272] T b1f9248d01a9496b9d1574466dc66d43 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.374488  4246 tablet_replica.cc:333] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.375156  4246 raft_consensus.cc:2243] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.375711  4246 raft_consensus.cc:2272] T c01be016235a423e80a9915aa6285945 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.378367  4246 tablet_replica.cc:333] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.379117  4246 raft_consensus.cc:2243] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.380249  4246 raft_consensus.cc:2272] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.383399  4246 tablet_replica.cc:333] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.384151  4246 raft_consensus.cc:2243] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.384774  4246 raft_consensus.cc:2272] T 98da3e79bd3a47369b2c6d41e0151470 P 86cbe005f1b04a3c99562111b01847e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.387743  4246 tablet_replica.cc:333] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
W20260709 13:20:46.388181 14266 consensus_peers.cc:597] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.388454  4246 raft_consensus.cc:2243] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.389106  4246 raft_consensus.cc:2272] T 86e0da4aaa5c4c88adc94081e83baaab P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.391978  4246 tablet_replica.cc:333] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.392637  4246 raft_consensus.cc:2243] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.393138  4246 raft_consensus.cc:2272] T d6eb8dec8f80469e908bba7053af18a1 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.396176  4246 tablet_replica.cc:333] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.396919  4246 raft_consensus.cc:2243] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.398079  4246 raft_consensus.cc:2272] T cfe3a7dffcb540448cbeba5e852c5d65 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.400571  4246 tablet_replica.cc:333] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.401177  4246 raft_consensus.cc:2243] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.401734  4246 raft_consensus.cc:2272] T 2412bd2aec3744b69d4fa16d6b96ed3d P 86cbe005f1b04a3c99562111b01847e8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.404129  4246 tablet_replica.cc:333] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.404584  4246 raft_consensus.cc:2243] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.405314  4246 raft_consensus.cc:2272] T 1250eb4ed6ed42629983aaf3f1af0994 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.407529  4246 tablet_replica.cc:333] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.408025  4246 raft_consensus.cc:2243] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.408797  4246 raft_consensus.cc:2272] T 54b6e843913d4557bdaf57a2c7a21aa3 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.410920  4246 tablet_replica.cc:333] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.411559  4246 raft_consensus.cc:2243] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.411981  4246 raft_consensus.cc:2272] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 86cbe005f1b04a3c99562111b01847e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.414436  4246 tablet_replica.cc:333] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.414951  4246 raft_consensus.cc:2243] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.415437  4246 raft_consensus.cc:2272] T fad1a0487508442287b6c802b75bc409 P 86cbe005f1b04a3c99562111b01847e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.418218  4246 tablet_replica.cc:333] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8: stopping tablet replica
I20260709 13:20:46.418767  4246 raft_consensus.cc:2243] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.419265  4246 raft_consensus.cc:2272] T 5d56a931d31246a4b5592ae7bb17e3c4 P 86cbe005f1b04a3c99562111b01847e8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:46.424770 14266 consensus_peers.cc:597] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.444571 14266 consensus_peers.cc:597] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.448141 14266 consensus_peers.cc:597] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.448835 14266 consensus_peers.cc:597] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.507004 14266 consensus_peers.cc:597] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.131:32995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.544103  4246 tablet_server.cc:196] TabletServer@127.4.37.131:0 shutdown complete.
W20260709 13:20:46.555554 14266 consensus_peers.cc:597] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.131:32995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.592749 14266 consensus_peers.cc:597] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.131:32995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.644649  4246 tablet_server.cc:179] TabletServer@127.4.37.132:0 shutting down...
W20260709 13:20:46.685739 14266 consensus_peers.cc:597] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d -> Peer 86cbe005f1b04a3c99562111b01847e8 (127.4.37.131:32995): Couldn't send request to peer 86cbe005f1b04a3c99562111b01847e8. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.131:32995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.695540 14267 consensus_peers.cc:597] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d -> Peer ff2956d2be4d4ef98fdc5dc75bceff81 (127.4.37.129:33687): Couldn't send request to peer ff2956d2be4d4ef98fdc5dc75bceff81. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:33687: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:46.714936  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:46.716120  4246 tablet_replica.cc:333] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.716929  4246 raft_consensus.cc:2243] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.718282  4246 raft_consensus.cc:2272] T 50a70b817b674bd197cdb804bcf25840 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.722038  4246 tablet_replica.cc:333] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.722824  4246 raft_consensus.cc:2243] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.724071  4246 raft_consensus.cc:2272] T 944276202aa94d11a0203aa2291a9692 P 4db315fd9fb94434a179b03f5b4c083d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.727312  4246 tablet_replica.cc:333] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.728075  4246 raft_consensus.cc:2243] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.729032  4246 raft_consensus.cc:2272] T a8f3cee515a2410aaf0a7767f0d6587e P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.731982  4246 tablet_replica.cc:333] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.732656  4246 raft_consensus.cc:2243] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.733327  4246 raft_consensus.cc:2272] T b06e3182ee5d4798b9145b000d822462 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.736435  4246 tablet_replica.cc:333] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.737156  4246 raft_consensus.cc:2243] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.737739  4246 raft_consensus.cc:2272] T fcd37714ddc243ad88669511b6e6b4d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.740018  4246 tablet_replica.cc:333] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.740728  4246 raft_consensus.cc:2243] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.741971  4246 raft_consensus.cc:2272] T c56ca0f27ffe4236ba41dc9e1e765cf4 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.744158  4246 tablet_replica.cc:333] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.744835  4246 raft_consensus.cc:2243] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.745318  4246 raft_consensus.cc:2272] T e920394df0034e98ab19842b8206bbb5 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.748484  4246 tablet_replica.cc:333] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.749410  4246 raft_consensus.cc:2243] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.750774  4246 raft_consensus.cc:2272] T 03bef24cb5de488fa1610fa18979e0bb P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.754101  4246 tablet_replica.cc:333] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.755014  4246 raft_consensus.cc:2243] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.756793  4246 raft_consensus.cc:2272] T 81c21d80fe34435a9dc4b1435f136941 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.760160  4246 tablet_replica.cc:333] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.761385  4246 raft_consensus.cc:2243] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.763588  4246 raft_consensus.cc:2272] T 0217d8525e174f758cfd48c0a04a7caf P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.768781  4246 tablet_replica.cc:333] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.769979  4246 raft_consensus.cc:2243] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.770620  4246 raft_consensus.cc:2272] T 40e2f1ef94db448c8f64eafba0ddb66a P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.773680  4246 tablet_replica.cc:333] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.774549  4246 raft_consensus.cc:2243] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.775189  4246 raft_consensus.cc:2272] T fad1a0487508442287b6c802b75bc409 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.778529  4246 tablet_replica.cc:333] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.779563  4246 raft_consensus.cc:2243] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.782197  4246 raft_consensus.cc:2272] T 120b27990187463c8945db388e219f76 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.787876  4246 tablet_replica.cc:333] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.788758  4246 raft_consensus.cc:2243] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.789943  4246 raft_consensus.cc:2272] T f971376cf118457b9be1708b9bee92f5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.792915  4246 tablet_replica.cc:333] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.793742  4246 raft_consensus.cc:2243] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.794303  4246 raft_consensus.cc:2272] T c144f8c18cd84075a92d25a0250bb9e6 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.797114  4246 tablet_replica.cc:333] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.797914  4246 raft_consensus.cc:2243] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.798496  4246 raft_consensus.cc:2272] T 1c886c57f4374a5891c9aa1df562c6d2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.801880  4246 tablet_replica.cc:333] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.803004  4246 raft_consensus.cc:2243] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.803783  4246 raft_consensus.cc:2272] T 6d03691b876d4eeb969dcd24d00ddfa2 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.808897  4246 tablet_replica.cc:333] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.809891  4246 raft_consensus.cc:2243] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.810542  4246 raft_consensus.cc:2272] T 0d768389115849fca4a304f575143630 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.813746  4246 tablet_replica.cc:333] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.814666  4246 raft_consensus.cc:2243] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.815987  4246 raft_consensus.cc:2272] T d3c80f2afcca4b789590b8d372a3b3a5 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.819403  4246 tablet_replica.cc:333] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.820415  4246 raft_consensus.cc:2243] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.821694  4246 raft_consensus.cc:2272] T 8b2459c85ae6463580c794485b524d70 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.826388  4246 tablet_replica.cc:333] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.827564  4246 raft_consensus.cc:2243] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.828550  4246 raft_consensus.cc:2272] T a2ed8864f59448b2a69c2bcddd26a98d P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.831861  4246 tablet_replica.cc:333] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.832692  4246 raft_consensus.cc:2243] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.833315  4246 raft_consensus.cc:2272] T e82c5d7cc48d49fe8a64eafb263bc10a P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.836295  4246 tablet_replica.cc:333] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.837097  4246 raft_consensus.cc:2243] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.837726  4246 raft_consensus.cc:2272] T 5b15bc48cf0e44b2aaaa1401be80044a P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.840718  4246 tablet_replica.cc:333] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.841532  4246 raft_consensus.cc:2243] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.842358  4246 raft_consensus.cc:2272] T 86e0da4aaa5c4c88adc94081e83baaab P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.844740  4246 tablet_replica.cc:333] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.845379  4246 raft_consensus.cc:2243] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.846272  4246 raft_consensus.cc:2272] T bcbdfedd963a49c1b2da5553ac8ad00f P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.848189  4246 tablet_replica.cc:333] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.848773  4246 raft_consensus.cc:2243] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.849678  4246 raft_consensus.cc:2272] T b1f9248d01a9496b9d1574466dc66d43 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.851866  4246 tablet_replica.cc:333] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.852489  4246 raft_consensus.cc:2243] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.853365  4246 raft_consensus.cc:2272] T c01be016235a423e80a9915aa6285945 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.855433  4246 tablet_replica.cc:333] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.856242  4246 raft_consensus.cc:2243] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.856827  4246 raft_consensus.cc:2272] T 19c67d33181e414897d5de3731e98030 P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.859292  4246 tablet_replica.cc:333] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.860128  4246 raft_consensus.cc:2243] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.860634  4246 raft_consensus.cc:2272] T 3e7053b6fc124e37a58aab2689df06df P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.863209  4246 tablet_replica.cc:333] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.864013  4246 raft_consensus.cc:2243] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.864581  4246 raft_consensus.cc:2272] T bfe20916a56c44f6b30d4b2e7e7b3154 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.866721  4246 tablet_replica.cc:333] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.867308  4246 raft_consensus.cc:2243] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.868674  4246 raft_consensus.cc:2272] T 0138f6cda3ff43d2bce4723559454144 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.871794  4246 tablet_replica.cc:333] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.872435  4246 raft_consensus.cc:2243] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.873288  4246 raft_consensus.cc:2272] T d6eb8dec8f80469e908bba7053af18a1 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.875852  4246 tablet_replica.cc:333] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.876618  4246 raft_consensus.cc:2243] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.877737  4246 raft_consensus.cc:2272] T bd3dbbe44a364ffb8dfefce3315273ad P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.880446  4246 tablet_replica.cc:333] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.881104  4246 raft_consensus.cc:2243] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.881723  4246 raft_consensus.cc:2272] T 54b6e843913d4557bdaf57a2c7a21aa3 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.884390  4246 tablet_replica.cc:333] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.885329  4246 raft_consensus.cc:2243] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.886816  4246 raft_consensus.cc:2272] T 5c75fd8dc7cb4bdcb2456a29de8392e2 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.890789  4246 tablet_replica.cc:333] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.891469  4246 raft_consensus.cc:2243] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.891999  4246 raft_consensus.cc:2272] T cb22a4f3e09e401296389c126d11edc0 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.894157  4246 tablet_replica.cc:333] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.894752  4246 raft_consensus.cc:2243] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.895568  4246 raft_consensus.cc:2272] T a32ffa9a52c4465a98b4615f03092c27 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.897748  4246 tablet_replica.cc:333] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.898294  4246 raft_consensus.cc:2243] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.899349  4246 raft_consensus.cc:2272] T 96745973797345908d4d9937507add14 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.901487  4246 tablet_replica.cc:333] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.902066  4246 raft_consensus.cc:2243] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.902860  4246 raft_consensus.cc:2272] T 111880dc525744b486e22a9921476257 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.905062  4246 tablet_replica.cc:333] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.905715  4246 raft_consensus.cc:2243] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:46.906183  4246 raft_consensus.cc:2272] T 5c9c5f286ddb4582a67c471c4f1bdc67 P 4db315fd9fb94434a179b03f5b4c083d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.908360  4246 tablet_replica.cc:333] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.909080  4246 raft_consensus.cc:2243] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.909996  4246 raft_consensus.cc:2272] T 98da3e79bd3a47369b2c6d41e0151470 P 4db315fd9fb94434a179b03f5b4c083d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.912076  4246 tablet_replica.cc:333] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.912652  4246 raft_consensus.cc:2243] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.913621  4246 raft_consensus.cc:2272] T 3c8bde50cec1487ab96a9bf5e86c8fd4 P 4db315fd9fb94434a179b03f5b4c083d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.916069  4246 tablet_replica.cc:333] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.916651  4246 raft_consensus.cc:2243] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.917685  4246 raft_consensus.cc:2272] T 2412bd2aec3744b69d4fa16d6b96ed3d P 4db315fd9fb94434a179b03f5b4c083d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:46.920495  4246 tablet_replica.cc:333] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d: stopping tablet replica
I20260709 13:20:46.921209  4246 raft_consensus.cc:2243] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:46.922262  4246 raft_consensus.cc:2272] T 31dabf2cb78a41b3b7df2e4915051150 P 4db315fd9fb94434a179b03f5b4c083d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.051496  4246 tablet_server.cc:196] TabletServer@127.4.37.132:0 shutdown complete.
I20260709 13:20:47.123680  4246 master.cc:562] Master@127.4.37.190:44771 shutting down...
I20260709 13:20:47.163411  4246 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:47.164259  4246 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:47.164639  4246 tablet_replica.cc:333] T 00000000000000000000000000000000 P f1c0fed8c36f41399952408dd461e2a7: stopping tablet replica
I20260709 13:20:47.191540  4246 master.cc:584] Master@127.4.37.190:44771 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (59037 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:20:47.299549  4246 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.37.190:43717
I20260709 13:20:47.300776  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:47.308957 15773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:47.309154 15774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:47.310369 15776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:47.311985  4246 server_base.cc:1061] running on GCE node
I20260709 13:20:47.313804  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:47.314002  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:47.314188  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603247314170 us; error 0 us; skew 500 ppm
I20260709 13:20:47.314778  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:47.317746  4246 webserver.cc:533] Webserver started at http://127.4.37.190:45373/ using document root <none> and password file <none>
I20260709 13:20:47.318270  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:47.318447  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:47.318706  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:47.319978  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/master-0-root/instance:
uuid: "f36aef8a61a34d0ba7cdd567df03ac44"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:47.326457  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:20:47.330498 15781 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.331535  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:20:47.332002  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/master-0-root
uuid: "f36aef8a61a34d0ba7cdd567df03ac44"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:47.332357  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:47.360286  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:47.361768  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:47.414103  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.190:43717
I20260709 13:20:47.414203 15832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.190:43717 every 8 connection(s)
I20260709 13:20:47.418954 15833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.432204 15833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44: Bootstrap starting.
I20260709 13:20:47.437848 15833 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:47.443533 15833 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44: No bootstrap required, opened a new log
I20260709 13:20:47.446403 15833 raft_consensus.cc:359] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36aef8a61a34d0ba7cdd567df03ac44" member_type: VOTER }
I20260709 13:20:47.447115 15833 raft_consensus.cc:385] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:47.447453 15833 raft_consensus.cc:740] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f36aef8a61a34d0ba7cdd567df03ac44, State: Initialized, Role: FOLLOWER
I20260709 13:20:47.448278 15833 consensus_queue.cc:260] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36aef8a61a34d0ba7cdd567df03ac44" member_type: VOTER }
I20260709 13:20:47.448836 15833 raft_consensus.cc:399] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:47.449100 15833 raft_consensus.cc:493] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:47.449468 15833 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:47.455123 15833 raft_consensus.cc:515] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36aef8a61a34d0ba7cdd567df03ac44" member_type: VOTER }
I20260709 13:20:47.455756 15833 leader_election.cc:304] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f36aef8a61a34d0ba7cdd567df03ac44; no voters: 
I20260709 13:20:47.457026 15833 leader_election.cc:290] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:47.457600 15836 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:47.459295 15836 raft_consensus.cc:697] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 1 LEADER]: Becoming Leader. State: Replica: f36aef8a61a34d0ba7cdd567df03ac44, State: Running, Role: LEADER
I20260709 13:20:47.460053 15836 consensus_queue.cc:237] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36aef8a61a34d0ba7cdd567df03ac44" member_type: VOTER }
I20260709 13:20:47.460376 15833 sys_catalog.cc:565] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:47.466266 15838 sys_catalog.cc:455] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f36aef8a61a34d0ba7cdd567df03ac44. Latest consensus state: current_term: 1 leader_uuid: "f36aef8a61a34d0ba7cdd567df03ac44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36aef8a61a34d0ba7cdd567df03ac44" member_type: VOTER } }
I20260709 13:20:47.466207 15837 sys_catalog.cc:455] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f36aef8a61a34d0ba7cdd567df03ac44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f36aef8a61a34d0ba7cdd567df03ac44" member_type: VOTER } }
I20260709 13:20:47.467077 15838 sys_catalog.cc:458] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:47.467206 15837 sys_catalog.cc:458] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:47.470597 15844 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:47.476137 15844 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:47.480911  4246 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:47.488906 15844 catalog_manager.cc:1383] Generated new cluster ID: e958565c97044fa1a866723838535b6c
I20260709 13:20:47.489475 15844 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:47.522231 15844 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:47.523588 15844 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:47.542028 15844 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44: Generated new TSK 0
I20260709 13:20:47.542876 15844 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:47.549795  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:47.556913 15854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:47.557886 15855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:47.559371 15857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:47.561287  4246 server_base.cc:1061] running on GCE node
I20260709 13:20:47.563297  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:47.563539  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:47.563661  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603247563648 us; error 0 us; skew 500 ppm
I20260709 13:20:47.564185  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:47.566957  4246 webserver.cc:533] Webserver started at http://127.4.37.129:37843/ using document root <none> and password file <none>
I20260709 13:20:47.567457  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:47.567633  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:47.567883  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:47.569092  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root/instance:
uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:47.574853  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:20:47.578850 15862 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.579978  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:20:47.580466  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:47.580896  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:47.600518  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:47.601917  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:47.603475  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:47.606499  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:47.606801  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.607097  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:47.607312  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.660972  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:38415
I20260709 13:20:47.661073 15924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:38415 every 8 connection(s)
I20260709 13:20:47.669175  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:47.680190 15929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:47.682579 15930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:47.689353 15932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:47.690385  4246 server_base.cc:1061] running on GCE node
I20260709 13:20:47.690850 15925 heartbeater.cc:344] Connected to a master server at 127.4.37.190:43717
I20260709 13:20:47.691306 15925 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:47.692090  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:47.692335  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:47.692240 15925 heartbeater.cc:507] Master 127.4.37.190:43717 requested a full tablet report, sending...
I20260709 13:20:47.692716  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603247692676 us; error 0 us; skew 500 ppm
I20260709 13:20:47.693816  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:47.695317 15798 ts_manager.cc:194] Registered new tserver with Master: 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415)
I20260709 13:20:47.696638  4246 webserver.cc:533] Webserver started at http://127.4.37.130:38521/ using document root <none> and password file <none>
I20260709 13:20:47.697248  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:47.697517  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:47.697832  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:47.698124 15798 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48076
I20260709 13:20:47.699715  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-1-root/instance:
uuid: "069b53329b674338a0ac50c8d7dd32ab"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:47.706696  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:20:47.711794 15937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.713021  4246 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:20:47.713411  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-1-root
uuid: "069b53329b674338a0ac50c8d7dd32ab"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:47.713871  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:47.727092  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:47.729123  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:47.731130  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:47.733752  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:47.734020  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.734272  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:47.734450  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.792500  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.130:33927
I20260709 13:20:47.792609 15999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.130:33927 every 8 connection(s)
I20260709 13:20:47.797814  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:47.807684 16003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:47.810693 16004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:47.816208 16000 heartbeater.cc:344] Connected to a master server at 127.4.37.190:43717
I20260709 13:20:47.816697 16000 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:47.817667 16000 heartbeater.cc:507] Master 127.4.37.190:43717 requested a full tablet report, sending...
I20260709 13:20:47.820438 15798 ts_manager.cc:194] Registered new tserver with Master: 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:47.820750  4246 server_base.cc:1061] running on GCE node
W20260709 13:20:47.821100 16007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:47.822537  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:47.822794  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:47.823024  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603247823004 us; error 0 us; skew 500 ppm
I20260709 13:20:47.823062 15798 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48084
I20260709 13:20:47.823745  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:47.827281  4246 webserver.cc:533] Webserver started at http://127.4.37.131:38095/ using document root <none> and password file <none>
I20260709 13:20:47.827877  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:47.828090  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:47.828406  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:47.829818  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-2-root/instance:
uuid: "616fa025246b4022b5d2a596ed64e042"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:47.834954  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:47.838697 16011 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.839751  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:20:47.840276  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-2-root
uuid: "616fa025246b4022b5d2a596ed64e042"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:47.840588  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:47.856851  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:47.858289  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:47.859925  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:47.862534  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:47.862757  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.863128  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:47.863265  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:47.912974  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.131:40031
I20260709 13:20:47.913115 16073 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.131:40031 every 8 connection(s)
I20260709 13:20:47.931717 16074 heartbeater.cc:344] Connected to a master server at 127.4.37.190:43717
I20260709 13:20:47.932265 16074 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:47.933065 16074 heartbeater.cc:507] Master 127.4.37.190:43717 requested a full tablet report, sending...
I20260709 13:20:47.935410 15798 ts_manager.cc:194] Registered new tserver with Master: 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:47.936333  4246 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020001747s
I20260709 13:20:47.937073 15798 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48088
I20260709 13:20:47.967706 15798 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48102:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:47.971629 15798 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:48.071666 15965 tablet_service.cc:1511] Processing CreateTablet for tablet c02a481e00d1499a956b2dc0c3d610cc (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:48.072418 15963 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2b182cc4ac4585b1661a8bbfc06007 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:48.073297 15965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02a481e00d1499a956b2dc0c3d610cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.074039 15963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2b182cc4ac4585b1661a8bbfc06007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.075505 15964 tablet_service.cc:1511] Processing CreateTablet for tablet 019dd5c4cdd74e1184e1f47b27e4d8a7 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:48.076997 15964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019dd5c4cdd74e1184e1f47b27e4d8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.083706 16039 tablet_service.cc:1511] Processing CreateTablet for tablet c02a481e00d1499a956b2dc0c3d610cc (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:48.085044 15890 tablet_service.cc:1511] Processing CreateTablet for tablet c02a481e00d1499a956b2dc0c3d610cc (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:48.085795 16039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02a481e00d1499a956b2dc0c3d610cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.087112 15890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02a481e00d1499a956b2dc0c3d610cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.090888 16038 tablet_service.cc:1511] Processing CreateTablet for tablet 019dd5c4cdd74e1184e1f47b27e4d8a7 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:48.092465 16038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019dd5c4cdd74e1184e1f47b27e4d8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.096760 15889 tablet_service.cc:1511] Processing CreateTablet for tablet 019dd5c4cdd74e1184e1f47b27e4d8a7 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:48.098354 15889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019dd5c4cdd74e1184e1f47b27e4d8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.111001 15888 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2b182cc4ac4585b1661a8bbfc06007 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:48.112639 15888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2b182cc4ac4585b1661a8bbfc06007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.111032 16089 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:48.122991 16037 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2b182cc4ac4585b1661a8bbfc06007 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:48.124608 16037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2b182cc4ac4585b1661a8bbfc06007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.136178 15887 tablet_service.cc:1511] Processing CreateTablet for tablet 385784a6bc654afd91c6702337db1344 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:48.137831 15887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385784a6bc654afd91c6702337db1344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.143291 15964 tablet_service.cc:1511] Processing CreateTablet for tablet 385784a6bc654afd91c6702337db1344 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:48.144335 15886 tablet_service.cc:1511] Processing CreateTablet for tablet e7a9d3c73f7f4c44bd74ce1169af7274 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:48.145366 15964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385784a6bc654afd91c6702337db1344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.145999 15886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a9d3c73f7f4c44bd74ce1169af7274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.149334 15963 tablet_service.cc:1511] Processing CreateTablet for tablet e7a9d3c73f7f4c44bd74ce1169af7274 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:48.150290 16036 tablet_service.cc:1511] Processing CreateTablet for tablet 385784a6bc654afd91c6702337db1344 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:48.151620 15963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a9d3c73f7f4c44bd74ce1169af7274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.151815 16036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385784a6bc654afd91c6702337db1344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.152509 16035 tablet_service.cc:1511] Processing CreateTablet for tablet e7a9d3c73f7f4c44bd74ce1169af7274 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:48.154013 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a9d3c73f7f4c44bd74ce1169af7274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.176733 16089 tablet_bootstrap.cc:654] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.179939 15885 tablet_service.cc:1511] Processing CreateTablet for tablet 1839e6ef03cc42ceae174cf8ee6c1240 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:48.181911 15885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1839e6ef03cc42ceae174cf8ee6c1240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.186525 15965 tablet_service.cc:1511] Processing CreateTablet for tablet 1839e6ef03cc42ceae174cf8ee6c1240 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:48.188134 15965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1839e6ef03cc42ceae174cf8ee6c1240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.189229 16038 tablet_service.cc:1511] Processing CreateTablet for tablet 1839e6ef03cc42ceae174cf8ee6c1240 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:48.192605 16038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1839e6ef03cc42ceae174cf8ee6c1240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.229918 16090 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.230114 15888 tablet_service.cc:1511] Processing CreateTablet for tablet 5c31d43899ac479c9bb445a6410082bb (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:48.231760 15888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c31d43899ac479c9bb445a6410082bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.232349 16091 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.243673 16090 tablet_bootstrap.cc:654] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.244870 16089 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:48.245838 16089 ts_tablet_manager.cc:1403] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.007s
I20260709 13:20:48.247329 16091 tablet_bootstrap.cc:654] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.246789 15964 tablet_service.cc:1511] Processing CreateTablet for tablet 5c31d43899ac479c9bb445a6410082bb (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:48.248720 15964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c31d43899ac479c9bb445a6410082bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.265106 16090 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:48.264230 16089 raft_consensus.cc:359] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.265758 16090 ts_tablet_manager.cc:1403] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.003s
I20260709 13:20:48.265920 16089 raft_consensus.cc:385] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.268971 16091 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.269622 16091 ts_tablet_manager.cc:1403] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.006s
I20260709 13:20:48.270135 16090 raft_consensus.cc:359] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.270969 16038 tablet_service.cc:1511] Processing CreateTablet for tablet 5c31d43899ac479c9bb445a6410082bb (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:48.272421 16038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c31d43899ac479c9bb445a6410082bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.272794 16091 raft_consensus.cc:359] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.273602 16091 raft_consensus.cc:385] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.273928 16091 raft_consensus.cc:740] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.274888 16091 consensus_queue.cc:260] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.275385 15888 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90c36d25a045bdb39f490500ff9512 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:48.277671 15888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90c36d25a045bdb39f490500ff9512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.270977 16090 raft_consensus.cc:385] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.286134 16090 raft_consensus.cc:740] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.287029 15965 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90c36d25a045bdb39f490500ff9512 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:48.287878 16090 consensus_queue.cc:260] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.289319 15965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90c36d25a045bdb39f490500ff9512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.285523 16089 raft_consensus.cc:740] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.293188 16089 consensus_queue.cc:260] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.298791 16035 tablet_service.cc:1511] Processing CreateTablet for tablet 7b90c36d25a045bdb39f490500ff9512 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:48.300907 16035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b90c36d25a045bdb39f490500ff9512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.310364 15885 tablet_service.cc:1511] Processing CreateTablet for tablet 7b47783d71eb44df81b2322d8f5b32f0 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:48.311909 15885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b47783d71eb44df81b2322d8f5b32f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.313032 15964 tablet_service.cc:1511] Processing CreateTablet for tablet 7b47783d71eb44df81b2322d8f5b32f0 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:48.314468 15964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b47783d71eb44df81b2322d8f5b32f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.315316 16036 tablet_service.cc:1511] Processing CreateTablet for tablet 7b47783d71eb44df81b2322d8f5b32f0 (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:48.316769 16036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b47783d71eb44df81b2322d8f5b32f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.317919 15925 heartbeater.cc:499] Master 127.4.37.190:43717 was elected leader, sending a full tablet report...
I20260709 13:20:48.329804 16090 ts_tablet_manager.cc:1434] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.006s
I20260709 13:20:48.330729 16074 heartbeater.cc:499] Master 127.4.37.190:43717 was elected leader, sending a full tablet report...
I20260709 13:20:48.331097 16090 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.333191 15887 tablet_service.cc:1511] Processing CreateTablet for tablet c1b2fbd7292c4f969b00378057d957ff (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:48.335436 15887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b2fbd7292c4f969b00378057d957ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.338315 16090 tablet_bootstrap.cc:654] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.324806 16091 ts_tablet_manager.cc:1434] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.055s	user 0.028s	sys 0.011s
I20260709 13:20:48.346338 16091 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.355618 16089 ts_tablet_manager.cc:1434] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.109s	user 0.027s	sys 0.012s
I20260709 13:20:48.363155 16000 heartbeater.cc:499] Master 127.4.37.190:43717 was elected leader, sending a full tablet report...
I20260709 13:20:48.365119 16091 tablet_bootstrap.cc:654] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.368265 16089 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:48.392338 16090 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:48.397356 16089 tablet_bootstrap.cc:654] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.397897 16090 ts_tablet_manager.cc:1403] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.005s
I20260709 13:20:48.401589 15964 tablet_service.cc:1511] Processing CreateTablet for tablet c1b2fbd7292c4f969b00378057d957ff (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:48.405558 15964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b2fbd7292c4f969b00378057d957ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.407032 16038 tablet_service.cc:1511] Processing CreateTablet for tablet c1b2fbd7292c4f969b00378057d957ff (DEFAULT_TABLE table=test-workload [id=2d25991527be430697728ffdaabb9403]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:48.409088 16038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b2fbd7292c4f969b00378057d957ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:48.411237 16091 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.411991 16091 ts_tablet_manager.cc:1403] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.008s
I20260709 13:20:48.414045 16090 raft_consensus.cc:359] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.414960 16090 raft_consensus.cc:385] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.415287 16090 raft_consensus.cc:740] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.415987 16091 raft_consensus.cc:359] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.416136 16090 consensus_queue.cc:260] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
W20260709 13:20:48.417398 16075 tablet.cc:2406] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:48.421977 16090 ts_tablet_manager.cc:1434] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:20:48.423388 16090 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.417106 16091 raft_consensus.cc:385] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.425976 16091 raft_consensus.cc:740] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.426887 16091 consensus_queue.cc:260] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.439409 16091 ts_tablet_manager.cc:1434] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.006s
I20260709 13:20:48.444191 16090 tablet_bootstrap.cc:654] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.445061 16091 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.455783 16091 tablet_bootstrap.cc:654] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.456709 16090 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:48.464066 16090 ts_tablet_manager.cc:1403] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.005s
I20260709 13:20:48.465241 16089 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:48.465916 16089 ts_tablet_manager.cc:1403] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.098s	user 0.029s	sys 0.019s
I20260709 13:20:48.467440 16090 raft_consensus.cc:359] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.468561 16090 raft_consensus.cc:385] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.468482 16089 raft_consensus.cc:359] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.469480 16090 raft_consensus.cc:740] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.469669 16089 raft_consensus.cc:385] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.470134 16089 raft_consensus.cc:740] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.470705 16090 consensus_queue.cc:260] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.471006 16089 consensus_queue.cc:260] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.471894 16091 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.472450 16091 ts_tablet_manager.cc:1403] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.001s
I20260709 13:20:48.473727 16090 ts_tablet_manager.cc:1434] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
W20260709 13:20:48.475270 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:48.475317 16090 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.475685 16089 ts_tablet_manager.cc:1434] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:48.479070 16091 raft_consensus.cc:359] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.479697 16089 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:48.479988 16091 raft_consensus.cc:385] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.480355 16091 raft_consensus.cc:740] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.481292 16091 consensus_queue.cc:260] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.483843 16091 ts_tablet_manager.cc:1434] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:20:48.484970 16091 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.489763 16090 tablet_bootstrap.cc:654] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.492728 16089 tablet_bootstrap.cc:654] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.494102 16091 tablet_bootstrap.cc:654] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.505966 16090 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:48.506639 16090 ts_tablet_manager.cc:1403] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.009s
I20260709 13:20:48.507194 16091 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.507997 16091 ts_tablet_manager.cc:1403] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:20:48.510684 16090 raft_consensus.cc:359] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.511385 16090 raft_consensus.cc:385] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.511706 16090 raft_consensus.cc:740] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.512554 16090 consensus_queue.cc:260] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.512826 16091 raft_consensus.cc:359] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.513659 16091 raft_consensus.cc:385] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.513983 16091 raft_consensus.cc:740] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.514339 16089 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:48.514895 16089 ts_tablet_manager.cc:1403] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.008s
I20260709 13:20:48.514766 16091 consensus_queue.cc:260] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.515908 16097 raft_consensus.cc:493] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.516395 16097 raft_consensus.cc:515] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.516825 16090 ts_tablet_manager.cc:1434] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:20:48.518049 16090 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.519284 16091 ts_tablet_manager.cc:1434] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 13:20:48.520538 16091 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.522064 16097 leader_election.cc:290] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:48.529208 16091 tablet_bootstrap.cc:654] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.527334 16090 tablet_bootstrap.cc:654] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.533636 16089 raft_consensus.cc:359] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.540032 16089 raft_consensus.cc:385] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.546912 16089 raft_consensus.cc:740] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.547767 16089 consensus_queue.cc:260] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.561870 16090 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:48.562721 16090 ts_tablet_manager.cc:1403] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.009s
I20260709 13:20:48.564687 16089 ts_tablet_manager.cc:1434] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 13:20:48.566624 16090 raft_consensus.cc:359] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.567569 16090 raft_consensus.cc:385] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.567873 16090 raft_consensus.cc:740] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.569483 16090 consensus_queue.cc:260] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.571913 16090 ts_tablet_manager.cc:1434] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:20:48.573067 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385784a6bc654afd91c6702337db1344" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:48.573997 15900 raft_consensus.cc:2468] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 0.
I20260709 13:20:48.575914 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385784a6bc654afd91c6702337db1344" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:48.577186 16012 leader_election.cc:304] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 
W20260709 13:20:48.578085 16013 leader_election.cc:343] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.578228 16097 raft_consensus.cc:2804] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.578483 16091 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.578724 16097 raft_consensus.cc:493] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.579182 16091 ts_tablet_manager.cc:1403] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.023s
I20260709 13:20:48.579221 16097 raft_consensus.cc:3060] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.579821 16090 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.583326 16091 raft_consensus.cc:359] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.584308 16091 raft_consensus.cc:385] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.585152 16091 raft_consensus.cc:740] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.586685 16091 consensus_queue.cc:260] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.589336 16091 ts_tablet_manager.cc:1434] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:20:48.590328 16090 tablet_bootstrap.cc:654] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.590552 16091 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.591779 16089 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:48.599761 16089 tablet_bootstrap.cc:654] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.600101 16091 tablet_bootstrap.cc:654] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.601914 16097 raft_consensus.cc:515] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.606356 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385784a6bc654afd91c6702337db1344" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:48.607079 16097 leader_election.cc:290] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:48.607136 15900 raft_consensus.cc:3060] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.608441 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385784a6bc654afd91c6702337db1344" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
W20260709 13:20:48.611222 16013 leader_election.cc:343] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.612867 16090 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:48.613561 16090 ts_tablet_manager.cc:1403] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.007s
I20260709 13:20:48.615115 16091 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.615943 16091 ts_tablet_manager.cc:1403] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.015s
I20260709 13:20:48.618395 15900 raft_consensus.cc:2468] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:48.618054 16090 raft_consensus.cc:359] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.619441 16090 raft_consensus.cc:385] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.619328 16091 raft_consensus.cc:359] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.620057 16090 raft_consensus.cc:740] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.620373 16091 raft_consensus.cc:385] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.620154 16012 leader_election.cc:304] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:48.621282 16090 consensus_queue.cc:260] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.621109 16091 raft_consensus.cc:740] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.622431 16097 raft_consensus.cc:2804] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.624176 16091 consensus_queue.cc:260] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.632714 16091 ts_tablet_manager.cc:1434] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:20:48.632889 16089 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:48.634708 16091 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.636340 16089 ts_tablet_manager.cc:1403] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.017s
I20260709 13:20:48.635154 16097 raft_consensus.cc:697] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:48.641465 16089 raft_consensus.cc:359] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.642980 16089 raft_consensus.cc:385] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.643441 16089 raft_consensus.cc:740] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.641768 16097 consensus_queue.cc:237] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.644656 16090 ts_tablet_manager.cc:1434] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 13:20:48.646243 16090 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.646517 16113 raft_consensus.cc:493] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.647020 16113 raft_consensus.cc:515] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.648327 16089 consensus_queue.cc:260] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.651312 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02a481e00d1499a956b2dc0c3d610cc" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:48.652191 16089 ts_tablet_manager.cc:1434] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:20:48.652215 15975 raft_consensus.cc:2468] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 0.
I20260709 13:20:48.654126 16013 leader_election.cc:304] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:48.655038 16114 raft_consensus.cc:2804] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.655241 16090 tablet_bootstrap.cc:654] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.655544 16114 raft_consensus.cc:493] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.656031 16114 raft_consensus.cc:3060] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.656526 16113 leader_election.cc:290] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927), 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415)
I20260709 13:20:48.657075 16091 tablet_bootstrap.cc:654] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.656801 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02a481e00d1499a956b2dc0c3d610cc" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:48.658079 15900 raft_consensus.cc:2468] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 0.
I20260709 13:20:48.663015 15796 catalog_manager.cc:5697] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.664005 16096 raft_consensus.cc:493] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.672281 16096 raft_consensus.cc:515] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.675693 16096 leader_election.cc:290] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:48.667132 16089 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:48.669847 16095 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.679486 16095 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.692819 16114 raft_consensus.cc:515] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.696671 16114 leader_election.cc:290] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Requested vote from peers 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927), 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415)
I20260709 13:20:48.697324 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02a481e00d1499a956b2dc0c3d610cc" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:48.698087 15975 raft_consensus.cc:3060] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.699757 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02a481e00d1499a956b2dc0c3d610cc" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:48.700774 15900 raft_consensus.cc:3060] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.698815 16095 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:48.716216 16089 tablet_bootstrap.cc:654] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.719580 15974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:48.720661 15974 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 0.
I20260709 13:20:48.723572 16090 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:48.724997 16090 ts_tablet_manager.cc:1403] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.079s	user 0.024s	sys 0.012s
I20260709 13:20:48.724921 15864 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:48.727319 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a9d3c73f7f4c44bd74ce1169af7274" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:48.728338 16049 raft_consensus.cc:2468] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 0.
I20260709 13:20:48.728840 15900 raft_consensus.cc:2468] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:48.729607 16095 raft_consensus.cc:2804] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.730648 15940 leader_election.cc:304] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:48.732050 16096 raft_consensus.cc:2804] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.731901 16012 leader_election.cc:304] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:48.732693 16096 raft_consensus.cc:493] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.730068 16095 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.737145 16114 raft_consensus.cc:2804] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.742534 15975 raft_consensus.cc:2468] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:48.743678 16114 raft_consensus.cc:697] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:48.737625 16095 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.733148 16096 raft_consensus.cc:3060] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.745625 16114 consensus_queue.cc:237] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:48.748714 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a9d3c73f7f4c44bd74ce1169af7274" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:48.749624 15900 raft_consensus.cc:2468] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 0.
I20260709 13:20:48.754714 16091 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.755434 16091 ts_tablet_manager.cc:1403] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.122s	user 0.035s	sys 0.008s
I20260709 13:20:48.756628 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:48.757472 16049 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 0.
I20260709 13:20:48.757704 16126 raft_consensus.cc:493] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.758309 16126 raft_consensus.cc:515] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.758901 16090 raft_consensus.cc:359] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.759222 16091 raft_consensus.cc:359] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.760121 16091 raft_consensus.cc:385] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.759750 16090 raft_consensus.cc:385] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.761157 16090 raft_consensus.cc:740] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.763561 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:48.760505 16091 raft_consensus.cc:740] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.763862 16096 raft_consensus.cc:515] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.765268 16091 consensus_queue.cc:260] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
W20260709 13:20:48.765837 15864 leader_election.cc:343] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.766069 16126 leader_election.cc:290] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:48.765856 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:48.767670 16095 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.768463 16049 raft_consensus.cc:2468] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 0.
I20260709 13:20:48.768635 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a9d3c73f7f4c44bd74ce1169af7274" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:48.769667 16048 raft_consensus.cc:3060] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.769790 16097 raft_consensus.cc:493] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.770380 16097 raft_consensus.cc:515] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.771178 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a9d3c73f7f4c44bd74ce1169af7274" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:48.772094 15900 raft_consensus.cc:3060] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.772603 16097 leader_election.cc:290] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:48.774595 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b182cc4ac4585b1661a8bbfc06007" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:48.775302 16091 ts_tablet_manager.cc:1434] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:20:48.775378 15975 raft_consensus.cc:2468] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 0.
I20260709 13:20:48.777046 16013 leader_election.cc:304] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:48.778034 16097 raft_consensus.cc:2804] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.778435 16097 raft_consensus.cc:493] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.778815 16097 raft_consensus.cc:3060] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.778596 16048 raft_consensus.cc:2468] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 1.
I20260709 13:20:48.780447 15899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b182cc4ac4585b1661a8bbfc06007" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:48.781358 15899 raft_consensus.cc:2468] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 0.
I20260709 13:20:48.781527 15940 leader_election.cc:304] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:48.782115 16095 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 election: Requested vote from peers 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:48.785565 16091 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.784162 15865 leader_election.cc:304] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:48.789403 16095 raft_consensus.cc:2804] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.789404 16096 leader_election.cc:290] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:48.790086 16095 raft_consensus.cc:493] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.790526 16095 raft_consensus.cc:3060] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.790663 16096 raft_consensus.cc:2804] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.791664 16096 raft_consensus.cc:697] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:48.784173 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:48.792505 16096 consensus_queue.cc:237] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.792310 15900 raft_consensus.cc:2468] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 1.
I20260709 13:20:48.788471 16089 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:48.808382 16089 ts_tablet_manager.cc:1403] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.142s	user 0.013s	sys 0.012s
I20260709 13:20:48.792649 15975 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.812520 16089 raft_consensus.cc:359] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.813791 16089 raft_consensus.cc:385] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.814203 16089 raft_consensus.cc:740] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.815124 16089 consensus_queue.cc:260] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.799340 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:48.817833 16048 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.818017 16089 ts_tablet_manager.cc:1434] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:48.796310 16090 consensus_queue.cc:260] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.792357 16097 raft_consensus.cc:515] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.819810 16089 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:48.822636 16097 leader_election.cc:290] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:48.804714 16091 tablet_bootstrap.cc:654] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.816366 15795 catalog_manager.cc:5697] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 1 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.828696 16089 tablet_bootstrap.cc:654] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.823447 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b182cc4ac4585b1661a8bbfc06007" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:48.838097 15900 raft_consensus.cc:3060] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.838424 16090 ts_tablet_manager.cc:1434] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.007s
I20260709 13:20:48.839564 16090 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.853263 16126 raft_consensus.cc:493] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.849905 16090 tablet_bootstrap.cc:654] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.824615 15974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b182cc4ac4585b1661a8bbfc06007" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:48.863019 16126 raft_consensus.cc:515] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.822886 15796 catalog_manager.cc:5697] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.863960 15974 raft_consensus.cc:3060] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.866609 15973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
W20260709 13:20:48.868562 15864 leader_election.cc:343] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.871050 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:48.836241 15975 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 1.
I20260709 13:20:48.872013 16049 raft_consensus.cc:2468] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 0.
I20260709 13:20:48.873569 15865 leader_election.cc:304] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:48.874841 16130 raft_consensus.cc:2804] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:48.875289 16130 raft_consensus.cc:493] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.875605 16130 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.877012 15974 raft_consensus.cc:2468] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:48.878504 16013 leader_election.cc:304] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:48.879528 16097 raft_consensus.cc:2804] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.880064 16097 raft_consensus.cc:697] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:48.880970 16097 consensus_queue.cc:237] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.881794 15864 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:48.882053 16048 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 1.
I20260709 13:20:48.885474 16091 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.886147 16091 ts_tablet_manager.cc:1403] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.004s
I20260709 13:20:48.891005 16126 leader_election.cc:290] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:48.892235 16126 raft_consensus.cc:2804] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.892752 16126 raft_consensus.cc:697] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 LEADER]: Becoming Leader. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Running, Role: LEADER
I20260709 13:20:48.893059 16090 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:48.894547 16089 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:48.894528 16095 raft_consensus.cc:515] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.895543 16089 ts_tablet_manager.cc:1403] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.076s	user 0.045s	sys 0.018s
I20260709 13:20:48.897563 16095 leader_election.cc:290] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 election: Requested vote from peers 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:48.890579 16091 raft_consensus.cc:359] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.898237 16091 raft_consensus.cc:385] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.898593 16091 raft_consensus.cc:740] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.898965 16089 raft_consensus.cc:359] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.899395 16091 consensus_queue.cc:260] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.899521 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:48.899919 16089 raft_consensus.cc:385] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.900911 16089 raft_consensus.cc:740] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.901819 16048 raft_consensus.cc:3060] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.902482 16089 consensus_queue.cc:260] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.903908 15900 raft_consensus.cc:2468] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:48.905589 16089 ts_tablet_manager.cc:1434] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:20:48.889092 16130 raft_consensus.cc:515] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.906966 16089 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:48.908718 16130 leader_election.cc:290] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 election: Requested vote from peers 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:48.910557 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:48.912863 16049 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.916426 15974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:48.917186 15974 raft_consensus.cc:3060] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:48.923426 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:48.923933 16089 tablet_bootstrap.cc:654] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:48.930781 15864 leader_election.cc:343] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:48.933027 15974 raft_consensus.cc:2468] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 1.
I20260709 13:20:48.934700 15864 leader_election.cc:304] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:48.896522 16090 ts_tablet_manager.cc:1403] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.001s
I20260709 13:20:48.935758 16130 raft_consensus.cc:2804] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.936357 16130 raft_consensus.cc:697] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 LEADER]: Becoming Leader. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Running, Role: LEADER
I20260709 13:20:48.936971 16091 ts_tablet_manager.cc:1434] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.050s	user 0.019s	sys 0.012s
I20260709 13:20:48.937302 16130 consensus_queue.cc:237] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.938261 16091 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.938426 16049 raft_consensus.cc:2468] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 1.
I20260709 13:20:48.939003 16089 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:48.939929 16089 ts_tablet_manager.cc:1403] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.004s
I20260709 13:20:48.939826 15865 leader_election.cc:304] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:48.896504 16126 consensus_queue.cc:237] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.943953 16089 raft_consensus.cc:359] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.944862 16089 raft_consensus.cc:385] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.945199 16089 raft_consensus.cc:740] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.946141 16091 tablet_bootstrap.cc:654] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.946208 16089 consensus_queue.cc:260] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.947372 16138 raft_consensus.cc:2804] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:48.948511 16138 raft_consensus.cc:697] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 LEADER]: Becoming Leader. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Running, Role: LEADER
I20260709 13:20:48.950251 16138 consensus_queue.cc:237] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.953702 16089 ts_tablet_manager.cc:1434] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:20:48.955324 16089 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:48.955947 16090 raft_consensus.cc:359] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.956772 16090 raft_consensus.cc:385] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.957054 16090 raft_consensus.cc:740] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.960131 16091 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:48.960807 16091 ts_tablet_manager.cc:1403] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 13:20:48.962787 16048 raft_consensus.cc:2468] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in term 1.
I20260709 13:20:48.963156 16089 tablet_bootstrap.cc:654] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.964605 16091 raft_consensus.cc:359] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.968104 16091 raft_consensus.cc:385] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:48.967574 15796 catalog_manager.cc:5697] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.965080 16090 consensus_queue.cc:260] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.968650 16091 raft_consensus.cc:740] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:48.971956 16091 consensus_queue.cc:260] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:48.975239 16090 ts_tablet_manager.cc:1434] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.003s
I20260709 13:20:48.977337 16090 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:48.978127 15797 catalog_manager.cc:5697] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.981348 16091 ts_tablet_manager.cc:1434] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:20:48.982479 16091 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:48.987120 16090 tablet_bootstrap.cc:654] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:48.988915 16091 tablet_bootstrap.cc:654] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.007261 16096 raft_consensus.cc:493] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.008121 16096 raft_consensus.cc:515] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.011972 16096 leader_election.cc:290] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:49.012714 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385784a6bc654afd91c6702337db1344" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:49.012778 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385784a6bc654afd91c6702337db1344" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:49.014736 15900 raft_consensus.cc:2393] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 069b53329b674338a0ac50c8d7dd32ab in current term 1: Already voted for candidate 616fa025246b4022b5d2a596ed64e042 in this term.
I20260709 13:20:49.015527 16090 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:49.015872 15938 leader_election.cc:304] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab; no voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042
I20260709 13:20:49.016394 16090 ts_tablet_manager.cc:1403] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.005s
I20260709 13:20:49.017228 16096 raft_consensus.cc:3060] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.019413 16089 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:49.019229 16090 raft_consensus.cc:359] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.020009 16090 raft_consensus.cc:385] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.020105 16089 ts_tablet_manager.cc:1403] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.020s
I20260709 13:20:49.020319 16090 raft_consensus.cc:740] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.021565 16090 consensus_queue.cc:260] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.023751 16091 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: No bootstrap required, opened a new log
I20260709 13:20:49.026525 16091 ts_tablet_manager.cc:1403] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.007s
I20260709 13:20:49.026592 16089 raft_consensus.cc:359] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.027634 16089 raft_consensus.cc:385] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.027997 16089 raft_consensus.cc:740] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.022536 15796 catalog_manager.cc:5697] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.028882 16089 consensus_queue.cc:260] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.029765 16091 raft_consensus.cc:359] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.030560 16091 raft_consensus.cc:385] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.030879 16091 raft_consensus.cc:740] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.030030 15796 catalog_manager.cc:5697] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.031719 16089 ts_tablet_manager.cc:1434] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:20:49.031781 16091 consensus_queue.cc:260] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.033126 16089 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:49.024142 16090 ts_tablet_manager.cc:1434] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:49.034535 16091 ts_tablet_manager.cc:1434] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:20:49.034698 16090 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042: Bootstrap starting.
I20260709 13:20:49.035598 16096 raft_consensus.cc:2749] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.038964 16089 tablet_bootstrap.cc:654] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.041249 16090 tablet_bootstrap.cc:654] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.044999 16089 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:49.045639 16089 ts_tablet_manager.cc:1403] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:20:49.047834 16089 raft_consensus.cc:359] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.048166 16090 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042: No bootstrap required, opened a new log
I20260709 13:20:49.048420 16089 raft_consensus.cc:385] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.049139 16089 raft_consensus.cc:740] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.049252 16090 ts_tablet_manager.cc:1403] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:20:49.050319 16089 consensus_queue.cc:260] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.051215 16096 raft_consensus.cc:493] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.052192 16090 raft_consensus.cc:359] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.051698 16096 raft_consensus.cc:515] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.052933 16090 raft_consensus.cc:385] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.053279 16090 raft_consensus.cc:740] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.054026 16090 consensus_queue.cc:260] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.056396 16090 ts_tablet_manager.cc:1434] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:49.056792 16096 leader_election.cc:290] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:49.057503 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b47783d71eb44df81b2322d8f5b32f0" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:49.058301 15900 raft_consensus.cc:2468] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 0.
I20260709 13:20:49.059227 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b47783d71eb44df81b2322d8f5b32f0" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:49.059723 15938 leader_election.cc:304] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:49.059930 16048 raft_consensus.cc:2468] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 0.
I20260709 13:20:49.060727 16096 raft_consensus.cc:2804] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:49.061153 16096 raft_consensus.cc:493] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.061514 16096 raft_consensus.cc:3060] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.062326 16089 ts_tablet_manager.cc:1434] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:20:49.063381 16089 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab: Bootstrap starting.
I20260709 13:20:49.071058 16089 tablet_bootstrap.cc:654] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.071695 16097 raft_consensus.cc:493] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.072664 16097 raft_consensus.cc:515] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.078982 16096 raft_consensus.cc:515] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.079294 15974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b2fbd7292c4f969b00378057d957ff" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:49.077040 16097 leader_election.cc:290] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
W20260709 13:20:49.081851 16013 leader_election.cc:343] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:49.083906 16096 leader_election.cc:290] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:49.084044 15900 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b2fbd7292c4f969b00378057d957ff" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:49.085877 15900 raft_consensus.cc:2468] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 0.
I20260709 13:20:49.085940 15899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b47783d71eb44df81b2322d8f5b32f0" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:49.086616 15899 raft_consensus.cc:3060] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.089102 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b47783d71eb44df81b2322d8f5b32f0" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:49.090013 16048 raft_consensus.cc:3060] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.090340 16012 leader_election.cc:304] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:49.091173 16097 raft_consensus.cc:2804] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:49.091742 16097 raft_consensus.cc:493] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.092093 16097 raft_consensus.cc:3060] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.090015 16089 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab: No bootstrap required, opened a new log
I20260709 13:20:49.094314 16089 ts_tablet_manager.cc:1403] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.004s
I20260709 13:20:49.097105 16089 raft_consensus.cc:359] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.097819 16089 raft_consensus.cc:385] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.098031 15899 raft_consensus.cc:2468] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 1.
I20260709 13:20:49.098065 16089 raft_consensus.cc:740] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.099027 16048 raft_consensus.cc:2468] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 1.
I20260709 13:20:49.099402 15938 leader_election.cc:304] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:49.099252 16089 consensus_queue.cc:260] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.100440 16096 raft_consensus.cc:2804] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.100361 16097 raft_consensus.cc:515] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.102157 16089 ts_tablet_manager.cc:1434] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:49.102569 16096 raft_consensus.cc:697] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:49.103827 15899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b2fbd7292c4f969b00378057d957ff" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:49.103552 16096 consensus_queue.cc:237] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.104022 16097 leader_election.cc:290] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:49.104871 15974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b2fbd7292c4f969b00378057d957ff" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:49.104898 15899 raft_consensus.cc:3060] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.105914 15974 raft_consensus.cc:3060] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.115118 15974 raft_consensus.cc:2468] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:49.115118 15899 raft_consensus.cc:2468] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:49.116624 16012 leader_election.cc:304] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:49.117467 16097 raft_consensus.cc:2804] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.118003 16097 raft_consensus.cc:697] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:49.118835 16097 consensus_queue.cc:237] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.123133 15795 catalog_manager.cc:5697] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 1 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:49.136209 15797 catalog_manager.cc:5697] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.159885 16097 consensus_queue.cc:1048] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.177860 16114 raft_consensus.cc:493] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.178000 16155 consensus_queue.cc:1048] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.178650 16114 raft_consensus.cc:515] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.182410 16114 leader_election.cc:290] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:49.183877 15899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90c36d25a045bdb39f490500ff9512" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:49.184660 15899 raft_consensus.cc:2468] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 0.
I20260709 13:20:49.186383 16012 leader_election.cc:304] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:49.187616 16155 raft_consensus.cc:2804] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:49.187827 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90c36d25a045bdb39f490500ff9512" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:49.188970 15975 raft_consensus.cc:2468] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 0.
I20260709 13:20:49.188159 16155 raft_consensus.cc:493] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:49.190243 16155 raft_consensus.cc:3060] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.199843 16155 raft_consensus.cc:515] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.203773 15899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90c36d25a045bdb39f490500ff9512" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:49.204046 16155 leader_election.cc:290] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:49.204792 15899 raft_consensus.cc:3060] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.207556 16114 consensus_queue.cc:1048] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.209791 15974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90c36d25a045bdb39f490500ff9512" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:49.210512 15974 raft_consensus.cc:3060] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.213974 15899 raft_consensus.cc:2468] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:49.215464 16012 leader_election.cc:304] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:49.216482 16114 raft_consensus.cc:2804] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.217203 16114 raft_consensus.cc:697] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:49.218174 16114 consensus_queue.cc:237] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.225152 16097 consensus_queue.cc:1048] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.225473 15974 raft_consensus.cc:2468] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:49.253201 16096 raft_consensus.cc:493] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:49.255788 16150 consensus_queue.cc:1048] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.257479 15795 catalog_manager.cc:5697] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 0 to 1, leader changed from <none> to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:49.254244 16096 raft_consensus.cc:515] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:49.263443 15899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" is_pre_election: true
I20260709 13:20:49.272747 16096 leader_election.cc:290] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:49.275285 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:49.276638 16048 raft_consensus.cc:2393] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 069b53329b674338a0ac50c8d7dd32ab in current term 1: Already voted for candidate 0f12ad97cf1c48fc896a4a95b60f1a36 in this term.
I20260709 13:20:49.279289 15940 leader_election.cc:304] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab; no voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042
I20260709 13:20:49.280095 16150 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.281935 16096 consensus_queue.cc:1048] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.290675 16150 raft_consensus.cc:2749] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:49.350133 16114 consensus_queue.cc:1048] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.362125 16157 consensus_queue.cc:1048] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.391372 16130 consensus_queue.cc:1048] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.394313 16130 consensus_queue.cc:1048] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.408483 16095 consensus_queue.cc:1048] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.412580 16136 consensus_queue.cc:1048] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.465978 16136 consensus_queue.cc:1048] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.477638 16095 consensus_queue.cc:1048] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:49.489009  4246 ts_manager.cc:295] Set tserver state for 0f12ad97cf1c48fc896a4a95b60f1a36 to MAINTENANCE_MODE
I20260709 13:20:49.490031  4246 tablet_server.cc:179] TabletServer@127.4.37.129:0 shutting down...
I20260709 13:20:49.532256 16150 consensus_queue.cc:1048] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.542585 16157 consensus_queue.cc:1048] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:49.551640  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:49.555811  4246 tablet_replica.cc:333] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.557046  4246 raft_consensus.cc:2243] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.558248  4246 raft_consensus.cc:2272] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:49.557605 15938 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 244 similar messages]
I20260709 13:20:49.565469  4246 tablet_replica.cc:333] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.566578  4246 raft_consensus.cc:2243] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.568477  4246 raft_consensus.cc:2272] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.571904  4246 tablet_replica.cc:333] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.572723  4246 raft_consensus.cc:2243] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.573272  4246 raft_consensus.cc:2272] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:49.577701 15938 consensus_peers.cc:597] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.577629  4246 tablet_replica.cc:333] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.579918  4246 raft_consensus.cc:2243] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.581128  4246 raft_consensus.cc:2272] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:49.585140 16012 consensus_peers.cc:597] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.585501  4246 tablet_replica.cc:333] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.586655  4246 raft_consensus.cc:2243] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.587637  4246 raft_consensus.cc:2272] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.590384  4246 tablet_replica.cc:333] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.591253  4246 raft_consensus.cc:2243] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.591778  4246 raft_consensus.cc:2272] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.594118  4246 tablet_replica.cc:333] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.594751  4246 raft_consensus.cc:2243] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.595361  4246 raft_consensus.cc:2272] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.598076  4246 tablet_replica.cc:333] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.598642  4246 raft_consensus.cc:2243] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.599052  4246 raft_consensus.cc:2272] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.600838  4246 tablet_replica.cc:333] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.601351  4246 raft_consensus.cc:2243] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.601850  4246 raft_consensus.cc:2272] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.604305  4246 tablet_replica.cc:333] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: stopping tablet replica
I20260709 13:20:49.604853  4246 raft_consensus.cc:2243] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.605309  4246 raft_consensus.cc:2272] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.640395  4246 tablet_server.cc:196] TabletServer@127.4.37.129:0 shutdown complete.
W20260709 13:20:49.658007 16012 consensus_peers.cc:597] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.663784 16114 consensus_queue.cc:1048] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:49.677690 16012 consensus_peers.cc:597] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.688446 16012 consensus_peers.cc:597] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.878854 16012 consensus_peers.cc:597] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.883767 15938 consensus_peers.cc:597] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.520540 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:50.907033 16155 raft_consensus.cc:493] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.908588 16097 raft_consensus.cc:493] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.908525 16155 raft_consensus.cc:515] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.909816 16097 raft_consensus.cc:515] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.911798 16155 leader_election.cc:290] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:50.912508 16097 leader_election.cc:290] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:50.913744 15974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:50.914712 16182 raft_consensus.cc:493] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.914899 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:50.915872 16182 raft_consensus.cc:515] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.917457 15975 raft_consensus.cc:2468] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
I20260709 13:20:50.917608 16181 raft_consensus.cc:493] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
W20260709 13:20:50.918367 16012 leader_election.cc:336] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:50.918861 16181 raft_consensus.cc:515] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.919422 16012 leader_election.cc:304] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 616fa025246b4022b5d2a596ed64e042; no voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36
I20260709 13:20:50.920802 16097 raft_consensus.cc:2749] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:50.922529 16012 leader_election.cc:336] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:50.922850 16182 leader_election.cc:290] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:50.924110 16181 leader_election.cc:290] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:50.924847 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:50.925668 16049 raft_consensus.cc:2468] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 1.
I20260709 13:20:50.927040 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:50.927951 16048 raft_consensus.cc:2468] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 1.
I20260709 13:20:50.927963 15940 leader_election.cc:304] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:50.928190 16013 leader_election.cc:304] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 0f12ad97cf1c48fc896a4a95b60f1a36
W20260709 13:20:50.929015 15938 leader_election.cc:336] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:50.929454 15940 leader_election.cc:304] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:50.929577 16097 raft_consensus.cc:2804] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:50.929704 16181 raft_consensus.cc:2804] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:50.930318 16097 raft_consensus.cc:493] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.930434 16181 raft_consensus.cc:493] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.930470 16182 raft_consensus.cc:2804] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:50.930918 16097 raft_consensus.cc:3060] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.931275 16181 raft_consensus.cc:3060] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.931355 16182 raft_consensus.cc:493] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.932235 16182 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:50.933554 15938 leader_election.cc:336] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:50.943336 16182 raft_consensus.cc:515] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.945943 16181 raft_consensus.cc:515] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.947513 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:50.948473 16048 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.948452 16097 raft_consensus.cc:515] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.951454 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:50.952517 16049 raft_consensus.cc:2393] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 069b53329b674338a0ac50c8d7dd32ab in current term 2: Already voted for candidate 616fa025246b4022b5d2a596ed64e042 in this term.
I20260709 13:20:50.954282 16181 leader_election.cc:290] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:50.955686 16097 leader_election.cc:290] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
W20260709 13:20:50.957072 16012 leader_election.cc:336] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:50.972363 16048 raft_consensus.cc:2468] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:50.972669 16182 leader_election.cc:290] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:50.974231 15940 leader_election.cc:304] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:50.975267 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:50.975667 16182 raft_consensus.cc:2804] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:20:50.975970 15938 leader_election.cc:336] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:50.976449 15975 raft_consensus.cc:2393] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 616fa025246b4022b5d2a596ed64e042 in current term 2: Already voted for candidate 069b53329b674338a0ac50c8d7dd32ab in this term.
I20260709 13:20:50.976459 16182 raft_consensus.cc:697] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:50.978223 16181 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.978470 16182 consensus_queue.cc:237] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.980474 16013 leader_election.cc:304] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 616fa025246b4022b5d2a596ed64e042; no voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36
I20260709 13:20:50.982180 16097 raft_consensus.cc:2749] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:50.979146 16181 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.982451 16155 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.984028 16155 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:50.986084 16181 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:50.988245 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:50.989607 16048 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 1.
I20260709 13:20:50.990393 16155 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:50.991654 15940 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:50.993048 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:50.993906 15975 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 1.
W20260709 13:20:50.994285 16012 leader_election.cc:336] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:50.994553 16184 raft_consensus.cc:2804] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:50.995182 15938 leader_election.cc:336] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:50.995246 16184 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.995913 15938 leader_election.cc:304] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab; no voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042
I20260709 13:20:50.996090 16184 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:50.996816 16182 raft_consensus.cc:2749] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:50.997727 16013 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 0f12ad97cf1c48fc896a4a95b60f1a36
I20260709 13:20:50.998545 16155 raft_consensus.cc:2804] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:50.998998 16155 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f12ad97cf1c48fc896a4a95b60f1a36)
I20260709 13:20:50.999531 16155 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:51.002774 15938 leader_election.cc:336] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:51.005132 15797 catalog_manager.cc:5697] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 1 to 2, leader changed from 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129) to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 2 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.010701 16184 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:51.012713 16155 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:51.015247 16155 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:51.015916 16184 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:51.016644 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:51.017664 15975 raft_consensus.cc:2393] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 616fa025246b4022b5d2a596ed64e042 in current term 2: Already voted for candidate 069b53329b674338a0ac50c8d7dd32ab in this term.
I20260709 13:20:51.021234 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:51.022284 16048 raft_consensus.cc:2393] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 069b53329b674338a0ac50c8d7dd32ab in current term 2: Already voted for candidate 616fa025246b4022b5d2a596ed64e042 in this term.
W20260709 13:20:51.023769 16012 leader_election.cc:336] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:51.024822 16012 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 616fa025246b4022b5d2a596ed64e042; no voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36
I20260709 13:20:51.026136 16155 raft_consensus.cc:2749] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:51.027631 15938 leader_election.cc:336] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:51.028216 15938 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab; no voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042
I20260709 13:20:51.029145 16184 raft_consensus.cc:2749] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:51.413527 15938 consensus_peers.cc:597] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.491166 16048 raft_consensus.cc:1275] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.492674 16181 consensus_queue.cc:1048] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:51.522998 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:51.931842 16012 consensus_peers.cc:597] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.033641 15938 consensus_peers.cc:597] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.188666 16012 consensus_peers.cc:597] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.234907 16012 consensus_peers.cc:597] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.375077 16012 consensus_peers.cc:597] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.438167 16012 consensus_peers.cc:597] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:52.524076 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:52.607985 15938 consensus_peers.cc:597] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.966800 16155 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:52.967651 16155 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:52.970854 16155 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:52.972117 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab" is_pre_election: true
I20260709 13:20:52.972940 15975 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 2.
I20260709 13:20:52.974345 16013 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
W20260709 13:20:52.975271 16012 leader_election.cc:336] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:52.975294 16155 raft_consensus.cc:2804] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:52.975870 16155 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:52.976215 16155 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:52.982412 16155 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:52.984779 16155 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 3 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:52.986517 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:52.987282 15975 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:52.989279 16012 leader_election.cc:336] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:52.994407 15975 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 3.
I20260709 13:20:52.995862 16013 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 0f12ad97cf1c48fc896a4a95b60f1a36
I20260709 13:20:52.996835 16155 raft_consensus.cc:2804] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:52.998083 16155 raft_consensus.cc:697] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:52.999336 16155 consensus_queue.cc:237] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:53.017115 15797 catalog_manager.cc:5697] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 1 to 3, leader changed from 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129) to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:53.023284 16184 raft_consensus.cc:493] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:53.024063 16184 raft_consensus.cc:515] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:53.027294 16184 leader_election.cc:290] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:53.028760 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042" is_pre_election: true
I20260709 13:20:53.029568 16048 raft_consensus.cc:2468] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:53.031082 15940 leader_election.cc:304] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:53.032011 16184 raft_consensus.cc:2804] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:20:53.032135 15938 leader_election.cc:336] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:53.032451 16184 raft_consensus.cc:493] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:53.032900 16184 raft_consensus.cc:3060] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:53.041175 16184 raft_consensus.cc:515] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:53.043222 16184 leader_election.cc:290] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 3 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:53.044428 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1839e6ef03cc42ceae174cf8ee6c1240" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:53.045279 16048 raft_consensus.cc:3060] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:53.047932 15938 leader_election.cc:336] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111)
I20260709 13:20:53.052723 16048 raft_consensus.cc:2468] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 3.
I20260709 13:20:53.054061 15940 leader_election.cc:304] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 0f12ad97cf1c48fc896a4a95b60f1a36
I20260709 13:20:53.054862 16184 raft_consensus.cc:2804] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:53.056015 16184 raft_consensus.cc:697] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 3 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:53.057142 16184 consensus_queue.cc:237] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:53.070798 15797 catalog_manager.cc:5697] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 1 to 3, leader changed from 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129) to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 3 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:53.519225 16012 consensus_peers.cc:597] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:53.525321 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:53.542176 15975 raft_consensus.cc:1275] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:53.543622 16195 consensus_queue.cc:1048] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:53.554116 16048 raft_consensus.cc:1275] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:53.556131 16184 consensus_queue.cc:1048] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:53.574826 15938 consensus_peers.cc:597] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:53.686308 15938 consensus_peers.cc:597] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:54.514432 15938 consensus_peers.cc:597] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:54.525799 16012 consensus_peers.cc:597] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:54.526515 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:54.600376 16012 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111) [suppressed 97 similar messages]
W20260709 13:20:54.603785 16012 consensus_peers.cc:597] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:54.669516  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:54.678553 16209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:54.679116 16210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:54.679431 16212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:54.681782  4246 server_base.cc:1061] running on GCE node
I20260709 13:20:54.683032  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:54.683351  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:54.683601  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603254683579 us; error 0 us; skew 500 ppm
I20260709 13:20:54.684278  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:54.687345  4246 webserver.cc:533] Webserver started at http://127.4.37.129:37843/ using document root <none> and password file <none>
I20260709 13:20:54.687935  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:54.688153  4246 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:20:54.692389  4246 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:20:54.697077 16217 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:54.698110  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:20:54.698504  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
format_stamp: "Formatted at 2026-07-09 13:20:47 on dist-test-slave-jk05"
I20260709 13:20:54.699380  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:54.725688  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:54.727578  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:54.730219  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:54.735570 16224 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:20:54.794803 16012 consensus_peers.cc:597] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:54.800308  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:20:54.800900  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.067s	user 0.000s	sys 0.003s
I20260709 13:20:54.801520  4246 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:20:54.808811 16224 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:54.825062 16224 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:54.825996 16224 tablet_bootstrap.cc:492] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:54.826787 16224 ts_tablet_manager.cc:1403] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:20:54.829792 16224 raft_consensus.cc:359] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.830528 16224 raft_consensus.cc:740] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.831298 16224 consensus_queue.cc:260] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.834751 16224 ts_tablet_manager.cc:1434] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:54.835661 16224 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
W20260709 13:20:54.838789 16012 consensus_peers.cc:597] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:54.852506 16224 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:54.853669 16224 tablet_bootstrap.cc:492] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:54.854529 16224 ts_tablet_manager.cc:1403] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:20:54.857875 16224 raft_consensus.cc:359] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.858665 16224 raft_consensus.cc:740] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.859486 16224 consensus_queue.cc:260] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.861984 16224 ts_tablet_manager.cc:1434] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:54.862977 16224 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:54.874090  4246 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:20:54.874522  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.073s	user 0.071s	sys 0.000s
I20260709 13:20:54.878911 16224 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:54.879951 16224 tablet_bootstrap.cc:492] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:54.880728 16224 ts_tablet_manager.cc:1403] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:20:54.884039 16224 raft_consensus.cc:359] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.884918 16224 raft_consensus.cc:740] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.885902 16224 consensus_queue.cc:260] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.889998 16224 ts_tablet_manager.cc:1434] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.003s
I20260709 13:20:54.891827 16224 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:54.913923 16224 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:54.914896 16224 tablet_bootstrap.cc:492] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:54.915544 16224 ts_tablet_manager.cc:1403] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:20:54.917865 16224 raft_consensus.cc:359] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.918434 16224 raft_consensus.cc:740] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.919121 16224 consensus_queue.cc:260] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.921599 16224 ts_tablet_manager.cc:1434] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:54.923245 16224 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:54.942608 16224 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:54.943576 16224 tablet_bootstrap.cc:492] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:54.944221 16224 ts_tablet_manager.cc:1403] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.011s
I20260709 13:20:54.946429 16224 raft_consensus.cc:359] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.947100 16224 raft_consensus.cc:740] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.947893 16224 consensus_queue.cc:260] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.949980 16224 ts_tablet_manager.cc:1434] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:20:54.951028 16224 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:54.953408  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:38415
I20260709 13:20:54.953562 16286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:38415 every 8 connection(s)
I20260709 13:20:54.975209  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:54.981530 16224 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:54.982743 16224 tablet_bootstrap.cc:492] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:54.983538 16224 ts_tablet_manager.cc:1403] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.002s
I20260709 13:20:54.987092 16224 raft_consensus.cc:359] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.989722 16224 raft_consensus.cc:740] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.991258 16224 consensus_queue.cc:260] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:54.994510 16224 ts_tablet_manager.cc:1434] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:20:54.995065 16288 heartbeater.cc:344] Connected to a master server at 127.4.37.190:43717
I20260709 13:20:54.995632 16288 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:54.996117 16224 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:54.996889 16288 heartbeater.cc:507] Master 127.4.37.190:43717 requested a full tablet report, sending...
I20260709 13:20:55.009840 15798 ts_manager.cc:194] Re-registered known tserver with Master: 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415)
I20260709 13:20:55.017125 16048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
mode: GRACEFUL
new_leader_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:36980
I20260709 13:20:55.017598 16261 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.018065 16048 raft_consensus.cc:606] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Received request to transfer leadership to TS 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:55.019774 16224 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:55.021034 16224 tablet_bootstrap.cc:492] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:55.021951 16224 ts_tablet_manager.cc:1403] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 13:20:55.022019 16048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "385784a6bc654afd91c6702337db1344"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
mode: GRACEFUL
new_leader_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:36980
I20260709 13:20:55.022918 16048 raft_consensus.cc:606] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Received request to transfer leadership to TS 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:55.025213 16224 raft_consensus.cc:359] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.026302 16224 raft_consensus.cc:740] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.026376  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:55.027557  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:55.027246 16224 consensus_queue.cc:260] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.028785  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:55.026477 15798 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56606
I20260709 13:20:55.030910 16224 ts_tablet_manager.cc:1434] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:55.032567 16224 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:55.036238 16288 heartbeater.cc:499] Master 127.4.37.190:43717 was elected leader, sending a full tablet report...
I20260709 13:20:55.053853 16224 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:55.054736 16224 tablet_bootstrap.cc:492] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:55.055943 16224 ts_tablet_manager.cc:1403] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 13:20:55.058137 16224 raft_consensus.cc:359] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.058734 16224 raft_consensus.cc:740] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.059433 16224 consensus_queue.cc:260] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.061121 16224 ts_tablet_manager.cc:1434] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:55.061911 16224 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:55.076795 16224 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:55.077672 16224 tablet_bootstrap.cc:492] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:55.078197 16224 ts_tablet_manager.cc:1403] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:20:55.080020 16224 raft_consensus.cc:359] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.080509 16224 raft_consensus.cc:740] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.081037 16224 consensus_queue.cc:260] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.083207 16224 ts_tablet_manager.cc:1434] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:55.084371 16224 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap starting.
I20260709 13:20:55.098160 16224 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:55.099020 16224 tablet_bootstrap.cc:492] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Bootstrap complete.
I20260709 13:20:55.099673 16224 ts_tablet_manager.cc:1403] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:20:55.102319 16224 raft_consensus.cc:359] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:55.102831 16224 raft_consensus.cc:740] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f12ad97cf1c48fc896a4a95b60f1a36, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.103699 16224 consensus_queue.cc:260] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:55.105867 16224 ts_tablet_manager.cc:1434] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:20:55.207935 16195 raft_consensus.cc:993] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042: : Instructing follower 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:55.208653 16303 raft_consensus.cc:1081] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Signalling peer 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:55.211062 15975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "385784a6bc654afd91c6702337db1344"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:48932
I20260709 13:20:55.211580 15975 raft_consensus.cc:493] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.211855 15975 raft_consensus.cc:3060] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.217703 15975 raft_consensus.cc:515] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.219471 15975 leader_election.cc:290] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:55.220640 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385784a6bc654afd91c6702337db1344" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:55.221006 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385784a6bc654afd91c6702337db1344" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:55.221544 16048 raft_consensus.cc:3055] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:55.222040 16048 raft_consensus.cc:740] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:55.222055 16260 raft_consensus.cc:3060] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.223094 16048 consensus_queue.cc:260] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.224642 16048 raft_consensus.cc:3060] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.225476 16261 raft_consensus.cc:3060] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:55.232885 16260 raft_consensus.cc:2468] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:55.233716 16048 raft_consensus.cc:2468] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:55.234486 15938 leader_election.cc:304] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:55.235617 16184 raft_consensus.cc:2804] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:55.237043 16184 raft_consensus.cc:697] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:55.238534 16184 consensus_queue.cc:237] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.248663 15798 catalog_manager.cc:5697] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 1 to 2, leader changed from 616fa025246b4022b5d2a596ed64e042 (127.4.37.131) to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 2 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.284431 16304 raft_consensus.cc:993] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042: : Instructing follower 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:55.284947 16195 raft_consensus.cc:1081] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Signalling peer 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:55.287290 15975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:48932
I20260709 13:20:55.287987 15975 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.288339 15975 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:55.294060 15975 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.296327 15975 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 4 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:55.296829 16261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:55.296964 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:55.297534 16261 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 4
I20260709 13:20:55.297654 16048 raft_consensus.cc:3055] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:55.298283 16048 raft_consensus.cc:740] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:55.299273 16048 consensus_queue.cc:260] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.300760 16048 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:55.305953 16261 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 4.
I20260709 13:20:55.307158 15938 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:55.307880 16184 raft_consensus.cc:2804] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:55.308346 16184 raft_consensus.cc:697] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 4 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:55.309389 16184 consensus_queue.cc:237] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:55.312181 16048 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 4.
I20260709 13:20:55.318528 15798 catalog_manager.cc:5697] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 3 to 4, leader changed from 616fa025246b4022b5d2a596ed64e042 (127.4.37.131) to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 4 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:55.527505 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:55.619290 16261 raft_consensus.cc:1275] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:55.620958 16314 consensus_queue.cc:1048] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:55.634269 16048 raft_consensus.cc:1275] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:55.636742 16314 consensus_queue.cc:1048] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:55.748261 16261 raft_consensus.cc:1275] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 4 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:55.750062 16314 consensus_queue.cc:1048] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:55.763620 16048 raft_consensus.cc:1275] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 4 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:55.767215 16184 consensus_queue.cc:1048] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:56.042098  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:56.063795 15975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
mode: GRACEFUL
new_leader_uuid: "616fa025246b4022b5d2a596ed64e042"
 from {username='slave'} at 127.0.0.1:60666
I20260709 13:20:56.064421 15975 raft_consensus.cc:606] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Received request to transfer leadership to TS 616fa025246b4022b5d2a596ed64e042
I20260709 13:20:56.067704 15975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7a9d3c73f7f4c44bd74ce1169af7274"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
mode: GRACEFUL
new_leader_uuid: "616fa025246b4022b5d2a596ed64e042"
 from {username='slave'} at 127.0.0.1:60666
I20260709 13:20:56.068198 15975 raft_consensus.cc:606] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Received request to transfer leadership to TS 616fa025246b4022b5d2a596ed64e042
I20260709 13:20:56.069628  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:56.070421  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:56.071550  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:56.241063 16314 raft_consensus.cc:993] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab: : Instructing follower 616fa025246b4022b5d2a596ed64e042 to start an election
I20260709 13:20:56.241806 16321 raft_consensus.cc:1081] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Signalling peer 616fa025246b4022b5d2a596ed64e042 to start an election
I20260709 13:20:56.243809 16049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
 from {username='slave'} at 127.0.0.1:39098
I20260709 13:20:56.244550 16049 raft_consensus.cc:493] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.245146 16049 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:56.252683 16049 raft_consensus.cc:515] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:56.254514 16049 leader_election.cc:290] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 3 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:56.255601 16261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:56.255894 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:56.256314 16261 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:56.256543 15975 raft_consensus.cc:3055] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:56.257030 15975 raft_consensus.cc:740] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:56.258854 15975 consensus_queue.cc:260] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:56.259995 15975 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:56.263527 16261 raft_consensus.cc:2468] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 3.
I20260709 13:20:56.265620 16012 leader_election.cc:304] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:56.266541 16195 raft_consensus.cc:2804] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:56.267154 16195 raft_consensus.cc:697] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:56.269384 16195 consensus_queue.cc:237] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:56.270956 15975 raft_consensus.cc:2468] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 3.
I20260709 13:20:56.278190 15797 catalog_manager.cc:5697] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 2 to 3, leader changed from 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130) to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:56.529146 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:56.573338 16314 raft_consensus.cc:993] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab: : Instructing follower 616fa025246b4022b5d2a596ed64e042 to start an election
I20260709 13:20:56.574012 16321 raft_consensus.cc:1081] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Signalling peer 616fa025246b4022b5d2a596ed64e042 to start an election
I20260709 13:20:56.575656 16049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7a9d3c73f7f4c44bd74ce1169af7274"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
 from {username='slave'} at 127.0.0.1:39098
I20260709 13:20:56.576138 16049 raft_consensus.cc:493] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.576406 16049 raft_consensus.cc:3060] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.582203 16049 raft_consensus.cc:515] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:56.584041 16049 leader_election.cc:290] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:56.584998 16261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a9d3c73f7f4c44bd74ce1169af7274" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:56.585294 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a9d3c73f7f4c44bd74ce1169af7274" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:56.585729 16261 raft_consensus.cc:3060] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.585932 15975 raft_consensus.cc:3055] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.586316 15975 raft_consensus.cc:740] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:56.587051 15975 consensus_queue.cc:260] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:56.588094 15975 raft_consensus.cc:3060] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.592506 16261 raft_consensus.cc:2468] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 2.
I20260709 13:20:56.593746 16012 leader_election.cc:304] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f12ad97cf1c48fc896a4a95b60f1a36, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:56.594604 16195 raft_consensus.cc:2804] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.595896 15975 raft_consensus.cc:2468] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 2.
I20260709 13:20:56.595948 16195 raft_consensus.cc:697] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 2 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:56.597661 16195 consensus_queue.cc:237] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:56.605621 15797 catalog_manager.cc:5697] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 1 to 2, leader changed from 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130) to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.691272 16261 raft_consensus.cc:1275] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 3 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:56.692725 16195 consensus_queue.cc:1048] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:56.706574 15975 raft_consensus.cc:1275] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:56.708864 16303 consensus_queue.cc:1048] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:57.061875 15975 raft_consensus.cc:1275] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.063294 16303 consensus_queue.cc:1048] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.074451 16261 raft_consensus.cc:1275] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.076428 16195 consensus_queue.cc:1048] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.079258  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:57.090441 16049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
mode: GRACEFUL
new_leader_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:36980
I20260709 13:20:57.091344 16049 raft_consensus.cc:606] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Received request to transfer leadership to TS 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:57.095022 16049 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c02a481e00d1499a956b2dc0c3d610cc"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
mode: GRACEFUL
new_leader_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:36980
I20260709 13:20:57.095695 16049 raft_consensus.cc:606] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Received request to transfer leadership to TS 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:57.097078  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:57.097929  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:57.098717  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:57.153771 16303 raft_consensus.cc:993] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042: : Instructing follower 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:57.154423 16195 raft_consensus.cc:1081] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Signalling peer 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:57.156172 15975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:48932
I20260709 13:20:57.156735 15975 raft_consensus.cc:493] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:57.157145 15975 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:57.164013 15975 raft_consensus.cc:515] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:57.165910 15975 leader_election.cc:290] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 4 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:57.167343 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:57.167138 16261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c31d43899ac479c9bb445a6410082bb" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:57.168154 16049 raft_consensus.cc:3055] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:57.168181 16261 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:57.168785 16049 raft_consensus.cc:740] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:57.169991 16049 consensus_queue.cc:260] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:57.171705 16049 raft_consensus.cc:3060] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:57.177306 16261 raft_consensus.cc:2468] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 4.
I20260709 13:20:57.179108 15938 leader_election.cc:304] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:57.179450 16049 raft_consensus.cc:2468] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 4.
I20260709 13:20:57.180414 16321 raft_consensus.cc:2804] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:57.181028 16321 raft_consensus.cc:697] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 4 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:57.182051 16321 consensus_queue.cc:237] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:57.190364 15797 catalog_manager.cc:5697] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 3 to 4, leader changed from 616fa025246b4022b5d2a596ed64e042 (127.4.37.131) to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 4 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.294639 16303 raft_consensus.cc:993] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042: : Instructing follower 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:57.295109 16195 raft_consensus.cc:1081] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Signalling peer 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:57.296677 15975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c02a481e00d1499a956b2dc0c3d610cc"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:48932
I20260709 13:20:57.297102 15975 raft_consensus.cc:493] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:57.297339 15975 raft_consensus.cc:3060] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:57.303085 15975 raft_consensus.cc:515] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:57.305097 15975 leader_election.cc:290] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Requested vote from peers 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031), 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415)
I20260709 13:20:57.306453 16049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02a481e00d1499a956b2dc0c3d610cc" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:57.306619 16261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02a481e00d1499a956b2dc0c3d610cc" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:57.307538 16049 raft_consensus.cc:3055] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:57.307636 16261 raft_consensus.cc:3060] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:57.308065 16049 raft_consensus.cc:740] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:57.309177 16049 consensus_queue.cc:260] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:57.311043 16049 raft_consensus.cc:3060] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:57.317524 16261 raft_consensus.cc:2468] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:57.318934 15938 leader_election.cc:304] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:57.319804 16321 raft_consensus.cc:2804] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:57.320039 16049 raft_consensus.cc:2468] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:57.320325 16321 raft_consensus.cc:697] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:57.322082 16321 consensus_queue.cc:237] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } }
I20260709 13:20:57.331077 15797 catalog_manager.cc:5697] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 1 to 2, leader changed from 616fa025246b4022b5d2a596ed64e042 (127.4.37.131) to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 2 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:57.531045 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:57.606065 16261 raft_consensus.cc:1275] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 4 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:57.607692 16321 consensus_queue.cc:1048] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:57.619802 16049 raft_consensus.cc:1275] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 4 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:57.622408 16314 consensus_queue.cc:1048] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:57.828559 16049 raft_consensus.cc:1275] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.830899 16321 consensus_queue.cc:1048] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.841989 16261 raft_consensus.cc:1275] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.845486 16321 consensus_queue.cc:1048] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:58.106046  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:58.115046 15975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
mode: GRACEFUL
new_leader_uuid: "616fa025246b4022b5d2a596ed64e042"
 from {username='slave'} at 127.0.0.1:60666
I20260709 13:20:58.115780 15975 raft_consensus.cc:606] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 4 LEADER]: Received request to transfer leadership to TS 616fa025246b4022b5d2a596ed64e042
I20260709 13:20:58.118894 15975 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b47783d71eb44df81b2322d8f5b32f0"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
mode: GRACEFUL
new_leader_uuid: "616fa025246b4022b5d2a596ed64e042"
 from {username='slave'} at 127.0.0.1:60666
I20260709 13:20:58.119446 15975 raft_consensus.cc:606] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Received request to transfer leadership to TS 616fa025246b4022b5d2a596ed64e042
I20260709 13:20:58.121968  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:58.122787  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:58.123631  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:58.347142 16350 raft_consensus.cc:993] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab: : Instructing follower 616fa025246b4022b5d2a596ed64e042 to start an election
I20260709 13:20:58.347744 16321 raft_consensus.cc:1081] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 4 LEADER]: Signalling peer 616fa025246b4022b5d2a596ed64e042 to start an election
I20260709 13:20:58.349634 16048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
 from {username='slave'} at 127.0.0.1:39098
I20260709 13:20:58.350138 16048 raft_consensus.cc:493] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:58.350416 16048 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:58.356208 16048 raft_consensus.cc:515] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:58.357890 16048 leader_election.cc:290] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 5 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:58.358956 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:58.358980 16261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019dd5c4cdd74e1184e1f47b27e4d8a7" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:58.359637 15975 raft_consensus.cc:3055] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:20:58.359865 16261 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:58.360010 15975 raft_consensus.cc:740] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:58.361007 15975 consensus_queue.cc:260] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:58.362023 15975 raft_consensus.cc:3060] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:58.367305 15975 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 5.
I20260709 13:20:58.368813 16013 leader_election.cc:304] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:58.369946 16349 raft_consensus.cc:2804] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:58.370676 16349 raft_consensus.cc:697] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 5 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:58.371253 16261 raft_consensus.cc:2468] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 5.
I20260709 13:20:58.372232 16260 raft_consensus.cc:1240] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 5 FOLLOWER]: Rejecting Update request from peer 069b53329b674338a0ac50c8d7dd32ab for earlier term 4. Current term is 5. Ops: []
I20260709 13:20:58.371937 16349 consensus_queue.cc:237] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:58.382042 15797 catalog_manager.cc:5697] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 4 to 5, leader changed from 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130) to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 5 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:58.532155 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:58.559556 16350 raft_consensus.cc:993] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab: : Instructing follower 616fa025246b4022b5d2a596ed64e042 to start an election
I20260709 13:20:58.560549 16321 raft_consensus.cc:1081] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Signalling peer 616fa025246b4022b5d2a596ed64e042 to start an election
I20260709 13:20:58.563026 16048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b47783d71eb44df81b2322d8f5b32f0"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
 from {username='slave'} at 127.0.0.1:39098
I20260709 13:20:58.563580 16048 raft_consensus.cc:493] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:58.563860 16048 raft_consensus.cc:3060] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.571516 16048 raft_consensus.cc:515] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:58.573698 16048 leader_election.cc:290] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927)
I20260709 13:20:58.574728 15975 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b47783d71eb44df81b2322d8f5b32f0" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
I20260709 13:20:58.574868 16260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b47783d71eb44df81b2322d8f5b32f0" candidate_uuid: "616fa025246b4022b5d2a596ed64e042" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:58.575522 15975 raft_consensus.cc:3055] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:58.575677 16260 raft_consensus.cc:3060] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.575826 15975 raft_consensus.cc:740] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:58.576819 15975 consensus_queue.cc:260] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:58.577859 15975 raft_consensus.cc:3060] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:58.583081 15975 raft_consensus.cc:2468] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 2.
I20260709 13:20:58.583515 16260 raft_consensus.cc:2468] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616fa025246b4022b5d2a596ed64e042 in term 2.
I20260709 13:20:58.584323 16013 leader_election.cc:304] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 616fa025246b4022b5d2a596ed64e042; no voters: 
I20260709 13:20:58.585320 16349 raft_consensus.cc:2804] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:58.585878 16349 raft_consensus.cc:697] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 2 LEADER]: Becoming Leader. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:58.587690 16349 consensus_queue.cc:237] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:58.596303 15797 catalog_manager.cc:5697] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 reported cstate change: term changed from 1 to 2, leader changed from 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130) to 616fa025246b4022b5d2a596ed64e042 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "616fa025246b4022b5d2a596ed64e042" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:58.791524 16260 raft_consensus.cc:1275] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 5 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:20:58.792963 16349 consensus_queue.cc:1048] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:58.806555 15975 raft_consensus.cc:1275] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 5 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:20:58.809497 16349 consensus_queue.cc:1048] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:59.052307 15975 raft_consensus.cc:1275] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:59.054327 16349 consensus_queue.cc:1048] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:59.065335 16260 raft_consensus.cc:1275] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Refusing update from remote peer 616fa025246b4022b5d2a596ed64e042: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:59.068583 16328 consensus_queue.cc:1048] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:59.133332  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:59.142637 16048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b90c36d25a045bdb39f490500ff9512"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
mode: GRACEFUL
new_leader_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:36980
I20260709 13:20:59.143977 16048 raft_consensus.cc:606] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Received request to transfer leadership to TS 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:59.148193 16048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f2b182cc4ac4585b1661a8bbfc06007"
dest_uuid: "616fa025246b4022b5d2a596ed64e042"
mode: GRACEFUL
new_leader_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:36980
I20260709 13:20:59.149156 16048 raft_consensus.cc:606] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Received request to transfer leadership to TS 069b53329b674338a0ac50c8d7dd32ab
I20260709 13:20:59.150972  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:59.151819  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:59.152645  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:59.170779 16360 raft_consensus.cc:993] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042: : Instructing follower 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:59.171334 16360 raft_consensus.cc:1081] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Signalling peer 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:59.172817 15975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f2b182cc4ac4585b1661a8bbfc06007"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:48932
I20260709 13:20:59.173233 15975 raft_consensus.cc:493] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:59.173492 15975 raft_consensus.cc:3060] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.178813 15975 raft_consensus.cc:515] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:59.180445 15975 leader_election.cc:290] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:59.181942 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b182cc4ac4585b1661a8bbfc06007" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:59.182034 16261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b182cc4ac4585b1661a8bbfc06007" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:59.183087 16048 raft_consensus.cc:3055] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:59.183218 16261 raft_consensus.cc:3060] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.183657 16048 raft_consensus.cc:740] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:59.184651 16048 consensus_queue.cc:260] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:59.186200 16048 raft_consensus.cc:3060] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.191869 16261 raft_consensus.cc:2468] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:59.194000 15938 leader_election.cc:304] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:59.194195 16048 raft_consensus.cc:2468] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:59.194897 16321 raft_consensus.cc:2804] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:59.195483 16321 raft_consensus.cc:697] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:59.196374 16321 consensus_queue.cc:237] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:59.204792 15797 catalog_manager.cc:5697] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 1 to 2, leader changed from 616fa025246b4022b5d2a596ed64e042 (127.4.37.131) to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 2 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:59.273003 16328 raft_consensus.cc:993] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042: : Instructing follower 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:59.273705 16360 raft_consensus.cc:1081] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Signalling peer 069b53329b674338a0ac50c8d7dd32ab to start an election
I20260709 13:20:59.275477 15975 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b90c36d25a045bdb39f490500ff9512"
dest_uuid: "069b53329b674338a0ac50c8d7dd32ab"
 from {username='slave'} at 127.0.0.1:48932
I20260709 13:20:59.276042 15975 raft_consensus.cc:493] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:59.276351 15975 raft_consensus.cc:3060] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.282506 15975 raft_consensus.cc:515] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:59.284282 15975 leader_election.cc:290] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Requested vote from peers 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415), 616fa025246b4022b5d2a596ed64e042 (127.4.37.131:40031)
I20260709 13:20:59.285631 16261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90c36d25a045bdb39f490500ff9512" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36"
I20260709 13:20:59.286229 16048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b90c36d25a045bdb39f490500ff9512" candidate_uuid: "069b53329b674338a0ac50c8d7dd32ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "616fa025246b4022b5d2a596ed64e042"
I20260709 13:20:59.286553 16261 raft_consensus.cc:3060] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.286918 16048 raft_consensus.cc:3055] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:59.287243 16048 raft_consensus.cc:740] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 616fa025246b4022b5d2a596ed64e042, State: Running, Role: LEADER
I20260709 13:20:59.288187 16048 consensus_queue.cc:260] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:59.289752 16048 raft_consensus.cc:3060] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.295670 16261 raft_consensus.cc:2468] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:59.297277 15938 leader_election.cc:304] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 069b53329b674338a0ac50c8d7dd32ab, 0f12ad97cf1c48fc896a4a95b60f1a36; no voters: 
I20260709 13:20:59.297791 16048 raft_consensus.cc:2468] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 069b53329b674338a0ac50c8d7dd32ab in term 2.
I20260709 13:20:59.298415 16321 raft_consensus.cc:2804] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:59.299038 16321 raft_consensus.cc:697] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Becoming Leader. State: Replica: 069b53329b674338a0ac50c8d7dd32ab, State: Running, Role: LEADER
I20260709 13:20:59.299955 16321 consensus_queue.cc:237] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } }
I20260709 13:20:59.310695 15797 catalog_manager.cc:5697] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab reported cstate change: term changed from 1 to 2, leader changed from 616fa025246b4022b5d2a596ed64e042 (127.4.37.131) to 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130). New cstate: current_term: 2 leader_uuid: "069b53329b674338a0ac50c8d7dd32ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069b53329b674338a0ac50c8d7dd32ab" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 33927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:59.533331 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:59.755678 16261 raft_consensus.cc:1275] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:59.757022 16321 consensus_queue.cc:1048] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:59.770331 16048 raft_consensus.cc:1275] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:59.772114 16366 consensus_queue.cc:1048] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:59.774650 16261 raft_consensus.cc:1275] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:59.776538 16375 consensus_queue.cc:1048] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f12ad97cf1c48fc896a4a95b60f1a36" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 38415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:59.791921 16048 raft_consensus.cc:1275] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Refusing update from remote peer 069b53329b674338a0ac50c8d7dd32ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:59.795130 16321 consensus_queue.cc:1048] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "616fa025246b4022b5d2a596ed64e042" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 40031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:00.159632  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:00.195979  4246 tablet_server.cc:179] TabletServer@127.4.37.129:38415 shutting down...
W20260709 13:21:00.198153 16012 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:21:00.203465 16012 consensus_peers.cc:597] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.218703  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:00.219520  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.220155  4246 raft_consensus.cc:2243] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.220651  4246 raft_consensus.cc:2272] T 7f2b182cc4ac4585b1661a8bbfc06007 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.224045  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.225091  4246 raft_consensus.cc:2243] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.226049  4246 raft_consensus.cc:2272] T 5c31d43899ac479c9bb445a6410082bb P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.228766  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.229772  4246 raft_consensus.cc:2243] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.230279  4246 raft_consensus.cc:2272] T 385784a6bc654afd91c6702337db1344 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.232259  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.232851  4246 raft_consensus.cc:2243] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.233301  4246 raft_consensus.cc:2272] T c1b2fbd7292c4f969b00378057d957ff P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.235356  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.236166  4246 raft_consensus.cc:2243] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.236848  4246 raft_consensus.cc:2272] T e7a9d3c73f7f4c44bd74ce1169af7274 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.239771  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.240708  4246 raft_consensus.cc:2243] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.241886  4246 raft_consensus.cc:2272] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.244547  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.245329  4246 raft_consensus.cc:2243] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.246788  4246 raft_consensus.cc:2272] T 1839e6ef03cc42ceae174cf8ee6c1240 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.250568  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.251112  4246 raft_consensus.cc:2243] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.251638  4246 raft_consensus.cc:2272] T c02a481e00d1499a956b2dc0c3d610cc P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.253803  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.254333  4246 raft_consensus.cc:2243] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.254804  4246 raft_consensus.cc:2272] T 7b47783d71eb44df81b2322d8f5b32f0 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:00.255350 16012 consensus_peers.cc:597] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.256963  4246 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:00.257593  4246 raft_consensus.cc:2243] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.258000  4246 raft_consensus.cc:2272] T 7b90c36d25a045bdb39f490500ff9512 P 0f12ad97cf1c48fc896a4a95b60f1a36 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:00.267437 15938 consensus_peers.cc:597] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.286346 15938 consensus_peers.cc:597] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.294303  4246 tablet_server.cc:196] TabletServer@127.4.37.129:38415 shutdown complete.
W20260709 13:21:00.296897 15938 consensus_peers.cc:597] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.321282  4246 tablet_server.cc:179] TabletServer@127.4.37.130:0 shutting down...
W20260709 13:21:00.326191 15938 consensus_peers.cc:597] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.358580 15938 consensus_peers.cc:597] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.360425  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:00.361739  4246 tablet_replica.cc:333] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.362771  4246 raft_consensus.cc:2243] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.364514  4246 raft_consensus.cc:2272] T 7b90c36d25a045bdb39f490500ff9512 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.368731  4246 tablet_replica.cc:333] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.369930  4246 raft_consensus.cc:2243] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.371459  4246 raft_consensus.cc:2272] T 5c31d43899ac479c9bb445a6410082bb P 069b53329b674338a0ac50c8d7dd32ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.374091  4246 tablet_replica.cc:333] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.374972  4246 raft_consensus.cc:2243] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.375519  4246 raft_consensus.cc:2272] T c1b2fbd7292c4f969b00378057d957ff P 069b53329b674338a0ac50c8d7dd32ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.378278  4246 tablet_replica.cc:333] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.378931  4246 raft_consensus.cc:2243] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.380077  4246 raft_consensus.cc:2272] T 385784a6bc654afd91c6702337db1344 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.382931  4246 tablet_replica.cc:333] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.383960  4246 raft_consensus.cc:2243] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.384518  4246 raft_consensus.cc:2272] T e7a9d3c73f7f4c44bd74ce1169af7274 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.387475  4246 tablet_replica.cc:333] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.388221  4246 raft_consensus.cc:2243] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.389238  4246 raft_consensus.cc:2272] T 7f2b182cc4ac4585b1661a8bbfc06007 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.392875  4246 tablet_replica.cc:333] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.393666  4246 raft_consensus.cc:2243] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.394539  4246 raft_consensus.cc:2272] T 1839e6ef03cc42ceae174cf8ee6c1240 P 069b53329b674338a0ac50c8d7dd32ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.396659  4246 tablet_replica.cc:333] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.397240  4246 raft_consensus.cc:2243] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.397766  4246 raft_consensus.cc:2272] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 069b53329b674338a0ac50c8d7dd32ab [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.400055  4246 tablet_replica.cc:333] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.400693  4246 raft_consensus.cc:2243] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.401583  4246 raft_consensus.cc:2272] T 7b47783d71eb44df81b2322d8f5b32f0 P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.404281  4246 tablet_replica.cc:333] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab: stopping tablet replica
I20260709 13:21:00.405172  4246 raft_consensus.cc:2243] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.406383  4246 raft_consensus.cc:2272] T c02a481e00d1499a956b2dc0c3d610cc P 069b53329b674338a0ac50c8d7dd32ab [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:00.437850 16013 consensus_peers.cc:597] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 -> Peer 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927): Couldn't send request to peer 069b53329b674338a0ac50c8d7dd32ab. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.448966  4246 tablet_server.cc:196] TabletServer@127.4.37.130:0 shutdown complete.
W20260709 13:21:00.450835 16012 consensus_peers.cc:597] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 -> Peer 0f12ad97cf1c48fc896a4a95b60f1a36 (127.4.37.129:38415): Couldn't send request to peer 0f12ad97cf1c48fc896a4a95b60f1a36. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:38415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:00.476655 16013 consensus_peers.cc:597] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 -> Peer 069b53329b674338a0ac50c8d7dd32ab (127.4.37.130:33927): Couldn't send request to peer 069b53329b674338a0ac50c8d7dd32ab. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:33927: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.477113  4246 tablet_server.cc:179] TabletServer@127.4.37.131:0 shutting down...
I20260709 13:21:00.512519  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:00.513506  4246 tablet_replica.cc:333] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.514257  4246 raft_consensus.cc:2243] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.514773  4246 raft_consensus.cc:2272] T 7b90c36d25a045bdb39f490500ff9512 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.518288  4246 tablet_replica.cc:333] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.518926  4246 raft_consensus.cc:2243] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.519407  4246 raft_consensus.cc:2272] T 5c31d43899ac479c9bb445a6410082bb P 616fa025246b4022b5d2a596ed64e042 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.522285  4246 tablet_replica.cc:333] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.523355  4246 raft_consensus.cc:2243] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.524808  4246 raft_consensus.cc:2272] T c1b2fbd7292c4f969b00378057d957ff P 616fa025246b4022b5d2a596ed64e042 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.528128  4246 tablet_replica.cc:333] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.528893  4246 raft_consensus.cc:2243] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.530078  4246 raft_consensus.cc:2272] T e7a9d3c73f7f4c44bd74ce1169af7274 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.532301  4246 tablet_replica.cc:333] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.532851  4246 raft_consensus.cc:2243] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.533248  4246 raft_consensus.cc:2272] T 385784a6bc654afd91c6702337db1344 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:00.534409 15846 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:00.535868  4246 tablet_replica.cc:333] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.536494  4246 raft_consensus.cc:2243] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.536931  4246 raft_consensus.cc:2272] T 7f2b182cc4ac4585b1661a8bbfc06007 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.539829  4246 tablet_replica.cc:333] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.540413  4246 raft_consensus.cc:2243] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.541174  4246 raft_consensus.cc:2272] T 1839e6ef03cc42ceae174cf8ee6c1240 P 616fa025246b4022b5d2a596ed64e042 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.544148  4246 tablet_replica.cc:333] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.545037  4246 raft_consensus.cc:2243] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.546496  4246 raft_consensus.cc:2272] T 019dd5c4cdd74e1184e1f47b27e4d8a7 P 616fa025246b4022b5d2a596ed64e042 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.549759  4246 tablet_replica.cc:333] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.550334  4246 raft_consensus.cc:2243] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.551187  4246 raft_consensus.cc:2272] T 7b47783d71eb44df81b2322d8f5b32f0 P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.553603  4246 tablet_replica.cc:333] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042: stopping tablet replica
I20260709 13:21:00.554107  4246 raft_consensus.cc:2243] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.554512  4246 raft_consensus.cc:2272] T c02a481e00d1499a956b2dc0c3d610cc P 616fa025246b4022b5d2a596ed64e042 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.590339  4246 tablet_server.cc:196] TabletServer@127.4.37.131:0 shutdown complete.
I20260709 13:21:00.621662  4246 master.cc:562] Master@127.4.37.190:43717 shutting down...
I20260709 13:21:00.658849  4246 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.659509  4246 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.660336  4246 tablet_replica.cc:333] T 00000000000000000000000000000000 P f36aef8a61a34d0ba7cdd567df03ac44: stopping tablet replica
I20260709 13:21:00.684856  4246 master.cc:584] Master@127.4.37.190:43717 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13439 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:21:00.738433  4246 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.37.190:44837
I20260709 13:21:00.739666  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:00.749068 16388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:00.749379 16387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:00.752117 16390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:00.753150  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:00.754459  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:00.754653  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:00.754856  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603260754821 us; error 0 us; skew 500 ppm
I20260709 13:21:00.755429  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:00.759032  4246 webserver.cc:533] Webserver started at http://127.4.37.190:44247/ using document root <none> and password file <none>
I20260709 13:21:00.759763  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:00.759970  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:00.760636  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:00.762193  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/master-0-root/instance:
uuid: "de3d6c48baf943f38fdf60a8c3945089"
format_stamp: "Formatted at 2026-07-09 13:21:00 on dist-test-slave-jk05"
I20260709 13:21:00.769140  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:21:00.773825 16395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:00.774744  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:00.775027  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/master-0-root
uuid: "de3d6c48baf943f38fdf60a8c3945089"
format_stamp: "Formatted at 2026-07-09 13:21:00 on dist-test-slave-jk05"
I20260709 13:21:00.775300  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:00.790191  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:00.791399  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:00.860752  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.190:44837
I20260709 13:21:00.860874 16447 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.190:44837 every 8 connection(s)
I20260709 13:21:00.867938 16448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:00.888857 16448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089: Bootstrap starting.
I20260709 13:21:00.894676 16448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:00.900193 16448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089: No bootstrap required, opened a new log
I20260709 13:21:00.903039 16448 raft_consensus.cc:359] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3d6c48baf943f38fdf60a8c3945089" member_type: VOTER }
I20260709 13:21:00.903597 16448 raft_consensus.cc:385] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:00.903877 16448 raft_consensus.cc:740] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de3d6c48baf943f38fdf60a8c3945089, State: Initialized, Role: FOLLOWER
I20260709 13:21:00.904883 16448 consensus_queue.cc:260] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3d6c48baf943f38fdf60a8c3945089" member_type: VOTER }
I20260709 13:21:00.905527 16448 raft_consensus.cc:399] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:00.905787 16448 raft_consensus.cc:493] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:00.906080 16448 raft_consensus.cc:3060] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:00.911697 16448 raft_consensus.cc:515] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3d6c48baf943f38fdf60a8c3945089" member_type: VOTER }
I20260709 13:21:00.912317 16448 leader_election.cc:304] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de3d6c48baf943f38fdf60a8c3945089; no voters: 
I20260709 13:21:00.913690 16448 leader_election.cc:290] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:00.914181 16451 raft_consensus.cc:2804] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:00.915822 16451 raft_consensus.cc:697] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 1 LEADER]: Becoming Leader. State: Replica: de3d6c48baf943f38fdf60a8c3945089, State: Running, Role: LEADER
I20260709 13:21:00.916649 16451 consensus_queue.cc:237] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3d6c48baf943f38fdf60a8c3945089" member_type: VOTER }
I20260709 13:21:00.917654 16448 sys_catalog.cc:565] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:00.927143 16452 sys_catalog.cc:455] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de3d6c48baf943f38fdf60a8c3945089" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3d6c48baf943f38fdf60a8c3945089" member_type: VOTER } }
I20260709 13:21:00.927143 16453 sys_catalog.cc:455] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [sys.catalog]: SysCatalogTable state changed. Reason: New leader de3d6c48baf943f38fdf60a8c3945089. Latest consensus state: current_term: 1 leader_uuid: "de3d6c48baf943f38fdf60a8c3945089" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de3d6c48baf943f38fdf60a8c3945089" member_type: VOTER } }
I20260709 13:21:00.928920 16452 sys_catalog.cc:458] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:00.929049 16453 sys_catalog.cc:458] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:00.931655 16459 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:00.940297 16459 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:00.941854  4246 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:00.954268 16459 catalog_manager.cc:1383] Generated new cluster ID: d09b3eb28c9a4d21a79f5e619ab32461
I20260709 13:21:00.954653 16459 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:01.033699 16459 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:01.035221 16459 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:01.051045 16459 catalog_manager.cc:6070] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089: Generated new TSK 0
I20260709 13:21:01.051775 16459 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:01.074144  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:01.084308 16470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:01.084466 16469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:01.087432 16472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:01.091869  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:01.092996  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:01.093221  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:01.093477  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603261093412 us; error 0 us; skew 500 ppm
I20260709 13:21:01.094195  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:01.097231  4246 webserver.cc:533] Webserver started at http://127.4.37.129:45465/ using document root <none> and password file <none>
I20260709 13:21:01.097911  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:01.098143  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:01.098495  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:01.099992  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-0-root/instance:
uuid: "acfddec6d2284f0897b1e3bf4daa721d"
format_stamp: "Formatted at 2026-07-09 13:21:01 on dist-test-slave-jk05"
I20260709 13:21:01.105949  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:21:01.110638 16477 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:01.111685  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:21:01.111956  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "acfddec6d2284f0897b1e3bf4daa721d"
format_stamp: "Formatted at 2026-07-09 13:21:01 on dist-test-slave-jk05"
I20260709 13:21:01.112216  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:01.137030  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:01.138547  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:01.140125  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:01.143757  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:01.143990  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:01.144194  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:01.144318  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:01.212149  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:46299
I20260709 13:21:01.212280 16539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:46299 every 8 connection(s)
I20260709 13:21:01.218147  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:01.230474 16544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:01.232650 16545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:01.235386 16540 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44837
I20260709 13:21:01.235922 16540 heartbeater.cc:461] Registering TS with master...
W20260709 13:21:01.236896 16547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:01.237067 16540 heartbeater.cc:507] Master 127.4.37.190:44837 requested a full tablet report, sending...
I20260709 13:21:01.237914  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:01.239161  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:01.239367  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:01.239596  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603261239554 us; error 0 us; skew 500 ppm
I20260709 13:21:01.239877 16413 ts_manager.cc:194] Registered new tserver with Master: acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299)
I20260709 13:21:01.240518  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:01.243211 16413 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54620
I20260709 13:21:01.245852  4246 webserver.cc:533] Webserver started at http://127.4.37.130:36427/ using document root <none> and password file <none>
I20260709 13:21:01.247030  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:01.247445  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:01.247864  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:01.250471  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-1-root/instance:
uuid: "d86d2660b98f41d59cf5056ac5345701"
format_stamp: "Formatted at 2026-07-09 13:21:01 on dist-test-slave-jk05"
I20260709 13:21:01.256616  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:21:01.260819 16552 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:01.262766  4246 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:21:01.263411  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-1-root
uuid: "d86d2660b98f41d59cf5056ac5345701"
format_stamp: "Formatted at 2026-07-09 13:21:01 on dist-test-slave-jk05"
I20260709 13:21:01.263882  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:01.276997  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:01.278467  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:01.280469  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:01.288796  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:01.289326  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:21:01.290192  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:01.290388  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:01.357360  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.130:39605
I20260709 13:21:01.357535 16614 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.130:39605 every 8 connection(s)
I20260709 13:21:01.365168  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:01.377816 16618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:01.379302 16619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:01.390599 16615 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44837
I20260709 13:21:01.390733  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:01.391211 16615 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:01.392091 16615 heartbeater.cc:507] Master 127.4.37.190:44837 requested a full tablet report, sending...
W20260709 13:21:01.392132 16621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:01.393514  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:01.393765  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:01.393975  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603261393953 us; error 0 us; skew 500 ppm
I20260709 13:21:01.394678  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:01.395234 16413 ts_manager.cc:194] Registered new tserver with Master: d86d2660b98f41d59cf5056ac5345701 (127.4.37.130:39605)
I20260709 13:21:01.397346 16413 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54628
I20260709 13:21:01.398129  4246 webserver.cc:533] Webserver started at http://127.4.37.131:36211/ using document root <none> and password file <none>
I20260709 13:21:01.398844  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:01.399144  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:01.399489  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:01.401875  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-2-root/instance:
uuid: "7db76a8916224d18b6f98ab3c6b15431"
format_stamp: "Formatted at 2026-07-09 13:21:01 on dist-test-slave-jk05"
I20260709 13:21:01.408687  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:21:01.412770 16626 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:01.413861  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:01.414207  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-2-root
uuid: "7db76a8916224d18b6f98ab3c6b15431"
format_stamp: "Formatted at 2026-07-09 13:21:01 on dist-test-slave-jk05"
I20260709 13:21:01.414528  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602897722324-4246-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:01.434825  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:01.436203  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:01.437932  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:01.440546  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:01.441272  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:21:01.441915  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:01.443203  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:21:01.515702  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.131:35219
I20260709 13:21:01.516153 16688 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.131:35219 every 8 connection(s)
I20260709 13:21:01.538098 16689 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44837
I20260709 13:21:01.538568 16689 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:01.539520 16689 heartbeater.cc:507] Master 127.4.37.190:44837 requested a full tablet report, sending...
I20260709 13:21:01.541862 16413 ts_manager.cc:194] Registered new tserver with Master: 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219)
I20260709 13:21:01.542032  4246 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021229527s
I20260709 13:21:01.543907 16413 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54632
I20260709 13:21:01.581326 16413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54646:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:01.584419 16413 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:01.662326 16580 tablet_service.cc:1511] Processing CreateTablet for tablet 39cac207653f446e9d3221b2efdba2c5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=92489b3b45414964b386321dbe93b25f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:01.663177 16579 tablet_service.cc:1511] Processing CreateTablet for tablet 4c49535722dc4e58803648e68ea212cc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=92489b3b45414964b386321dbe93b25f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:01.664207 16580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cac207653f446e9d3221b2efdba2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:01.666435 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c49535722dc4e58803648e68ea212cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:01.666049 16653 tablet_service.cc:1511] Processing CreateTablet for tablet 4c49535722dc4e58803648e68ea212cc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=92489b3b45414964b386321dbe93b25f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:01.668515 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c49535722dc4e58803648e68ea212cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:01.667670 16654 tablet_service.cc:1511] Processing CreateTablet for tablet 39cac207653f446e9d3221b2efdba2c5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=92489b3b45414964b386321dbe93b25f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:01.670482 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cac207653f446e9d3221b2efdba2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:01.676200 16505 tablet_service.cc:1511] Processing CreateTablet for tablet 39cac207653f446e9d3221b2efdba2c5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=92489b3b45414964b386321dbe93b25f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:01.678035 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cac207653f446e9d3221b2efdba2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:01.697785 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 4c49535722dc4e58803648e68ea212cc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=92489b3b45414964b386321dbe93b25f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:01.699508 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c49535722dc4e58803648e68ea212cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:01.717758 16708 tablet_bootstrap.cc:492] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701: Bootstrap starting.
I20260709 13:21:01.734622 16708 tablet_bootstrap.cc:654] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:01.732990 16707 tablet_bootstrap.cc:492] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431: Bootstrap starting.
I20260709 13:21:01.745289 16707 tablet_bootstrap.cc:654] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:01.749312 16710 tablet_bootstrap.cc:492] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d: Bootstrap starting.
I20260709 13:21:01.750428 16708 tablet_bootstrap.cc:492] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701: No bootstrap required, opened a new log
I20260709 13:21:01.751017 16708 ts_tablet_manager.cc:1403] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.008s
I20260709 13:21:01.754259 16707 tablet_bootstrap.cc:492] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431: No bootstrap required, opened a new log
I20260709 13:21:01.754829 16707 ts_tablet_manager.cc:1403] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.006s
I20260709 13:21:01.755071 16708 raft_consensus.cc:359] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.755970 16708 raft_consensus.cc:385] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:01.756327 16708 raft_consensus.cc:740] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Initialized, Role: FOLLOWER
I20260709 13:21:01.757253 16708 consensus_queue.cc:260] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.757807 16707 raft_consensus.cc:359] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.758574 16707 raft_consensus.cc:385] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:01.758844 16707 raft_consensus.cc:740] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7db76a8916224d18b6f98ab3c6b15431, State: Initialized, Role: FOLLOWER
I20260709 13:21:01.758898 16710 tablet_bootstrap.cc:654] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:01.759653 16707 consensus_queue.cc:260] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.766063 16689 heartbeater.cc:499] Master 127.4.37.190:44837 was elected leader, sending a full tablet report...
I20260709 13:21:01.766698 16707 ts_tablet_manager.cc:1434] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.002s
I20260709 13:21:01.767866 16707 tablet_bootstrap.cc:492] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431: Bootstrap starting.
I20260709 13:21:01.771971 16708 ts_tablet_manager.cc:1434] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.012s
I20260709 13:21:01.773075 16615 heartbeater.cc:499] Master 127.4.37.190:44837 was elected leader, sending a full tablet report...
I20260709 13:21:01.776328 16708 tablet_bootstrap.cc:492] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701: Bootstrap starting.
I20260709 13:21:01.784214 16712 raft_consensus.cc:493] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.791524 16712 raft_consensus.cc:515] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.795778 16707 tablet_bootstrap.cc:654] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:01.799273 16712 leader_election.cc:290] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299), 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219)
I20260709 13:21:01.812016 16708 tablet_bootstrap.cc:654] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:01.819171 16707 tablet_bootstrap.cc:492] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431: No bootstrap required, opened a new log
I20260709 13:21:01.819916 16707 ts_tablet_manager.cc:1403] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.011s
I20260709 13:21:01.819999 16710 tablet_bootstrap.cc:492] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d: No bootstrap required, opened a new log
I20260709 13:21:01.821643 16710 ts_tablet_manager.cc:1403] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d: Time spent bootstrapping tablet: real 0.074s	user 0.033s	sys 0.026s
I20260709 13:21:01.825989 16710 raft_consensus.cc:359] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.827184 16710 raft_consensus.cc:385] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:01.827533 16710 raft_consensus.cc:740] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acfddec6d2284f0897b1e3bf4daa721d, State: Initialized, Role: FOLLOWER
I20260709 13:21:01.828222 16710 consensus_queue.cc:260] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.828896 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c49535722dc4e58803648e68ea212cc" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d" is_pre_election: true
I20260709 13:21:01.825708 16707 raft_consensus.cc:359] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.830315 16515 raft_consensus.cc:2468] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 0.
I20260709 13:21:01.830705 16707 raft_consensus.cc:385] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:01.831048 16707 raft_consensus.cc:740] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7db76a8916224d18b6f98ab3c6b15431, State: Initialized, Role: FOLLOWER
I20260709 13:21:01.831303 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c49535722dc4e58803648e68ea212cc" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7db76a8916224d18b6f98ab3c6b15431" is_pre_election: true
I20260709 13:21:01.832101 16555 leader_election.cc:304] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acfddec6d2284f0897b1e3bf4daa721d, d86d2660b98f41d59cf5056ac5345701; no voters: 
I20260709 13:21:01.832053 16707 consensus_queue.cc:260] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.833990 16540 heartbeater.cc:499] Master 127.4.37.190:44837 was elected leader, sending a full tablet report...
I20260709 13:21:01.834558 16710 ts_tablet_manager.cc:1434] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.006s
I20260709 13:21:01.835636 16710 tablet_bootstrap.cc:492] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d: Bootstrap starting.
I20260709 13:21:01.836297 16664 raft_consensus.cc:2468] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 0.
I20260709 13:21:01.836948 16712 raft_consensus.cc:2804] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:01.837654 16712 raft_consensus.cc:493] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.838160 16712 raft_consensus.cc:3060] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:01.845965 16710 tablet_bootstrap.cc:654] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:01.850908 16707 ts_tablet_manager.cc:1434] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.004s
I20260709 13:21:01.861629 16712 raft_consensus.cc:515] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.866925 16712 leader_election.cc:290] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 1 election: Requested vote from peers acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299), 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219)
I20260709 13:21:01.867086 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c49535722dc4e58803648e68ea212cc" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
I20260709 13:21:01.867719 16515 raft_consensus.cc:3060] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:01.876006 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c49535722dc4e58803648e68ea212cc" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7db76a8916224d18b6f98ab3c6b15431"
I20260709 13:21:01.877188 16664 raft_consensus.cc:3060] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:01.893325 16515 raft_consensus.cc:2468] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 1.
I20260709 13:21:01.895906 16555 leader_election.cc:304] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acfddec6d2284f0897b1e3bf4daa721d, d86d2660b98f41d59cf5056ac5345701; no voters: 
I20260709 13:21:01.897307 16712 raft_consensus.cc:2804] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:01.897894 16712 raft_consensus.cc:697] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Becoming Leader. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Running, Role: LEADER
I20260709 13:21:01.898856 16712 consensus_queue.cc:237] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:01.908197 16710 tablet_bootstrap.cc:492] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d: No bootstrap required, opened a new log
I20260709 13:21:01.908216 16708 tablet_bootstrap.cc:492] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701: No bootstrap required, opened a new log
I20260709 13:21:01.909714 16664 raft_consensus.cc:2468] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 1.
I20260709 13:21:01.910708 16708 ts_tablet_manager.cc:1403] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701: Time spent bootstrapping tablet: real 0.135s	user 0.030s	sys 0.047s
I20260709 13:21:01.909716 16710 ts_tablet_manager.cc:1403] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d: Time spent bootstrapping tablet: real 0.074s	user 0.038s	sys 0.025s
I20260709 13:21:01.914867 16708 raft_consensus.cc:359] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.915916 16708 raft_consensus.cc:385] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:01.916019 16710 raft_consensus.cc:359] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.916320 16708 raft_consensus.cc:740] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Initialized, Role: FOLLOWER
I20260709 13:21:01.917004 16710 raft_consensus.cc:385] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:01.917629 16710 raft_consensus.cc:740] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acfddec6d2284f0897b1e3bf4daa721d, State: Initialized, Role: FOLLOWER
I20260709 13:21:01.917399 16708 consensus_queue.cc:260] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.918797 16710 consensus_queue.cc:260] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.918723 16410 catalog_manager.cc:5697] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 reported cstate change: term changed from 0 to 1, leader changed from <none> to d86d2660b98f41d59cf5056ac5345701 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "d86d2660b98f41d59cf5056ac5345701" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:01.920439 16708 ts_tablet_manager.cc:1434] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:01.923400 16710 ts_tablet_manager.cc:1434] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
W20260709 13:21:01.933773 16461 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:01.945132 16712 raft_consensus.cc:493] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.946362 16712 raft_consensus.cc:515] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.948348 16712 leader_election.cc:290] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219), acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299)
I20260709 13:21:01.949826 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cac207653f446e9d3221b2efdba2c5" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7db76a8916224d18b6f98ab3c6b15431" is_pre_election: true
I20260709 13:21:01.949962 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cac207653f446e9d3221b2efdba2c5" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d" is_pre_election: true
I20260709 13:21:01.950733 16664 raft_consensus.cc:2468] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 0.
I20260709 13:21:01.950749 16515 raft_consensus.cc:2468] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 0.
I20260709 13:21:01.952585 16553 leader_election.cc:304] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, d86d2660b98f41d59cf5056ac5345701; no voters: 
I20260709 13:21:01.953644 16712 raft_consensus.cc:2804] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:01.954216 16712 raft_consensus.cc:493] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:01.954516 16712 raft_consensus.cc:3060] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:01.960559 16712 raft_consensus.cc:515] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.966984 16712 leader_election.cc:290] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 1 election: Requested vote from peers 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219), acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299)
I20260709 13:21:01.968366 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cac207653f446e9d3221b2efdba2c5" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7db76a8916224d18b6f98ab3c6b15431"
I20260709 13:21:01.968950 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cac207653f446e9d3221b2efdba2c5" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
I20260709 13:21:01.969094 16664 raft_consensus.cc:3060] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:01.970537 16515 raft_consensus.cc:3060] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:01.976122 16664 raft_consensus.cc:2468] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 1.
I20260709 13:21:01.977640 16553 leader_election.cc:304] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, d86d2660b98f41d59cf5056ac5345701; no voters: 
I20260709 13:21:01.977659 16515 raft_consensus.cc:2468] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 1.
I20260709 13:21:01.978744 16712 raft_consensus.cc:2804] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:01.979233 16712 raft_consensus.cc:697] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Becoming Leader. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Running, Role: LEADER
I20260709 13:21:01.979907 16712 consensus_queue.cc:237] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:01.990870 16410 catalog_manager.cc:5697] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 reported cstate change: term changed from 0 to 1, leader changed from <none> to d86d2660b98f41d59cf5056ac5345701 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "d86d2660b98f41d59cf5056ac5345701" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:02.031704 16413 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54658:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:02.034276 16413 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:02.064713 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 37d5b196763a4c6691e95970ed06fad4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=190a7a760d3f4755b7adc595931bad16]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:02.065140 16580 tablet_service.cc:1511] Processing CreateTablet for tablet 37d5b196763a4c6691e95970ed06fad4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=190a7a760d3f4755b7adc595931bad16]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:02.066475 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d5b196763a4c6691e95970ed06fad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.066726 16580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d5b196763a4c6691e95970ed06fad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.066901 16654 tablet_service.cc:1511] Processing CreateTablet for tablet 37d5b196763a4c6691e95970ed06fad4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=190a7a760d3f4755b7adc595931bad16]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:21:02.068559 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37d5b196763a4c6691e95970ed06fad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.073675 16505 tablet_service.cc:1511] Processing CreateTablet for tablet 0684b21d741c4cc6aa22f371eee8d629 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=190a7a760d3f4755b7adc595931bad16]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:02.074651 16653 tablet_service.cc:1511] Processing CreateTablet for tablet 0684b21d741c4cc6aa22f371eee8d629 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=190a7a760d3f4755b7adc595931bad16]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:02.074817 16579 tablet_service.cc:1511] Processing CreateTablet for tablet 0684b21d741c4cc6aa22f371eee8d629 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=190a7a760d3f4755b7adc595931bad16]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:21:02.075201 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0684b21d741c4cc6aa22f371eee8d629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.075994 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0684b21d741c4cc6aa22f371eee8d629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.076217 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0684b21d741c4cc6aa22f371eee8d629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:02.090727 16710 tablet_bootstrap.cc:492] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d: Bootstrap starting.
I20260709 13:21:02.097995 16710 tablet_bootstrap.cc:654] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:02.101747 16708 tablet_bootstrap.cc:492] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701: Bootstrap starting.
I20260709 13:21:02.112805 16708 tablet_bootstrap.cc:654] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:02.115222 16710 tablet_bootstrap.cc:492] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d: No bootstrap required, opened a new log
I20260709 13:21:02.116925 16710 ts_tablet_manager.cc:1403] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 13:21:02.117439 16707 tablet_bootstrap.cc:492] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431: Bootstrap starting.
I20260709 13:21:02.120952 16710 raft_consensus.cc:359] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.123492 16710 raft_consensus.cc:385] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:02.124142 16710 raft_consensus.cc:740] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acfddec6d2284f0897b1e3bf4daa721d, State: Initialized, Role: FOLLOWER
I20260709 13:21:02.126367 16710 consensus_queue.cc:260] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.127323 16708 tablet_bootstrap.cc:492] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701: No bootstrap required, opened a new log
I20260709 13:21:02.130642 16707 tablet_bootstrap.cc:654] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:02.128857 16710 ts_tablet_manager.cc:1434] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:21:02.132097 16710 tablet_bootstrap.cc:492] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d: Bootstrap starting.
I20260709 13:21:02.133795 16708 ts_tablet_manager.cc:1403] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.020s
I20260709 13:21:02.138846 16708 raft_consensus.cc:359] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.139573 16710 tablet_bootstrap.cc:654] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:02.139986 16708 raft_consensus.cc:385] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:02.140487 16708 raft_consensus.cc:740] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Initialized, Role: FOLLOWER
I20260709 13:21:02.146713 16708 consensus_queue.cc:260] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.148842 16707 tablet_bootstrap.cc:492] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431: No bootstrap required, opened a new log
I20260709 13:21:02.149621 16707 ts_tablet_manager.cc:1403] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431: Time spent bootstrapping tablet: real 0.032s	user 0.027s	sys 0.004s
I20260709 13:21:02.150588 16710 tablet_bootstrap.cc:492] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d: No bootstrap required, opened a new log
I20260709 13:21:02.149622 16708 ts_tablet_manager.cc:1434] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:21:02.151312 16710 ts_tablet_manager.cc:1403] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:21:02.152000 16708 tablet_bootstrap.cc:492] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701: Bootstrap starting.
I20260709 13:21:02.153682 16707 raft_consensus.cc:359] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.154497 16707 raft_consensus.cc:385] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:02.154851 16707 raft_consensus.cc:740] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7db76a8916224d18b6f98ab3c6b15431, State: Initialized, Role: FOLLOWER
I20260709 13:21:02.154691 16710 raft_consensus.cc:359] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.155560 16710 raft_consensus.cc:385] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:02.155850 16707 consensus_queue.cc:260] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.158571 16707 ts_tablet_manager.cc:1434] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:21:02.155869 16710 raft_consensus.cc:740] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acfddec6d2284f0897b1e3bf4daa721d, State: Initialized, Role: FOLLOWER
I20260709 13:21:02.162135 16708 tablet_bootstrap.cc:654] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:02.162616 16710 consensus_queue.cc:260] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.168012 16707 tablet_bootstrap.cc:492] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431: Bootstrap starting.
I20260709 13:21:02.172099 16710 ts_tablet_manager.cc:1434] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:21:02.175567 16708 tablet_bootstrap.cc:492] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701: No bootstrap required, opened a new log
I20260709 13:21:02.176229 16708 ts_tablet_manager.cc:1403] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:21:02.179400 16708 raft_consensus.cc:359] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.179973 16707 tablet_bootstrap.cc:654] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:02.180038 16708 raft_consensus.cc:385] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:02.181156 16708 raft_consensus.cc:740] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Initialized, Role: FOLLOWER
I20260709 13:21:02.182004 16708 consensus_queue.cc:260] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.187595 16708 ts_tablet_manager.cc:1434] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.006s
I20260709 13:21:02.192029 16707 tablet_bootstrap.cc:492] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431: No bootstrap required, opened a new log
I20260709 13:21:02.192713 16707 ts_tablet_manager.cc:1403] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260709 13:21:02.195334 16707 raft_consensus.cc:359] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.196135 16707 raft_consensus.cc:385] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:02.196388 16707 raft_consensus.cc:740] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7db76a8916224d18b6f98ab3c6b15431, State: Initialized, Role: FOLLOWER
I20260709 13:21:02.197103 16707 consensus_queue.cc:260] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.199433 16707 ts_tablet_manager.cc:1434] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:21:02.286461 16712 consensus_queue.cc:1048] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:02.298964 16718 raft_consensus.cc:493] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.299849 16718 raft_consensus.cc:515] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.307304 16718 leader_election.cc:290] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d86d2660b98f41d59cf5056ac5345701 (127.4.37.130:39605), 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219)
I20260709 13:21:02.314479 16736 consensus_queue.cc:1048] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:02.338315 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d5b196763a4c6691e95970ed06fad4" candidate_uuid: "acfddec6d2284f0897b1e3bf4daa721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7db76a8916224d18b6f98ab3c6b15431" is_pre_election: true
I20260709 13:21:02.339016 16664 raft_consensus.cc:2468] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acfddec6d2284f0897b1e3bf4daa721d in term 0.
I20260709 13:21:02.339957 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d5b196763a4c6691e95970ed06fad4" candidate_uuid: "acfddec6d2284f0897b1e3bf4daa721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d86d2660b98f41d59cf5056ac5345701" is_pre_election: true
I20260709 13:21:02.340298 16478 leader_election.cc:304] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, acfddec6d2284f0897b1e3bf4daa721d; no voters: 
I20260709 13:21:02.340775 16590 raft_consensus.cc:2468] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acfddec6d2284f0897b1e3bf4daa721d in term 0.
I20260709 13:21:02.341307 16718 raft_consensus.cc:2804] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:02.341751 16718 raft_consensus.cc:493] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.341991 16718 raft_consensus.cc:3060] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:02.349682 16718 raft_consensus.cc:515] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.352233 16718 leader_election.cc:290] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [CANDIDATE]: Term 1 election: Requested vote from peers d86d2660b98f41d59cf5056ac5345701 (127.4.37.130:39605), 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219)
I20260709 13:21:02.353224 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d5b196763a4c6691e95970ed06fad4" candidate_uuid: "acfddec6d2284f0897b1e3bf4daa721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d86d2660b98f41d59cf5056ac5345701"
I20260709 13:21:02.353359 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d5b196763a4c6691e95970ed06fad4" candidate_uuid: "acfddec6d2284f0897b1e3bf4daa721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7db76a8916224d18b6f98ab3c6b15431"
I20260709 13:21:02.353900 16590 raft_consensus.cc:3060] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:02.354040 16664 raft_consensus.cc:3060] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:02.360153 16664 raft_consensus.cc:2468] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acfddec6d2284f0897b1e3bf4daa721d in term 1.
I20260709 13:21:02.360311 16590 raft_consensus.cc:2468] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acfddec6d2284f0897b1e3bf4daa721d in term 1.
I20260709 13:21:02.361526 16478 leader_election.cc:304] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, acfddec6d2284f0897b1e3bf4daa721d; no voters: 
I20260709 13:21:02.362317 16718 raft_consensus.cc:2804] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:02.363420 16718 raft_consensus.cc:697] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 1 LEADER]: Becoming Leader. State: Replica: acfddec6d2284f0897b1e3bf4daa721d, State: Running, Role: LEADER
I20260709 13:21:02.364267 16718 consensus_queue.cc:237] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.371876 16410 catalog_manager.cc:5697] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d reported cstate change: term changed from 0 to 1, leader changed from <none> to acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129). New cstate: current_term: 1 leader_uuid: "acfddec6d2284f0897b1e3bf4daa721d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:02.440807 16713 raft_consensus.cc:493] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:02.442140 16713 raft_consensus.cc:515] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.444603 16713 leader_election.cc:290] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299), d86d2660b98f41d59cf5056ac5345701 (127.4.37.130:39605)
I20260709 13:21:02.457247 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0684b21d741c4cc6aa22f371eee8d629" candidate_uuid: "7db76a8916224d18b6f98ab3c6b15431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d" is_pre_election: true
I20260709 13:21:02.458185 16515 raft_consensus.cc:2468] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7db76a8916224d18b6f98ab3c6b15431 in term 0.
I20260709 13:21:02.459045 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0684b21d741c4cc6aa22f371eee8d629" candidate_uuid: "7db76a8916224d18b6f98ab3c6b15431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d86d2660b98f41d59cf5056ac5345701" is_pre_election: true
I20260709 13:21:02.459450 16629 leader_election.cc:304] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, acfddec6d2284f0897b1e3bf4daa721d; no voters: 
I20260709 13:21:02.459923 16590 raft_consensus.cc:2468] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7db76a8916224d18b6f98ab3c6b15431 in term 0.
I20260709 13:21:02.460585 16713 raft_consensus.cc:2804] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:02.460978 16713 raft_consensus.cc:493] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:02.461349 16713 raft_consensus.cc:3060] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:02.468881 16713 raft_consensus.cc:515] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.470718 16713 leader_election.cc:290] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [CANDIDATE]: Term 1 election: Requested vote from peers acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299), d86d2660b98f41d59cf5056ac5345701 (127.4.37.130:39605)
I20260709 13:21:02.472046 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0684b21d741c4cc6aa22f371eee8d629" candidate_uuid: "7db76a8916224d18b6f98ab3c6b15431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d86d2660b98f41d59cf5056ac5345701"
I20260709 13:21:02.471971 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0684b21d741c4cc6aa22f371eee8d629" candidate_uuid: "7db76a8916224d18b6f98ab3c6b15431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
I20260709 13:21:02.472851 16590 raft_consensus.cc:3060] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:02.472957 16515 raft_consensus.cc:3060] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:02.478385 16590 raft_consensus.cc:2468] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7db76a8916224d18b6f98ab3c6b15431 in term 1.
I20260709 13:21:02.478883 16515 raft_consensus.cc:2468] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7db76a8916224d18b6f98ab3c6b15431 in term 1.
I20260709 13:21:02.479658 16629 leader_election.cc:304] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, d86d2660b98f41d59cf5056ac5345701; no voters: 
I20260709 13:21:02.480480 16713 raft_consensus.cc:2804] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:02.481705 16713 raft_consensus.cc:697] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 LEADER]: Becoming Leader. State: Replica: 7db76a8916224d18b6f98ab3c6b15431, State: Running, Role: LEADER
I20260709 13:21:02.482445 16713 consensus_queue.cc:237] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.491096 16410 catalog_manager.cc:5697] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "7db76a8916224d18b6f98ab3c6b15431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.526173 16712 consensus_queue.cc:1048] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:02.537762 16590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39cac207653f446e9d3221b2efdba2c5"
dest_uuid: "d86d2660b98f41d59cf5056ac5345701"
mode: GRACEFUL
new_leader_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
 from {username='slave'} at 127.0.0.1:54072
I20260709 13:21:02.538544 16590 raft_consensus.cc:606] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Received request to transfer leadership to TS acfddec6d2284f0897b1e3bf4daa721d
I20260709 13:21:02.543097 16712 consensus_queue.cc:1048] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:02.547686 16590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c49535722dc4e58803648e68ea212cc"
dest_uuid: "d86d2660b98f41d59cf5056ac5345701"
mode: GRACEFUL
new_leader_uuid: "7db76a8916224d18b6f98ab3c6b15431"
 from {username='slave'} at 127.0.0.1:54072
I20260709 13:21:02.548367 16590 raft_consensus.cc:606] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Received request to transfer leadership to TS 7db76a8916224d18b6f98ab3c6b15431
I20260709 13:21:02.556669 16712 raft_consensus.cc:993] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701: : Instructing follower acfddec6d2284f0897b1e3bf4daa721d to start an election
I20260709 13:21:02.557281 16712 raft_consensus.cc:1081] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Signalling peer acfddec6d2284f0897b1e3bf4daa721d to start an election
I20260709 13:21:02.559092 16515 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39cac207653f446e9d3221b2efdba2c5"
dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
 from {username='slave'} at 127.0.0.1:33280
I20260709 13:21:02.559774 16515 raft_consensus.cc:493] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:02.560163 16515 raft_consensus.cc:3060] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.568910 16515 raft_consensus.cc:515] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:02.571954 16515 leader_election.cc:290] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [CANDIDATE]: Term 2 election: Requested vote from peers d86d2660b98f41d59cf5056ac5345701 (127.4.37.130:39605), 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219)
I20260709 13:21:02.572135 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cac207653f446e9d3221b2efdba2c5" candidate_uuid: "acfddec6d2284f0897b1e3bf4daa721d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d86d2660b98f41d59cf5056ac5345701"
I20260709 13:21:02.572718 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cac207653f446e9d3221b2efdba2c5" candidate_uuid: "acfddec6d2284f0897b1e3bf4daa721d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7db76a8916224d18b6f98ab3c6b15431"
I20260709 13:21:02.573293 16590 raft_consensus.cc:3055] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:02.572013 16664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0684b21d741c4cc6aa22f371eee8d629"
dest_uuid: "7db76a8916224d18b6f98ab3c6b15431"
mode: GRACEFUL
new_leader_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
 from {username='slave'} at 127.0.0.1:50960
I20260709 13:21:02.573458 16663 raft_consensus.cc:3060] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.573760 16590 raft_consensus.cc:740] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Running, Role: LEADER
I20260709 13:21:02.574095 16664 raft_consensus.cc:606] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 LEADER]: Received request to transfer leadership to TS acfddec6d2284f0897b1e3bf4daa721d
I20260709 13:21:02.574819 16590 consensus_queue.cc:260] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:02.577951 16590 raft_consensus.cc:3060] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.582840 16663 raft_consensus.cc:2468] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acfddec6d2284f0897b1e3bf4daa721d in term 2.
I20260709 13:21:02.584327 16478 leader_election.cc:304] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, acfddec6d2284f0897b1e3bf4daa721d; no voters: 
I20260709 13:21:02.585263 16718 raft_consensus.cc:2804] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:02.585846 16718 raft_consensus.cc:697] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 2 LEADER]: Becoming Leader. State: Replica: acfddec6d2284f0897b1e3bf4daa721d, State: Running, Role: LEADER
I20260709 13:21:02.586257 16590 raft_consensus.cc:2468] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acfddec6d2284f0897b1e3bf4daa721d in term 2.
I20260709 13:21:02.586705 16718 consensus_queue.cc:237] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } }
I20260709 13:21:02.595542 16411 catalog_manager.cc:5697] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d reported cstate change: term changed from 1 to 2, leader changed from d86d2660b98f41d59cf5056ac5345701 (127.4.37.130) to acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129). New cstate: current_term: 2 leader_uuid: "acfddec6d2284f0897b1e3bf4daa721d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.813195 16718 consensus_queue.cc:1048] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:02.828636 16744 consensus_queue.cc:1048] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:02.871462 16712 raft_consensus.cc:993] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701: : Instructing follower 7db76a8916224d18b6f98ab3c6b15431 to start an election
I20260709 13:21:02.871960 16715 raft_consensus.cc:1081] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Signalling peer 7db76a8916224d18b6f98ab3c6b15431 to start an election
I20260709 13:21:02.873952 16663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c49535722dc4e58803648e68ea212cc"
dest_uuid: "7db76a8916224d18b6f98ab3c6b15431"
 from {username='slave'} at 127.0.0.1:50942
I20260709 13:21:02.874502 16663 raft_consensus.cc:493] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:02.874781 16663 raft_consensus.cc:3060] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.880839 16663 raft_consensus.cc:515] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.884207 16663 leader_election.cc:290] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [CANDIDATE]: Term 2 election: Requested vote from peers acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299), d86d2660b98f41d59cf5056ac5345701 (127.4.37.130:39605)
I20260709 13:21:02.886418 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c49535722dc4e58803648e68ea212cc" candidate_uuid: "7db76a8916224d18b6f98ab3c6b15431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d86d2660b98f41d59cf5056ac5345701"
I20260709 13:21:02.886196 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c49535722dc4e58803648e68ea212cc" candidate_uuid: "7db76a8916224d18b6f98ab3c6b15431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
I20260709 13:21:02.887254 16590 raft_consensus.cc:3055] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:02.887254 16515 raft_consensus.cc:3060] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.887832 16590 raft_consensus.cc:740] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Running, Role: LEADER
I20260709 13:21:02.889034 16590 consensus_queue.cc:260] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.891700 16590 raft_consensus.cc:3060] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.898460 16515 raft_consensus.cc:2468] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7db76a8916224d18b6f98ab3c6b15431 in term 2.
I20260709 13:21:02.900048 16629 leader_election.cc:304] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, acfddec6d2284f0897b1e3bf4daa721d; no voters: 
I20260709 13:21:02.900161 16590 raft_consensus.cc:2468] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7db76a8916224d18b6f98ab3c6b15431 in term 2.
I20260709 13:21:02.901446 16713 raft_consensus.cc:2804] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:02.902190 16713 raft_consensus.cc:697] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 2 LEADER]: Becoming Leader. State: Replica: 7db76a8916224d18b6f98ab3c6b15431, State: Running, Role: LEADER
I20260709 13:21:02.903126 16713 consensus_queue.cc:237] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.912598 16411 catalog_manager.cc:5697] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 reported cstate change: term changed from 1 to 2, leader changed from d86d2660b98f41d59cf5056ac5345701 (127.4.37.130) to 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "7db76a8916224d18b6f98ab3c6b15431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:02.941998 16713 consensus_queue.cc:1048] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:02.952194 16749 raft_consensus.cc:993] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431: : Instructing follower acfddec6d2284f0897b1e3bf4daa721d to start an election
I20260709 13:21:02.954069 16749 raft_consensus.cc:1081] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 LEADER]: Signalling peer acfddec6d2284f0897b1e3bf4daa721d to start an election
I20260709 13:21:02.957239 16514 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0684b21d741c4cc6aa22f371eee8d629"
dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
 from {username='slave'} at 127.0.0.1:33286
I20260709 13:21:02.958644 16514 raft_consensus.cc:493] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:02.959215 16514 raft_consensus.cc:3060] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.960776 16749 consensus_queue.cc:1048] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:02.969875 16514 raft_consensus.cc:515] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.973517 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0684b21d741c4cc6aa22f371eee8d629" candidate_uuid: "acfddec6d2284f0897b1e3bf4daa721d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7db76a8916224d18b6f98ab3c6b15431"
I20260709 13:21:02.974038 16514 leader_election.cc:290] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [CANDIDATE]: Term 2 election: Requested vote from peers d86d2660b98f41d59cf5056ac5345701 (127.4.37.130:39605), 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219)
I20260709 13:21:02.974215 16663 raft_consensus.cc:3055] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:02.974681 16663 raft_consensus.cc:740] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7db76a8916224d18b6f98ab3c6b15431, State: Running, Role: LEADER
I20260709 13:21:02.973538 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0684b21d741c4cc6aa22f371eee8d629" candidate_uuid: "acfddec6d2284f0897b1e3bf4daa721d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d86d2660b98f41d59cf5056ac5345701"
I20260709 13:21:02.975548 16663 consensus_queue.cc:260] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.976022 16589 raft_consensus.cc:3060] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.977134 16663 raft_consensus.cc:3060] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:02.984620 16663 raft_consensus.cc:2468] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acfddec6d2284f0897b1e3bf4daa721d in term 2.
I20260709 13:21:02.984620 16589 raft_consensus.cc:2468] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acfddec6d2284f0897b1e3bf4daa721d in term 2.
I20260709 13:21:02.986261 16478 leader_election.cc:304] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, acfddec6d2284f0897b1e3bf4daa721d; no voters: 
I20260709 13:21:02.987119 16744 raft_consensus.cc:2804] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:02.987629 16744 raft_consensus.cc:697] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 2 LEADER]: Becoming Leader. State: Replica: acfddec6d2284f0897b1e3bf4daa721d, State: Running, Role: LEADER
I20260709 13:21:02.988456 16744 consensus_queue.cc:237] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:02.995508 16413 catalog_manager.cc:5697] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d reported cstate change: term changed from 1 to 2, leader changed from 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131) to acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129). New cstate: current_term: 2 leader_uuid: "acfddec6d2284f0897b1e3bf4daa721d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.089191  4246 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:21:03.091473  4246 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:21:03.091930  4246 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:21:03.098299 16663 raft_consensus.cc:1275] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Refusing update from remote peer acfddec6d2284f0897b1e3bf4daa721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:03.099848 16744 consensus_queue.cc:1048] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:03.107403 16514 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37d5b196763a4c6691e95970ed06fad4"
dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
mode: GRACEFUL
new_leader_uuid: "d86d2660b98f41d59cf5056ac5345701"
 from {username='slave'} at 127.0.0.1:55230
I20260709 13:21:03.110970 16589 raft_consensus.cc:1275] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Refusing update from remote peer acfddec6d2284f0897b1e3bf4daa721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:03.111848 16514 raft_consensus.cc:606] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 1 LEADER]: Received request to transfer leadership to TS d86d2660b98f41d59cf5056ac5345701
I20260709 13:21:03.112568 16718 consensus_queue.cc:1048] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:03.114181  4246 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:21:03.396584 16514 raft_consensus.cc:1275] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Refusing update from remote peer 7db76a8916224d18b6f98ab3c6b15431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:03.398238 16749 consensus_queue.cc:1048] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:03.399111 16663 raft_consensus.cc:1275] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Refusing update from remote peer acfddec6d2284f0897b1e3bf4daa721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:03.400553 16718 consensus_queue.cc:1048] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:03.411422 16589 raft_consensus.cc:1275] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Refusing update from remote peer acfddec6d2284f0897b1e3bf4daa721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:03.411973 16590 raft_consensus.cc:1275] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Refusing update from remote peer 7db76a8916224d18b6f98ab3c6b15431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:03.413802 16744 consensus_queue.cc:1048] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:03.419049 16755 raft_consensus.cc:993] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d: : Instructing follower d86d2660b98f41d59cf5056ac5345701 to start an election
I20260709 13:21:03.419909 16744 raft_consensus.cc:1081] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 1 LEADER]: Signalling peer d86d2660b98f41d59cf5056ac5345701 to start an election
I20260709 13:21:03.422822 16589 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37d5b196763a4c6691e95970ed06fad4"
dest_uuid: "d86d2660b98f41d59cf5056ac5345701"
 from {username='slave'} at 127.0.0.1:54046
I20260709 13:21:03.423514 16589 raft_consensus.cc:493] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:03.423946 16589 raft_consensus.cc:3060] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:03.428772 16758 consensus_queue.cc:1048] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:03.437243 16589 raft_consensus.cc:515] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:03.441215 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d5b196763a4c6691e95970ed06fad4" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acfddec6d2284f0897b1e3bf4daa721d"
I20260709 13:21:03.441882 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37d5b196763a4c6691e95970ed06fad4" candidate_uuid: "d86d2660b98f41d59cf5056ac5345701" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7db76a8916224d18b6f98ab3c6b15431"
I20260709 13:21:03.442548 16663 raft_consensus.cc:3060] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:03.442920 16589 leader_election.cc:290] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 2 election: Requested vote from peers acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129:46299), 7db76a8916224d18b6f98ab3c6b15431 (127.4.37.131:35219)
I20260709 13:21:03.441942 16514 raft_consensus.cc:3055] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:03.449867 16514 raft_consensus.cc:740] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: acfddec6d2284f0897b1e3bf4daa721d, State: Running, Role: LEADER
I20260709 13:21:03.450798 16514 consensus_queue.cc:260] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:03.451200 16663 raft_consensus.cc:2468] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 2.
I20260709 13:21:03.452333 16514 raft_consensus.cc:3060] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:03.452986 16553 leader_election.cc:304] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7db76a8916224d18b6f98ab3c6b15431, d86d2660b98f41d59cf5056ac5345701; no voters: 
I20260709 13:21:03.453991 16715 raft_consensus.cc:2804] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:03.455149 16715 raft_consensus.cc:697] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 2 LEADER]: Becoming Leader. State: Replica: d86d2660b98f41d59cf5056ac5345701, State: Running, Role: LEADER
I20260709 13:21:03.456044 16715 consensus_queue.cc:237] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } }
I20260709 13:21:03.460038 16514 raft_consensus.cc:2468] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d86d2660b98f41d59cf5056ac5345701 in term 2.
I20260709 13:21:03.464591 16411 catalog_manager.cc:5697] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 reported cstate change: term changed from 1 to 2, leader changed from acfddec6d2284f0897b1e3bf4daa721d (127.4.37.129) to d86d2660b98f41d59cf5056ac5345701 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "d86d2660b98f41d59cf5056ac5345701" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acfddec6d2284f0897b1e3bf4daa721d" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 46299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d86d2660b98f41d59cf5056ac5345701" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 39605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7db76a8916224d18b6f98ab3c6b15431" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 35219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:03.498566  4246 tablet_server.cc:179] TabletServer@127.4.37.129:0 shutting down...
I20260709 13:21:03.523130  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:03.524048  4246 tablet_replica.cc:333] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d: stopping tablet replica
I20260709 13:21:03.524770  4246 raft_consensus.cc:2243] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.525982  4246 raft_consensus.cc:2272] T 0684b21d741c4cc6aa22f371eee8d629 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.529211  4246 tablet_replica.cc:333] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d: stopping tablet replica
I20260709 13:21:03.530048  4246 raft_consensus.cc:2243] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.530522  4246 raft_consensus.cc:2272] T 37d5b196763a4c6691e95970ed06fad4 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.533331  4246 tablet_replica.cc:333] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d: stopping tablet replica
I20260709 13:21:03.534029  4246 raft_consensus.cc:2243] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.534945  4246 raft_consensus.cc:2272] T 39cac207653f446e9d3221b2efdba2c5 P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.537549  4246 tablet_replica.cc:333] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d: stopping tablet replica
I20260709 13:21:03.538128  4246 raft_consensus.cc:2243] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.538604  4246 raft_consensus.cc:2272] T 4c49535722dc4e58803648e68ea212cc P acfddec6d2284f0897b1e3bf4daa721d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.567745  4246 tablet_server.cc:196] TabletServer@127.4.37.129:0 shutdown complete.
I20260709 13:21:03.582877  4246 tablet_server.cc:179] TabletServer@127.4.37.130:0 shutting down...
I20260709 13:21:03.604441  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:03.605094  4246 tablet_replica.cc:333] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701: stopping tablet replica
I20260709 13:21:03.605891  4246 raft_consensus.cc:2243] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.606474  4246 raft_consensus.cc:2272] T 0684b21d741c4cc6aa22f371eee8d629 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.609167  4246 tablet_replica.cc:333] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701: stopping tablet replica
I20260709 13:21:03.609844  4246 raft_consensus.cc:2243] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.610556  4246 pending_rounds.cc:70] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701: Trying to abort 1 pending ops.
I20260709 13:21:03.610742  4246 pending_rounds.cc:77] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638967126224896 op_type: NO_OP noop_request { }
I20260709 13:21:03.611079  4246 raft_consensus.cc:2889] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:03.611367  4246 raft_consensus.cc:2272] T 37d5b196763a4c6691e95970ed06fad4 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.613969  4246 tablet_replica.cc:333] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701: stopping tablet replica
I20260709 13:21:03.614547  4246 raft_consensus.cc:2243] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.615031  4246 raft_consensus.cc:2272] T 39cac207653f446e9d3221b2efdba2c5 P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.617588  4246 tablet_replica.cc:333] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701: stopping tablet replica
I20260709 13:21:03.618144  4246 raft_consensus.cc:2243] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.618597  4246 raft_consensus.cc:2272] T 4c49535722dc4e58803648e68ea212cc P d86d2660b98f41d59cf5056ac5345701 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.634109  4246 tablet_server.cc:196] TabletServer@127.4.37.130:0 shutdown complete.
I20260709 13:21:03.647346  4246 tablet_server.cc:179] TabletServer@127.4.37.131:0 shutting down...
I20260709 13:21:03.676143  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:03.676973  4246 tablet_replica.cc:333] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431: stopping tablet replica
I20260709 13:21:03.677716  4246 raft_consensus.cc:2243] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.678189  4246 raft_consensus.cc:2272] T 0684b21d741c4cc6aa22f371eee8d629 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.680506  4246 tablet_replica.cc:333] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431: stopping tablet replica
I20260709 13:21:03.681042  4246 raft_consensus.cc:2243] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.681551  4246 raft_consensus.cc:2272] T 37d5b196763a4c6691e95970ed06fad4 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.684329  4246 tablet_replica.cc:333] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431: stopping tablet replica
I20260709 13:21:03.684988  4246 raft_consensus.cc:2243] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.685989  4246 raft_consensus.cc:2272] T 4c49535722dc4e58803648e68ea212cc P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.688501  4246 tablet_replica.cc:333] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431: stopping tablet replica
I20260709 13:21:03.688988  4246 raft_consensus.cc:2243] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.689406  4246 raft_consensus.cc:2272] T 39cac207653f446e9d3221b2efdba2c5 P 7db76a8916224d18b6f98ab3c6b15431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.714756  4246 tablet_server.cc:196] TabletServer@127.4.37.131:0 shutdown complete.
I20260709 13:21:03.731003  4246 master.cc:562] Master@127.4.37.190:44837 shutting down...
I20260709 13:21:03.757664  4246 raft_consensus.cc:2243] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.758222  4246 raft_consensus.cc:2272] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.758504  4246 tablet_replica.cc:333] T 00000000000000000000000000000000 P de3d6c48baf943f38fdf60a8c3945089: stopping tablet replica
I20260709 13:21:03.781306  4246 master.cc:584] Master@127.4.37.190:44837 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3083 ms)
[----------] 6 tests from LeaderRebalancerTest (365916 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:21:03.822235  4246 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.37.190:36013
I20260709 13:21:03.823939  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:03.830552 16766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:03.830874 16765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:03.833690 16768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:03.833947  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:03.835093  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:03.835332  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:03.835501  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603263835479 us; error 0 us; skew 500 ppm
I20260709 13:21:03.836073  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:03.838707  4246 webserver.cc:533] Webserver started at http://127.4.37.190:45635/ using document root <none> and password file <none>
I20260709 13:21:03.839227  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:03.839437  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:03.839717  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:03.841042  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/master-0-root/instance:
uuid: "1457d84f7ef4443f873ebcbc7a44ff4a"
format_stamp: "Formatted at 2026-07-09 13:21:03 on dist-test-slave-jk05"
I20260709 13:21:03.846275  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:21:03.851300 16773 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:03.852257  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:21:03.852608  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/master-0-root
uuid: "1457d84f7ef4443f873ebcbc7a44ff4a"
format_stamp: "Formatted at 2026-07-09 13:21:03 on dist-test-slave-jk05"
I20260709 13:21:03.852952  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:03.874807  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:03.875964  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:03.927278  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.190:36013
I20260709 13:21:03.927448 16824 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.190:36013 every 8 connection(s)
I20260709 13:21:03.932118 16825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:03.944121 16825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a: Bootstrap starting.
I20260709 13:21:03.949759 16825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:03.954531 16825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a: No bootstrap required, opened a new log
I20260709 13:21:03.956856 16825 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1457d84f7ef4443f873ebcbc7a44ff4a" member_type: VOTER }
I20260709 13:21:03.957271 16825 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:03.957592 16825 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1457d84f7ef4443f873ebcbc7a44ff4a, State: Initialized, Role: FOLLOWER
I20260709 13:21:03.958230 16825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1457d84f7ef4443f873ebcbc7a44ff4a" member_type: VOTER }
I20260709 13:21:03.958664 16825 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:03.958935 16825 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:03.959255 16825 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:03.967229 16825 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1457d84f7ef4443f873ebcbc7a44ff4a" member_type: VOTER }
I20260709 13:21:03.968070 16825 leader_election.cc:304] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1457d84f7ef4443f873ebcbc7a44ff4a; no voters: 
I20260709 13:21:03.969883 16825 leader_election.cc:290] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:03.970131 16828 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:03.971707 16828 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 1 LEADER]: Becoming Leader. State: Replica: 1457d84f7ef4443f873ebcbc7a44ff4a, State: Running, Role: LEADER
I20260709 13:21:03.972433 16828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1457d84f7ef4443f873ebcbc7a44ff4a" member_type: VOTER }
I20260709 13:21:03.973317 16825 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:03.975562 16829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1457d84f7ef4443f873ebcbc7a44ff4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1457d84f7ef4443f873ebcbc7a44ff4a" member_type: VOTER } }
I20260709 13:21:03.976426 16829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:03.975611 16830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1457d84f7ef4443f873ebcbc7a44ff4a. Latest consensus state: current_term: 1 leader_uuid: "1457d84f7ef4443f873ebcbc7a44ff4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1457d84f7ef4443f873ebcbc7a44ff4a" member_type: VOTER } }
I20260709 13:21:03.976979 16830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:03.980185 16833 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:03.986083 16833 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:03.991381  4246 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:03.996367 16833 catalog_manager.cc:1383] Generated new cluster ID: 6d1469f4ce1f4334976e9a5f731106e6
I20260709 13:21:03.996681 16833 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:04.018292 16833 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:04.019920 16833 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:04.051631 16833 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a: Generated new TSK 0
I20260709 13:21:04.052332 16833 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:04.058770  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:04.065693 16846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:04.067054 16847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:04.069931 16849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:04.070061  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:04.071406  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:04.071789  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:04.071972  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603264071954 us; error 0 us; skew 500 ppm
I20260709 13:21:04.072605  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:04.075569  4246 webserver.cc:533] Webserver started at http://127.4.37.129:39385/ using document root <none> and password file <none>
I20260709 13:21:04.076085  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:04.076293  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:04.076573  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:04.077826  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-0-root/instance:
uuid: "5581e4f0fdf3412c9e169bd05c247948"
format_stamp: "Formatted at 2026-07-09 13:21:04 on dist-test-slave-jk05"
I20260709 13:21:04.083173  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:04.088169 16854 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.090070  4246 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:21:04.090596  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "5581e4f0fdf3412c9e169bd05c247948"
format_stamp: "Formatted at 2026-07-09 13:21:04 on dist-test-slave-jk05"
I20260709 13:21:04.090951  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:04.105773  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:04.107240  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:04.108982  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:04.112784  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:04.113108  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.113509  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:04.113749  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.164644  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:39451
I20260709 13:21:04.165055 16916 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:39451 every 8 connection(s)
I20260709 13:21:04.171914  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:04.182267 16921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:04.185151 16922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:04.189711 16917 heartbeater.cc:344] Connected to a master server at 127.4.37.190:36013
I20260709 13:21:04.190222 16917 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:04.191118 16917 heartbeater.cc:507] Master 127.4.37.190:36013 requested a full tablet report, sending...
W20260709 13:21:04.191323 16924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:04.191969  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:04.193110  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:04.193400  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:04.193645  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603264193625 us; error 0 us; skew 500 ppm
I20260709 13:21:04.193677 16790 ts_manager.cc:194] Registered new tserver with Master: 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451)
I20260709 13:21:04.194535  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:04.196247 16790 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43032
I20260709 13:21:04.197533  4246 webserver.cc:533] Webserver started at http://127.4.37.130:33635/ using document root <none> and password file <none>
I20260709 13:21:04.198135  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:04.198381  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:04.198658  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:04.199774  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-1-root/instance:
uuid: "3599d38261fe499e84ec6e5b55db87cc"
format_stamp: "Formatted at 2026-07-09 13:21:04 on dist-test-slave-jk05"
I20260709 13:21:04.204459  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:04.208469 16929 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.209621  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:04.210106  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-1-root
uuid: "3599d38261fe499e84ec6e5b55db87cc"
format_stamp: "Formatted at 2026-07-09 13:21:04 on dist-test-slave-jk05"
I20260709 13:21:04.210389  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:04.238083  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:04.239387  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:04.242450  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:04.248605  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:04.248988  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.249326  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:04.249655  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.002s	sys 0.000s
I20260709 13:21:04.310189  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.130:42119
I20260709 13:21:04.310287 16991 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.130:42119 every 8 connection(s)
I20260709 13:21:04.316291  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:04.324648 16995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:04.326951 16996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:04.331956  4246 server_base.cc:1061] running on GCE node
W20260709 13:21:04.332264 16998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:04.333853 16992 heartbeater.cc:344] Connected to a master server at 127.4.37.190:36013
I20260709 13:21:04.334141  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:21:04.334342 16992 heartbeater.cc:461] Registering TS with master...
W20260709 13:21:04.334507  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:04.334854  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603264334831 us; error 0 us; skew 500 ppm
I20260709 13:21:04.335389 16992 heartbeater.cc:507] Master 127.4.37.190:36013 requested a full tablet report, sending...
I20260709 13:21:04.335542  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:04.337961 16790 ts_manager.cc:194] Registered new tserver with Master: 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:04.338919  4246 webserver.cc:533] Webserver started at http://127.4.37.131:44125/ using document root <none> and password file <none>
I20260709 13:21:04.339584  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:04.339660 16790 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43038
I20260709 13:21:04.339849  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:04.340325  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:04.344118  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-2-root/instance:
uuid: "377c24fd9c7040eea797cad32ea6f601"
format_stamp: "Formatted at 2026-07-09 13:21:04 on dist-test-slave-jk05"
I20260709 13:21:04.350947  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.005s
I20260709 13:21:04.354928 17003 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.356022  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:21:04.356474  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-2-root
uuid: "377c24fd9c7040eea797cad32ea6f601"
format_stamp: "Formatted at 2026-07-09 13:21:04 on dist-test-slave-jk05"
I20260709 13:21:04.356801  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602897722324-4246-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:04.393218  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:04.394451  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:04.396133  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:04.399482  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:04.399902  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.400329  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:04.400533  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:04.461042  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.131:32835
I20260709 13:21:04.461683 17065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.131:32835 every 8 connection(s)
I20260709 13:21:04.478349 17066 heartbeater.cc:344] Connected to a master server at 127.4.37.190:36013
I20260709 13:21:04.478845 17066 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:04.479684 17066 heartbeater.cc:507] Master 127.4.37.190:36013 requested a full tablet report, sending...
I20260709 13:21:04.482519 16790 ts_manager.cc:194] Registered new tserver with Master: 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:04.483754  4246 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01763891s
I20260709 13:21:04.484257 16790 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43052
I20260709 13:21:04.517848 16790 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43056:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:04.520514 16790 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:04.612049 17031 tablet_service.cc:1511] Processing CreateTablet for tablet 3175ca44790543feac2c09a4e54d1016 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:04.612771 17029 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6d59b141324efc9b840bd7e5e4510f (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:04.614368 17031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3175ca44790543feac2c09a4e54d1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.615031 16882 tablet_service.cc:1511] Processing CreateTablet for tablet 3175ca44790543feac2c09a4e54d1016 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:04.616847 16882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3175ca44790543feac2c09a4e54d1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.618667 17030 tablet_service.cc:1511] Processing CreateTablet for tablet 699f2b86ba424b5caf2427b5baf231b8 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:04.619074 16880 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6d59b141324efc9b840bd7e5e4510f (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:04.620280 17030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699f2b86ba424b5caf2427b5baf231b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.620404 16880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6d59b141324efc9b840bd7e5e4510f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.624593 16879 tablet_service.cc:1511] Processing CreateTablet for tablet 0a10f6b5a9ec4a86bfc505e074eb89ea (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:04.625969 16957 tablet_service.cc:1511] Processing CreateTablet for tablet 3175ca44790543feac2c09a4e54d1016 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:04.626643 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a10f6b5a9ec4a86bfc505e074eb89ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.627600 16957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3175ca44790543feac2c09a4e54d1016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.627447 17028 tablet_service.cc:1511] Processing CreateTablet for tablet 0a10f6b5a9ec4a86bfc505e074eb89ea (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:04.629179 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a10f6b5a9ec4a86bfc505e074eb89ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.614959 16881 tablet_service.cc:1511] Processing CreateTablet for tablet 699f2b86ba424b5caf2427b5baf231b8 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:04.630998 16956 tablet_service.cc:1511] Processing CreateTablet for tablet 699f2b86ba424b5caf2427b5baf231b8 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:04.632238 16881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699f2b86ba424b5caf2427b5baf231b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.633016 16956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 699f2b86ba424b5caf2427b5baf231b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.633670 17029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6d59b141324efc9b840bd7e5e4510f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.633842 16878 tablet_service.cc:1511] Processing CreateTablet for tablet c9343a142b1949afb6f9f2f6d5f10ebb (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:04.635382 16878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9343a142b1949afb6f9f2f6d5f10ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.634996 16955 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6d59b141324efc9b840bd7e5e4510f (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:04.641721 16954 tablet_service.cc:1511] Processing CreateTablet for tablet 0a10f6b5a9ec4a86bfc505e074eb89ea (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:04.646495 16955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6d59b141324efc9b840bd7e5e4510f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.648468 16954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a10f6b5a9ec4a86bfc505e074eb89ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.660544 16953 tablet_service.cc:1511] Processing CreateTablet for tablet c9343a142b1949afb6f9f2f6d5f10ebb (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:04.663699 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9343a142b1949afb6f9f2f6d5f10ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.679945 17027 tablet_service.cc:1511] Processing CreateTablet for tablet c9343a142b1949afb6f9f2f6d5f10ebb (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:04.681617 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9343a142b1949afb6f9f2f6d5f10ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.682760 16877 tablet_service.cc:1511] Processing CreateTablet for tablet 8130a5849e7d4b48878df9e4ff6d48c4 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:04.684803 16877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8130a5849e7d4b48878df9e4ff6d48c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.691881 16951 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7d92610c01418f9b56c1213fd0114a (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:04.693583 16951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7d92610c01418f9b56c1213fd0114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.693797 16952 tablet_service.cc:1511] Processing CreateTablet for tablet 8130a5849e7d4b48878df9e4ff6d48c4 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:04.695736 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8130a5849e7d4b48878df9e4ff6d48c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.693823 16876 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7d92610c01418f9b56c1213fd0114a (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:04.697091 16876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7d92610c01418f9b56c1213fd0114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.687578 17026 tablet_service.cc:1511] Processing CreateTablet for tablet 8130a5849e7d4b48878df9e4ff6d48c4 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:04.699085 17026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8130a5849e7d4b48878df9e4ff6d48c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.722504 17025 tablet_service.cc:1511] Processing CreateTablet for tablet 9d7d92610c01418f9b56c1213fd0114a (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:04.724493 17025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d7d92610c01418f9b56c1213fd0114a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.735704 16875 tablet_service.cc:1511] Processing CreateTablet for tablet cf11378569ee4907aae5a4119cc741ff (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:04.739039 16950 tablet_service.cc:1511] Processing CreateTablet for tablet cf11378569ee4907aae5a4119cc741ff (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:04.740883 16950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf11378569ee4907aae5a4119cc741ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.745950 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf11378569ee4907aae5a4119cc741ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.760188 17081 tablet_bootstrap.cc:492] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:04.796514 17081 tablet_bootstrap.cc:654] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:04.797709 17024 tablet_service.cc:1511] Processing CreateTablet for tablet cf11378569ee4907aae5a4119cc741ff (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:04.799245 17024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf11378569ee4907aae5a4119cc741ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.824383 17082 tablet_bootstrap.cc:492] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:04.849814 17082 tablet_bootstrap.cc:654] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:04.877040 17082 tablet_bootstrap.cc:492] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:04.877694 17082 ts_tablet_manager.cc:1403] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.005s
I20260709 13:21:04.877508 16879 tablet_service.cc:1511] Processing CreateTablet for tablet 2834cb5f402f4562811a5743bfc32387 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:04.879132 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2834cb5f402f4562811a5743bfc32387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.881237 17082 raft_consensus.cc:359] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:04.881753 16957 tablet_service.cc:1511] Processing CreateTablet for tablet 2834cb5f402f4562811a5743bfc32387 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:04.884699 17082 raft_consensus.cc:385] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:04.885401 16957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2834cb5f402f4562811a5743bfc32387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.885525 17082 raft_consensus.cc:740] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:04.887699 17082 consensus_queue.cc:260] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:04.900254 17084 tablet_bootstrap.cc:492] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:04.916218 16917 heartbeater.cc:499] Master 127.4.37.190:36013 was elected leader, sending a full tablet report...
I20260709 13:21:04.926855 17027 tablet_service.cc:1511] Processing CreateTablet for tablet 2834cb5f402f4562811a5743bfc32387 (DEFAULT_TABLE table=test-workload [id=bcd837c5137d4e00a58beb7713826353]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:04.928380 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2834cb5f402f4562811a5743bfc32387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:04.929152 17082 ts_tablet_manager.cc:1434] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 13:21:04.930542 17082 tablet_bootstrap.cc:492] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:04.934254 17081 tablet_bootstrap.cc:492] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:04.934536 17084 tablet_bootstrap.cc:654] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:04.934851 17081 ts_tablet_manager.cc:1403] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.175s	user 0.024s	sys 0.018s
I20260709 13:21:04.937180 17082 tablet_bootstrap.cc:654] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:04.955907 17081 raft_consensus.cc:359] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:04.959781 17081 raft_consensus.cc:385] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:04.960223 17081 raft_consensus.cc:740] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:04.969905 17081 consensus_queue.cc:260] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
W20260709 13:21:04.986264 16838 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:04.992216 17082 tablet_bootstrap.cc:492] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:04.992455 17084 tablet_bootstrap.cc:492] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:04.992939 17082 ts_tablet_manager.cc:1403] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.032s
I20260709 13:21:04.993264 17084 ts_tablet_manager.cc:1403] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.024s
I20260709 13:21:04.996376 17082 raft_consensus.cc:359] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:04.997278 17082 raft_consensus.cc:385] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:04.997611 17082 raft_consensus.cc:740] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:04.997673 17084 raft_consensus.cc:359] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:04.998943 17084 raft_consensus.cc:385] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:04.999982 17084 raft_consensus.cc:740] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.000789 17084 consensus_queue.cc:260] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.001107 17081 ts_tablet_manager.cc:1434] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.066s	user 0.015s	sys 0.010s
I20260709 13:21:05.002686 17066 heartbeater.cc:499] Master 127.4.37.190:36013 was elected leader, sending a full tablet report...
I20260709 13:21:05.003047 17081 tablet_bootstrap.cc:492] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:04.998551 17082 consensus_queue.cc:260] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:05.012285 17081 tablet_bootstrap.cc:654] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.013967 17082 ts_tablet_manager.cc:1434] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:21:05.015177 17082 tablet_bootstrap.cc:492] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:05.021571 17082 tablet_bootstrap.cc:654] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.025269 16992 heartbeater.cc:499] Master 127.4.37.190:36013 was elected leader, sending a full tablet report...
I20260709 13:21:05.036947 17084 ts_tablet_manager.cc:1434] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.043s	user 0.015s	sys 0.007s
I20260709 13:21:05.038021 17082 tablet_bootstrap.cc:492] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:05.038651 17084 tablet_bootstrap.cc:492] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:05.038784 17082 ts_tablet_manager.cc:1403] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 13:21:05.042865 17082 raft_consensus.cc:359] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.043946 17082 raft_consensus.cc:385] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.044334 17082 raft_consensus.cc:740] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.052229 17084 tablet_bootstrap.cc:654] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.052647 17081 tablet_bootstrap.cc:492] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:05.053225 17081 ts_tablet_manager.cc:1403] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.024s
I20260709 13:21:05.045383 17082 consensus_queue.cc:260] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.056362 17082 ts_tablet_manager.cc:1434] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:21:05.057538 17082 tablet_bootstrap.cc:492] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:05.063421 17081 raft_consensus.cc:359] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.064165 17082 tablet_bootstrap.cc:654] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.064596 17081 raft_consensus.cc:385] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.065074 17081 raft_consensus.cc:740] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.066443 17081 consensus_queue.cc:260] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.075749 17081 ts_tablet_manager.cc:1434] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:21:05.078207 17081 tablet_bootstrap.cc:492] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:05.085595 17084 tablet_bootstrap.cc:492] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:05.086179 17084 ts_tablet_manager.cc:1403] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.024s
I20260709 13:21:05.086601 17082 tablet_bootstrap.cc:492] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:05.086885 17081 tablet_bootstrap.cc:654] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.087210 17082 ts_tablet_manager.cc:1403] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.014s
I20260709 13:21:05.090941 17082 raft_consensus.cc:359] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.091799 17082 raft_consensus.cc:385] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.091214 17084 raft_consensus.cc:359] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.092141 17082 raft_consensus.cc:740] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.092331 17084 raft_consensus.cc:385] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.092752 17084 raft_consensus.cc:740] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.093029 17081 tablet_bootstrap.cc:492] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:05.093693 17081 ts_tablet_manager.cc:1403] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:21:05.093394 17082 consensus_queue.cc:260] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.093518 17084 consensus_queue.cc:260] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.096032 17084 ts_tablet_manager.cc:1434] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:05.097061 17084 tablet_bootstrap.cc:492] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:05.097121 17081 raft_consensus.cc:359] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.098007 17081 raft_consensus.cc:385] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.098326 17081 raft_consensus.cc:740] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.099128 17081 consensus_queue.cc:260] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.100734 17090 raft_consensus.cc:493] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.101460 17081 ts_tablet_manager.cc:1434] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:21:05.101325 17090 raft_consensus.cc:515] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.102635 17081 tablet_bootstrap.cc:492] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:05.104502 17084 tablet_bootstrap.cc:654] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.113582 17090 leader_election.cc:290] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.114650 17081 tablet_bootstrap.cc:654] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.120752 17084 tablet_bootstrap.cc:492] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:05.121515 17084 ts_tablet_manager.cc:1403] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.005s
I20260709 13:21:05.125617 17084 raft_consensus.cc:359] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.126549 17084 raft_consensus.cc:385] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.126858 17084 raft_consensus.cc:740] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.127964 17082 ts_tablet_manager.cc:1434] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:21:05.127609 17084 consensus_queue.cc:260] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.128791 17081 tablet_bootstrap.cc:492] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:05.129555 17081 ts_tablet_manager.cc:1403] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 13:21:05.132522 17084 ts_tablet_manager.cc:1434] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:21:05.133903 17084 tablet_bootstrap.cc:492] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:05.133664 17081 raft_consensus.cc:359] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.134526 17081 raft_consensus.cc:385] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.134828 17081 raft_consensus.cc:740] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.135877 17081 consensus_queue.cc:260] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.138610 17081 ts_tablet_manager.cc:1434] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:21:05.139456 17082 tablet_bootstrap.cc:492] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:05.139631 17081 tablet_bootstrap.cc:492] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:05.141209 17084 tablet_bootstrap.cc:654] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.154100 17081 tablet_bootstrap.cc:654] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.158856 17082 tablet_bootstrap.cc:654] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.160820 17084 tablet_bootstrap.cc:492] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:05.161478 17084 ts_tablet_manager.cc:1403] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.011s
I20260709 13:21:05.164978 17084 raft_consensus.cc:359] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.165815 17084 raft_consensus.cc:385] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.166141 17084 raft_consensus.cc:740] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.169320 17084 consensus_queue.cc:260] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.169968 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.170641 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.171459 16892 raft_consensus.cc:2468] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
I20260709 13:21:05.171728 17041 raft_consensus.cc:2468] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
I20260709 13:21:05.172526 17084 ts_tablet_manager.cc:1434] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:21:05.174067 17084 tablet_bootstrap.cc:492] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:05.174328 16933 leader_election.cc:304] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:05.177983 17090 raft_consensus.cc:2804] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.178470 17090 raft_consensus.cc:493] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.178870 17090 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.183130 17084 tablet_bootstrap.cc:654] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.183931 17081 tablet_bootstrap.cc:492] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:05.184562 17081 ts_tablet_manager.cc:1403] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.005s
I20260709 13:21:05.188511 17090 raft_consensus.cc:515] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.188673 17081 raft_consensus.cc:359] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.189718 17081 raft_consensus.cc:385] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.190056 17081 raft_consensus.cc:740] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.190425 17084 tablet_bootstrap.cc:492] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:05.191155 17084 ts_tablet_manager.cc:1403] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.002s
I20260709 13:21:05.191641 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:05.191393 17081 consensus_queue.cc:260] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.192270 16892 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.192449 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:05.193080 17041 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.194653 17084 raft_consensus.cc:359] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:05.195592 17084 raft_consensus.cc:385] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.195945 17084 raft_consensus.cc:740] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.196817 17084 consensus_queue.cc:260] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:05.178802 17082 tablet_bootstrap.cc:492] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:05.198278 17082 ts_tablet_manager.cc:1403] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.008s
I20260709 13:21:05.202287 16892 raft_consensus.cc:2468] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:05.203953 16932 leader_election.cc:304] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.204967 17081 ts_tablet_manager.cc:1434] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:21:05.205893 17082 raft_consensus.cc:359] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.207203 17082 raft_consensus.cc:385] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.207679 17082 raft_consensus.cc:740] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.211280 17041 raft_consensus.cc:2468] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:05.211930 17090 leader_election.cc:290] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.219015 17090 raft_consensus.cc:2804] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.219580 17090 raft_consensus.cc:697] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:05.220424 17090 consensus_queue.cc:237] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.212634 17082 consensus_queue.cc:260] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.221331 17081 tablet_bootstrap.cc:492] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:05.231693 17081 tablet_bootstrap.cc:654] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.233101 17086 raft_consensus.cc:493] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.233981 17086 raft_consensus.cc:515] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.242023 17086 leader_election.cc:290] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.244486 17082 ts_tablet_manager.cc:1434] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.004s
I20260709 13:21:05.247917 17084 ts_tablet_manager.cc:1434] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.056s	user 0.029s	sys 0.024s
I20260709 13:21:05.249835 17084 tablet_bootstrap.cc:492] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:05.255925 17082 tablet_bootstrap.cc:492] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:05.259138 17084 tablet_bootstrap.cc:654] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.258805 16967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.262187 17081 tablet_bootstrap.cc:492] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:05.263311 17081 ts_tablet_manager.cc:1403] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.015s
W20260709 13:21:05.263604 16855 leader_election.cc:343] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:05.269644 17081 raft_consensus.cc:359] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.271171 17081 raft_consensus.cc:385] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.271960 17081 raft_consensus.cc:740] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.273337 17081 consensus_queue.cc:260] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.274056 17086 raft_consensus.cc:493] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.274690 17086 raft_consensus.cc:515] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.277805 17084 tablet_bootstrap.cc:492] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:05.278375 17086 leader_election.cc:290] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.278473 17084 ts_tablet_manager.cc:1403] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.009s
I20260709 13:21:05.279230 16967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.280381 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
W20260709 13:21:05.281533 16855 leader_election.cc:343] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:05.281904 16789 catalog_manager.cc:5697] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.282563 17084 raft_consensus.cc:359] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.283416 17084 raft_consensus.cc:385] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.283738 17084 raft_consensus.cc:740] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.284529 17084 consensus_queue.cc:260] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
W20260709 13:21:05.286319 16858 leader_election.cc:343] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:05.286964 17084 ts_tablet_manager.cc:1434] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:21:05.286926 16858 leader_election.cc:304] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5581e4f0fdf3412c9e169bd05c247948; no voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:05.287354 17082 tablet_bootstrap.cc:654] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.287849 17086 raft_consensus.cc:2749] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.288204 17084 tablet_bootstrap.cc:492] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:05.288483 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
W20260709 13:21:05.290119 16858 leader_election.cc:343] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:05.290803 16858 leader_election.cc:304] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5581e4f0fdf3412c9e169bd05c247948; no voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:05.292537 17086 raft_consensus.cc:2749] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.295436 17081 ts_tablet_manager.cc:1434] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.004s
I20260709 13:21:05.296988 17084 tablet_bootstrap.cc:654] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.300175 17082 tablet_bootstrap.cc:492] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:05.300740 17082 ts_tablet_manager.cc:1403] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.003s
I20260709 13:21:05.303668 17082 raft_consensus.cc:359] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.304423 17082 raft_consensus.cc:385] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.304325 17089 raft_consensus.cc:493] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.304955 17082 raft_consensus.cc:740] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.305138 17089 raft_consensus.cc:515] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.306128 17084 tablet_bootstrap.cc:492] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:05.306988 17084 ts_tablet_manager.cc:1403] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 13:21:05.306120 17082 consensus_queue.cc:260] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.308266 17081 tablet_bootstrap.cc:492] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:05.312287 17084 raft_consensus.cc:359] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.313210 17084 raft_consensus.cc:385] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.313623 17084 raft_consensus.cc:740] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.314229 17082 ts_tablet_manager.cc:1434] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:21:05.314734 17084 consensus_queue.cc:260] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.315971 17082 tablet_bootstrap.cc:492] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:05.317642 17084 ts_tablet_manager.cc:1434] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.006s
I20260709 13:21:05.319231 17084 tablet_bootstrap.cc:492] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:05.324798 17082 tablet_bootstrap.cc:654] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.329458 17084 tablet_bootstrap.cc:654] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.329953 17089 leader_election.cc:290] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.334609 17081 tablet_bootstrap.cc:654] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.340277 17089 raft_consensus.cc:493] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.341292 17089 raft_consensus.cc:515] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.344370 17089 leader_election.cc:290] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.349620 17089 raft_consensus.cc:493] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.350284 17089 raft_consensus.cc:515] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.352910 17089 leader_election.cc:290] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.359627 17082 tablet_bootstrap.cc:492] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:05.360278 17082 ts_tablet_manager.cc:1403] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.006s
I20260709 13:21:05.360818 17089 raft_consensus.cc:493] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.362350 17089 raft_consensus.cc:515] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:05.364207 17082 raft_consensus.cc:359] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.366938 17082 raft_consensus.cc:385] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.367328 17082 raft_consensus.cc:740] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.368255 17082 consensus_queue.cc:260] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.368783 17081 tablet_bootstrap.cc:492] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:05.369566 17081 ts_tablet_manager.cc:1403] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.013s
I20260709 13:21:05.373150 17081 raft_consensus.cc:359] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.374020 17081 raft_consensus.cc:385] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.374473 17081 raft_consensus.cc:740] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.375702 17089 leader_election.cc:290] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.377115 17081 consensus_queue.cc:260] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.379868 17081 ts_tablet_manager.cc:1434] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:05.381623 17081 tablet_bootstrap.cc:492] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:05.381688 17090 raft_consensus.cc:493] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.379868 17082 ts_tablet_manager.cc:1434] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:21:05.382827 17090 raft_consensus.cc:515] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.387046 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8130a5849e7d4b48878df9e4ff6d48c4" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.388471 17086 raft_consensus.cc:493] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.388511 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8130a5849e7d4b48878df9e4ff6d48c4" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.389256 17086 raft_consensus.cc:515] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:05.389767 17041 raft_consensus.cc:2468] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
W20260709 13:21:05.392038 16932 leader_election.cc:343] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:05.393721 17081 tablet_bootstrap.cc:654] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.393528 16933 leader_election.cc:304] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.394047 17086 leader_election.cc:290] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.395025 17104 raft_consensus.cc:2804] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.395633 17104 raft_consensus.cc:493] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.396095 17104 raft_consensus.cc:3060] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.398921 17082 tablet_bootstrap.cc:492] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:05.402354 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3175ca44790543feac2c09a4e54d1016" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.403384 17041 raft_consensus.cc:2468] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:05.404985 16858 leader_election.cc:304] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.406075 17081 tablet_bootstrap.cc:492] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:05.406334 17086 raft_consensus.cc:2804] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.406772 17081 ts_tablet_manager.cc:1403] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.012s
I20260709 13:21:05.407008 17086 raft_consensus.cc:493] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.407563 17086 raft_consensus.cc:3060] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.408371 17082 tablet_bootstrap.cc:654] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.410373 17081 raft_consensus.cc:359] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.411257 17081 raft_consensus.cc:385] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.411808 17081 raft_consensus.cc:740] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.413162 17081 consensus_queue.cc:260] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.417196 17081 ts_tablet_manager.cc:1434] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:21:05.418388 17081 tablet_bootstrap.cc:492] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:05.419654 17090 leader_election.cc:290] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.420295 17082 tablet_bootstrap.cc:492] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:05.421002 17105 raft_consensus.cc:493] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.421703 17105 raft_consensus.cc:515] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.421950 16967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3175ca44790543feac2c09a4e54d1016" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.422981 16967 raft_consensus.cc:2468] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:05.424500 17105 leader_election.cc:290] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.425329 17082 ts_tablet_manager.cc:1403] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.013s
I20260709 13:21:05.428452 17081 tablet_bootstrap.cc:654] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.428646 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.429687 17041 raft_consensus.cc:2468] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
I20260709 13:21:05.433936 16933 leader_election.cc:304] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:05.435374 17090 raft_consensus.cc:2804] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.435866 17090 raft_consensus.cc:493] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.436306 17090 raft_consensus.cc:3060] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:05.440536 16932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:39451, user_credentials={real_user=slave}} blocked reactor thread for 48557.8us
I20260709 13:21:05.444036 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.445294 16892 raft_consensus.cc:2468] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
I20260709 13:21:05.446429 17082 raft_consensus.cc:359] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.450205 17082 raft_consensus.cc:385] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.450815 17082 raft_consensus.cc:740] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.452160 17082 consensus_queue.cc:260] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.458048 17081 tablet_bootstrap.cc:492] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:05.458825 17081 ts_tablet_manager.cc:1403] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.020s
I20260709 13:21:05.460191 17126 raft_consensus.cc:493] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.462014 17081 raft_consensus.cc:359] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.463024 17081 raft_consensus.cc:385] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.462679 17126 raft_consensus.cc:515] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.463364 17081 raft_consensus.cc:740] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.461984 17082 ts_tablet_manager.cc:1434] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.006s
I20260709 13:21:05.464193 17081 consensus_queue.cc:260] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.465530 17084 tablet_bootstrap.cc:492] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:05.466318 17084 ts_tablet_manager.cc:1403] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.147s	user 0.052s	sys 0.091s
I20260709 13:21:05.467082 17082 tablet_bootstrap.cc:492] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:05.469870 17084 raft_consensus.cc:359] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.470846 17084 raft_consensus.cc:385] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.471220 17084 raft_consensus.cc:740] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.472147 17084 consensus_queue.cc:260] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.468729 17081 ts_tablet_manager.cc:1434] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:05.477106 17126 leader_election.cc:290] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.481173 17082 tablet_bootstrap.cc:654] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.478111 17084 ts_tablet_manager.cc:1434] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:21:05.483771 17084 tablet_bootstrap.cc:492] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:05.491057 17084 tablet_bootstrap.cc:654] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:05.491847 17086 raft_consensus.cc:515] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:05.498205 17125 raft_consensus.cc:493] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.499119 17125 raft_consensus.cc:515] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.503854 17090 raft_consensus.cc:515] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.508610 17089 raft_consensus.cc:493] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.508771 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3175ca44790543feac2c09a4e54d1016" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:05.509971 17040 raft_consensus.cc:3060] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.509678 17089 raft_consensus.cc:515] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.514925 17089 leader_election.cc:290] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.483302 17104 raft_consensus.cc:515] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.519158 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.520151 16892 raft_consensus.cc:2468] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:05.523219 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.524255 16892 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:05.526996 17006 leader_election.cc:304] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.529297 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.529753 16891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3175ca44790543feac2c09a4e54d1016" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.530714 16891 raft_consensus.cc:2393] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 377c24fd9c7040eea797cad32ea6f601 in current term 1: Already voted for candidate 5581e4f0fdf3412c9e169bd05c247948 in this term.
I20260709 13:21:05.530553 17039 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:05.531263 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.530702 17006 leader_election.cc:304] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.529968 17089 raft_consensus.cc:2804] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.532599 17089 raft_consensus.cc:493] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.533078 17089 raft_consensus.cc:3060] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.534252 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8130a5849e7d4b48878df9e4ff6d48c4" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:05.534500 16858 leader_election.cc:304] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.535207 16890 raft_consensus.cc:3060] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.535859 17126 raft_consensus.cc:2804] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.536226 17126 raft_consensus.cc:493] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.536569 17126 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.538837 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.539534 17086 leader_election.cc:290] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Requested vote from peers 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.539083 17125 leader_election.cc:290] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.539844 17041 raft_consensus.cc:2468] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:05.541260 16858 leader_election.cc:304] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.542241 17090 leader_election.cc:290] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.542616 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8130a5849e7d4b48878df9e4ff6d48c4" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.520200 17104 leader_election.cc:290] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.542959 17125 raft_consensus.cc:2804] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.543708 17125 raft_consensus.cc:493] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.544122 17125 raft_consensus.cc:3060] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.545881 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8130a5849e7d4b48878df9e4ff6d48c4" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:05.545773 17126 raft_consensus.cc:515] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.546578 17039 raft_consensus.cc:3060] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.549564 17126 leader_election.cc:290] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.550077 17038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:05.550595 17040 raft_consensus.cc:2468] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:05.550819 17038 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.551713 16858 leader_election.cc:304] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.552598 17037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:05.549605 17104 raft_consensus.cc:493] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.553380 17104 raft_consensus.cc:515] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.554407 16967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.555114 17082 tablet_bootstrap.cc:492] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:05.555107 16967 raft_consensus.cc:2468] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:05.555802 17082 ts_tablet_manager.cc:1403] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.044s
I20260709 13:21:05.555980 17104 leader_election.cc:290] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.556800 17126 raft_consensus.cc:2804] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.560060 17125 raft_consensus.cc:515] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.561513 17090 raft_consensus.cc:493] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.562505 17038 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:05.562700 17126 raft_consensus.cc:697] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:05.563354 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:05.564112 16891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.564482 17040 raft_consensus.cc:3060] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.564365 17082 raft_consensus.cc:359] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.565279 16891 raft_consensus.cc:2393] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3599d38261fe499e84ec6e5b55db87cc in current term 1: Already voted for candidate 5581e4f0fdf3412c9e169bd05c247948 in this term.
I20260709 13:21:05.565521 17082 raft_consensus.cc:385] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.565958 17082 raft_consensus.cc:740] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.566798 17082 consensus_queue.cc:260] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.562788 17090 raft_consensus.cc:515] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.568046 17086 raft_consensus.cc:493] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.568225 17039 raft_consensus.cc:2468] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:05.568749 17086 raft_consensus.cc:515] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.571715 17090 leader_election.cc:290] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.545874 17089 raft_consensus.cc:515] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.571489 17086 leader_election.cc:290] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.572799 17037 raft_consensus.cc:2393] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3599d38261fe499e84ec6e5b55db87cc in current term 1: Already voted for candidate 377c24fd9c7040eea797cad32ea6f601 in this term.
I20260709 13:21:05.573855 16967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.574659 16967 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:05.573884 16891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.576651 16891 raft_consensus.cc:2393] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3599d38261fe499e84ec6e5b55db87cc in current term 1: Already voted for candidate 5581e4f0fdf3412c9e169bd05c247948 in this term.
I20260709 13:21:05.576458 16967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3175ca44790543feac2c09a4e54d1016" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:05.577900 16967 raft_consensus.cc:3060] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.575592 17082 ts_tablet_manager.cc:1434] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:21:05.563848 17125 leader_election.cc:290] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.582054 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:05.582845 17040 raft_consensus.cc:2468] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:05.585831 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:05.586834 16966 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.589210 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:05.589951 17129 raft_consensus.cc:2764] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:21:05.590435 16965 raft_consensus.cc:3060] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:05.593207 17006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:39451, user_credentials={real_user=slave}} blocked reactor thread for 62596.7us
I20260709 13:21:05.594408 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.595815 16891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
W20260709 13:21:05.598886 17006 leader_election.cc:343] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:05.583765 16892 raft_consensus.cc:3060] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.603680 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.604176 16890 raft_consensus.cc:2468] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:05.604993 17040 raft_consensus.cc:2393] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3599d38261fe499e84ec6e5b55db87cc in current term 1: Already voted for candidate 5581e4f0fdf3412c9e169bd05c247948 in this term.
I20260709 13:21:05.606153 16932 leader_election.cc:304] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.607844 17104 raft_consensus.cc:2804] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.608544 17104 raft_consensus.cc:697] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:05.609678 17105 raft_consensus.cc:493] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.610175 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.611104 17041 raft_consensus.cc:2393] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3599d38261fe499e84ec6e5b55db87cc in current term 1: Already voted for candidate 5581e4f0fdf3412c9e169bd05c247948 in this term.
I20260709 13:21:05.611757 17104 consensus_queue.cc:237] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.577072 17089 leader_election.cc:290] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.613266 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.610443 17105 raft_consensus.cc:515] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.615273 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8130a5849e7d4b48878df9e4ff6d48c4" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.617462 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3175ca44790543feac2c09a4e54d1016" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.618157 17105 leader_election.cc:290] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.619386 16962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.620419 16967 raft_consensus.cc:2468] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:05.620893 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.620309 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.621649 16890 raft_consensus.cc:2468] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
I20260709 13:21:05.622090 16964 raft_consensus.cc:2393] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 377c24fd9c7040eea797cad32ea6f601 in current term 1: Already voted for candidate 3599d38261fe499e84ec6e5b55db87cc in this term.
I20260709 13:21:05.623350 16932 leader_election.cc:304] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.624814 17105 raft_consensus.cc:2804] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.625219 17105 raft_consensus.cc:493] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.625602 17105 raft_consensus.cc:3060] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.627617 17084 tablet_bootstrap.cc:492] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:05.628242 17084 ts_tablet_manager.cc:1403] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.145s	user 0.041s	sys 0.043s
I20260709 13:21:05.583737 17126 consensus_queue.cc:237] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } }
I20260709 13:21:05.631276 17084 raft_consensus.cc:359] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.632032 17084 raft_consensus.cc:385] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:05.632323 17084 raft_consensus.cc:740] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:05.634654 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:05.635293 16933 leader_election.cc:304] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc; no voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.635735 17084 consensus_queue.cc:260] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.636364 17089 raft_consensus.cc:493] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.635205 16892 raft_consensus.cc:2468] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:05.637356 16964 raft_consensus.cc:2393] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 377c24fd9c7040eea797cad32ea6f601 in current term 1: Already voted for candidate 3599d38261fe499e84ec6e5b55db87cc in this term.
I20260709 13:21:05.638092 16932 leader_election.cc:304] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:05.641963 16858 leader_election.cc:304] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.642689 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.643220 16858 leader_election.cc:304] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.644169 17125 raft_consensus.cc:2804] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.644686 17125 raft_consensus.cc:697] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:05.645671 17086 raft_consensus.cc:2804] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.636969 17089 raft_consensus.cc:515] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.646720 17125 consensus_queue.cc:237] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.650522 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.645172 16933 leader_election.cc:304] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc; no voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.651494 16892 raft_consensus.cc:2468] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:05.653081 17006 leader_election.cc:304] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.654650 17129 raft_consensus.cc:2804] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.653386 16789 catalog_manager.cc:5697] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.655356 17129 raft_consensus.cc:493] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.655900 17129 raft_consensus.cc:3060] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.667513 17086 raft_consensus.cc:697] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:05.668872 17086 consensus_queue.cc:237] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.676023 17104 raft_consensus.cc:2804] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.676944 17104 raft_consensus.cc:697] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:05.677852 17089 leader_election.cc:290] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
W20260709 13:21:05.679636 16855 leader_election.cc:343] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:05.667582 17105 raft_consensus.cc:515] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.686870 17004 leader_election.cc:304] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601; no voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.690157 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.700603 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.701833 17089 raft_consensus.cc:2749] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.643399 17040 raft_consensus.cc:2468] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:05.699151 17004 leader_election.cc:304] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601; no voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.712147 17089 raft_consensus.cc:493] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:05.713111 17004 leader_election.cc:343] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:05.713924 17004 leader_election.cc:304] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601; no voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.717499 16858 leader_election.cc:304] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 3599d38261fe499e84ec6e5b55db87cc
I20260709 13:21:05.719981 17130 raft_consensus.cc:2804] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.720667 17130 raft_consensus.cc:493] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.721176 17130 raft_consensus.cc:3060] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.724797 16966 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:05.694959 17104 consensus_queue.cc:237] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.730363 16964 raft_consensus.cc:2393] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 377c24fd9c7040eea797cad32ea6f601 in current term 1: Already voted for candidate 3599d38261fe499e84ec6e5b55db87cc in this term.
I20260709 13:21:05.731467 17136 raft_consensus.cc:2749] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.712908 17089 raft_consensus.cc:515] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.757155 17089 leader_election.cc:290] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.767416 17089 raft_consensus.cc:2749] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.767660 16965 raft_consensus.cc:2468] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:05.768747 17089 raft_consensus.cc:2749] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.770625 17090 raft_consensus.cc:2749] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.701217 17129 raft_consensus.cc:515] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.787460 17084 ts_tablet_manager.cc:1434] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.159s	user 0.062s	sys 0.062s
W20260709 13:21:05.783923 17004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:42119, user_credentials={real_user=slave}} blocked reactor thread for 70821.6us
I20260709 13:21:05.793048 17041 raft_consensus.cc:2393] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3599d38261fe499e84ec6e5b55db87cc in current term 1: Already voted for candidate 377c24fd9c7040eea797cad32ea6f601 in this term.
I20260709 13:21:05.794700 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
W20260709 13:21:05.784235 16932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.129:39451, user_credentials={real_user=slave}} blocked reactor thread for 146246us
I20260709 13:21:05.802178 16892 raft_consensus.cc:2468] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:05.802448 17129 leader_election.cc:290] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.802187 17004 leader_election.cc:304] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601; no voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.806239 17006 leader_election.cc:304] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.806458 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:05.807077 17105 leader_election.cc:290] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.807191 16890 raft_consensus.cc:3060] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.808910 17140 raft_consensus.cc:2804] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:05.809484 17140 raft_consensus.cc:493] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:05.809868 17140 raft_consensus.cc:3060] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.803730 17129 raft_consensus.cc:2749] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.811879 16789 catalog_manager.cc:5697] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.813834 17136 raft_consensus.cc:493] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:05.814401 17136 raft_consensus.cc:515] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.816705 17136 leader_election.cc:290] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.817972 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:05.817749 17130 raft_consensus.cc:515] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.820149 17130 leader_election.cc:290] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:05.821475 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:05.821246 17140 raft_consensus.cc:515] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.819273 16790 catalog_manager.cc:5697] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.823747 17140 leader_election.cc:290] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:05.822167 17041 raft_consensus.cc:3060] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.823633 16890 raft_consensus.cc:2468] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:05.827394 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:05.827930 16889 raft_consensus.cc:3060] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.826125 16891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:05.830037 16891 raft_consensus.cc:2393] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3599d38261fe499e84ec6e5b55db87cc in current term 1: Already voted for candidate 5581e4f0fdf3412c9e169bd05c247948 in this term.
I20260709 13:21:05.833371 16932 leader_election.cc:304] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.833649 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:05.834444 16965 raft_consensus.cc:2468] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:05.834573 17037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:05.835387 17037 raft_consensus.cc:2393] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3599d38261fe499e84ec6e5b55db87cc in current term 1: Already voted for candidate 377c24fd9c7040eea797cad32ea6f601 in this term.
I20260709 13:21:05.835749 17136 raft_consensus.cc:2804] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.836409 17136 raft_consensus.cc:697] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:05.836529 17105 consensus_queue.cc:1048] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:05.836714 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:05.837503 17136 consensus_queue.cc:237] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.836199 16889 raft_consensus.cc:2468] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 1.
I20260709 13:21:05.839094 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:05.839399 17006 leader_election.cc:304] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.839928 16965 raft_consensus.cc:3060] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.836925 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:05.855583 17004 leader_election.cc:304] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601; no voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.856657 17129 raft_consensus.cc:2804] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.856911 17140 raft_consensus.cc:2749] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.857375 17129 raft_consensus.cc:697] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:05.858780 17129 consensus_queue.cc:237] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.860002 16933 leader_election.cc:304] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc; no voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:05.860884 17090 consensus_queue.cc:1048] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:05.861076 17105 raft_consensus.cc:3060] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:05.862188 16965 raft_consensus.cc:2468] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 1.
I20260709 13:21:05.858963 16964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:05.858444 17041 raft_consensus.cc:2468] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:05.872817 17105 raft_consensus.cc:2749] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:05.873559 16858 leader_election.cc:304] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:05.879570 17130 raft_consensus.cc:2804] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:05.880137 17130 raft_consensus.cc:697] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:05.881090 17130 consensus_queue.cc:237] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:05.883219 16789 catalog_manager.cc:5697] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.888139 16788 catalog_manager.cc:5697] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.890508 16788 catalog_manager.cc:5697] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:05.912943 16790 catalog_manager.cc:5697] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 0 to 1, leader changed from <none> to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:05.926105 16964 raft_consensus.cc:2468] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:05.951859 16789 catalog_manager.cc:5697] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.060990 17133 consensus_queue.cc:1048] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.073904 17104 consensus_queue.cc:1048] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.076602 17130 consensus_queue.cc:1048] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.093335 17130 consensus_queue.cc:1048] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.100639 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
mode: GRACEFUL
new_leader_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:21:06.101409 16964 raft_consensus.cc:606] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Received request to transfer leadership to TS 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:06.103192 17130 consensus_queue.cc:1048] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:06.116194 16964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
mode: GRACEFUL
new_leader_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:21:06.117043 16964 raft_consensus.cc:606] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Received request to transfer leadership to TS 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:06.124468 17086 consensus_queue.cc:1048] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:06.128877 16965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
mode: GRACEFUL
new_leader_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:21:06.129578 16965 raft_consensus.cc:606] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Received request to transfer leadership to TS 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:06.157248 16892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
mode: GRACEFUL
new_leader_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:21:06.157954 16892 raft_consensus.cc:606] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Received request to transfer leadership to TS 3599d38261fe499e84ec6e5b55db87cc
I20260709 13:21:06.170491 16892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
mode: GRACEFUL
new_leader_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:21:06.171052 16892 raft_consensus.cc:606] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Received request to transfer leadership to TS 3599d38261fe499e84ec6e5b55db87cc
I20260709 13:21:06.172283 17134 consensus_queue.cc:1048] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.181529 17086 raft_consensus.cc:993] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948: : Instructing follower 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:06.182227 17086 raft_consensus.cc:1081] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Signalling peer 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:06.184859 16965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:21:06.185514 16965 raft_consensus.cc:493] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.185907 16965 raft_consensus.cc:3060] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.187173 17104 consensus_queue.cc:1048] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:06.189589 17134 consensus_queue.cc:1048] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.199373 16965 raft_consensus.cc:515] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.209928 16964 raft_consensus.cc:1240] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Rejecting Update request from peer 5581e4f0fdf3412c9e169bd05c247948 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:06.210330 17041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff"
dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
mode: GRACEFUL
new_leader_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:48126
I20260709 13:21:06.211402 17041 raft_consensus.cc:606] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Received request to transfer leadership to TS 3599d38261fe499e84ec6e5b55db87cc
I20260709 13:21:06.216630 16965 leader_election.cc:290] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:06.218453 17134 consensus_queue.cc:1059] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:06.219146 17090 raft_consensus.cc:993] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc: : Instructing follower 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:06.219558 17134 raft_consensus.cc:3055] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:06.219761 17090 raft_consensus.cc:1081] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Signalling peer 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:06.220039 17134 raft_consensus.cc:740] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:06.220575 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:06.221385 17041 raft_consensus.cc:3060] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.221215 17134 consensus_queue.cc:260] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.221092 16891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
mode: GRACEFUL
new_leader_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:21:06.222877 17134 raft_consensus.cc:3060] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.222930 16891 raft_consensus.cc:606] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Received request to transfer leadership to TS 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:06.218631 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d7d92610c01418f9b56c1213fd0114a" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:06.227870 16890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:44826
I20260709 13:21:06.228904 16890 raft_consensus.cc:493] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.229755 16890 raft_consensus.cc:3060] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.230909 17041 raft_consensus.cc:2468] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:06.233947 16933 leader_election.cc:304] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:06.234805 17090 consensus_queue.cc:1048] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.235015 17104 raft_consensus.cc:2804] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:06.235975 17104 raft_consensus.cc:697] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:06.237344 17104 consensus_queue.cc:237] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.244444 16890 raft_consensus.cc:515] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.245887 16891 raft_consensus.cc:1240] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Rejecting Update request from peer 3599d38261fe499e84ec6e5b55db87cc for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:06.248374 16889 raft_consensus.cc:2468] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:06.248648 17104 consensus_queue.cc:1059] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.249645 17104 raft_consensus.cc:3055] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:06.249972 17104 raft_consensus.cc:740] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:06.250989 17104 consensus_queue.cc:260] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.252049 17104 raft_consensus.cc:3060] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.251993 16787 catalog_manager.cc:5697] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 1 to 2, leader changed from 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129) to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.256789 16890 leader_election.cc:290] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:06.258845 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:06.259570 17039 raft_consensus.cc:3060] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.260926 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6d59b141324efc9b840bd7e5e4510f" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:06.261919 17090 consensus_queue.cc:1048] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.272468 17039 raft_consensus.cc:2468] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:06.274042 16858 leader_election.cc:304] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:06.274294 16965 raft_consensus.cc:2468] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:06.274899 17134 raft_consensus.cc:2804] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:06.275650 17134 raft_consensus.cc:697] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:06.276837 17134 consensus_queue.cc:237] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.290361 17104 consensus_queue.cc:1048] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:06.293257 16788 catalog_manager.cc:5697] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 1 to 2, leader changed from 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130) to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.301599 17105 raft_consensus.cc:993] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc: : Instructing follower 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:06.302362 17104 raft_consensus.cc:1081] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Signalling peer 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:06.304101 16890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:44826
I20260709 13:21:06.304697 16890 raft_consensus.cc:493] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.305020 16890 raft_consensus.cc:3060] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.309749 17129 consensus_queue.cc:1048] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.312521 16890 raft_consensus.cc:515] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.315367 16890 leader_election.cc:290] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:06.317521 17037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:06.318305 17037 raft_consensus.cc:3060] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.318382 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "699f2b86ba424b5caf2427b5baf231b8" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:06.319294 16965 raft_consensus.cc:3055] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:06.319626 16965 raft_consensus.cc:740] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:06.320489 16965 consensus_queue.cc:260] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.321843 16965 raft_consensus.cc:3060] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.327201 17104 raft_consensus.cc:993] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc: : Instructing follower 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:06.327718 17104 raft_consensus.cc:1081] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Signalling peer 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:06.326845 17134 consensus_queue.cc:1048] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:06.330157 16890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:44826
I20260709 13:21:06.332890 16890 raft_consensus.cc:493] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.334659 16890 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.335755 16965 raft_consensus.cc:2468] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:06.329761 17037 raft_consensus.cc:2468] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:06.337205 16858 leader_election.cc:304] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:06.339388 17125 raft_consensus.cc:2804] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:06.339900 17125 raft_consensus.cc:697] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:06.341521 17086 raft_consensus.cc:993] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948: : Instructing follower 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:06.342882 17086 raft_consensus.cc:1081] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Signalling peer 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:06.340921 17125 consensus_queue.cc:237] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.345294 16890 raft_consensus.cc:515] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.349647 16967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:06.350556 16967 raft_consensus.cc:3055] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:06.351152 16967 raft_consensus.cc:740] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:06.348889 16890 leader_election.cc:290] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:06.352007 16967 consensus_queue.cc:260] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.353832 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:06.354521 17041 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.356374 17039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387"
dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:48114
I20260709 13:21:06.357081 17039 raft_consensus.cc:493] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.357543 17039 raft_consensus.cc:3060] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.359201 17139 consensus_queue.cc:1048] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:06.359645 17125 consensus_queue.cc:1048] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:06.365578 16967 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.370232 17039 raft_consensus.cc:515] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.371265 17041 raft_consensus.cc:2468] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:06.374087 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:06.373492 16788 catalog_manager.cc:5697] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 1 to 2, leader changed from 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130) to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.374856 16889 raft_consensus.cc:3055] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:06.375286 16889 raft_consensus.cc:740] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:06.375342 16858 leader_election.cc:304] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:06.373821 16967 raft_consensus.cc:2468] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:06.377879 17125 raft_consensus.cc:2804] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:06.378487 17125 raft_consensus.cc:697] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:06.379390 17125 consensus_queue.cc:237] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.380604 17139 raft_consensus.cc:993] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601: : Instructing follower 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:06.381407 17139 raft_consensus.cc:1081] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Signalling peer 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:06.376235 16889 consensus_queue.cc:260] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.383842 16889 raft_consensus.cc:3060] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.384805 16966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:41304
I20260709 13:21:06.386286 16966 raft_consensus.cc:493] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.387102 16966 raft_consensus.cc:3060] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.387758 17039 leader_election.cc:290] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 2 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:06.391054 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2834cb5f402f4562811a5743bfc32387" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:06.391772 16965 raft_consensus.cc:3060] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.394004 16889 raft_consensus.cc:2468] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 2.
I20260709 13:21:06.396601 17006 leader_election.cc:304] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:06.398516 17139 raft_consensus.cc:2804] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:06.399449 16966 raft_consensus.cc:515] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.399941 17139 raft_consensus.cc:697] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 2 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:06.401484 16965 raft_consensus.cc:2468] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 2.
I20260709 13:21:06.401021 17139 consensus_queue.cc:237] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.405813 16966 leader_election.cc:290] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:06.407096 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:06.407526 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11378569ee4907aae5a4119cc741ff" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:06.407941 17039 raft_consensus.cc:3055] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:06.408180 16889 raft_consensus.cc:3060] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.408376 17039 raft_consensus.cc:740] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:06.410617 16787 catalog_manager.cc:5697] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 1 to 2, leader changed from 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130) to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.413354 17039 consensus_queue.cc:260] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.415293 17039 raft_consensus.cc:3060] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.420332 16889 raft_consensus.cc:2468] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:06.423226 16932 leader_election.cc:304] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:06.425107 17133 raft_consensus.cc:2804] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:06.426003 17039 raft_consensus.cc:2468] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:06.425740 17133 raft_consensus.cc:697] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:06.425379 16789 catalog_manager.cc:5697] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 1 to 2, leader changed from 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129) to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:06.428409 17133 consensus_queue.cc:237] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.447260 16788 catalog_manager.cc:5697] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 1 to 2, leader changed from 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131) to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.511862 17086 raft_consensus.cc:993] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948: : Instructing follower 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:06.512423 17125 raft_consensus.cc:1081] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Signalling peer 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:06.514394 16966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:21:06.515046 16966 raft_consensus.cc:493] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:06.515502 16966 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.521528 16966 raft_consensus.cc:515] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.525961 16966 leader_election.cc:290] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:06.526844 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:06.527810 16889 raft_consensus.cc:3055] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:06.528216 16889 raft_consensus.cc:740] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:06.530402 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:06.530297 16889 consensus_queue.cc:260] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.531754 17039 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.532584 16889 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:06.540624 16889 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:06.542078 16932 leader_election.cc:304] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:06.543275 17039 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:06.543277 17133 raft_consensus.cc:2804] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:06.544589 17133 raft_consensus.cc:697] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:06.545478 17133 consensus_queue.cc:237] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:06.555107 16788 catalog_manager.cc:5697] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 1 to 2, leader changed from 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129) to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:06.664203 16966 raft_consensus.cc:1275] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.665561 17125 consensus_queue.cc:1048] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:06.676570 17039 raft_consensus.cc:1275] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.676570 17041 raft_consensus.cc:1275] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.678644 17105 consensus_queue.cc:1048] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:06.678835 17126 consensus_queue.cc:1048] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:06.691358 16889 raft_consensus.cc:1275] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.693054 17105 consensus_queue.cc:1048] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:06.736917 17039 raft_consensus.cc:1275] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.738456 17126 consensus_queue.cc:1048] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:06.749294 16966 raft_consensus.cc:1275] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.752280 17134 consensus_queue.cc:1048] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:06.790752 16966 raft_consensus.cc:1275] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.792484 17139 consensus_queue.cc:1048] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:06.802475 16889 raft_consensus.cc:1275] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.804803 17139 consensus_queue.cc:1048] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:06.845091 17039 raft_consensus.cc:1275] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.847030 17105 consensus_queue.cc:1048] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:06.856431 16889 raft_consensus.cc:1275] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.858338 17104 consensus_queue.cc:1048] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:06.962787 17039 raft_consensus.cc:1275] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.964480 17134 consensus_queue.cc:1048] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:06.974484 16966 raft_consensus.cc:1275] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:06.976641 17126 consensus_queue.cc:1048] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:07.099252 16889 raft_consensus.cc:1275] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:07.100499 17039 raft_consensus.cc:1275] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:07.100653 17104 consensus_queue.cc:1048] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:07.102183 17105 consensus_queue.cc:1048] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:09.257886 16789 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43068:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:09.260666 16789 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:09.319845 16879 tablet_service.cc:1511] Processing CreateTablet for tablet 2c141115f1a34bc9924e98f969b5f9dd (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:09.321242 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c141115f1a34bc9924e98f969b5f9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.320938 16957 tablet_service.cc:1511] Processing CreateTablet for tablet 2c141115f1a34bc9924e98f969b5f9dd (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:09.322171 17027 tablet_service.cc:1511] Processing CreateTablet for tablet 2c141115f1a34bc9924e98f969b5f9dd (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:09.322844 16957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c141115f1a34bc9924e98f969b5f9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.323707 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c141115f1a34bc9924e98f969b5f9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.329914 16877 tablet_service.cc:1511] Processing CreateTablet for tablet 7e153fbeee80460286e13aea7d689a8d (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:09.331728 16877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e153fbeee80460286e13aea7d689a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.334025 17030 tablet_service.cc:1511] Processing CreateTablet for tablet 7e153fbeee80460286e13aea7d689a8d (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:09.335677 17030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e153fbeee80460286e13aea7d689a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.338497 16950 tablet_service.cc:1511] Processing CreateTablet for tablet 7e153fbeee80460286e13aea7d689a8d (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:09.340557 16950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e153fbeee80460286e13aea7d689a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.342656 16878 tablet_service.cc:1511] Processing CreateTablet for tablet 7e45ec944b8c4b1596f6d1cdf4858855 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:09.345528 16956 tablet_service.cc:1511] Processing CreateTablet for tablet 7e45ec944b8c4b1596f6d1cdf4858855 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:09.347064 16956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e45ec944b8c4b1596f6d1cdf4858855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.349936 17024 tablet_service.cc:1511] Processing CreateTablet for tablet 7e45ec944b8c4b1596f6d1cdf4858855 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:09.351488 17024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e45ec944b8c4b1596f6d1cdf4858855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.352140 17187 tablet_bootstrap.cc:492] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:09.355299 16878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e45ec944b8c4b1596f6d1cdf4858855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.365311 17187 tablet_bootstrap.cc:654] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.378597 16880 tablet_service.cc:1511] Processing CreateTablet for tablet 3682db159d4c4d0292cd1618870494da (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:09.380105 17188 tablet_bootstrap.cc:492] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:09.381807 17027 tablet_service.cc:1511] Processing CreateTablet for tablet 3682db159d4c4d0292cd1618870494da (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:09.382323 16951 tablet_service.cc:1511] Processing CreateTablet for tablet 3682db159d4c4d0292cd1618870494da (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:09.383809 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3682db159d4c4d0292cd1618870494da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.384371 16951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3682db159d4c4d0292cd1618870494da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.380108 16880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3682db159d4c4d0292cd1618870494da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.396888 16879 tablet_service.cc:1511] Processing CreateTablet for tablet 2903bf0573c845bc9afd64b21d738d8b (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:09.398437 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2903bf0573c845bc9afd64b21d738d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.399372 17188 tablet_bootstrap.cc:654] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.421530 16955 tablet_service.cc:1511] Processing CreateTablet for tablet 2903bf0573c845bc9afd64b21d738d8b (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:09.423821 16955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2903bf0573c845bc9afd64b21d738d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.428473 17025 tablet_service.cc:1511] Processing CreateTablet for tablet 2903bf0573c845bc9afd64b21d738d8b (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:09.435202 17025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2903bf0573c845bc9afd64b21d738d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.456746 16878 tablet_service.cc:1511] Processing CreateTablet for tablet ef919afc271f41fe8862d8725e4ce653 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:09.463085 17188 tablet_bootstrap.cc:492] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:09.463963 17188 ts_tablet_manager.cc:1403] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.001s
I20260709 13:21:09.467089 17187 tablet_bootstrap.cc:492] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:09.467213 17027 tablet_service.cc:1511] Processing CreateTablet for tablet ef919afc271f41fe8862d8725e4ce653 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:09.468892 17027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef919afc271f41fe8862d8725e4ce653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.473011 16876 tablet_service.cc:1511] Processing CreateTablet for tablet a42703d2f78443579cccd3246e12734d (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:09.474089 16952 tablet_service.cc:1511] Processing CreateTablet for tablet a42703d2f78443579cccd3246e12734d (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:09.480422 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42703d2f78443579cccd3246e12734d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.467880 17187 ts_tablet_manager.cc:1403] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.054s
I20260709 13:21:09.475562 17188 raft_consensus.cc:359] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.483043 17188 raft_consensus.cc:385] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.483398 17188 raft_consensus.cc:740] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.484396 17188 consensus_queue.cc:260] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.486596 17188 ts_tablet_manager.cc:1434] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:21:09.488040 17188 tablet_bootstrap.cc:492] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:09.496955 16877 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5c291920854d239e1d03dce782aef8 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:09.498611 16957 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5c291920854d239e1d03dce782aef8 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:09.500206 16957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5c291920854d239e1d03dce782aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.499832 17187 raft_consensus.cc:359] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.462339 16878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef919afc271f41fe8862d8725e4ce653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.506760 17187 raft_consensus.cc:385] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.519567 17187 raft_consensus.cc:740] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.512276 16875 tablet_service.cc:1511] Processing CreateTablet for tablet 61a8a8d97d3a4228a370581c50ec0a3c (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:09.522166 16876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42703d2f78443579cccd3246e12734d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.523363 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a8a8d97d3a4228a370581c50ec0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.525117 16877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5c291920854d239e1d03dce782aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.509260 17029 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5c291920854d239e1d03dce782aef8 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:09.528573 17029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5c291920854d239e1d03dce782aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.530380 16956 tablet_service.cc:1511] Processing CreateTablet for tablet ef919afc271f41fe8862d8725e4ce653 (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:09.520601 17187 consensus_queue.cc:260] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.502645 17024 tablet_service.cc:1511] Processing CreateTablet for tablet a42703d2f78443579cccd3246e12734d (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:09.558364 17028 tablet_service.cc:1511] Processing CreateTablet for tablet 61a8a8d97d3a4228a370581c50ec0a3c (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:09.562610 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a8a8d97d3a4228a370581c50ec0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.566011 17024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42703d2f78443579cccd3246e12734d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.567631 16954 tablet_service.cc:1511] Processing CreateTablet for tablet 61a8a8d97d3a4228a370581c50ec0a3c (DEFAULT_TABLE table=soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:09.588976 16956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef919afc271f41fe8862d8725e4ce653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.589367 17175 raft_consensus.cc:493] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.590164 17175 raft_consensus.cc:515] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.590356 16954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a8a8d97d3a4228a370581c50ec0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:09.592170 17175 leader_election.cc:290] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:09.592815 17187 ts_tablet_manager.cc:1434] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.110s	user 0.002s	sys 0.012s
I20260709 13:21:09.593021 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:09.593912 16889 raft_consensus.cc:2468] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:09.595311 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:09.595711 17006 leader_election.cc:304] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:09.596849 17175 raft_consensus.cc:2804] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.597323 17175 raft_consensus.cc:493] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.597818 17175 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:09.602216 17004 leader_election.cc:343] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.607774 17175 raft_consensus.cc:515] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.572336 17191 tablet_bootstrap.cc:492] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:09.672747 17188 tablet_bootstrap.cc:654] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.674521 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:09.674798 17175 leader_election.cc:290] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:09.675287 16890 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.679354 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
W20260709 13:21:09.686431 17004 leader_election.cc:343] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.688828 16890 raft_consensus.cc:2468] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 1.
I20260709 13:21:09.690555 17191 tablet_bootstrap.cc:654] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.694434 17006 leader_election.cc:304] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 3599d38261fe499e84ec6e5b55db87cc
I20260709 13:21:09.695896 17175 raft_consensus.cc:2804] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:09.709897 17187 tablet_bootstrap.cc:492] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:09.714568 17175 raft_consensus.cc:697] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:09.715636 17175 consensus_queue.cc:237] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.724409 17187 tablet_bootstrap.cc:654] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.737274 16789 catalog_manager.cc:5697] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 0 to 1, leader changed from <none> to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:09.738058 17191 tablet_bootstrap.cc:492] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:09.740464 17191 ts_tablet_manager.cc:1403] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.176s	user 0.008s	sys 0.008s
W20260709 13:21:09.741454 16932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:39451, user_credentials={real_user=slave}} blocked reactor thread for 65902.3us
I20260709 13:21:09.744637 17191 raft_consensus.cc:359] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.745502 17191 raft_consensus.cc:385] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.745816 17191 raft_consensus.cc:740] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.748333 17191 consensus_queue.cc:260] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.751075 17191 ts_tablet_manager.cc:1434] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:21:09.752166 17191 tablet_bootstrap.cc:492] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:09.756500 17188 tablet_bootstrap.cc:492] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:09.756707 17187 tablet_bootstrap.cc:492] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:09.757280 17188 ts_tablet_manager.cc:1403] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.270s	user 0.010s	sys 0.009s
I20260709 13:21:09.757320 17187 ts_tablet_manager.cc:1403] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.009s
I20260709 13:21:09.759016 17191 tablet_bootstrap.cc:654] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.761291 17187 raft_consensus.cc:359] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.763870 17187 raft_consensus.cc:385] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.764330 17187 raft_consensus.cc:740] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.765491 17187 consensus_queue.cc:260] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.769740 17187 ts_tablet_manager.cc:1434] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:21:09.771109 17187 tablet_bootstrap.cc:492] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:09.766754 17188 raft_consensus.cc:359] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.778700 17188 raft_consensus.cc:385] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.779045 17188 raft_consensus.cc:740] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.779811 17188 consensus_queue.cc:260] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.780557 17187 tablet_bootstrap.cc:654] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.783313 17188 ts_tablet_manager.cc:1434] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 13:21:09.781320 17191 tablet_bootstrap.cc:492] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:09.784487 17191 ts_tablet_manager.cc:1403] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.007s
I20260709 13:21:09.784528 17188 tablet_bootstrap.cc:492] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:09.788645 17191 raft_consensus.cc:359] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.789899 17191 raft_consensus.cc:385] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.790302 17191 raft_consensus.cc:740] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.792155 17187 tablet_bootstrap.cc:492] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:09.792301 17191 consensus_queue.cc:260] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.793040 17187 ts_tablet_manager.cc:1403] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.008s
I20260709 13:21:09.794934 17188 tablet_bootstrap.cc:654] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.795454 17191 ts_tablet_manager.cc:1434] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:21:09.799279 17191 tablet_bootstrap.cc:492] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:09.802989 17187 raft_consensus.cc:359] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.804407 17187 raft_consensus.cc:385] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.804935 17187 raft_consensus.cc:740] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.806830 17187 consensus_queue.cc:260] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.811288 17187 ts_tablet_manager.cc:1434] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:21:09.814286 17187 tablet_bootstrap.cc:492] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:09.815409 17188 tablet_bootstrap.cc:492] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:09.816008 17188 ts_tablet_manager.cc:1403] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.006s
I20260709 13:21:09.818745 17191 tablet_bootstrap.cc:654] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.819363 17188 raft_consensus.cc:359] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.820436 17188 raft_consensus.cc:385] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.820755 17188 raft_consensus.cc:740] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.821724 17188 consensus_queue.cc:260] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.822175 17187 tablet_bootstrap.cc:654] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.827801 17188 ts_tablet_manager.cc:1434] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:21:09.828948 17191 tablet_bootstrap.cc:492] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:09.829262 17188 tablet_bootstrap.cc:492] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:09.830022 17191 ts_tablet_manager.cc:1403] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.003s
I20260709 13:21:09.834210 17191 raft_consensus.cc:359] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.835105 17191 raft_consensus.cc:385] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.835474 17191 raft_consensus.cc:740] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.836313 17191 consensus_queue.cc:260] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.839339 17191 ts_tablet_manager.cc:1434] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:21:09.839366 17188 tablet_bootstrap.cc:654] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.840817 17191 tablet_bootstrap.cc:492] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:09.848495 17187 tablet_bootstrap.cc:492] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:09.849287 17187 ts_tablet_manager.cc:1403] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.012s
I20260709 13:21:09.851743 17191 tablet_bootstrap.cc:654] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.852993 17188 tablet_bootstrap.cc:492] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:09.852911 17187 raft_consensus.cc:359] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.854005 17187 raft_consensus.cc:385] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.854336 17187 raft_consensus.cc:740] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.854377 17188 ts_tablet_manager.cc:1403] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:21:09.855327 17187 consensus_queue.cc:260] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.858346 17191 tablet_bootstrap.cc:492] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:09.858064 17105 raft_consensus.cc:493] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.858264 17188 raft_consensus.cc:359] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.859186 17191 ts_tablet_manager.cc:1403] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:21:09.859529 17187 ts_tablet_manager.cc:1434] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:09.859268 17105 raft_consensus.cc:515] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.860658 17187 tablet_bootstrap.cc:492] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:09.864424 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3682db159d4c4d0292cd1618870494da" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:09.859304 17188 raft_consensus.cc:385] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.865998 17188 raft_consensus.cc:740] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
W20260709 13:21:09.867321 16932 leader_election.cc:343] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.866866 17188 consensus_queue.cc:260] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.870991 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3682db159d4c4d0292cd1618870494da" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:09.871508 17188 ts_tablet_manager.cc:1434] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:21:09.871006 17191 raft_consensus.cc:359] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.871785 17039 raft_consensus.cc:2468] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
I20260709 13:21:09.872082 17191 raft_consensus.cc:385] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.872567 17191 raft_consensus.cc:740] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.872983 17188 tablet_bootstrap.cc:492] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:09.873524 17191 consensus_queue.cc:260] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.878942 17191 ts_tablet_manager.cc:1434] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:21:09.876546 17187 tablet_bootstrap.cc:654] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.873522 16933 leader_election.cc:304] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:09.883651 17192 raft_consensus.cc:2804] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.884161 17192 raft_consensus.cc:493] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.884572 17192 raft_consensus.cc:3060] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.885818 17188 tablet_bootstrap.cc:654] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.889089 17105 leader_election.cc:290] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:09.893298 17134 raft_consensus.cc:493] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.893980 17134 raft_consensus.cc:515] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.897192 17134 leader_election.cc:290] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:09.897794 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e45ec944b8c4b1596f6d1cdf4858855" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:09.898500 16966 raft_consensus.cc:2468] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:09.899344 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e45ec944b8c4b1596f6d1cdf4858855" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:09.900064 17039 raft_consensus.cc:2468] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:09.901369 16858 leader_election.cc:304] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:09.903311 17187 tablet_bootstrap.cc:492] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:09.903775 17134 raft_consensus.cc:2804] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.904356 17187 ts_tablet_manager.cc:1403] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.017s
I20260709 13:21:09.904624 17134 raft_consensus.cc:493] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.905380 17134 raft_consensus.cc:3060] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.909576 17187 raft_consensus.cc:359] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.911877 17187 raft_consensus.cc:385] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.912391 17187 raft_consensus.cc:740] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.882694 17191 tablet_bootstrap.cc:492] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:09.913558 17187 consensus_queue.cc:260] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.917236 17187 ts_tablet_manager.cc:1434] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:21:09.918692 17187 tablet_bootstrap.cc:492] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:09.919695 17175 raft_consensus.cc:493] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.920264 17175 raft_consensus.cc:515] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.922768 17175 leader_election.cc:290] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:09.923996 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:09.925175 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
W20260709 13:21:09.926779 17006 leader_election.cc:343] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.927357 17192 raft_consensus.cc:515] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
W20260709 13:21:09.928107 17004 leader_election.cc:343] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.928550 17004 leader_election.cc:304] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601; no voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:09.930109 17175 raft_consensus.cc:2749] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:09.930624 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3682db159d4c4d0292cd1618870494da" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:09.931463 17134 raft_consensus.cc:515] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
W20260709 13:21:09.932694 16932 leader_election.cc:343] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:09.936395 17187 tablet_bootstrap.cc:654] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.938535 17191 tablet_bootstrap.cc:654] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.941959 17192 leader_election.cc:290] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:09.943418 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3682db159d4c4d0292cd1618870494da" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:09.944216 17039 raft_consensus.cc:3060] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.945827 17134 leader_election.cc:290] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:09.946206 17188 tablet_bootstrap.cc:492] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:09.946943 17188 ts_tablet_manager.cc:1403] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.040s
I20260709 13:21:09.949234 17187 tablet_bootstrap.cc:492] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:09.949908 17187 ts_tablet_manager.cc:1403] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.002s
I20260709 13:21:09.950719 17188 raft_consensus.cc:359] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.951720 17188 raft_consensus.cc:385] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.952087 17188 raft_consensus.cc:740] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.953018 17041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e45ec944b8c4b1596f6d1cdf4858855" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:09.953116 17188 consensus_queue.cc:260] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.953794 17191 tablet_bootstrap.cc:492] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:09.954455 17191 ts_tablet_manager.cc:1403] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.007s
I20260709 13:21:09.954272 17187 raft_consensus.cc:359] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.955261 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e45ec944b8c4b1596f6d1cdf4858855" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:09.955363 17187 raft_consensus.cc:385] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.955907 17187 raft_consensus.cc:740] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.955921 16966 raft_consensus.cc:3060] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.957020 17187 consensus_queue.cc:260] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.958171 17191 raft_consensus.cc:359] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.958542 17194 raft_consensus.cc:493] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:09.958947 17191 raft_consensus.cc:385] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:09.959357 17191 raft_consensus.cc:740] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:09.959313 17194 raft_consensus.cc:515] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.953766 17041 raft_consensus.cc:3060] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.960443 17191 consensus_queue.cc:260] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.962549 17194 leader_election.cc:290] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:09.963491 17191 ts_tablet_manager.cc:1434] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:09.964604 17191 tablet_bootstrap.cc:492] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:09.965658 17187 ts_tablet_manager.cc:1434] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:21:09.966835 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e153fbeee80460286e13aea7d689a8d" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:09.967603 16890 raft_consensus.cc:2468] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:09.968830 17187 tablet_bootstrap.cc:492] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:09.969492 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e153fbeee80460286e13aea7d689a8d" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:09.970288 16965 raft_consensus.cc:2468] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:09.971886 17006 leader_election.cc:304] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:09.972940 17194 raft_consensus.cc:2804] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:09.973311 17194 raft_consensus.cc:493] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:09.973698 17194 raft_consensus.cc:3060] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:09.977667 17191 tablet_bootstrap.cc:654] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.977671 16966 raft_consensus.cc:2468] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:09.979701 17187 tablet_bootstrap.cc:654] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:09.981803 16855 leader_election.cc:304] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:09.982646 17188 ts_tablet_manager.cc:1434] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.010s
I20260709 13:21:09.983038 17211 raft_consensus.cc:2804] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:09.983991 17188 tablet_bootstrap.cc:492] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:09.984258 17211 raft_consensus.cc:697] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:09.985196 17211 consensus_queue.cc:237] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:09.993050 17188 tablet_bootstrap.cc:654] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.000355 17191 tablet_bootstrap.cc:492] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:10.001111 17191 ts_tablet_manager.cc:1403] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.004s
I20260709 13:21:10.013123 17191 raft_consensus.cc:359] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.014012 17191 raft_consensus.cc:385] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.014424 17191 raft_consensus.cc:740] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.015434 17191 consensus_queue.cc:260] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.020684 17191 ts_tablet_manager.cc:1434] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:21:10.022775 17191 tablet_bootstrap.cc:492] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:10.030086 17188 tablet_bootstrap.cc:492] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:10.030784 17188 ts_tablet_manager.cc:1403] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.003s
I20260709 13:21:10.033380 17191 tablet_bootstrap.cc:654] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.034850 17188 raft_consensus.cc:359] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.035718 17188 raft_consensus.cc:385] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.036053 17188 raft_consensus.cc:740] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.029942 17041 raft_consensus.cc:2468] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:10.036886 17188 consensus_queue.cc:260] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
W20260709 13:21:10.039149 16838 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:10.039429 17188 ts_tablet_manager.cc:1434] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:10.040659 17188 tablet_bootstrap.cc:492] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:10.041181 17194 raft_consensus.cc:515] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.045835 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e153fbeee80460286e13aea7d689a8d" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:10.046629 16890 raft_consensus.cc:3060] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.052338 17188 tablet_bootstrap.cc:654] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.054032 17039 raft_consensus.cc:2468] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:10.055665 16890 raft_consensus.cc:2468] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 1.
I20260709 13:21:10.056432 16933 leader_election.cc:304] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:10.058964 17191 tablet_bootstrap.cc:492] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:10.059553 17191 ts_tablet_manager.cc:1403] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.001s
I20260709 13:21:10.060580 17006 leader_election.cc:304] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:10.060819 17188 tablet_bootstrap.cc:492] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:10.061515 17188 ts_tablet_manager.cc:1403] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.002s
I20260709 13:21:10.061587 17175 raft_consensus.cc:2804] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.059480 17192 raft_consensus.cc:2804] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.063464 17191 raft_consensus.cc:359] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.064438 17191 raft_consensus.cc:385] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.063486 17192 raft_consensus.cc:697] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:10.063818 16789 catalog_manager.cc:5697] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.064857 17191 raft_consensus.cc:740] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.064852 17188 raft_consensus.cc:359] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.067572 17192 consensus_queue.cc:237] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.071785 17188 raft_consensus.cc:385] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.072327 17188 raft_consensus.cc:740] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.072886 17187 tablet_bootstrap.cc:492] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:10.072086 17191 consensus_queue.cc:260] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.073794 17187 ts_tablet_manager.cc:1403] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.014s
I20260709 13:21:10.073542 17188 consensus_queue.cc:260] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.075418 17175 raft_consensus.cc:697] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:10.076581 17191 ts_tablet_manager.cc:1434] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.007s
I20260709 13:21:10.079897 17191 tablet_bootstrap.cc:492] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:10.080298 17188 ts_tablet_manager.cc:1434] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:21:10.082170 17188 tablet_bootstrap.cc:492] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:10.076473 17175 consensus_queue.cc:237] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.084380 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e153fbeee80460286e13aea7d689a8d" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:10.084380 17187 raft_consensus.cc:359] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.085793 16966 raft_consensus.cc:3060] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.090652 17191 tablet_bootstrap.cc:654] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.092363 17188 tablet_bootstrap.cc:654] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.069809 17194 leader_election.cc:290] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:10.085837 17187 raft_consensus.cc:385] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.102433 17187 raft_consensus.cc:740] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.102124 17211 raft_consensus.cc:493] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.103714 17211 raft_consensus.cc:515] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.107820 17211 leader_election.cc:290] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.109057 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:10.109782 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:10.110005 16965 raft_consensus.cc:2468] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:10.111335 16855 leader_election.cc:304] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
W20260709 13:21:10.112483 16858 leader_election.cc:343] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.116986 17187 consensus_queue.cc:260] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.127197 17187 ts_tablet_manager.cc:1434] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.053s	user 0.012s	sys 0.000s
I20260709 13:21:10.116271 17211 raft_consensus.cc:2804] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.129616 17211 raft_consensus.cc:493] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.130136 17211 raft_consensus.cc:3060] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.115595 16966 raft_consensus.cc:2468] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 1.
I20260709 13:21:10.133193 16789 catalog_manager.cc:5697] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.123883 16787 catalog_manager.cc:5697] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 0 to 1, leader changed from <none> to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.135402 17191 tablet_bootstrap.cc:492] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:10.136148 17188 tablet_bootstrap.cc:492] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:10.136234 17191 ts_tablet_manager.cc:1403] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.020s
I20260709 13:21:10.136732 17188 ts_tablet_manager.cc:1403] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.026s
I20260709 13:21:10.139969 17188 raft_consensus.cc:359] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.140673 17188 raft_consensus.cc:385] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.140993 17188 raft_consensus.cc:740] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.136776 17187 tablet_bootstrap.cc:492] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:10.141743 17188 consensus_queue.cc:260] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.153947 17211 raft_consensus.cc:515] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.141557 17191 raft_consensus.cc:359] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.158295 17191 raft_consensus.cc:385] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.158659 17191 raft_consensus.cc:740] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.158932 17188 ts_tablet_manager.cc:1434] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 13:21:10.159564 17191 consensus_queue.cc:260] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.160385 17188 tablet_bootstrap.cc:492] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: Bootstrap starting.
I20260709 13:21:10.168242 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:10.169114 16966 raft_consensus.cc:3060] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.168221 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:10.170411 17191 ts_tablet_manager.cc:1434] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.000s
W20260709 13:21:10.172703 16858 leader_election.cc:343] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:10.175683 17187 tablet_bootstrap.cc:654] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.177929 17211 leader_election.cc:290] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.179140 17188 tablet_bootstrap.cc:654] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.184458 17191 tablet_bootstrap.cc:492] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc: Bootstrap starting.
I20260709 13:21:10.191563 17191 tablet_bootstrap.cc:654] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.191828 16966 raft_consensus.cc:2468] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:10.192662 17188 tablet_bootstrap.cc:492] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: No bootstrap required, opened a new log
I20260709 13:21:10.193190 17188 ts_tablet_manager.cc:1403] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.000s
I20260709 13:21:10.193284 16855 leader_election.cc:304] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:10.194783 17211 raft_consensus.cc:2804] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.195036 17187 tablet_bootstrap.cc:492] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:10.195590 17187 ts_tablet_manager.cc:1403] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.010s
I20260709 13:21:10.195465 17211 raft_consensus.cc:697] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:10.196465 17188 raft_consensus.cc:359] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.197271 17188 raft_consensus.cc:385] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.196816 17211 consensus_queue.cc:237] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.197718 17188 raft_consensus.cc:740] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.198441 17188 consensus_queue.cc:260] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.198681 17187 raft_consensus.cc:359] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.199476 17187 raft_consensus.cc:385] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.199772 17187 raft_consensus.cc:740] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.200430 17187 consensus_queue.cc:260] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.202486 17187 ts_tablet_manager.cc:1434] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:21:10.203780 17187 tablet_bootstrap.cc:492] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601: Bootstrap starting.
I20260709 13:21:10.205828 17188 ts_tablet_manager.cc:1434] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:21:10.217059 17187 tablet_bootstrap.cc:654] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:10.217149 17191 tablet_bootstrap.cc:492] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc: No bootstrap required, opened a new log
I20260709 13:21:10.218046 17191 ts_tablet_manager.cc:1403] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.008s
I20260709 13:21:10.220870 17191 raft_consensus.cc:359] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.221621 17191 raft_consensus.cc:385] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.221922 17191 raft_consensus.cc:740] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.221871 16789 catalog_manager.cc:5697] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.223089 17191 consensus_queue.cc:260] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.228047 17187 tablet_bootstrap.cc:492] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601: No bootstrap required, opened a new log
I20260709 13:21:10.228777 17187 ts_tablet_manager.cc:1403] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.001s
I20260709 13:21:10.230538 17191 ts_tablet_manager.cc:1434] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:21:10.234454 17187 raft_consensus.cc:359] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.235242 17187 raft_consensus.cc:385] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:10.238143 17187 raft_consensus.cc:740] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Initialized, Role: FOLLOWER
I20260709 13:21:10.238914 17187 consensus_queue.cc:260] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.240878 17187 ts_tablet_manager.cc:1434] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:21:10.285041 17195 raft_consensus.cc:493] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.285784 17195 raft_consensus.cc:515] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.288218 17195 leader_election.cc:290] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.289404 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42703d2f78443579cccd3246e12734d" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:10.289404 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42703d2f78443579cccd3246e12734d" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:10.290270 17039 raft_consensus.cc:2468] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
I20260709 13:21:10.290373 16890 raft_consensus.cc:2468] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 0.
I20260709 13:21:10.291509 16933 leader_election.cc:304] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:10.292217 17195 raft_consensus.cc:2804] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.292567 17195 raft_consensus.cc:493] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.292819 17195 raft_consensus.cc:3060] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.298574 17175 consensus_queue.cc:1048] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.299418 17195 raft_consensus.cc:515] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.302497 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42703d2f78443579cccd3246e12734d" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:10.302906 17195 leader_election.cc:290] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.302727 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42703d2f78443579cccd3246e12734d" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:10.303196 16889 raft_consensus.cc:3060] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.303576 17039 raft_consensus.cc:3060] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.312758 17039 raft_consensus.cc:2468] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:10.313941 16933 leader_election.cc:304] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:10.314538 16966 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.317337 16889 raft_consensus.cc:2468] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 1.
I20260709 13:21:10.314934 17195 raft_consensus.cc:2804] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.318270 17195 raft_consensus.cc:697] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:10.319027 17195 consensus_queue.cc:237] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.326166 17175 raft_consensus.cc:493] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.326830 17175 raft_consensus.cc:515] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.330793 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:10.331411 17192 raft_consensus.cc:493] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.331012 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:10.331672 16965 raft_consensus.cc:2393] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 377c24fd9c7040eea797cad32ea6f601 in current term 1: Already voted for candidate 5581e4f0fdf3412c9e169bd05c247948 in this term.
I20260709 13:21:10.332006 17192 raft_consensus.cc:515] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.333480 17222 consensus_queue.cc:1048] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:10.333508 17006 leader_election.cc:304] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601; no voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:10.331990 17175 leader_election.cc:290] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:10.338079 17222 raft_consensus.cc:3060] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.341056 16789 catalog_manager.cc:5697] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 1 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.345567 17192 leader_election.cc:290] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.347607 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:10.348021 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:10.356575 17194 raft_consensus.cc:493] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.357383 17194 raft_consensus.cc:515] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.360405 17194 leader_election.cc:290] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:10.355401 16933 leader_election.cc:304] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc; no voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:10.361454 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a8a8d97d3a4228a370581c50ec0a3c" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948" is_pre_election: true
I20260709 13:21:10.362308 16889 raft_consensus.cc:2468] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:10.362367 17222 raft_consensus.cc:2749] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:10.364013 17006 leader_election.cc:304] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:10.364143 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a8a8d97d3a4228a370581c50ec0a3c" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:10.364920 17222 raft_consensus.cc:2804] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.365154 16965 raft_consensus.cc:2468] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 0.
I20260709 13:21:10.365335 17222 raft_consensus.cc:493] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.366097 17222 raft_consensus.cc:3060] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.366276 17195 raft_consensus.cc:2749] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:10.372813 17222 raft_consensus.cc:515] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.375134 17222 leader_election.cc:290] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:10.376488 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a8a8d97d3a4228a370581c50ec0a3c" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:10.377305 16966 raft_consensus.cc:3060] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.377570 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a8a8d97d3a4228a370581c50ec0a3c" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:10.378288 16889 raft_consensus.cc:3060] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.379176 17211 raft_consensus.cc:493] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.379860 17211 raft_consensus.cc:515] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.383356 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2903bf0573c845bc9afd64b21d738d8b" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:10.384034 17211 leader_election.cc:290] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.384037 17039 raft_consensus.cc:2468] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:10.384850 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2903bf0573c845bc9afd64b21d738d8b" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:10.385643 16965 raft_consensus.cc:2468] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:10.386277 16966 raft_consensus.cc:2468] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 1.
I20260709 13:21:10.386708 16858 leader_election.cc:304] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:10.387476 17004 leader_election.cc:304] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:10.387699 17211 raft_consensus.cc:2804] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.388180 17211 raft_consensus.cc:493] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.388396 17222 raft_consensus.cc:2804] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.388573 17211 raft_consensus.cc:3060] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.388998 16889 raft_consensus.cc:2468] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 1.
I20260709 13:21:10.389186 17222 raft_consensus.cc:697] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:10.390270 17222 consensus_queue.cc:237] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.397929 17211 raft_consensus.cc:515] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.399868 17211 leader_election.cc:290] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.399605 16789 catalog_manager.cc:5697] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 0 to 1, leader changed from <none> to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:10.401026 16966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2903bf0573c845bc9afd64b21d738d8b" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:10.401321 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2903bf0573c845bc9afd64b21d738d8b" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:10.401736 16966 raft_consensus.cc:3060] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.401927 17039 raft_consensus.cc:3060] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.408238 17039 raft_consensus.cc:2468] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:10.408988 16966 raft_consensus.cc:2468] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:10.409570 16858 leader_election.cc:304] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:10.410466 17211 raft_consensus.cc:2804] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.410976 17211 raft_consensus.cc:697] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:10.412274 17211 consensus_queue.cc:237] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.422197 16789 catalog_manager.cc:5697] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.503798 16889 raft_consensus.cc:3060] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.509197 17218 consensus_queue.cc:1048] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.512667 17218 raft_consensus.cc:493] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:10.512568 17195 consensus_queue.cc:1048] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.513552 17218 raft_consensus.cc:515] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.518265 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601" is_pre_election: true
I20260709 13:21:10.518299 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc" is_pre_election: true
I20260709 13:21:10.519111 17039 raft_consensus.cc:2468] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:10.519304 16965 raft_consensus.cc:2468] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 0.
I20260709 13:21:10.522504 16858 leader_election.cc:304] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:10.524225 17217 raft_consensus.cc:2804] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:10.526314 17217 raft_consensus.cc:493] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:10.526727 17217 raft_consensus.cc:3060] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.538962 17218 leader_election.cc:290] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.542919 17218 consensus_queue.cc:1048] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.547330 17105 consensus_queue.cc:1048] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.548358 17222 consensus_queue.cc:1048] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.552762 17217 raft_consensus.cc:515] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.557384 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:10.558063 17040 raft_consensus.cc:3060] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.558390 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:10.559060 16965 raft_consensus.cc:3060] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:10.568131 16965 raft_consensus.cc:2468] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:10.569403 16855 leader_election.cc:304] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:10.570580 17218 raft_consensus.cc:2804] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:10.571887 17218 raft_consensus.cc:697] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:10.574862 17217 leader_election.cc:290] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 1 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.573248 17218 consensus_queue.cc:237] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.581736 17040 raft_consensus.cc:2468] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 1.
I20260709 13:21:10.591733 17175 consensus_queue.cc:1048] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.597800 16789 catalog_manager.cc:5697] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:10.733527 17134 consensus_queue.cc:1048] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.748703 17134 consensus_queue.cc:1048] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.770676 17040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd"
dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
mode: GRACEFUL
new_leader_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:48126
I20260709 13:21:10.771301 17040 raft_consensus.cc:606] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Received request to transfer leadership to TS 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:10.778301 17040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e153fbeee80460286e13aea7d689a8d"
dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
mode: GRACEFUL
new_leader_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:48126
I20260709 13:21:10.779287 17040 raft_consensus.cc:606] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Received request to transfer leadership to TS 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:10.791412 16966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3682db159d4c4d0292cd1618870494da"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
mode: GRACEFUL
new_leader_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:41314
I20260709 13:21:10.791985 16966 raft_consensus.cc:606] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Received request to transfer leadership to TS 5581e4f0fdf3412c9e169bd05c247948
I20260709 13:21:10.799695 16890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2903bf0573c845bc9afd64b21d738d8b"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
mode: GRACEFUL
new_leader_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:21:10.800431 16890 raft_consensus.cc:606] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Received request to transfer leadership to TS 3599d38261fe499e84ec6e5b55db87cc
I20260709 13:21:10.806525 16890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
mode: GRACEFUL
new_leader_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:21:10.807106 16890 raft_consensus.cc:606] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Received request to transfer leadership to TS 3599d38261fe499e84ec6e5b55db87cc
I20260709 13:21:10.812779 17134 consensus_queue.cc:1048] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.817528 16890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
mode: GRACEFUL
new_leader_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:21:10.818272 16890 raft_consensus.cc:606] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Received request to transfer leadership to TS 3599d38261fe499e84ec6e5b55db87cc
I20260709 13:21:10.819955 17175 consensus_queue.cc:1048] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:10.822649 17217 raft_consensus.cc:993] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948: : Instructing follower 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:10.823117 17217 raft_consensus.cc:1081] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Signalling peer 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:10.827036 16967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2903bf0573c845bc9afd64b21d738d8b"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:21:10.828984 16967 raft_consensus.cc:493] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.829594 16967 raft_consensus.cc:3060] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.833307 17218 consensus_queue.cc:1048] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.844348 16967 raft_consensus.cc:515] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.844507 17194 consensus_queue.cc:1048] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.848942 16967 leader_election.cc:290] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.849306 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2903bf0573c845bc9afd64b21d738d8b" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:10.850040 16889 raft_consensus.cc:3055] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:10.849720 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2903bf0573c845bc9afd64b21d738d8b" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:10.850443 16889 raft_consensus.cc:740] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:10.850713 17040 raft_consensus.cc:3060] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.851666 16889 consensus_queue.cc:260] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.853482 16889 raft_consensus.cc:3060] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.860447 17040 raft_consensus.cc:2468] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:10.905112 16933 leader_election.cc:304] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:10.944132 17195 raft_consensus.cc:2804] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:10.947644 17105 consensus_queue.cc:1048] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:10.952229 16889 raft_consensus.cc:2468] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:10.958539 17243 consensus_queue.cc:1048] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:10.962934 17195 raft_consensus.cc:697] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:10.966022 17195 consensus_queue.cc:237] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.967902 17243 raft_consensus.cc:993] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc: : Instructing follower 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:10.968775 17192 raft_consensus.cc:1081] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Signalling peer 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:10.971753 16890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3682db159d4c4d0292cd1618870494da"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:44826
I20260709 13:21:10.973030 16890 raft_consensus.cc:493] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:10.973630 16890 raft_consensus.cc:3060] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.993649 16890 raft_consensus.cc:515] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:10.997599 16967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3682db159d4c4d0292cd1618870494da" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:10.997812 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3682db159d4c4d0292cd1618870494da" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:10.998411 16967 raft_consensus.cc:3055] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:10.998593 17040 raft_consensus.cc:3060] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:10.998864 16967 raft_consensus.cc:740] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:11.000432 16967 consensus_queue.cc:260] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.003011 16967 raft_consensus.cc:3060] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.005638 16890 leader_election.cc:290] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:10.999336 16787 catalog_manager.cc:5697] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 1 to 2, leader changed from 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129) to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.010269 17040 raft_consensus.cc:2468] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:11.012059 16858 leader_election.cc:304] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:11.013319 17134 raft_consensus.cc:2804] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:11.013895 17134 raft_consensus.cc:697] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:11.015231 17134 consensus_queue.cc:237] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.016242 16967 raft_consensus.cc:2468] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:11.024744 17134 consensus_queue.cc:1048] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:11.027906 16789 catalog_manager.cc:5697] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 1 to 2, leader changed from 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130) to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.064997 17134 consensus_queue.cc:1048] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:11.069006 17211 raft_consensus.cc:993] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: : Instructing follower 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:11.069820 17217 raft_consensus.cc:1081] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Signalling peer 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:11.072259 16965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:21:11.074242 16965 raft_consensus.cc:493] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.074949 16965 raft_consensus.cc:3060] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.099254 16965 raft_consensus.cc:515] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.103361 16965 leader_election.cc:290] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:11.103950 16890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:11.104127 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef919afc271f41fe8862d8725e4ce653" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:11.105006 16890 raft_consensus.cc:3055] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:11.105098 17040 raft_consensus.cc:3060] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.105684 16890 raft_consensus.cc:740] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:11.106973 16890 consensus_queue.cc:260] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.108744 16890 raft_consensus.cc:3060] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.112485 17040 raft_consensus.cc:2468] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:11.113876 16933 leader_election.cc:304] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:11.114588 17243 raft_consensus.cc:2804] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:11.115056 17243 raft_consensus.cc:697] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:11.116165 17243 consensus_queue.cc:237] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.117843 16890 raft_consensus.cc:2468] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:11.127470 16789 catalog_manager.cc:5697] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 1 to 2, leader changed from 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129) to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.162015 17211 raft_consensus.cc:993] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948: : Instructing follower 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:11.162837 17217 raft_consensus.cc:1081] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Signalling peer 3599d38261fe499e84ec6e5b55db87cc to start an election
I20260709 13:21:11.165041 16965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:21:11.165495 17194 raft_consensus.cc:993] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: : Instructing follower 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:11.165729 16965 raft_consensus.cc:493] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.166211 17222 raft_consensus.cc:1081] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Signalling peer 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:11.166257 16965 raft_consensus.cc:3060] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.168220 16890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e153fbeee80460286e13aea7d689a8d"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:44834
I20260709 13:21:11.168900 16890 raft_consensus.cc:493] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.169345 16890 raft_consensus.cc:3060] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.176263 16965 raft_consensus.cc:515] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.179181 16965 leader_election.cc:290] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:11.179165 16890 raft_consensus.cc:515] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.180152 17040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:11.180150 16889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5c291920854d239e1d03dce782aef8" candidate_uuid: "3599d38261fe499e84ec6e5b55db87cc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:11.181067 17040 raft_consensus.cc:3060] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.181175 16889 raft_consensus.cc:3055] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:11.181782 16889 raft_consensus.cc:740] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:11.183200 16890 leader_election.cc:290] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:11.183074 16889 consensus_queue.cc:260] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.183588 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e153fbeee80460286e13aea7d689a8d" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:11.184311 17039 raft_consensus.cc:3055] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:11.184616 16889 raft_consensus.cc:3060] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.184710 17039 raft_consensus.cc:740] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:11.185259 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e153fbeee80460286e13aea7d689a8d" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:11.185925 16965 raft_consensus.cc:3060] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.186322 17039 consensus_queue.cc:260] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.187772 17039 raft_consensus.cc:3060] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.191475 17040 raft_consensus.cc:2468] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:11.193411 16933 leader_election.cc:304] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:11.194361 17192 raft_consensus.cc:2804] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:11.194978 17192 raft_consensus.cc:697] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Becoming Leader. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:11.196036 17192 consensus_queue.cc:237] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.200807 16965 raft_consensus.cc:2468] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:11.201719 16889 raft_consensus.cc:2468] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3599d38261fe499e84ec6e5b55db87cc in term 2.
I20260709 13:21:11.202723 16855 leader_election.cc:304] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:11.203496 17217 raft_consensus.cc:2804] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:11.204073 17217 raft_consensus.cc:697] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:11.205243 17217 consensus_queue.cc:237] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.205602 17039 raft_consensus.cc:2468] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:11.207664 16789 catalog_manager.cc:5697] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc reported cstate change: term changed from 1 to 2, leader changed from 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129) to 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130). New cstate: current_term: 2 leader_uuid: "3599d38261fe499e84ec6e5b55db87cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.215890 16788 catalog_manager.cc:5697] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 1 to 2, leader changed from 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131) to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.283581 17194 raft_consensus.cc:993] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601: : Instructing follower 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:11.284114 17222 raft_consensus.cc:1081] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Signalling peer 5581e4f0fdf3412c9e169bd05c247948 to start an election
I20260709 13:21:11.286335 16889 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
 from {username='slave'} at 127.0.0.1:44834
I20260709 13:21:11.287225 16889 raft_consensus.cc:493] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:11.287552 16889 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.293462 16889 raft_consensus.cc:515] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.295341 16889 leader_election.cc:290] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Requested vote from peers 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119), 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835)
I20260709 13:21:11.296149 16965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:11.296511 17039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "5581e4f0fdf3412c9e169bd05c247948" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
I20260709 13:21:11.296840 16965 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.297134 17039 raft_consensus.cc:3055] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:11.297592 17039 raft_consensus.cc:740] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:11.298398 17039 consensus_queue.cc:260] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.299435 17039 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:11.303869 16965 raft_consensus.cc:2468] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:11.304850 17039 raft_consensus.cc:2468] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5581e4f0fdf3412c9e169bd05c247948 in term 2.
I20260709 13:21:11.305294 16855 leader_election.cc:304] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:11.306241 17217 raft_consensus.cc:2804] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:11.306933 17217 raft_consensus.cc:697] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Becoming Leader. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:11.308041 17217 consensus_queue.cc:237] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:11.316350 16788 catalog_manager.cc:5697] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 reported cstate change: term changed from 1 to 2, leader changed from 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131) to 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "5581e4f0fdf3412c9e169bd05c247948" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:11.417874 16889 raft_consensus.cc:1275] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.419353 17243 consensus_queue.cc:1048] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.421670 17039 raft_consensus.cc:1275] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.423528 17217 consensus_queue.cc:1048] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:11.434340 17041 raft_consensus.cc:1275] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.436086 17195 consensus_queue.cc:1048] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.448578 16967 raft_consensus.cc:1275] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.450668 17134 consensus_queue.cc:1048] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:11.582794 17040 raft_consensus.cc:1275] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.584270 17195 consensus_queue.cc:1048] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.593638 16890 raft_consensus.cc:1275] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.595541 17192 consensus_queue.cc:1048] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.608307 17040 raft_consensus.cc:1275] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.609871 17192 consensus_queue.cc:1048] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.619606 16890 raft_consensus.cc:1275] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Refusing update from remote peer 3599d38261fe499e84ec6e5b55db87cc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.621119 17195 consensus_queue.cc:1048] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.769182 17040 raft_consensus.cc:1275] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.771054 17217 consensus_queue.cc:1048] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.781056 16965 raft_consensus.cc:1275] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.784150 17218 consensus_queue.cc:1048] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:11.836490 17040 raft_consensus.cc:1275] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.838143 17218 consensus_queue.cc:1048] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:11.847597 16965 raft_consensus.cc:1275] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Refusing update from remote peer 5581e4f0fdf3412c9e169bd05c247948: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:11.849592 17134 consensus_queue.cc:1048] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:13.827128 16789 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43068:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:21:13.848873 16789 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43068:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:21:13.909300  4246 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:21:14.086104 17284 log.cc:927] Time spent T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
W20260709 13:21:14.112267 16933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:32835, user_credentials={real_user=slave}} blocked reactor thread for 104836us
W20260709 13:21:14.192502 17294 log.cc:927] Time spent T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:21:14.194146 17290 log.cc:927] Time spent T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:21:14.206537 17297 log.cc:927] Time spent T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:21:14.214757 17281 log.cc:927] Time spent T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc: Append to log took a long time: real 0.227s	user 0.005s	sys 0.000s
I20260709 13:21:14.352037 17316 tablet.cc:1724] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.376464 17321 tablet.cc:1724] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.430998 17325 tablet.cc:1724] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.403970 17323 tablet.cc:1724] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.376320 17322 tablet.cc:1724] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:14.457644 17308 log.cc:927] Time spent T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
W20260709 13:21:14.461824 17315 log.cc:927] Time spent T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:21:14.504215 17327 tablet.cc:1724] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.432883 17320 tablet.cc:1724] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.507187 17325 tablet.cc:1724] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:14.535106 17067 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2c141115f1a34bc9924e98f969b5f9dd)
W20260709 13:21:14.536949 17067 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:2c141115f1a34bc9924e98f969b5f9dd)
I20260709 13:21:14.510113 17326 tablet.cc:1724] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:14.585410 16993 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:2903bf0573c845bc9afd64b21d738d8b)
I20260709 13:21:14.590564 17331 tablet.cc:1724] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.594200 17327 tablet.cc:1724] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.601879 16888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
mode: GRACEFUL
new_leader_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:21:14.602806 16888 raft_consensus.cc:606] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Received request to transfer leadership to TS 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:14.604849 17326 tablet.cc:1724] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.608870 17327 tablet.cc:1724] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.616950 17332 tablet.cc:1724] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.625550 17316 tablet.cc:1724] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:14.628966 17328 log.cc:927] Time spent T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:21:14.637977 17333 tablet.cc:1724] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.646045 16789 catalog_manager.cc:5789] TS 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119) does not have the latest schema for tablet 9c5c291920854d239e1d03dce782aef8 (table soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]). Expected version 1 got 0
I20260709 13:21:14.636387 17320 tablet.cc:1724] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.638027 17336 tablet.cc:1724] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.649765 17331 tablet.cc:1724] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.652366 16788 catalog_manager.cc:5789] TS 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451) does not have the latest schema for tablet 3682db159d4c4d0292cd1618870494da (table soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]). Expected version 1 got 0
I20260709 13:21:14.653261 16788 catalog_manager.cc:5789] TS 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451) does not have the latest schema for tablet 7e153fbeee80460286e13aea7d689a8d (table soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]). Expected version 1 got 0
I20260709 13:21:14.657161 16787 catalog_manager.cc:5789] TS 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131:32835) does not have the latest schema for tablet 61a8a8d97d3a4228a370581c50ec0a3c (table soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff]). Expected version 1 got 0
I20260709 13:21:14.659910 17321 tablet.cc:1724] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.669876 17323 tablet.cc:1724] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.658299 17322 tablet.cc:1724] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.694312 17332 tablet.cc:1724] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.710423 17323 tablet.cc:1724] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.728322 17316 tablet.cc:1724] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.733551 17325 tablet.cc:1724] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.744465 16963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a42703d2f78443579cccd3246e12734d"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
mode: GRACEFUL
new_leader_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:47854
I20260709 13:21:14.745265 16963 raft_consensus.cc:606] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Received request to transfer leadership to TS 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:14.747517  4246 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:21:14.748366  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:14.744767 17331 tablet.cc:1724] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:14.769273 16888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea"
dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
mode: GRACEFUL
new_leader_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:21:14.770182 16888 raft_consensus.cc:606] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Received request to transfer leadership to TS 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:14.776609 16963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb"
dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
mode: GRACEFUL
new_leader_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:47854
I20260709 13:21:14.777379 16963 raft_consensus.cc:606] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Received request to transfer leadership to TS 377c24fd9c7040eea797cad32ea6f601
I20260709 13:21:14.779760  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:14.780531  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:14.783156 17292 raft_consensus.cc:993] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: : Instructing follower 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:14.783934 17292 raft_consensus.cc:1081] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Signalling peer 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:14.786787 17037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd"
dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:48114
I20260709 13:21:14.787459 17037 raft_consensus.cc:493] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:14.787894 17037 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.805589 17037 raft_consensus.cc:515] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.811211 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:14.812376 16888 raft_consensus.cc:3055] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:14.812775 16888 raft_consensus.cc:740] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:14.815026 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c141115f1a34bc9924e98f969b5f9dd" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:14.815919 16963 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.813714 16888 consensus_queue.cc:260] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.819857 16888 raft_consensus.cc:3060] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.813479 17037 leader_election.cc:290] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 3 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:14.828109 16963 raft_consensus.cc:2468] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 3.
I20260709 13:21:14.830226 17004 leader_election.cc:304] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:14.831609 17299 raft_consensus.cc:2804] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:14.832310 17299 raft_consensus.cc:697] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 3 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:14.833217 17299 consensus_queue.cc:237] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.834050 16888 raft_consensus.cc:2468] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 3.
I20260709 13:21:14.835688 16788 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a: soft_deleted_table [id=7b7d9fb41846467b9c6911ffcf6d7fff] alter complete (version 1)
I20260709 13:21:14.849728 16790 catalog_manager.cc:5697] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 2 to 3, leader changed from 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129) to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.907008 17298 raft_consensus.cc:993] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc: : Instructing follower 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:14.907778 17312 raft_consensus.cc:1081] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Signalling peer 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:14.909380 17037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a42703d2f78443579cccd3246e12734d"
dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:48102
I20260709 13:21:14.909967 17037 raft_consensus.cc:493] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:14.910317 17037 raft_consensus.cc:3060] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.916785 17037 raft_consensus.cc:515] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.919682 17037 leader_election.cc:290] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 2 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:14.920100 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42703d2f78443579cccd3246e12734d" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:14.920305 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42703d2f78443579cccd3246e12734d" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:14.922544 16888 raft_consensus.cc:3060] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.922673 16963 raft_consensus.cc:3055] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:14.923255 16963 raft_consensus.cc:740] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:14.924237 16963 consensus_queue.cc:260] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.926160 16963 raft_consensus.cc:3060] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:14.931082 16888 raft_consensus.cc:2468] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 2.
I20260709 13:21:14.933538 17312 raft_consensus.cc:993] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc: : Instructing follower 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:14.933542 17006 leader_election.cc:304] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:14.935102 17312 raft_consensus.cc:1081] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Signalling peer 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:14.935745 17299 raft_consensus.cc:2804] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:14.936406 17299 raft_consensus.cc:697] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 2 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:14.937681 17299 consensus_queue.cc:237] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.938433 17037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb"
dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:48102
I20260709 13:21:14.939141 17037 raft_consensus.cc:493] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:14.940135 17037 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.942648 16963 raft_consensus.cc:2468] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 2.
I20260709 13:21:14.950474 16790 catalog_manager.cc:5697] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 1 to 2, leader changed from 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130) to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.950826 17037 raft_consensus.cc:515] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.954245 17037 leader_election.cc:290] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 3 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:14.955996 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:14.956985 16888 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.956492 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9343a142b1949afb6f9f2f6d5f10ebb" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:14.962594 16963 raft_consensus.cc:3055] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:14.962992 16963 raft_consensus.cc:740] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3599d38261fe499e84ec6e5b55db87cc, State: Running, Role: LEADER
I20260709 13:21:14.964048 16963 consensus_queue.cc:260] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.966779 16963 raft_consensus.cc:3060] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:14.968010 16888 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 3.
I20260709 13:21:14.969713 17006 leader_election.cc:304] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 377c24fd9c7040eea797cad32ea6f601, 5581e4f0fdf3412c9e169bd05c247948; no voters: 
I20260709 13:21:14.970680 17296 raft_consensus.cc:2804] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:14.971169 17296 raft_consensus.cc:697] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 3 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:14.972342 17296 consensus_queue.cc:237] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:14.979827 16963 raft_consensus.cc:2468] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 3.
I20260709 13:21:14.988462 16790 catalog_manager.cc:5697] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 2 to 3, leader changed from 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130) to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:14.996579 17292 raft_consensus.cc:993] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948: : Instructing follower 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:14.997292 17291 raft_consensus.cc:1081] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Signalling peer 377c24fd9c7040eea797cad32ea6f601 to start an election
I20260709 13:21:14.999418 17037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea"
dest_uuid: "377c24fd9c7040eea797cad32ea6f601"
 from {username='slave'} at 127.0.0.1:48114
I20260709 13:21:15.000023 17037 raft_consensus.cc:493] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:15.000355 17037 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.005834 17037 raft_consensus.cc:515] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:15.007717 17037 leader_election.cc:290] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 3 election: Requested vote from peers 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451), 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119)
I20260709 13:21:15.008714 16888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5581e4f0fdf3412c9e169bd05c247948"
I20260709 13:21:15.008916 16963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a10f6b5a9ec4a86bfc505e074eb89ea" candidate_uuid: "377c24fd9c7040eea797cad32ea6f601" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3599d38261fe499e84ec6e5b55db87cc"
I20260709 13:21:15.009513 16888 raft_consensus.cc:3055] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:15.009655 16963 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.009955 16888 raft_consensus.cc:740] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5581e4f0fdf3412c9e169bd05c247948, State: Running, Role: LEADER
I20260709 13:21:15.011121 16888 consensus_queue.cc:260] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:15.012897 16888 raft_consensus.cc:3060] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:15.019810 16963 raft_consensus.cc:2468] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 3.
I20260709 13:21:15.021392 16888 raft_consensus.cc:2468] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 377c24fd9c7040eea797cad32ea6f601 in term 3.
I20260709 13:21:15.021526 17004 leader_election.cc:304] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3599d38261fe499e84ec6e5b55db87cc, 377c24fd9c7040eea797cad32ea6f601; no voters: 
I20260709 13:21:15.023572 17296 raft_consensus.cc:2804] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:15.024199 17296 raft_consensus.cc:697] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 3 LEADER]: Becoming Leader. State: Replica: 377c24fd9c7040eea797cad32ea6f601, State: Running, Role: LEADER
I20260709 13:21:15.025254 17296 consensus_queue.cc:237] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } }
I20260709 13:21:15.036880 16790 catalog_manager.cc:5697] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 reported cstate change: term changed from 2 to 3, leader changed from 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129) to 377c24fd9c7040eea797cad32ea6f601 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "377c24fd9c7040eea797cad32ea6f601" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "377c24fd9c7040eea797cad32ea6f601" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 32835 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:15.307021 16963 raft_consensus.cc:1275] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:21:15.308733 17296 consensus_queue.cc:1048] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:21:15.321735 16888 raft_consensus.cc:1275] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:21:15.323509 17299 consensus_queue.cc:1048] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:21:15.364588 16963 raft_consensus.cc:1275] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:15.366199 17299 consensus_queue.cc:1048] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.377825 16888 raft_consensus.cc:1275] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:15.381368 17347 consensus_queue.cc:1048] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:15.401948 16888 raft_consensus.cc:1275] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:21:15.404985 17347 consensus_queue.cc:1048] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.416996 16963 raft_consensus.cc:1275] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:21:15.418913 17347 consensus_queue.cc:1048] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.589244 16963 raft_consensus.cc:1275] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:15.590998 17347 consensus_queue.cc:1048] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3599d38261fe499e84ec6e5b55db87cc" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 42119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.602035 16890 raft_consensus.cc:1275] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Refusing update from remote peer 377c24fd9c7040eea797cad32ea6f601: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:15.603639 17299 consensus_queue.cc:1048] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5581e4f0fdf3412c9e169bd05c247948" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:15.861531  4246 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:21:15.868758  4246 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:21:15.869822  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:15.880609  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:21:15.881385  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:16.921872  4246 tablet_server.cc:179] TabletServer@127.4.37.129:0 shutting down...
W20260709 13:21:16.924572 17006 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:21:16.928820 17006 consensus_peers.cc:597] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.944625 16932 consensus_peers.cc:597] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:16.967314 16932 consensus_peers.cc:597] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:16.970527  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:16.971498  4246 tablet_replica.cc:333] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:16.972683  4246 raft_consensus.cc:2243] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.973366  4246 raft_consensus.cc:2272] T 61a8a8d97d3a4228a370581c50ec0a3c P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.975924  4246 tablet_replica.cc:333] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:16.976662  4246 raft_consensus.cc:2243] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.977380  4246 raft_consensus.cc:2272] T a42703d2f78443579cccd3246e12734d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.980990  4246 tablet_replica.cc:333] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:16.982062  4246 raft_consensus.cc:2243] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:16.982861  4246 raft_consensus.cc:2272] T 7e153fbeee80460286e13aea7d689a8d P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.985822  4246 tablet_replica.cc:333] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:16.986647  4246 raft_consensus.cc:2243] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.987315  4246 raft_consensus.cc:2272] T 8130a5849e7d4b48878df9e4ff6d48c4 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.990394  4246 tablet_replica.cc:333] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:16.991104  4246 raft_consensus.cc:2243] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:16.992038  4246 raft_consensus.cc:2272] T 7e45ec944b8c4b1596f6d1cdf4858855 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.994426  4246 tablet_replica.cc:333] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:16.995121  4246 raft_consensus.cc:2243] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:16.996042  4246 raft_consensus.cc:2272] T 2f6d59b141324efc9b840bd7e5e4510f P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:16.998340  4246 tablet_replica.cc:333] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:16.998986  4246 raft_consensus.cc:2243] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:16.999475  4246 raft_consensus.cc:2272] T c9343a142b1949afb6f9f2f6d5f10ebb P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.001538  4246 tablet_replica.cc:333] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.002170  4246 raft_consensus.cc:2243] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.002961  4246 raft_consensus.cc:2272] T 3682db159d4c4d0292cd1618870494da P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.005031  4246 tablet_replica.cc:333] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.006208  4246 raft_consensus.cc:2243] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.006788  4246 raft_consensus.cc:2272] T 2834cb5f402f4562811a5743bfc32387 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.009115  4246 tablet_replica.cc:333] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.009893  4246 raft_consensus.cc:2243] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.010437  4246 raft_consensus.cc:2272] T 9c5c291920854d239e1d03dce782aef8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.012885  4246 tablet_replica.cc:333] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.013806  4246 raft_consensus.cc:2243] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.014359  4246 raft_consensus.cc:2272] T 9d7d92610c01418f9b56c1213fd0114a P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.016738  4246 tablet_replica.cc:333] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.017452  4246 raft_consensus.cc:2243] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.017980  4246 raft_consensus.cc:2272] T cf11378569ee4907aae5a4119cc741ff P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.020434  4246 tablet_replica.cc:333] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.021102  4246 raft_consensus.cc:2243] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.021670  4246 raft_consensus.cc:2272] T 2903bf0573c845bc9afd64b21d738d8b P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.023913  4246 tablet_replica.cc:333] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.024827  4246 raft_consensus.cc:2243] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.026052  4246 raft_consensus.cc:2272] T 699f2b86ba424b5caf2427b5baf231b8 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.029150  4246 tablet_replica.cc:333] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.030058  4246 raft_consensus.cc:2243] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.031283  4246 raft_consensus.cc:2272] T 3175ca44790543feac2c09a4e54d1016 P 5581e4f0fdf3412c9e169bd05c247948 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.034382  4246 tablet_replica.cc:333] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.035194  4246 raft_consensus.cc:2243] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.035792  4246 raft_consensus.cc:2272] T ef919afc271f41fe8862d8725e4ce653 P 5581e4f0fdf3412c9e169bd05c247948 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.038198  4246 tablet_replica.cc:333] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.038776  4246 raft_consensus.cc:2243] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.039220  4246 raft_consensus.cc:2272] T 2c141115f1a34bc9924e98f969b5f9dd P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.041298  4246 tablet_replica.cc:333] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948: stopping tablet replica
I20260709 13:21:17.041836  4246 raft_consensus.cc:2243] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.042274  4246 raft_consensus.cc:2272] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 5581e4f0fdf3412c9e169bd05c247948 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:17.056231 16932 consensus_peers.cc:597] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:17.085623 17006 consensus_peers.cc:597] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:39451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.087414  4246 tablet_server.cc:196] TabletServer@127.4.37.129:0 shutdown complete.
W20260709 13:21:17.118934 16932 consensus_peers.cc:597] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:39451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.134346  4246 tablet_server.cc:179] TabletServer@127.4.37.130:0 shutting down...
W20260709 13:21:17.136833 16932 consensus_peers.cc:597] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:39451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:17.176047 17004 consensus_peers.cc:597] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 -> Peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Couldn't send request to peer 3599d38261fe499e84ec6e5b55db87cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:17.177452 17006 consensus_peers.cc:597] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:39451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.179301  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:17.180418  4246 tablet_replica.cc:333] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.181536  4246 raft_consensus.cc:2243] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.182260  4246 raft_consensus.cc:2272] T a42703d2f78443579cccd3246e12734d P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.186373  4246 tablet_replica.cc:333] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.187247  4246 raft_consensus.cc:2243] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.187870  4246 raft_consensus.cc:2272] T 61a8a8d97d3a4228a370581c50ec0a3c P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:17.188392 17006 consensus_peers.cc:597] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:39451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.191295  4246 tablet_replica.cc:333] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.192086  4246 raft_consensus.cc:2243] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.192631  4246 raft_consensus.cc:2272] T 7e153fbeee80460286e13aea7d689a8d P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.195182  4246 tablet_replica.cc:333] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.195914  4246 raft_consensus.cc:2243] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.196844  4246 raft_consensus.cc:2272] T ef919afc271f41fe8862d8725e4ce653 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.199186  4246 tablet_replica.cc:333] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.199910  4246 raft_consensus.cc:2243] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.200451  4246 raft_consensus.cc:2272] T 2c141115f1a34bc9924e98f969b5f9dd P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.202804  4246 tablet_replica.cc:333] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.203688  4246 raft_consensus.cc:2243] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.204780  4246 raft_consensus.cc:2272] T cf11378569ee4907aae5a4119cc741ff P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.208086  4246 tablet_replica.cc:333] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.208906  4246 raft_consensus.cc:2243] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.210050  4246 raft_consensus.cc:2272] T 2903bf0573c845bc9afd64b21d738d8b P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.213020  4246 tablet_replica.cc:333] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.213793  4246 raft_consensus.cc:2243] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.214275  4246 raft_consensus.cc:2272] T 699f2b86ba424b5caf2427b5baf231b8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.216488  4246 tablet_replica.cc:333] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.217026  4246 raft_consensus.cc:2243] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.217890  4246 raft_consensus.cc:2272] T 9c5c291920854d239e1d03dce782aef8 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.219954  4246 tablet_replica.cc:333] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.220643  4246 raft_consensus.cc:2243] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.221859  4246 raft_consensus.cc:2272] T 9d7d92610c01418f9b56c1213fd0114a P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:17.225154 17004 consensus_peers.cc:597] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 -> Peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Couldn't send request to peer 3599d38261fe499e84ec6e5b55db87cc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.226109  4246 tablet_replica.cc:333] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.226981  4246 raft_consensus.cc:2243] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.228097  4246 raft_consensus.cc:2272] T 8130a5849e7d4b48878df9e4ff6d48c4 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.232177  4246 tablet_replica.cc:333] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.233075  4246 raft_consensus.cc:2243] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.233772  4246 raft_consensus.cc:2272] T 7e45ec944b8c4b1596f6d1cdf4858855 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.236224  4246 tablet_replica.cc:333] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.236907  4246 raft_consensus.cc:2243] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.237526  4246 raft_consensus.cc:2272] T 2f6d59b141324efc9b840bd7e5e4510f P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.240029  4246 tablet_replica.cc:333] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.240669  4246 raft_consensus.cc:2243] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.241171  4246 raft_consensus.cc:2272] T c9343a142b1949afb6f9f2f6d5f10ebb P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.243595  4246 tablet_replica.cc:333] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.244510  4246 raft_consensus.cc:2243] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.245256  4246 raft_consensus.cc:2272] T 3175ca44790543feac2c09a4e54d1016 P 3599d38261fe499e84ec6e5b55db87cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.248059  4246 tablet_replica.cc:333] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.248757  4246 raft_consensus.cc:2243] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.249325  4246 raft_consensus.cc:2272] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 3599d38261fe499e84ec6e5b55db87cc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.251967  4246 tablet_replica.cc:333] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.252892  4246 raft_consensus.cc:2243] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.253597  4246 raft_consensus.cc:2272] T 3682db159d4c4d0292cd1618870494da P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.256099  4246 tablet_replica.cc:333] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc: stopping tablet replica
I20260709 13:21:17.256719  4246 raft_consensus.cc:2243] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.257280  4246 raft_consensus.cc:2272] T 2834cb5f402f4562811a5743bfc32387 P 3599d38261fe499e84ec6e5b55db87cc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.312826  4246 tablet_server.cc:196] TabletServer@127.4.37.130:0 shutdown complete.
W20260709 13:21:17.345690 17006 consensus_peers.cc:597] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 -> Peer 5581e4f0fdf3412c9e169bd05c247948 (127.4.37.129:39451): Couldn't send request to peer 5581e4f0fdf3412c9e169bd05c247948. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:39451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.364954  4246 tablet_server.cc:179] TabletServer@127.4.37.131:0 shutting down...
W20260709 13:21:17.377249 17004 consensus_peers.cc:597] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 -> Peer 3599d38261fe499e84ec6e5b55db87cc (127.4.37.130:42119): Couldn't send request to peer 3599d38261fe499e84ec6e5b55db87cc. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:42119: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:17.412496  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:17.413934  4246 tablet_replica.cc:333] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.414747  4246 raft_consensus.cc:2243] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.415695  4246 raft_consensus.cc:2272] T a42703d2f78443579cccd3246e12734d P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.418223  4246 tablet_replica.cc:333] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.418954  4246 raft_consensus.cc:2243] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.419885  4246 raft_consensus.cc:2272] T 61a8a8d97d3a4228a370581c50ec0a3c P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.422379  4246 tablet_replica.cc:333] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.423049  4246 raft_consensus.cc:2243] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.423559  4246 raft_consensus.cc:2272] T 7e153fbeee80460286e13aea7d689a8d P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.425705  4246 tablet_replica.cc:333] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.426368  4246 raft_consensus.cc:2243] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.426869  4246 raft_consensus.cc:2272] T 2903bf0573c845bc9afd64b21d738d8b P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.429044  4246 tablet_replica.cc:333] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.429744  4246 raft_consensus.cc:2243] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.430236  4246 raft_consensus.cc:2272] T 699f2b86ba424b5caf2427b5baf231b8 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.432688  4246 tablet_replica.cc:333] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.433482  4246 raft_consensus.cc:2243] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.434021  4246 raft_consensus.cc:2272] T cf11378569ee4907aae5a4119cc741ff P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.436255  4246 tablet_replica.cc:333] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.437047  4246 raft_consensus.cc:2243] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.437635  4246 raft_consensus.cc:2272] T 9c5c291920854d239e1d03dce782aef8 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.440296  4246 tablet_replica.cc:333] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.441098  4246 raft_consensus.cc:2243] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.441772  4246 raft_consensus.cc:2272] T 9d7d92610c01418f9b56c1213fd0114a P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.444294  4246 tablet_replica.cc:333] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.444905  4246 raft_consensus.cc:2243] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.445407  4246 raft_consensus.cc:2272] T 3682db159d4c4d0292cd1618870494da P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.447441  4246 tablet_replica.cc:333] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.448074  4246 raft_consensus.cc:2243] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.449059  4246 raft_consensus.cc:2272] T 2834cb5f402f4562811a5743bfc32387 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.451372  4246 tablet_replica.cc:333] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.452018  4246 raft_consensus.cc:2243] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.452868  4246 raft_consensus.cc:2272] T c9343a142b1949afb6f9f2f6d5f10ebb P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.455252  4246 tablet_replica.cc:333] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.455947  4246 raft_consensus.cc:2243] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.456434  4246 raft_consensus.cc:2272] T 2f6d59b141324efc9b840bd7e5e4510f P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.458887  4246 tablet_replica.cc:333] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.459466  4246 raft_consensus.cc:2243] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.459939  4246 raft_consensus.cc:2272] T 7e45ec944b8c4b1596f6d1cdf4858855 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.462106  4246 tablet_replica.cc:333] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.462703  4246 raft_consensus.cc:2243] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.463176  4246 raft_consensus.cc:2272] T 8130a5849e7d4b48878df9e4ff6d48c4 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.465454  4246 tablet_replica.cc:333] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.466080  4246 raft_consensus.cc:2243] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.466559  4246 raft_consensus.cc:2272] T ef919afc271f41fe8862d8725e4ce653 P 377c24fd9c7040eea797cad32ea6f601 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.468653  4246 tablet_replica.cc:333] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.469251  4246 raft_consensus.cc:2243] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.470117  4246 raft_consensus.cc:2272] T 2c141115f1a34bc9924e98f969b5f9dd P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.472324  4246 tablet_replica.cc:333] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.472878  4246 raft_consensus.cc:2243] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.473742  4246 raft_consensus.cc:2272] T 0a10f6b5a9ec4a86bfc505e074eb89ea P 377c24fd9c7040eea797cad32ea6f601 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.476140  4246 tablet_replica.cc:333] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601: stopping tablet replica
I20260709 13:21:17.476714  4246 raft_consensus.cc:2243] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:17.477191  4246 raft_consensus.cc:2272] T 3175ca44790543feac2c09a4e54d1016 P 377c24fd9c7040eea797cad32ea6f601 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.523464  4246 tablet_server.cc:196] TabletServer@127.4.37.131:0 shutdown complete.
I20260709 13:21:17.561288  4246 master.cc:562] Master@127.4.37.190:36013 shutting down...
I20260709 13:21:17.594878  4246 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:17.595546  4246 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:17.595955  4246 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1457d84f7ef4443f873ebcbc7a44ff4a: stopping tablet replica
I20260709 13:21:17.618448  4246 master.cc:584] Master@127.4.37.190:36013 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13864 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:21:17.687564  4246 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.37.190:44623
I20260709 13:21:17.688807  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:17.697654 17361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:17.697751 17363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:17.697710 17360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:17.697675  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:17.699694  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:17.699905  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:17.700093  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603277700075 us; error 0 us; skew 500 ppm
I20260709 13:21:17.700657  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:17.703966  4246 webserver.cc:533] Webserver started at http://127.4.37.190:39541/ using document root <none> and password file <none>
I20260709 13:21:17.704592  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:17.704909  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:17.705240  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:17.706465  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/master-0-root/instance:
uuid: "ce2c179605574eae8d582b3b1d045ac1"
format_stamp: "Formatted at 2026-07-09 13:21:17 on dist-test-slave-jk05"
I20260709 13:21:17.711619  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:21:17.716003 17368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:17.717028  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:17.717311  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/master-0-root
uuid: "ce2c179605574eae8d582b3b1d045ac1"
format_stamp: "Formatted at 2026-07-09 13:21:17 on dist-test-slave-jk05"
I20260709 13:21:17.717640  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:17.755575  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:17.756811  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:17.810822  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.190:44623
I20260709 13:21:17.810958 17419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.190:44623 every 8 connection(s)
I20260709 13:21:17.815855 17420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:17.828071 17420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1: Bootstrap starting.
I20260709 13:21:17.833729 17420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:17.839718 17420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1: No bootstrap required, opened a new log
I20260709 13:21:17.842121 17420 raft_consensus.cc:359] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2c179605574eae8d582b3b1d045ac1" member_type: VOTER }
I20260709 13:21:17.842536 17420 raft_consensus.cc:385] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:17.842715 17420 raft_consensus.cc:740] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2c179605574eae8d582b3b1d045ac1, State: Initialized, Role: FOLLOWER
I20260709 13:21:17.843545 17420 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2c179605574eae8d582b3b1d045ac1" member_type: VOTER }
I20260709 13:21:17.843998 17420 raft_consensus.cc:399] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:17.844220 17420 raft_consensus.cc:493] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:17.844429 17420 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:17.849622 17420 raft_consensus.cc:515] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2c179605574eae8d582b3b1d045ac1" member_type: VOTER }
I20260709 13:21:17.850235 17420 leader_election.cc:304] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce2c179605574eae8d582b3b1d045ac1; no voters: 
I20260709 13:21:17.851881 17420 leader_election.cc:290] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:17.852324 17423 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:17.853952 17423 raft_consensus.cc:697] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 1 LEADER]: Becoming Leader. State: Replica: ce2c179605574eae8d582b3b1d045ac1, State: Running, Role: LEADER
I20260709 13:21:17.854725 17423 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2c179605574eae8d582b3b1d045ac1" member_type: VOTER }
I20260709 13:21:17.854934 17420 sys_catalog.cc:565] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:17.859699 17425 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce2c179605574eae8d582b3b1d045ac1. Latest consensus state: current_term: 1 leader_uuid: "ce2c179605574eae8d582b3b1d045ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2c179605574eae8d582b3b1d045ac1" member_type: VOTER } }
I20260709 13:21:17.860538 17425 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:17.860535 17424 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce2c179605574eae8d582b3b1d045ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce2c179605574eae8d582b3b1d045ac1" member_type: VOTER } }
I20260709 13:21:17.861835 17424 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:17.865300 17431 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:17.874836 17431 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:17.876042  4246 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:17.887369 17431 catalog_manager.cc:1383] Generated new cluster ID: 335ec134237a4de6a3338093e3a41014
I20260709 13:21:17.888005 17431 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:17.928718 17431 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:17.930712 17431 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:17.949194 17431 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1: Generated new TSK 0
I20260709 13:21:17.950753 17431 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:18.008447  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:18.016968 17441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:18.018535 17442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:18.020239  4246 server_base.cc:1061] running on GCE node
W20260709 13:21:18.021247 17444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:18.022795  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:18.023116  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:18.023314  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603278023295 us; error 0 us; skew 500 ppm
I20260709 13:21:18.024433  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:18.027266  4246 webserver.cc:533] Webserver started at http://127.4.37.129:45957/ using document root <none> and password file <none>
I20260709 13:21:18.027798  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:18.027988  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:18.028294  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:18.029553  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-0-root/instance:
uuid: "69f0069ff0474bc385b3ba8565409ce6"
format_stamp: "Formatted at 2026-07-09 13:21:18 on dist-test-slave-jk05"
I20260709 13:21:18.034480  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:21:18.038360 17449 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:18.039325  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:21:18.039742  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-0-root
uuid: "69f0069ff0474bc385b3ba8565409ce6"
format_stamp: "Formatted at 2026-07-09 13:21:18 on dist-test-slave-jk05"
I20260709 13:21:18.040015  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:18.062345  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:18.063657  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:18.065222  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:18.067982  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:18.068224  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:18.068970  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:18.069399  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:18.119649  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.129:41821
I20260709 13:21:18.119776 17511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.129:41821 every 8 connection(s)
I20260709 13:21:18.126484  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:18.136988 17517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:18.137126 17516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:18.140116  4246 server_base.cc:1061] running on GCE node
W20260709 13:21:18.141113 17520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:18.141937 17512 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44623
I20260709 13:21:18.142390 17512 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:18.142418  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:18.142833  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:18.143057  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603278143039 us; error 0 us; skew 500 ppm
I20260709 13:21:18.143486 17512 heartbeater.cc:507] Master 127.4.37.190:44623 requested a full tablet report, sending...
I20260709 13:21:18.143872  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:18.146246 17385 ts_manager.cc:194] Registered new tserver with Master: 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821)
I20260709 13:21:18.147235  4246 webserver.cc:533] Webserver started at http://127.4.37.130:43775/ using document root <none> and password file <none>
I20260709 13:21:18.147951  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:18.148196  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:18.148504  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:18.148878 17385 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43108
I20260709 13:21:18.150207  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-1-root/instance:
uuid: "576ae391841648b491a9f4570aea8424"
format_stamp: "Formatted at 2026-07-09 13:21:18 on dist-test-slave-jk05"
I20260709 13:21:18.155802  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:21:18.159611 17524 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:18.160583  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:21:18.160918  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-1-root
uuid: "576ae391841648b491a9f4570aea8424"
format_stamp: "Formatted at 2026-07-09 13:21:18 on dist-test-slave-jk05"
I20260709 13:21:18.161223  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:18.175448  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:18.176728  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:18.178385  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:18.180799  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:18.181053  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:18.181308  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:18.181511  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:21:18.231499  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.130:45861
I20260709 13:21:18.231678 17586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.130:45861 every 8 connection(s)
I20260709 13:21:18.237377  4246 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:18.247421 17590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:18.248739 17591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:18.252594 17593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:18.253041 17587 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44623
I20260709 13:21:18.253145  4246 server_base.cc:1061] running on GCE node
I20260709 13:21:18.253700 17587 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:18.254456  4246 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:21:18.254685 17587 heartbeater.cc:507] Master 127.4.37.190:44623 requested a full tablet report, sending...
W20260709 13:21:18.254802  4246 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:18.255192  4246 hybrid_clock.cc:648] HybridClock initialized: now 1783603278255170 us; error 0 us; skew 500 ppm
I20260709 13:21:18.256340  4246 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:18.257773 17385 ts_manager.cc:194] Registered new tserver with Master: 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:18.259625  4246 webserver.cc:533] Webserver started at http://127.4.37.131:35153/ using document root <none> and password file <none>
I20260709 13:21:18.259635 17385 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43114
I20260709 13:21:18.260336  4246 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:18.260613  4246 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:18.261003  4246 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:18.262921  4246 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-2-root/instance:
uuid: "6db76967201e4b50b35c35b520236758"
format_stamp: "Formatted at 2026-07-09 13:21:18 on dist-test-slave-jk05"
I20260709 13:21:18.268530  4246 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:18.272984 17598 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:18.274207  4246 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:18.274600  4246 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-2-root
uuid: "6db76967201e4b50b35c35b520236758"
format_stamp: "Formatted at 2026-07-09 13:21:18 on dist-test-slave-jk05"
I20260709 13:21:18.274958  4246 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task1U9pNK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602897722324-4246-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:18.288635  4246 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:18.289948  4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:18.292073  4246 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:18.295135  4246 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:18.295421  4246 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:18.295706  4246 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:18.295917  4246 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:18.340677  4246 rpc_server.cc:307] RPC server started. Bound to: 127.4.37.131:34757
I20260709 13:21:18.340883 17660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.37.131:34757 every 8 connection(s)
I20260709 13:21:18.357635 17661 heartbeater.cc:344] Connected to a master server at 127.4.37.190:44623
I20260709 13:21:18.358126 17661 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:18.358974 17661 heartbeater.cc:507] Master 127.4.37.190:44623 requested a full tablet report, sending...
I20260709 13:21:18.361248 17385 ts_manager.cc:194] Registered new tserver with Master: 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:18.361953  4246 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016614187s
I20260709 13:21:18.363158 17385 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43124
I20260709 13:21:18.392103 17385 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43126:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:18.395267 17385 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:18.471501 17552 tablet_service.cc:1511] Processing CreateTablet for tablet 6df549a3ca8d47aaa10181adc987402d (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:18.473011 17552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df549a3ca8d47aaa10181adc987402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.475574 17626 tablet_service.cc:1511] Processing CreateTablet for tablet 6df549a3ca8d47aaa10181adc987402d (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:18.475593 17551 tablet_service.cc:1511] Processing CreateTablet for tablet dde0ae00446748c0b567aad72551553d (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:18.477275 17551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde0ae00446748c0b567aad72551553d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.477293 17626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df549a3ca8d47aaa10181adc987402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.484505 17625 tablet_service.cc:1511] Processing CreateTablet for tablet dde0ae00446748c0b567aad72551553d (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:18.486171 17625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde0ae00446748c0b567aad72551553d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.487499 17550 tablet_service.cc:1511] Processing CreateTablet for tablet 920fcf8e4add4debbfc4574eb48d9069 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:18.489018 17550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920fcf8e4add4debbfc4574eb48d9069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.492117 17549 tablet_service.cc:1511] Processing CreateTablet for tablet f40f5b7124a24623bc51954334e2516b (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:18.493736 17624 tablet_service.cc:1511] Processing CreateTablet for tablet 920fcf8e4add4debbfc4574eb48d9069 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:18.494309 17549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40f5b7124a24623bc51954334e2516b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.495283 17624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920fcf8e4add4debbfc4574eb48d9069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.499075 17623 tablet_service.cc:1511] Processing CreateTablet for tablet f40f5b7124a24623bc51954334e2516b (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:18.500702 17623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40f5b7124a24623bc51954334e2516b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.509238 17477 tablet_service.cc:1511] Processing CreateTablet for tablet 6df549a3ca8d47aaa10181adc987402d (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:18.511343 17477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6df549a3ca8d47aaa10181adc987402d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.511076 17473 tablet_service.cc:1511] Processing CreateTablet for tablet ffb1969bbf6e455788991de0f0c1b9a7 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:18.512879 17473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffb1969bbf6e455788991de0f0c1b9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.514199 17476 tablet_service.cc:1511] Processing CreateTablet for tablet dde0ae00446748c0b567aad72551553d (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:18.515930 17476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde0ae00446748c0b567aad72551553d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.518821 17475 tablet_service.cc:1511] Processing CreateTablet for tablet 920fcf8e4add4debbfc4574eb48d9069 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:18.520488 17475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920fcf8e4add4debbfc4574eb48d9069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.522812 17474 tablet_service.cc:1511] Processing CreateTablet for tablet f40f5b7124a24623bc51954334e2516b (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:18.524369 17474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40f5b7124a24623bc51954334e2516b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.571918 17548 tablet_service.cc:1511] Processing CreateTablet for tablet ffb1969bbf6e455788991de0f0c1b9a7 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:18.574100 17676 tablet_bootstrap.cc:492] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:18.574222 17548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffb1969bbf6e455788991de0f0c1b9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.578480 17677 tablet_bootstrap.cc:492] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:18.582199 17626 tablet_service.cc:1511] Processing CreateTablet for tablet ffb1969bbf6e455788991de0f0c1b9a7 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:18.583709 17626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffb1969bbf6e455788991de0f0c1b9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.590811 17676 tablet_bootstrap.cc:654] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.593971 17678 tablet_bootstrap.cc:492] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:18.597322 17473 tablet_service.cc:1511] Processing CreateTablet for tablet 50fa947202d04956a12b0386f760259f (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:18.598807 17473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50fa947202d04956a12b0386f760259f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.601245 17678 tablet_bootstrap.cc:654] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.612797 17550 tablet_service.cc:1511] Processing CreateTablet for tablet 50fa947202d04956a12b0386f760259f (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:18.614462 17550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50fa947202d04956a12b0386f760259f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.617892 17676 tablet_bootstrap.cc:492] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:18.618793 17626 tablet_service.cc:1511] Processing CreateTablet for tablet 50fa947202d04956a12b0386f760259f (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:18.620779 17626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50fa947202d04956a12b0386f760259f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.618793 17676 ts_tablet_manager.cc:1403] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.006s
I20260709 13:21:18.629902 17678 tablet_bootstrap.cc:492] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:18.630609 17678 ts_tablet_manager.cc:1403] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.037s	user 0.001s	sys 0.012s
I20260709 13:21:18.633605 17472 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6d4a91cf714a2292cccb848a14b9a9 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:18.635228 17472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6d4a91cf714a2292cccb848a14b9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.635906 17676 raft_consensus.cc:359] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:18.636723 17676 raft_consensus.cc:385] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.637008 17676 raft_consensus.cc:740] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.634786 17548 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6d4a91cf714a2292cccb848a14b9a9 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:18.645766 17624 tablet_service.cc:1511] Processing CreateTablet for tablet 2d6d4a91cf714a2292cccb848a14b9a9 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:18.647447 17624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6d4a91cf714a2292cccb848a14b9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.647782 17676 consensus_queue.cc:260] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:18.650391 17678 raft_consensus.cc:359] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.651239 17678 raft_consensus.cc:385] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.651548 17678 raft_consensus.cc:740] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.653115 17677 tablet_bootstrap.cc:654] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.657132 17548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d6d4a91cf714a2292cccb848a14b9a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.657253 17471 tablet_service.cc:1511] Processing CreateTablet for tablet dbeb0989430845f3a1fb0cf8e2f25168 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:18.659474 17471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbeb0989430845f3a1fb0cf8e2f25168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.668164 17678 consensus_queue.cc:260] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.671983 17550 tablet_service.cc:1511] Processing CreateTablet for tablet dbeb0989430845f3a1fb0cf8e2f25168 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:18.674171 17550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbeb0989430845f3a1fb0cf8e2f25168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.686431 17623 tablet_service.cc:1511] Processing CreateTablet for tablet dbeb0989430845f3a1fb0cf8e2f25168 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:18.691244 17623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbeb0989430845f3a1fb0cf8e2f25168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.699874 17587 heartbeater.cc:499] Master 127.4.37.190:44623 was elected leader, sending a full tablet report...
I20260709 13:21:18.702404 17477 tablet_service.cc:1511] Processing CreateTablet for tablet d37d2bbaa22b4fb18bc3c5075cd0a4f1 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:18.704286 17477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37d2bbaa22b4fb18bc3c5075cd0a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.704139 17552 tablet_service.cc:1511] Processing CreateTablet for tablet d37d2bbaa22b4fb18bc3c5075cd0a4f1 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:18.705842 17552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37d2bbaa22b4fb18bc3c5075cd0a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.699891 17661 heartbeater.cc:499] Master 127.4.37.190:44623 was elected leader, sending a full tablet report...
I20260709 13:21:18.708506 17676 ts_tablet_manager.cc:1434] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.087s	user 0.029s	sys 0.018s
I20260709 13:21:18.715369 17676 tablet_bootstrap.cc:492] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:18.701138 17678 ts_tablet_manager.cc:1434] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.003s
I20260709 13:21:18.719381 17678 tablet_bootstrap.cc:492] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:18.720139 17677 tablet_bootstrap.cc:492] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:18.720818 17677 ts_tablet_manager.cc:1403] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.143s	user 0.019s	sys 0.011s
I20260709 13:21:18.724257 17677 raft_consensus.cc:359] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.730706 17677 raft_consensus.cc:385] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.731124 17677 raft_consensus.cc:740] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.732038 17677 consensus_queue.cc:260] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.730252 17676 tablet_bootstrap.cc:654] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:18.736132 17588 tablet.cc:2406] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:18.750138 17677 ts_tablet_manager.cc:1434] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.006s
I20260709 13:21:18.752998 17512 heartbeater.cc:499] Master 127.4.37.190:44623 was elected leader, sending a full tablet report...
I20260709 13:21:18.756021 17678 tablet_bootstrap.cc:654] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.765719 17626 tablet_service.cc:1511] Processing CreateTablet for tablet d37d2bbaa22b4fb18bc3c5075cd0a4f1 (DEFAULT_TABLE table=test-workload [id=b247ce4effeb4ecf8438dacc0e4467c0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:18.766835 17677 tablet_bootstrap.cc:492] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:18.777549 17626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d37d2bbaa22b4fb18bc3c5075cd0a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:18.778004 17676 tablet_bootstrap.cc:492] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:18.778738 17676 ts_tablet_manager.cc:1403] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.018s
I20260709 13:21:18.780324 17678 tablet_bootstrap.cc:492] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:18.780997 17678 ts_tablet_manager.cc:1403] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.002s
I20260709 13:21:18.782990 17676 raft_consensus.cc:359] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.783962 17676 raft_consensus.cc:385] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.784329 17676 raft_consensus.cc:740] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.785310 17676 consensus_queue.cc:260] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.789203 17677 tablet_bootstrap.cc:654] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.792989 17678 raft_consensus.cc:359] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.793052 17676 ts_tablet_manager.cc:1434] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:21:18.793912 17678 raft_consensus.cc:385] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.794322 17678 raft_consensus.cc:740] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.795158 17678 consensus_queue.cc:260] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.798126 17678 ts_tablet_manager.cc:1434] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:21:18.799669 17678 tablet_bootstrap.cc:492] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:18.801646 17676 tablet_bootstrap.cc:492] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:18.810974 17677 tablet_bootstrap.cc:492] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:18.811712 17677 ts_tablet_manager.cc:1403] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.059s	user 0.021s	sys 0.000s
I20260709 13:21:18.812407 17676 tablet_bootstrap.cc:654] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.815088 17677 raft_consensus.cc:359] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.816031 17677 raft_consensus.cc:385] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.816355 17677 raft_consensus.cc:740] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.817344 17677 consensus_queue.cc:260] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.819535 17678 tablet_bootstrap.cc:654] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.820133 17677 ts_tablet_manager.cc:1434] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:18.821516 17677 tablet_bootstrap.cc:492] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:18.821614 17676 tablet_bootstrap.cc:492] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:18.822187 17676 ts_tablet_manager.cc:1403] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:21:18.825356 17676 raft_consensus.cc:359] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.826196 17676 raft_consensus.cc:385] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.826488 17676 raft_consensus.cc:740] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.827629 17676 consensus_queue.cc:260] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.831110 17676 ts_tablet_manager.cc:1434] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:18.834944 17677 tablet_bootstrap.cc:654] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.837133 17676 tablet_bootstrap.cc:492] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:18.840445 17678 tablet_bootstrap.cc:492] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:18.841251 17678 ts_tablet_manager.cc:1403] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.020s
I20260709 13:21:18.845160 17676 tablet_bootstrap.cc:654] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.845964 17678 raft_consensus.cc:359] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.846870 17678 raft_consensus.cc:385] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.847191 17678 raft_consensus.cc:740] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.848126 17678 consensus_queue.cc:260] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.848865 17677 tablet_bootstrap.cc:492] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:18.849464 17677 ts_tablet_manager.cc:1403] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.006s
I20260709 13:21:18.850564 17681 raft_consensus.cc:493] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:18.851085 17681 raft_consensus.cc:515] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.852560 17678 ts_tablet_manager.cc:1434] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:21:18.852788 17677 raft_consensus.cc:359] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.853547 17677 raft_consensus.cc:385] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.853782 17678 tablet_bootstrap.cc:492] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:18.853852 17677 raft_consensus.cc:740] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.859517 17681 leader_election.cc:290] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:18.865208 17676 tablet_bootstrap.cc:492] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:18.865890 17676 ts_tablet_manager.cc:1403] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
W20260709 13:21:18.869304 17433 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:18.870889 17677 consensus_queue.cc:260] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.873674 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:18.874563 17487 raft_consensus.cc:2468] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:18.874857 17677 ts_tablet_manager.cc:1434] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:21:18.876077 17677 tablet_bootstrap.cc:492] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:18.878507 17599 leader_election.cc:304] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:18.879628 17681 raft_consensus.cc:2804] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:18.880007 17681 raft_consensus.cc:493] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:18.880340 17681 raft_consensus.cc:3060] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.883296 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:18.884454 17678 tablet_bootstrap.cc:654] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:18.886421 17601 leader_election.cc:343] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.870309 17676 raft_consensus.cc:359] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.888998 17677 tablet_bootstrap.cc:654] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.889089 17676 raft_consensus.cc:385] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.889896 17676 raft_consensus.cc:740] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.891386 17676 consensus_queue.cc:260] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.897330 17681 raft_consensus.cc:515] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.901712 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:18.902593 17487 raft_consensus.cc:3060] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:18.916304 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
W20260709 13:21:18.919145 17601 leader_election.cc:343] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:18.920122 17681 leader_election.cc:290] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:18.934669 17676 ts_tablet_manager.cc:1434] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.068s	user 0.019s	sys 0.030s
I20260709 13:21:18.937278 17487 raft_consensus.cc:2468] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:18.937333 17678 tablet_bootstrap.cc:492] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:18.938519 17678 ts_tablet_manager.cc:1403] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.036s
I20260709 13:21:18.938892 17599 leader_election.cc:304] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 576ae391841648b491a9f4570aea8424
I20260709 13:21:18.939345 17676 tablet_bootstrap.cc:492] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:18.943707 17678 raft_consensus.cc:359] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.944896 17678 raft_consensus.cc:385] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.945300 17678 raft_consensus.cc:740] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.947397 17694 raft_consensus.cc:2804] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:18.946530 17678 consensus_queue.cc:260] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.948014 17694 raft_consensus.cc:697] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:18.948997 17694 consensus_queue.cc:237] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.949350 17676 tablet_bootstrap.cc:654] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.951113 17678 ts_tablet_manager.cc:1434] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:21:18.952342 17678 tablet_bootstrap.cc:492] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:18.954689 17677 tablet_bootstrap.cc:492] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:18.955294 17677 ts_tablet_manager.cc:1403] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.079s	user 0.028s	sys 0.040s
I20260709 13:21:18.959921 17677 raft_consensus.cc:359] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.960800 17677 raft_consensus.cc:385] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.961129 17677 raft_consensus.cc:740] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.963632 17678 tablet_bootstrap.cc:654] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.962402 17677 consensus_queue.cc:260] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.980149 17676 tablet_bootstrap.cc:492] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:18.980796 17676 ts_tablet_manager.cc:1403] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.018s
I20260709 13:21:18.983281 17677 ts_tablet_manager.cc:1434] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:21:18.984104 17676 raft_consensus.cc:359] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.985060 17676 raft_consensus.cc:385] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.985476 17676 raft_consensus.cc:740] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.986403 17676 consensus_queue.cc:260] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.988646 17676 ts_tablet_manager.cc:1434] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:18.984733 17677 tablet_bootstrap.cc:492] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:18.989974 17381 catalog_manager.cc:5697] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:18.991439 17678 tablet_bootstrap.cc:492] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:18.992103 17678 ts_tablet_manager.cc:1403] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.011s
I20260709 13:21:18.996263 17677 tablet_bootstrap.cc:654] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:18.996187 17678 raft_consensus.cc:359] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:18.997594 17678 raft_consensus.cc:385] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:18.998006 17676 tablet_bootstrap.cc:492] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:18.998064 17678 raft_consensus.cc:740] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:18.999670 17678 consensus_queue.cc:260] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.007936 17678 ts_tablet_manager.cc:1434] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 13:21:19.009097 17676 tablet_bootstrap.cc:654] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.009564 17678 tablet_bootstrap.cc:492] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:19.015318 17694 raft_consensus.cc:493] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.015919 17694 raft_consensus.cc:515] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.020503 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0ae00446748c0b567aad72551553d" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.021588 17562 raft_consensus.cc:2468] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.021938 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0ae00446748c0b567aad72551553d" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:19.022991 17487 raft_consensus.cc:2468] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.023586 17601 leader_election.cc:304] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.024825 17681 raft_consensus.cc:2804] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.025250 17681 raft_consensus.cc:493] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.026089 17681 raft_consensus.cc:3060] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.027143 17676 tablet_bootstrap.cc:492] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:19.027819 17676 ts_tablet_manager.cc:1403] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.016s
I20260709 13:21:19.028514 17694 leader_election.cc:290] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.031406 17676 raft_consensus.cc:359] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.032598 17676 raft_consensus.cc:385] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.032994 17676 raft_consensus.cc:740] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.033116 17678 tablet_bootstrap.cc:654] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.027186 17677 tablet_bootstrap.cc:492] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:19.033990 17677 ts_tablet_manager.cc:1403] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.009s
I20260709 13:21:19.034173 17694 raft_consensus.cc:493] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.034312 17676 consensus_queue.cc:260] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.035182 17694 raft_consensus.cc:515] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:19.039350 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df549a3ca8d47aaa10181adc987402d" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:19.039631 17681 raft_consensus.cc:515] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
W20260709 13:21:19.040918 17599 leader_election.cc:343] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.042974 17681 leader_election.cc:290] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.044054 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0ae00446748c0b567aad72551553d" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:19.045192 17487 raft_consensus.cc:3060] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.045465 17677 raft_consensus.cc:359] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.046387 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0ae00446748c0b567aad72551553d" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:19.046705 17677 raft_consensus.cc:385] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.047199 17561 raft_consensus.cc:3060] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.047163 17677 raft_consensus.cc:740] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.045256 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df549a3ca8d47aaa10181adc987402d" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.048434 17677 consensus_queue.cc:260] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
W20260709 13:21:19.049623 17601 leader_election.cc:343] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.050345 17601 leader_election.cc:304] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6db76967201e4b50b35c35b520236758; no voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6
I20260709 13:21:19.044430 17694 leader_election.cc:290] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821)
I20260709 13:21:19.051757 17677 ts_tablet_manager.cc:1434] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:21:19.051836 17681 raft_consensus.cc:2749] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.059904 17676 ts_tablet_manager.cc:1434] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.032s	user 0.021s	sys 0.008s
I20260709 13:21:19.060448 17677 tablet_bootstrap.cc:492] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:19.061380 17676 tablet_bootstrap.cc:492] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:19.061806 17487 raft_consensus.cc:2468] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.063465 17599 leader_election.cc:304] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.070312 17676 tablet_bootstrap.cc:654] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.071934 17678 tablet_bootstrap.cc:492] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:19.072603 17678 ts_tablet_manager.cc:1403] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.004s
I20260709 13:21:19.069094 17561 raft_consensus.cc:2468] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.073678 17704 raft_consensus.cc:2804] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.076723 17704 raft_consensus.cc:697] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:19.077916 17678 raft_consensus.cc:359] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:19.077930 17704 consensus_queue.cc:237] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.079123 17678 raft_consensus.cc:385] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.079432 17677 tablet_bootstrap.cc:654] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.079610 17678 raft_consensus.cc:740] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.080773 17678 consensus_queue.cc:260] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:19.083827 17678 ts_tablet_manager.cc:1434] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:21:19.085994 17678 tablet_bootstrap.cc:492] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:19.095803 17678 tablet_bootstrap.cc:654] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.106550 17676 tablet_bootstrap.cc:492] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:19.107167 17676 ts_tablet_manager.cc:1403] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.000s
I20260709 13:21:19.108700 17678 tablet_bootstrap.cc:492] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:19.109398 17678 ts_tablet_manager.cc:1403] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 13:21:19.110544 17676 raft_consensus.cc:359] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.111382 17676 raft_consensus.cc:385] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.111683 17676 raft_consensus.cc:740] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.112622 17676 consensus_queue.cc:260] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.112846 17678 raft_consensus.cc:359] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.113811 17678 raft_consensus.cc:385] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.114231 17678 raft_consensus.cc:740] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.115217 17678 consensus_queue.cc:260] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.115232 17676 ts_tablet_manager.cc:1434] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:19.118125 17676 tablet_bootstrap.cc:492] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:19.120241 17678 ts_tablet_manager.cc:1434] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:21:19.121775 17683 raft_consensus.cc:493] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.122192 17678 tablet_bootstrap.cc:492] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:19.125993 17676 tablet_bootstrap.cc:654] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.122565 17683 raft_consensus.cc:515] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.134727 17684 raft_consensus.cc:493] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.135336 17684 raft_consensus.cc:515] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.141206 17678 tablet_bootstrap.cc:654] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.142863 17684 leader_election.cc:290] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.146921 17681 raft_consensus.cc:493] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.147770 17681 raft_consensus.cc:515] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.152612 17681 leader_election.cc:290] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.163483 17683 leader_election.cc:290] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.176559 17677 tablet_bootstrap.cc:492] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:19.197309 17681 raft_consensus.cc:493] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.201707 17677 ts_tablet_manager.cc:1403] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.141s	user 0.027s	sys 0.018s
I20260709 13:21:19.201514 17681 raft_consensus.cc:515] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.207415 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:19.208396 17487 raft_consensus.cc:2468] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.213693 17678 tablet_bootstrap.cc:492] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:19.214385 17678 ts_tablet_manager.cc:1403] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.041s
I20260709 13:21:19.210903 17681 leader_election.cc:290] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.217113 17599 leader_election.cc:304] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.218457 17678 raft_consensus.cc:359] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.219254 17678 raft_consensus.cc:385] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.219419 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:19.218307 17681 raft_consensus.cc:2804] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.219594 17678 raft_consensus.cc:740] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.220397 17681 raft_consensus.cc:493] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.219327 17382 catalog_manager.cc:5697] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.220819 17681 raft_consensus.cc:3060] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.220957 17678 consensus_queue.cc:260] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.224004 17678 ts_tablet_manager.cc:1434] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:19.225127 17678 tablet_bootstrap.cc:492] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:19.220408 17487 raft_consensus.cc:2468] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.230856 17683 raft_consensus.cc:493] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.230810 17599 leader_election.cc:304] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.231796 17683 raft_consensus.cc:515] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.234030 17683 leader_election.cc:290] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.236773 17681 raft_consensus.cc:515] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.238404 17678 tablet_bootstrap.cc:654] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.239513 17681 leader_election.cc:290] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.240517 17704 raft_consensus.cc:2804] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.240953 17704 raft_consensus.cc:493] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.241403 17704 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.246591 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.247467 17562 raft_consensus.cc:2468] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.248831 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:19.249698 17560 raft_consensus.cc:3060] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.249842 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.252218 17677 raft_consensus.cc:359] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:19.253093 17677 raft_consensus.cc:385] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.253404 17677 raft_consensus.cc:740] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.254220 17677 consensus_queue.cc:260] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:19.256071 17677 ts_tablet_manager.cc:1434] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.003s
I20260709 13:21:19.257004 17677 tablet_bootstrap.cc:492] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:19.261620 17560 raft_consensus.cc:2468] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.261946 17636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:19.263123 17601 leader_election.cc:304] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.263299 17636 raft_consensus.cc:2393] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69f0069ff0474bc385b3ba8565409ce6 in current term 1: Already voted for candidate 6db76967201e4b50b35c35b520236758 in this term.
I20260709 13:21:19.263753 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:19.264389 17487 raft_consensus.cc:3060] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.264739 17681 raft_consensus.cc:2804] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.265523 17681 raft_consensus.cc:697] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:19.266402 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:19.266631 17681 consensus_queue.cc:237] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.267369 17486 raft_consensus.cc:2393] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 576ae391841648b491a9f4570aea8424 in current term 1: Already voted for candidate 6db76967201e4b50b35c35b520236758 in this term.
I20260709 13:21:19.268688 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
W20260709 13:21:19.272742 17525 leader_election.cc:343] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.278640 17676 tablet_bootstrap.cc:492] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:19.279875 17676 ts_tablet_manager.cc:1403] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.162s	user 0.052s	sys 0.054s
I20260709 13:21:19.282773 17677 tablet_bootstrap.cc:654] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.290714 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.291726 17560 raft_consensus.cc:2393] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69f0069ff0474bc385b3ba8565409ce6 in current term 1: Already voted for candidate 6db76967201e4b50b35c35b520236758 in this term.
I20260709 13:21:19.293627 17684 raft_consensus.cc:493] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.294724 17684 raft_consensus.cc:515] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.298694 17684 leader_election.cc:290] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.298997 17452 leader_election.cc:304] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6; no voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758
I20260709 13:21:19.300818 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fa947202d04956a12b0386f760259f" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.303733 17636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fa947202d04956a12b0386f760259f" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:19.308794 17636 raft_consensus.cc:2468] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:19.304028 17676 raft_consensus.cc:359] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.310530 17676 raft_consensus.cc:385] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.310547 17451 leader_election.cc:304] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.310930 17676 raft_consensus.cc:740] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.310000 17704 raft_consensus.cc:515] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.311868 17676 consensus_queue.cc:260] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.315711 17676 ts_tablet_manager.cc:1434] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:21:19.316921 17560 raft_consensus.cc:2468] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:19.321161 17678 tablet_bootstrap.cc:492] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:19.321879 17678 ts_tablet_manager.cc:1403] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.097s	user 0.035s	sys 0.026s
I20260709 13:21:19.325320 17487 raft_consensus.cc:2468] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.326284 17676 tablet_bootstrap.cc:492] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:19.331050 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:19.331453 17684 raft_consensus.cc:2749] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.332122 17560 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.334955 17684 raft_consensus.cc:2804] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.335860 17684 raft_consensus.cc:493] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.336568 17677 tablet_bootstrap.cc:492] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:19.337155 17677 ts_tablet_manager.cc:1403] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.008s
I20260709 13:21:19.336608 17684 raft_consensus.cc:3060] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.340704 17560 raft_consensus.cc:2468] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.327950 17704 leader_election.cc:290] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.342110 17681 raft_consensus.cc:493] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.343494 17681 raft_consensus.cc:515] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.348731 17601 leader_election.cc:304] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.348917 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:19.349798 17487 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.349926 17704 raft_consensus.cc:2804] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.343062 17678 raft_consensus.cc:359] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.350703 17678 raft_consensus.cc:385] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.350922 17704 raft_consensus.cc:697] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:19.351091 17676 tablet_bootstrap.cc:654] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.351068 17678 raft_consensus.cc:740] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.352406 17678 consensus_queue.cc:260] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.352468 17704 consensus_queue.cc:237] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.347718 17677 raft_consensus.cc:359] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.356110 17681 leader_election.cc:290] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.356578 17677 raft_consensus.cc:385] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.357668 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:19.358064 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.358747 17560 raft_consensus.cc:2468] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.358434 17381 catalog_manager.cc:5697] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.361495 17601 leader_election.cc:304] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.363498 17681 raft_consensus.cc:2804] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.363821 17678 ts_tablet_manager.cc:1434] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.002s
I20260709 13:21:19.364034 17681 raft_consensus.cc:493] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.357069 17677 raft_consensus.cc:740] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.365024 17681 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.366400 17677 consensus_queue.cc:260] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.368441 17485 raft_consensus.cc:2468] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.374451 17636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:19.376022 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:19.376875 17677 ts_tablet_manager.cc:1434] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.039s	user 0.011s	sys 0.001s
I20260709 13:21:19.377928 17677 tablet_bootstrap.cc:492] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:19.382217 17487 raft_consensus.cc:2468] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.386008 17526 leader_election.cc:304] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 576ae391841648b491a9f4570aea8424; no voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758
I20260709 13:21:19.386911 17684 raft_consensus.cc:515] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
W20260709 13:21:19.387672 17526 leader_election.cc:343] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:19.388188 17676 tablet_bootstrap.cc:492] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:19.388350 17526 leader_election.cc:304] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 576ae391841648b491a9f4570aea8424; no voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758
I20260709 13:21:19.388849 17676 ts_tablet_manager.cc:1403] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.004s
I20260709 13:21:19.389669 17683 raft_consensus.cc:3060] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.391502 17684 leader_election.cc:290] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.392216 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fa947202d04956a12b0386f760259f" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:19.392498 17676 raft_consensus.cc:359] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.393064 17635 raft_consensus.cc:3060] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.390949 17681 raft_consensus.cc:515] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.396193 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:19.398052 17487 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.397064 17724 raft_consensus.cc:2749] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.398270 17681 leader_election.cc:290] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.393402 17676 raft_consensus.cc:385] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.399995 17676 raft_consensus.cc:740] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.400898 17676 consensus_queue.cc:260] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.402284 17683 raft_consensus.cc:2749] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:19.404224 17676 ts_tablet_manager.cc:1434] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:21:19.397141 17677 tablet_bootstrap.cc:654] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.404724 17635 raft_consensus.cc:2468] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:19.405604 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:19.407734 17451 leader_election.cc:304] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.408720 17684 raft_consensus.cc:493] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.409265 17684 raft_consensus.cc:515] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:19.409310 17487 raft_consensus.cc:2468] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.408749 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fa947202d04956a12b0386f760259f" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:19.410996 17560 raft_consensus.cc:3060] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.411762 17684 leader_election.cc:290] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.412405 17684 raft_consensus.cc:2804] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.413094 17684 raft_consensus.cc:697] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:19.415167 17599 leader_election.cc:304] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.416287 17681 raft_consensus.cc:2804] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.416817 17681 raft_consensus.cc:697] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:19.417392 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df549a3ca8d47aaa10181adc987402d" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:19.417750 17681 consensus_queue.cc:237] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.418232 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df549a3ca8d47aaa10181adc987402d" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.418927 17562 raft_consensus.cc:2468] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:19.419107 17684 consensus_queue.cc:237] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.420756 17452 leader_election.cc:304] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:19.425071 17560 raft_consensus.cc:2468] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:19.429689 17677 tablet_bootstrap.cc:492] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:19.406829 17561 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.430791 17677 ts_tablet_manager.cc:1403] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.002s
I20260709 13:21:19.434333 17677 raft_consensus.cc:359] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.435390 17677 raft_consensus.cc:385] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.435720 17677 raft_consensus.cc:740] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.436532 17677 consensus_queue.cc:260] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.418203 17635 raft_consensus.cc:2468] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:19.458405 17721 raft_consensus.cc:2804] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.459070 17721 raft_consensus.cc:493] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.458117 17381 catalog_manager.cc:5697] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.459519 17721 raft_consensus.cc:3060] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:19.467103 17452 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.37.130:45861, user_credentials={real_user=slave}} blocked reactor thread for 46451.6us
I20260709 13:21:19.472506 17677 ts_tablet_manager.cc:1434] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.041s	user 0.013s	sys 0.028s
I20260709 13:21:19.473202 17561 raft_consensus.cc:2468] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.474251 17677 tablet_bootstrap.cc:492] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:19.482474 17382 catalog_manager.cc:5697] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.485198 17677 tablet_bootstrap.cc:654] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:19.487468 17721 raft_consensus.cc:515] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:19.489516 17721 leader_election.cc:290] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.490403 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df549a3ca8d47aaa10181adc987402d" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:19.491073 17561 raft_consensus.cc:3060] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.491151 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6df549a3ca8d47aaa10181adc987402d" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:19.491782 17635 raft_consensus.cc:3060] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.497592 17681 raft_consensus.cc:493] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.498440 17681 raft_consensus.cc:515] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.501001 17704 consensus_queue.cc:1048] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.503675 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb0989430845f3a1fb0cf8e2f25168" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:19.504761 17487 raft_consensus.cc:2468] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.506596 17599 leader_election.cc:304] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.506937 17561 raft_consensus.cc:2468] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:19.510136 17452 leader_election.cc:304] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:19.511518 17721 raft_consensus.cc:2804] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.512228 17721 raft_consensus.cc:697] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:19.514216 17721 consensus_queue.cc:237] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } }
I20260709 13:21:19.515437 17635 raft_consensus.cc:2468] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:19.516055 17381 catalog_manager.cc:5697] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.521270 17704 raft_consensus.cc:2804] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.522070 17704 raft_consensus.cc:493] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.522702 17704 raft_consensus.cc:3060] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.530256 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb0989430845f3a1fb0cf8e2f25168" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.531301 17561 raft_consensus.cc:2468] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:19.533663 17694 consensus_queue.cc:1048] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.534737 17681 leader_election.cc:290] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.539356 17704 raft_consensus.cc:515] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.539896 17677 tablet_bootstrap.cc:492] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:19.540609 17677 ts_tablet_manager.cc:1403] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.067s	user 0.034s	sys 0.024s
I20260709 13:21:19.542892 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb0989430845f3a1fb0cf8e2f25168" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:19.544027 17485 raft_consensus.cc:3060] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.543889 17677 raft_consensus.cc:359] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.544821 17677 raft_consensus.cc:385] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:19.545152 17677 raft_consensus.cc:740] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:19.545347 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb0989430845f3a1fb0cf8e2f25168" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:19.546139 17561 raft_consensus.cc:3060] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.545984 17677 consensus_queue.cc:260] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.548441 17677 ts_tablet_manager.cc:1434] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:19.554510 17704 leader_election.cc:290] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:19.554304 17485 raft_consensus.cc:2468] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.556308 17599 leader_election.cc:304] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:19.554411 17561 raft_consensus.cc:2468] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:19.557122 17694 raft_consensus.cc:2804] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.565340 17681 consensus_queue.cc:1048] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.574288 17694 raft_consensus.cc:697] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:19.575677 17694 consensus_queue.cc:237] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.574724 17382 catalog_manager.cc:5697] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.595435 17704 consensus_queue.cc:1048] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.607652 17382 catalog_manager.cc:5697] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:19.658092 17704 consensus_queue.cc:1048] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.672595 17736 consensus_queue.cc:1048] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.692512 17721 raft_consensus.cc:493] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:19.693216 17721 raft_consensus.cc:515] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.695797 17721 leader_election.cc:290] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.696950 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:19.697263 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:19.697790 17561 raft_consensus.cc:2468] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:19.698814 17635 raft_consensus.cc:2468] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:19.699780 17452 leader_election.cc:304] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:19.700886 17721 raft_consensus.cc:2804] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:19.701340 17721 raft_consensus.cc:493] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:19.701730 17721 raft_consensus.cc:3060] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.707410 17721 raft_consensus.cc:515] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.709355 17721 leader_election.cc:290] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:19.710264 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:19.710572 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:19.711014 17561 raft_consensus.cc:3060] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.711093 17635 raft_consensus.cc:3060] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:19.718966 17635 raft_consensus.cc:2468] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:19.718966 17561 raft_consensus.cc:2468] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:19.720520 17452 leader_election.cc:304] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:19.721376 17721 raft_consensus.cc:2804] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:19.721938 17721 raft_consensus.cc:697] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:19.723055 17721 consensus_queue.cc:237] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:19.732879 17381 catalog_manager.cc:5697] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:19.771109 17736 consensus_queue.cc:1048] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.776705 17736 consensus_queue.cc:1048] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.874619 17735 consensus_queue.cc:1048] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.887457 17735 consensus_queue.cc:1048] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.910880 17721 consensus_queue.cc:1048] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:19.929049 17684 consensus_queue.cc:1048] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:19.967368 17635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dde0ae00446748c0b567aad72551553d"
dest_uuid: "6db76967201e4b50b35c35b520236758"
mode: GRACEFUL
new_leader_uuid: "69f0069ff0474bc385b3ba8565409ce6"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:21:19.967914 17635 raft_consensus.cc:606] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Received request to transfer leadership to TS 69f0069ff0474bc385b3ba8565409ce6
I20260709 13:21:19.973903 17635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069"
dest_uuid: "6db76967201e4b50b35c35b520236758"
mode: GRACEFUL
new_leader_uuid: "69f0069ff0474bc385b3ba8565409ce6"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:21:19.974452 17635 raft_consensus.cc:606] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Received request to transfer leadership to TS 69f0069ff0474bc385b3ba8565409ce6
I20260709 13:21:19.981189 17635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b"
dest_uuid: "6db76967201e4b50b35c35b520236758"
mode: GRACEFUL
new_leader_uuid: "69f0069ff0474bc385b3ba8565409ce6"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:21:19.982271 17635 raft_consensus.cc:606] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Received request to transfer leadership to TS 69f0069ff0474bc385b3ba8565409ce6
I20260709 13:21:19.988950 17635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7"
dest_uuid: "6db76967201e4b50b35c35b520236758"
mode: GRACEFUL
new_leader_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:21:19.989634 17635 raft_consensus.cc:606] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Received request to transfer leadership to TS 576ae391841648b491a9f4570aea8424
I20260709 13:21:20.006768 17487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50fa947202d04956a12b0386f760259f"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
mode: GRACEFUL
new_leader_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:21:20.007467 17487 raft_consensus.cc:606] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Received request to transfer leadership to TS 576ae391841648b491a9f4570aea8424
I20260709 13:21:20.007337 17721 consensus_queue.cc:1048] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.014364 17636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9"
dest_uuid: "6db76967201e4b50b35c35b520236758"
mode: GRACEFUL
new_leader_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:21:20.015030 17636 raft_consensus.cc:606] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Received request to transfer leadership to TS 576ae391841648b491a9f4570aea8424
I20260709 13:21:20.023120 17721 consensus_queue.cc:1048] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.023907 17636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbeb0989430845f3a1fb0cf8e2f25168"
dest_uuid: "6db76967201e4b50b35c35b520236758"
mode: GRACEFUL
new_leader_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:21:20.024663 17636 raft_consensus.cc:606] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Received request to transfer leadership to TS 576ae391841648b491a9f4570aea8424
I20260709 13:21:20.032258 17487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
mode: GRACEFUL
new_leader_uuid: "6db76967201e4b50b35c35b520236758"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:21:20.032968 17487 raft_consensus.cc:606] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Received request to transfer leadership to TS 6db76967201e4b50b35c35b520236758
I20260709 13:21:20.050218 17735 consensus_queue.cc:1048] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.064591 17740 consensus_queue.cc:1048] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.074808 17736 raft_consensus.cc:993] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758: : Instructing follower 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:20.075418 17736 raft_consensus.cc:1081] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Signalling peer 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:20.077577 17561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbeb0989430845f3a1fb0cf8e2f25168"
dest_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:42168
I20260709 13:21:20.078230 17561 raft_consensus.cc:493] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:20.078578 17561 raft_consensus.cc:3060] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.084654 17561 raft_consensus.cc:515] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.086843 17561 leader_election.cc:290] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:20.087787 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb0989430845f3a1fb0cf8e2f25168" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:20.088127 17636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbeb0989430845f3a1fb0cf8e2f25168" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:20.088507 17487 raft_consensus.cc:3060] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.088690 17636 raft_consensus.cc:3055] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.089103 17636 raft_consensus.cc:740] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:20.090029 17636 consensus_queue.cc:260] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.091367 17636 raft_consensus.cc:3060] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.097309 17487 raft_consensus.cc:2468] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:20.099129 17525 leader_election.cc:304] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:20.100070 17636 raft_consensus.cc:2468] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:20.100219 17683 raft_consensus.cc:2804] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.102195 17683 raft_consensus.cc:697] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Becoming Leader. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:20.103160 17683 consensus_queue.cc:237] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.109982 17382 catalog_manager.cc:5697] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 reported cstate change: term changed from 1 to 2, leader changed from 6db76967201e4b50b35c35b520236758 (127.4.37.131) to 576ae391841648b491a9f4570aea8424 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "576ae391841648b491a9f4570aea8424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.155624 17735 raft_consensus.cc:993] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758: : Instructing follower 69f0069ff0474bc385b3ba8565409ce6 to start an election
I20260709 13:21:20.156153 17735 raft_consensus.cc:993] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758: : Instructing follower 69f0069ff0474bc385b3ba8565409ce6 to start an election
I20260709 13:21:20.156216 17704 raft_consensus.cc:1081] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Signalling peer 69f0069ff0474bc385b3ba8565409ce6 to start an election
I20260709 13:21:20.156569 17735 raft_consensus.cc:1081] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Signalling peer 69f0069ff0474bc385b3ba8565409ce6 to start an election
I20260709 13:21:20.158324 17485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:21:20.158810 17487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dde0ae00446748c0b567aad72551553d"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:21:20.158969 17485 raft_consensus.cc:493] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:20.159559 17487 raft_consensus.cc:493] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:20.159878 17485 raft_consensus.cc:3060] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.160141 17487 raft_consensus.cc:3060] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.161329 17736 raft_consensus.cc:993] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758: : Instructing follower 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:20.161916 17704 raft_consensus.cc:1081] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Signalling peer 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:20.163810 17561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7"
dest_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:42168
I20260709 13:21:20.164440 17561 raft_consensus.cc:493] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:20.164844 17561 raft_consensus.cc:3060] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.166939 17485 raft_consensus.cc:515] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.169294 17487 raft_consensus.cc:515] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.169845 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:20.169955 17636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40f5b7124a24623bc51954334e2516b" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:20.170567 17560 raft_consensus.cc:3060] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.170679 17485 leader_election.cc:290] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:20.171922 17487 leader_election.cc:290] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:20.173368 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0ae00446748c0b567aad72551553d" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:20.170575 17636 raft_consensus.cc:3055] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.174129 17635 raft_consensus.cc:3055] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.174196 17636 raft_consensus.cc:740] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:20.174582 17635 raft_consensus.cc:740] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:20.174350 17561 raft_consensus.cc:515] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.174981 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde0ae00446748c0b567aad72551553d" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:20.175607 17562 raft_consensus.cc:3060] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.175362 17636 consensus_queue.cc:260] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.175561 17635 consensus_queue.cc:260] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.176991 17561 leader_election.cc:290] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:20.177134 17636 raft_consensus.cc:3060] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.177209 17635 raft_consensus.cc:3060] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.184720 17560 raft_consensus.cc:2468] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 2.
I20260709 13:21:20.185240 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:20.184813 17562 raft_consensus.cc:2468] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 2.
I20260709 13:21:20.186820 17485 raft_consensus.cc:3060] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.186956 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffb1969bbf6e455788991de0f0c1b9a7" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:20.187737 17634 raft_consensus.cc:3055] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.187172 17636 raft_consensus.cc:2468] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 2.
I20260709 13:21:20.187901 17452 leader_election.cc:304] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:20.188115 17634 raft_consensus.cc:740] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:20.186007 17635 raft_consensus.cc:2468] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 2.
I20260709 13:21:20.189007 17452 leader_election.cc:304] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:20.189606 17721 raft_consensus.cc:2804] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.190114 17729 raft_consensus.cc:2804] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.190187 17721 raft_consensus.cc:697] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:20.190784 17729 raft_consensus.cc:697] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:20.189050 17634 consensus_queue.cc:260] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.191414 17721 consensus_queue.cc:237] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.191679 17729 consensus_queue.cc:237] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.192857 17634 raft_consensus.cc:3060] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.195677 17485 raft_consensus.cc:2468] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:20.198997 17525 leader_election.cc:304] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:20.199893 17683 raft_consensus.cc:2804] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.200491 17683 raft_consensus.cc:697] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Becoming Leader. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:20.201326 17382 catalog_manager.cc:5697] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 1 to 2, leader changed from 6db76967201e4b50b35c35b520236758 (127.4.37.131) to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.201450 17683 consensus_queue.cc:237] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.202806 17382 catalog_manager.cc:5697] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 1 to 2, leader changed from 6db76967201e4b50b35c35b520236758 (127.4.37.131) to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.206005 17634 raft_consensus.cc:2468] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:20.210649 17385 catalog_manager.cc:5697] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 reported cstate change: term changed from 1 to 2, leader changed from 6db76967201e4b50b35c35b520236758 (127.4.37.131) to 576ae391841648b491a9f4570aea8424 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "576ae391841648b491a9f4570aea8424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.243160 17727 consensus_queue.cc:1048] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:20.250067 17684 raft_consensus.cc:993] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6: : Instructing follower 6db76967201e4b50b35c35b520236758 to start an election
I20260709 13:21:20.250593 17721 raft_consensus.cc:1081] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Signalling peer 6db76967201e4b50b35c35b520236758 to start an election
I20260709 13:21:20.253103 17635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1"
dest_uuid: "6db76967201e4b50b35c35b520236758"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:21:20.255549 17635 raft_consensus.cc:493] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:20.256090 17635 raft_consensus.cc:3060] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.257124 17721 consensus_queue.cc:1048] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:20.266911 17635 raft_consensus.cc:515] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.269510 17635 leader_election.cc:290] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:20.270442 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:20.271065 17485 raft_consensus.cc:3055] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.271384 17485 raft_consensus.cc:740] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:20.272185 17485 consensus_queue.cc:260] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.272612 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d37d2bbaa22b4fb18bc3c5075cd0a4f1" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "576ae391841648b491a9f4570aea8424"
W20260709 13:21:20.273227 17721 consensus_queue.cc:1175] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "576ae391841648b491a9f4570aea8424" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:21:20.273353 17560 raft_consensus.cc:3060] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.273466 17485 raft_consensus.cc:3060] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.282877 17485 raft_consensus.cc:2468] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 2.
I20260709 13:21:20.283272 17560 raft_consensus.cc:2468] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 2.
I20260709 13:21:20.283982 17599 leader_election.cc:304] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:20.285197 17704 raft_consensus.cc:2804] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.285772 17704 raft_consensus.cc:697] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 2 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:20.286707 17704 consensus_queue.cc:237] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.293565 17704 raft_consensus.cc:993] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758: : Instructing follower 69f0069ff0474bc385b3ba8565409ce6 to start an election
I20260709 13:21:20.294102 17740 raft_consensus.cc:1081] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Signalling peer 69f0069ff0474bc385b3ba8565409ce6 to start an election
I20260709 13:21:20.295008 17385 catalog_manager.cc:5697] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 1 to 2, leader changed from 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129) to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:20.296279 17485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:21:20.297128 17485 raft_consensus.cc:493] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:20.297541 17485 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.303968 17485 raft_consensus.cc:515] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.306332 17485 leader_election.cc:290] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:20.306548 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:20.307301 17560 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.307384 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:20.308015 17635 raft_consensus.cc:3055] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.308373 17635 raft_consensus.cc:740] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:20.309194 17635 consensus_queue.cc:260] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.310541 17635 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.315353 17560 raft_consensus.cc:2468] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 2.
I20260709 13:21:20.316857 17452 leader_election.cc:304] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:20.317690 17721 raft_consensus.cc:2804] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.318279 17721 raft_consensus.cc:697] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:20.318647 17635 raft_consensus.cc:2468] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 2.
I20260709 13:21:20.319281 17721 consensus_queue.cc:237] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.327292 17385 catalog_manager.cc:5697] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 1 to 2, leader changed from 6db76967201e4b50b35c35b520236758 (127.4.37.131) to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.487668 17704 raft_consensus.cc:993] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758: : Instructing follower 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:20.488453 17704 raft_consensus.cc:1081] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Signalling peer 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:20.490957 17560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9"
dest_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:42168
I20260709 13:21:20.491562 17560 raft_consensus.cc:493] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:20.491902 17560 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.497244 17560 raft_consensus.cc:515] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.499183 17560 leader_election.cc:290] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:20.500485 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:20.500483 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:20.501145 17487 raft_consensus.cc:1275] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.501243 17485 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.501341 17635 raft_consensus.cc:3055] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.502101 17635 raft_consensus.cc:740] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:20.503206 17683 consensus_queue.cc:1048] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.503609 17635 consensus_queue.cc:260] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.505481 17635 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.514395 17485 raft_consensus.cc:2468] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:20.515553 17525 leader_election.cc:304] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:20.516263 17635 raft_consensus.cc:2468] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:20.516489 17683 raft_consensus.cc:2804] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.517112 17683 raft_consensus.cc:697] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Becoming Leader. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:20.518047 17683 consensus_queue.cc:237] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.531147 17635 raft_consensus.cc:1275] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.534103 17382 catalog_manager.cc:5697] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 reported cstate change: term changed from 1 to 2, leader changed from 6db76967201e4b50b35c35b520236758 (127.4.37.131) to 576ae391841648b491a9f4570aea8424 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "576ae391841648b491a9f4570aea8424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.535729 17762 consensus_queue.cc:1048] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.542830 17721 raft_consensus.cc:993] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6: : Instructing follower 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:20.543354 17684 raft_consensus.cc:1081] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Signalling peer 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:20.546573 17560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50fa947202d04956a12b0386f760259f"
dest_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:42182
I20260709 13:21:20.547276 17560 raft_consensus.cc:493] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:20.547711 17560 raft_consensus.cc:3060] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.557194 17560 raft_consensus.cc:515] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.559106 17560 leader_election.cc:290] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:20.560046 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fa947202d04956a12b0386f760259f" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:20.560339 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50fa947202d04956a12b0386f760259f" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:20.560772 17485 raft_consensus.cc:3055] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:20.560964 17635 raft_consensus.cc:3060] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.561146 17485 raft_consensus.cc:740] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:20.562734 17485 consensus_queue.cc:260] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.564335 17485 raft_consensus.cc:3060] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:20.570310 17635 raft_consensus.cc:2468] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:20.571435 17485 raft_consensus.cc:2468] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:20.572551 17526 leader_election.cc:304] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:20.573812 17762 raft_consensus.cc:2804] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:20.574330 17762 raft_consensus.cc:697] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Becoming Leader. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:20.575136 17762 consensus_queue.cc:237] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:20.582217 17385 catalog_manager.cc:5697] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 reported cstate change: term changed from 1 to 2, leader changed from 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129) to 576ae391841648b491a9f4570aea8424 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "576ae391841648b491a9f4570aea8424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:20.626118 17485 raft_consensus.cc:1275] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.628368 17762 consensus_queue.cc:1048] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.639063 17635 raft_consensus.cc:1275] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.641248 17683 consensus_queue.cc:1048] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:20.659027 17560 raft_consensus.cc:1275] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Refusing update from remote peer 69f0069ff0474bc385b3ba8565409ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.660496 17684 consensus_queue.cc:1048] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.669991 17635 raft_consensus.cc:1275] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 69f0069ff0474bc385b3ba8565409ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.673228 17729 consensus_queue.cc:1048] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:20.753795 17560 raft_consensus.cc:1275] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Refusing update from remote peer 69f0069ff0474bc385b3ba8565409ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.755371 17729 consensus_queue.cc:1048] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.764649 17635 raft_consensus.cc:1275] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 69f0069ff0474bc385b3ba8565409ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.768853 17729 consensus_queue.cc:1048] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:20.780018 17560 raft_consensus.cc:1275] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Refusing update from remote peer 69f0069ff0474bc385b3ba8565409ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.781495 17729 consensus_queue.cc:1048] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.796301 17635 raft_consensus.cc:1275] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 69f0069ff0474bc385b3ba8565409ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.798102 17729 consensus_queue.cc:1048] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.855924 17485 raft_consensus.cc:1275] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 6db76967201e4b50b35c35b520236758: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.857484 17704 consensus_queue.cc:1048] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.866492 17560 raft_consensus.cc:1275] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Refusing update from remote peer 6db76967201e4b50b35c35b520236758: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.868099 17704 consensus_queue.cc:1048] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:20.989251 17635 raft_consensus.cc:1275] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.990141 17485 raft_consensus.cc:1275] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.990864 17634 raft_consensus.cc:1275] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:20.993544 17759 consensus_queue.cc:1048] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:20.993314 17683 consensus_queue.cc:1048] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:20.995289 17762 consensus_queue.cc:1048] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:21.025175 17485 raft_consensus.cc:1275] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:21.048040 17683 consensus_queue.cc:1048] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:23.068616 17385 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35210:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:23.071785 17385 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:23.128464 17477 tablet_service.cc:1511] Processing CreateTablet for tablet 42e4fbe5927a41f9800cd78d183798c2 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:23.129683 17550 tablet_service.cc:1511] Processing CreateTablet for tablet 42e4fbe5927a41f9800cd78d183798c2 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:23.130576 17477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e4fbe5927a41f9800cd78d183798c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.131485 17550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e4fbe5927a41f9800cd78d183798c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.134037 17626 tablet_service.cc:1511] Processing CreateTablet for tablet 42e4fbe5927a41f9800cd78d183798c2 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:21:23.134560 17548 tablet_service.cc:1511] Processing CreateTablet for tablet ec99073332d645568fed5203f3442130 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:23.135716 17626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e4fbe5927a41f9800cd78d183798c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.136292 17548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec99073332d645568fed5203f3442130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.140807 17471 tablet_service.cc:1511] Processing CreateTablet for tablet ec99073332d645568fed5203f3442130 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:23.141918 17475 tablet_service.cc:1511] Processing CreateTablet for tablet 2e994c97bf324744b409e9f787c0b207 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:23.142587 17471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec99073332d645568fed5203f3442130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.143424 17475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e994c97bf324744b409e9f787c0b207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.143807 17552 tablet_service.cc:1511] Processing CreateTablet for tablet 44534a11d13d4683a8525787b1141d60 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:23.145278 17552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44534a11d13d4683a8525787b1141d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.147599 17476 tablet_service.cc:1511] Processing CreateTablet for tablet 0198809fa015463388126ad25fdeaeba (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:23.149331 17476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0198809fa015463388126ad25fdeaeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.151376 17549 tablet_service.cc:1511] Processing CreateTablet for tablet 2e994c97bf324744b409e9f787c0b207 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:23.141144 17472 tablet_service.cc:1511] Processing CreateTablet for tablet 44534a11d13d4683a8525787b1141d60 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:23.155457 17472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44534a11d13d4683a8525787b1141d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.159369 17474 tablet_service.cc:1511] Processing CreateTablet for tablet 87e65f61e33d41f9bdb261e0efc4f53f (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:23.153317 17549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e994c97bf324744b409e9f787c0b207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.162482 17474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e65f61e33d41f9bdb261e0efc4f53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.169004 17473 tablet_service.cc:1511] Processing CreateTablet for tablet f0929868c2324f058900b34ff2fdc747 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:23.170713 17473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0929868c2324f058900b34ff2fdc747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.173516 17623 tablet_service.cc:1511] Processing CreateTablet for tablet ec99073332d645568fed5203f3442130 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:21:23.175096 17623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec99073332d645568fed5203f3442130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.177518 17470 tablet_service.cc:1511] Processing CreateTablet for tablet f1a53509092a42a8a7b9c820db33c536 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:23.179070 17470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a53509092a42a8a7b9c820db33c536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.180612 17469 tablet_service.cc:1511] Processing CreateTablet for tablet 175cf722af25496db08f28ab249ee187 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:23.183372 17625 tablet_service.cc:1511] Processing CreateTablet for tablet 2e994c97bf324744b409e9f787c0b207 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:21:23.174657 17624 tablet_service.cc:1511] Processing CreateTablet for tablet 44534a11d13d4683a8525787b1141d60 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:21:23.185070 17625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e994c97bf324744b409e9f787c0b207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.185914 17624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44534a11d13d4683a8525787b1141d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.192287 17622 tablet_service.cc:1511] Processing CreateTablet for tablet 0198809fa015463388126ad25fdeaeba (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:23.198076 17469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175cf722af25496db08f28ab249ee187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.202627 17620 tablet_service.cc:1511] Processing CreateTablet for tablet f0929868c2324f058900b34ff2fdc747 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:23.203263 17619 tablet_service.cc:1511] Processing CreateTablet for tablet f1a53509092a42a8a7b9c820db33c536 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:23.199929 17621 tablet_service.cc:1511] Processing CreateTablet for tablet 87e65f61e33d41f9bdb261e0efc4f53f (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:23.210826 17618 tablet_service.cc:1511] Processing CreateTablet for tablet 175cf722af25496db08f28ab249ee187 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:23.211220 17551 tablet_service.cc:1511] Processing CreateTablet for tablet 0198809fa015463388126ad25fdeaeba (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:21:23.212790 17551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0198809fa015463388126ad25fdeaeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.213279 17547 tablet_service.cc:1511] Processing CreateTablet for tablet 87e65f61e33d41f9bdb261e0efc4f53f (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:21:23.214979 17547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e65f61e33d41f9bdb261e0efc4f53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.218914 17546 tablet_service.cc:1511] Processing CreateTablet for tablet f0929868c2324f058900b34ff2fdc747 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:21:23.220674 17546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0929868c2324f058900b34ff2fdc747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.223472 17545 tablet_service.cc:1511] Processing CreateTablet for tablet f1a53509092a42a8a7b9c820db33c536 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:21:23.227088 17544 tablet_service.cc:1511] Processing CreateTablet for tablet 175cf722af25496db08f28ab249ee187 (DEFAULT_TABLE table=soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:21:23.229697 17545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a53509092a42a8a7b9c820db33c536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.233179 17544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175cf722af25496db08f28ab249ee187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.257254 17622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0198809fa015463388126ad25fdeaeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.259066 17621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e65f61e33d41f9bdb261e0efc4f53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.261824 17618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175cf722af25496db08f28ab249ee187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.262609 17620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0929868c2324f058900b34ff2fdc747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.266088 17619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a53509092a42a8a7b9c820db33c536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.341617 17788 tablet_bootstrap.cc:492] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.352316 17788 tablet_bootstrap.cc:654] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.381392 17790 tablet_bootstrap.cc:492] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:23.409605 17789 tablet_bootstrap.cc:492] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.443435 17790 tablet_bootstrap.cc:654] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.449846 17789 tablet_bootstrap.cc:654] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.452325 17788 tablet_bootstrap.cc:492] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:23.453522 17788 ts_tablet_manager.cc:1403] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.112s	user 0.024s	sys 0.029s
I20260709 13:21:23.458634 17788 raft_consensus.cc:359] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.461478 17788 raft_consensus.cc:385] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.462018 17788 raft_consensus.cc:740] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.463016 17788 consensus_queue.cc:260] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.465027 17789 tablet_bootstrap.cc:492] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:23.465746 17789 ts_tablet_manager.cc:1403] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.015s
I20260709 13:21:23.467128 17788 ts_tablet_manager.cc:1434] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:21:23.475594 17789 raft_consensus.cc:359] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.477347 17789 raft_consensus.cc:385] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.477967 17789 raft_consensus.cc:740] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.479679 17789 consensus_queue.cc:260] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.483474 17789 ts_tablet_manager.cc:1434] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:21:23.485320 17789 tablet_bootstrap.cc:492] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.493032 17790 tablet_bootstrap.cc:492] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:23.493734 17790 ts_tablet_manager.cc:1403] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.005s
I20260709 13:21:23.496260 17788 tablet_bootstrap.cc:492] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.498688 17789 tablet_bootstrap.cc:654] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.505102 17790 raft_consensus.cc:359] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.506238 17788 tablet_bootstrap.cc:654] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.506851 17790 raft_consensus.cc:385] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.507577 17790 raft_consensus.cc:740] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.512373 17790 consensus_queue.cc:260] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.513124 17789 tablet_bootstrap.cc:492] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:23.514034 17789 ts_tablet_manager.cc:1403] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.009s
I20260709 13:21:23.516369 17790 ts_tablet_manager.cc:1434] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:21:23.517107 17789 raft_consensus.cc:359] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.517729 17790 tablet_bootstrap.cc:492] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:23.518028 17789 raft_consensus.cc:385] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.518400 17789 raft_consensus.cc:740] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.519224 17789 consensus_queue.cc:260] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.519968 17788 tablet_bootstrap.cc:492] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:23.520709 17788 ts_tablet_manager.cc:1403] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:21:23.526075 17789 ts_tablet_manager.cc:1434] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:21:23.526016 17788 raft_consensus.cc:359] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.527315 17788 raft_consensus.cc:385] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.527639 17789 tablet_bootstrap.cc:492] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.527765 17788 raft_consensus.cc:740] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.528067 17790 tablet_bootstrap.cc:654] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.529011 17788 consensus_queue.cc:260] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.532968 17788 ts_tablet_manager.cc:1434] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:21:23.534545 17788 tablet_bootstrap.cc:492] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.536720 17789 tablet_bootstrap.cc:654] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.543829 17788 tablet_bootstrap.cc:654] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.558749 17788 tablet_bootstrap.cc:492] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:23.562598 17788 ts_tablet_manager.cc:1403] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 13:21:23.563104 17789 tablet_bootstrap.cc:492] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:23.563833 17789 ts_tablet_manager.cc:1403] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.006s
I20260709 13:21:23.564721 17790 tablet_bootstrap.cc:492] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:23.565357 17790 ts_tablet_manager.cc:1403] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.014s
I20260709 13:21:23.567345 17789 raft_consensus.cc:359] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.567462 17788 raft_consensus.cc:359] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.568401 17789 raft_consensus.cc:385] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.568845 17788 raft_consensus.cc:385] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.568825 17790 raft_consensus.cc:359] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.569443 17788 raft_consensus.cc:740] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.569825 17790 raft_consensus.cc:385] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.572476 17790 raft_consensus.cc:740] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.573351 17790 consensus_queue.cc:260] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.570341 17788 consensus_queue.cc:260] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.576184 17790 ts_tablet_manager.cc:1434] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:21:23.568866 17789 raft_consensus.cc:740] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.576699 17788 ts_tablet_manager.cc:1434] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:21:23.577514 17790 tablet_bootstrap.cc:492] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:23.577396 17789 consensus_queue.cc:260] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.578164 17792 raft_consensus.cc:493] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.579000 17792 raft_consensus.cc:515] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.581372 17788 tablet_bootstrap.cc:492] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.582932 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e4fbe5927a41f9800cd78d183798c2" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:23.583843 17560 raft_consensus.cc:2468] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:23.585623 17452 leader_election.cc:304] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:23.585995 17790 tablet_bootstrap.cc:654] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.586781 17727 raft_consensus.cc:2804] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.587213 17727 raft_consensus.cc:493] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.587579 17727 raft_consensus.cc:3060] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.589465 17788 tablet_bootstrap.cc:654] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.591073 17789 ts_tablet_manager.cc:1434] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:21:23.592278 17789 tablet_bootstrap.cc:492] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.597754 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e4fbe5927a41f9800cd78d183798c2" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:23.599737 17789 tablet_bootstrap.cc:654] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:23.599912 17451 leader_election.cc:343] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.609520 17788 tablet_bootstrap.cc:492] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:23.610229 17788 ts_tablet_manager.cc:1403] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.011s
I20260709 13:21:23.613574 17788 raft_consensus.cc:359] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.614473 17788 raft_consensus.cc:385] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.614763 17788 raft_consensus.cc:740] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.615724 17788 consensus_queue.cc:260] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.617992 17792 leader_election.cc:290] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.628104 17788 ts_tablet_manager.cc:1434] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.006s
I20260709 13:21:23.630084 17788 tablet_bootstrap.cc:492] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.634812 17776 raft_consensus.cc:493] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.635416 17776 raft_consensus.cc:515] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.640661 17788 tablet_bootstrap.cc:654] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.642241 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:23.643440 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:23.644268 17485 raft_consensus.cc:2468] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
W20260709 13:21:23.644551 17601 leader_election.cc:343] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.645356 17776 leader_election.cc:290] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:23.646143 17599 leader_election.cc:304] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 576ae391841648b491a9f4570aea8424
I20260709 13:21:23.647534 17776 raft_consensus.cc:2804] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.647918 17776 raft_consensus.cc:493] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.648263 17776 raft_consensus.cc:3060] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.649132 17789 tablet_bootstrap.cc:492] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:23.651738 17789 ts_tablet_manager.cc:1403] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.032s
I20260709 13:21:23.651321 17727 raft_consensus.cc:515] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.655427 17789 raft_consensus.cc:359] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.656225 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e4fbe5927a41f9800cd78d183798c2" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:23.656426 17789 raft_consensus.cc:385] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.657142 17789 raft_consensus.cc:740] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.657383 17560 raft_consensus.cc:3060] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.658169 17789 consensus_queue.cc:260] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.660794 17789 ts_tablet_manager.cc:1434] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:21:23.662205 17789 tablet_bootstrap.cc:492] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.669718 17789 tablet_bootstrap.cc:654] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.678303 17727 leader_election.cc:290] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.679702 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e4fbe5927a41f9800cd78d183798c2" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
W20260709 13:21:23.682001 17451 leader_election.cc:343] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.681780 17560 raft_consensus.cc:2468] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:23.684746 17452 leader_election.cc:304] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 6db76967201e4b50b35c35b520236758
I20260709 13:21:23.669891 17776 raft_consensus.cc:515] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.686534 17727 raft_consensus.cc:2804] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.687505 17727 raft_consensus.cc:697] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:23.692723 17727 consensus_queue.cc:237] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.690696 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:23.697290 17485 raft_consensus.cc:3060] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.697885 17788 tablet_bootstrap.cc:492] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:23.698474 17788 ts_tablet_manager.cc:1403] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.069s	user 0.038s	sys 0.026s
I20260709 13:21:23.698642 17789 tablet_bootstrap.cc:492] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:23.699167 17789 ts_tablet_manager.cc:1403] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.021s
I20260709 13:21:23.701977 17788 raft_consensus.cc:359] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.702862 17788 raft_consensus.cc:385] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.694024 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:23.695086 17776 leader_election.cc:290] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:23.690979 17790 tablet_bootstrap.cc:492] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:23.703797 17788 raft_consensus.cc:740] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.702474 17789 raft_consensus.cc:359] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.704793 17789 raft_consensus.cc:385] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.704952 17485 raft_consensus.cc:2468] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:23.705132 17789 raft_consensus.cc:740] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
W20260709 13:21:23.705699 17601 leader_election.cc:343] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.705084 17788 consensus_queue.cc:260] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.706444 17789 consensus_queue.cc:260] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.707074 17790 ts_tablet_manager.cc:1403] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.037s
I20260709 13:21:23.706872 17599 leader_election.cc:304] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 576ae391841648b491a9f4570aea8424
I20260709 13:21:23.708407 17788 ts_tablet_manager.cc:1434] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:21:23.708896 17789 ts_tablet_manager.cc:1434] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:23.709697 17788 tablet_bootstrap.cc:492] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.710090 17789 tablet_bootstrap.cc:492] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.711655 17790 raft_consensus.cc:359] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.712607 17790 raft_consensus.cc:385] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.713486 17803 raft_consensus.cc:493] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.715997 17803 raft_consensus.cc:515] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.719601 17788 tablet_bootstrap.cc:654] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.719521 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec99073332d645568fed5203f3442130" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:23.720398 17634 raft_consensus.cc:2468] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:23.721041 17776 raft_consensus.cc:2804] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.719524 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec99073332d645568fed5203f3442130" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:23.731012 17560 raft_consensus.cc:2468] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:23.722363 17451 leader_election.cc:304] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:23.722908 17803 leader_election.cc:290] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.732681 17803 raft_consensus.cc:2804] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.733094 17803 raft_consensus.cc:493] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.733696 17803 raft_consensus.cc:3060] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.712965 17790 raft_consensus.cc:740] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.738971 17790 consensus_queue.cc:260] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.740741 17777 raft_consensus.cc:493] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.741436 17777 raft_consensus.cc:515] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.746166 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44534a11d13d4683a8525787b1141d60" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:23.748065 17803 raft_consensus.cc:515] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
W20260709 13:21:23.748168 17526 leader_election.cc:343] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.749495 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44534a11d13d4683a8525787b1141d60" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:23.751376 17776 raft_consensus.cc:697] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
W20260709 13:21:23.751500 17525 leader_election.cc:343] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.752030 17777 leader_election.cc:290] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.752444 17803 leader_election.cc:290] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.752730 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec99073332d645568fed5203f3442130" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:23.753584 17634 raft_consensus.cc:3060] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.753636 17525 leader_election.cc:304] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 576ae391841648b491a9f4570aea8424; no voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758
I20260709 13:21:23.754972 17777 raft_consensus.cc:2749] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:23.751720 17790 ts_tablet_manager.cc:1434] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:21:23.757933 17790 tablet_bootstrap.cc:492] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:23.758541 17727 raft_consensus.cc:493] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.759310 17727 raft_consensus.cc:515] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.727092 17789 tablet_bootstrap.cc:654] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.761857 17384 catalog_manager.cc:5697] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.764390 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec99073332d645568fed5203f3442130" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:23.765196 17560 raft_consensus.cc:3060] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.768538 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0198809fa015463388126ad25fdeaeba" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
W20260709 13:21:23.770429 17451 leader_election.cc:343] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.773576 17727 leader_election.cc:290] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.775379 17776 consensus_queue.cc:237] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.775578 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0198809fa015463388126ad25fdeaeba" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:23.777051 17562 raft_consensus.cc:2468] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:23.778314 17560 raft_consensus.cc:2468] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:23.778519 17452 leader_election.cc:304] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 6db76967201e4b50b35c35b520236758
I20260709 13:21:23.780658 17803 raft_consensus.cc:2804] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.781210 17452 leader_election.cc:304] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:23.783000 17803 raft_consensus.cc:493] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.784528 17803 raft_consensus.cc:3060] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.786283 17792 raft_consensus.cc:2804] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.786985 17792 raft_consensus.cc:697] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:23.795207 17792 consensus_queue.cc:237] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.808425 17788 tablet_bootstrap.cc:492] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:23.808187 17803 raft_consensus.cc:515] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.809070 17788 ts_tablet_manager.cc:1403] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.042s
I20260709 13:21:23.789925 17634 raft_consensus.cc:2468] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:23.813892 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0198809fa015463388126ad25fdeaeba" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:23.811806 17803 leader_election.cc:290] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.815438 17789 tablet_bootstrap.cc:492] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
W20260709 13:21:23.815593 17451 leader_election.cc:343] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.816258 17789 ts_tablet_manager.cc:1403] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.007s
I20260709 13:21:23.818704 17788 raft_consensus.cc:359] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.819576 17788 raft_consensus.cc:385] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.819880 17788 raft_consensus.cc:740] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.820176 17790 tablet_bootstrap.cc:654] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.833953 17789 raft_consensus.cc:359] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.833636 17788 consensus_queue.cc:260] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.835204 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0198809fa015463388126ad25fdeaeba" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:23.836613 17789 raft_consensus.cc:385] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.836874 17560 raft_consensus.cc:3060] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.837369 17789 raft_consensus.cc:740] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.838896 17789 consensus_queue.cc:260] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.839672 17788 ts_tablet_manager.cc:1434] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:21:23.841125 17788 tablet_bootstrap.cc:492] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.845535 17789 ts_tablet_manager.cc:1434] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.009s
I20260709 13:21:23.846949 17789 tablet_bootstrap.cc:492] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.847606 17792 raft_consensus.cc:493] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.848187 17792 raft_consensus.cc:515] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.850620 17792 leader_election.cc:290] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.851756 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175cf722af25496db08f28ab249ee187" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:23.852625 17788 tablet_bootstrap.cc:654] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.852918 17562 raft_consensus.cc:2468] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:23.851756 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175cf722af25496db08f28ab249ee187" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:23.855146 17634 raft_consensus.cc:2468] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:23.856379 17789 tablet_bootstrap.cc:654] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.857304 17451 leader_election.cc:304] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:23.858764 17792 raft_consensus.cc:2804] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.859337 17792 raft_consensus.cc:493] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.859819 17792 raft_consensus.cc:3060] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.872284 17560 raft_consensus.cc:2468] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:23.874106 17452 leader_election.cc:304] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 6db76967201e4b50b35c35b520236758
I20260709 13:21:23.875321 17803 raft_consensus.cc:2804] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.875867 17803 raft_consensus.cc:697] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:23.876870 17803 consensus_queue.cc:237] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.891042 17382 catalog_manager.cc:5697] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:23.895530 17792 raft_consensus.cc:515] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.895855 17385 catalog_manager.cc:5697] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.898448 17792 leader_election.cc:290] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.898839 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175cf722af25496db08f28ab249ee187" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:23.899667 17560 raft_consensus.cc:3060] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.900478 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175cf722af25496db08f28ab249ee187" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:23.901134 17634 raft_consensus.cc:3060] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.903947 17385 catalog_manager.cc:5697] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.914254 17560 raft_consensus.cc:2468] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:23.916086 17634 raft_consensus.cc:2468] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:23.916440 17452 leader_election.cc:304] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:23.917235 17790 tablet_bootstrap.cc:492] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:23.916157 17788 tablet_bootstrap.cc:492] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:23.918251 17789 tablet_bootstrap.cc:492] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:23.918655 17788 ts_tablet_manager.cc:1403] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.016s
I20260709 13:21:23.918846 17789 ts_tablet_manager.cc:1403] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.010s
I20260709 13:21:23.917999 17790 ts_tablet_manager.cc:1403] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.160s	user 0.029s	sys 0.019s
I20260709 13:21:23.922261 17788 raft_consensus.cc:359] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.923210 17788 raft_consensus.cc:385] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.923537 17788 raft_consensus.cc:740] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.924401 17788 consensus_queue.cc:260] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.925195 17790 raft_consensus.cc:359] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.926177 17790 raft_consensus.cc:385] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.925840 17789 raft_consensus.cc:359] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.926600 17790 raft_consensus.cc:740] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.926898 17789 raft_consensus.cc:385] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.927376 17788 ts_tablet_manager.cc:1434] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:21:23.927574 17789 raft_consensus.cc:740] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.918007 17792 raft_consensus.cc:2804] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.927632 17790 consensus_queue.cc:260] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.928819 17792 raft_consensus.cc:697] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:23.929962 17792 consensus_queue.cc:237] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.931001 17789 consensus_queue.cc:260] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.933063 17790 ts_tablet_manager.cc:1434] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:21:23.934041 17803 raft_consensus.cc:493] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.934605 17803 raft_consensus.cc:515] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.937726 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:23.938869 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:23.939478 17562 raft_consensus.cc:2468] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
W20260709 13:21:23.940455 17451 leader_election.cc:343] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.941073 17451 leader_election.cc:304] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 6db76967201e4b50b35c35b520236758
I20260709 13:21:23.936820 17803 leader_election.cc:290] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.936257 17789 ts_tablet_manager.cc:1434] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:21:23.942188 17812 raft_consensus.cc:2804] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:23.942813 17812 raft_consensus.cc:493] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.943316 17812 raft_consensus.cc:3060] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.944274 17789 tablet_bootstrap.cc:492] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.945403 17788 tablet_bootstrap.cc:492] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.953385 17789 tablet_bootstrap.cc:654] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:23.954175 17433 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:23.953408 17790 tablet_bootstrap.cc:492] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:23.953815 17788 tablet_bootstrap.cc:654] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.965265 17790 tablet_bootstrap.cc:654] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.967082 17812 raft_consensus.cc:515] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.969897 17789 tablet_bootstrap.cc:492] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:23.968904 17383 catalog_manager.cc:5697] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:23.970494 17789 ts_tablet_manager.cc:1403] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 13:21:23.970496 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:23.971292 17560 raft_consensus.cc:3060] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.973243 17788 tablet_bootstrap.cc:492] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:23.974085 17789 raft_consensus.cc:359] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.974704 17788 ts_tablet_manager.cc:1403] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 13:21:23.974860 17789 raft_consensus.cc:385] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.976704 17789 raft_consensus.cc:740] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.977407 17789 consensus_queue.cc:260] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.979549 17789 ts_tablet_manager.cc:1434] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:23.980028 17788 raft_consensus.cc:359] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.980798 17788 raft_consensus.cc:385] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.981009 17789 tablet_bootstrap.cc:492] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424: Bootstrap starting.
I20260709 13:21:23.981082 17788 raft_consensus.cc:740] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.982329 17788 consensus_queue.cc:260] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:23.984947 17788 ts_tablet_manager.cc:1434] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:23.987449 17788 tablet_bootstrap.cc:492] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6: Bootstrap starting.
I20260709 13:21:23.988525 17789 tablet_bootstrap.cc:654] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.990522 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
W20260709 13:21:23.992512 17451 leader_election.cc:343] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.988554 17560 raft_consensus.cc:2468] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:23.994088 17812 leader_election.cc:290] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:23.999910 17452 leader_election.cc:304] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 6db76967201e4b50b35c35b520236758
I20260709 13:21:24.003450 17812 raft_consensus.cc:2804] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.003576 17789 tablet_bootstrap.cc:492] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424: No bootstrap required, opened a new log
I20260709 13:21:24.003978 17812 raft_consensus.cc:697] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:24.004972 17812 consensus_queue.cc:237] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.007684 17790 tablet_bootstrap.cc:492] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:24.008327 17790 ts_tablet_manager.cc:1403] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.001s
I20260709 13:21:24.011848 17790 raft_consensus.cc:359] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.012852 17790 raft_consensus.cc:385] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.013252 17790 raft_consensus.cc:740] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.014416 17790 consensus_queue.cc:260] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.005475 17789 ts_tablet_manager.cc:1403] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 13:21:24.000535 17788 tablet_bootstrap.cc:654] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.021308 17790 ts_tablet_manager.cc:1434] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:21:24.022634 17790 tablet_bootstrap.cc:492] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:24.019631 17789 raft_consensus.cc:359] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.023190 17789 raft_consensus.cc:385] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.023458 17789 raft_consensus.cc:740] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.024112 17789 consensus_queue.cc:260] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.026979 17789 ts_tablet_manager.cc:1434] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:21:24.028930 17382 catalog_manager.cc:5697] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.035744 17788 tablet_bootstrap.cc:492] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6: No bootstrap required, opened a new log
I20260709 13:21:24.036554 17790 tablet_bootstrap.cc:654] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.036670 17788 ts_tablet_manager.cc:1403] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.000s
I20260709 13:21:24.040163 17788 raft_consensus.cc:359] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.040934 17788 raft_consensus.cc:385] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.041237 17788 raft_consensus.cc:740] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.042088 17788 consensus_queue.cc:260] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.046139 17788 ts_tablet_manager.cc:1434] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:21:24.052002 17790 tablet_bootstrap.cc:492] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:24.052723 17790 ts_tablet_manager.cc:1403] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.011s
I20260709 13:21:24.055785 17790 raft_consensus.cc:359] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.056584 17790 raft_consensus.cc:385] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.056871 17790 raft_consensus.cc:740] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.057602 17790 consensus_queue.cc:260] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.059746 17790 ts_tablet_manager.cc:1434] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:21:24.061035 17790 tablet_bootstrap.cc:492] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:24.067015 17790 tablet_bootstrap.cc:654] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.072685 17790 tablet_bootstrap.cc:492] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:24.073161 17790 ts_tablet_manager.cc:1403] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:21:24.075845 17790 raft_consensus.cc:359] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.076428 17790 raft_consensus.cc:385] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.076807 17790 raft_consensus.cc:740] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.077584 17790 consensus_queue.cc:260] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.079536 17790 ts_tablet_manager.cc:1434] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:24.080468 17790 tablet_bootstrap.cc:492] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:24.085919 17790 tablet_bootstrap.cc:654] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.090991 17790 tablet_bootstrap.cc:492] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:24.091521 17790 ts_tablet_manager.cc:1403] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:24.093865 17790 raft_consensus.cc:359] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.094390 17790 raft_consensus.cc:385] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.094599 17790 raft_consensus.cc:740] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.095268 17790 consensus_queue.cc:260] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.096932 17790 ts_tablet_manager.cc:1434] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:24.097935 17790 tablet_bootstrap.cc:492] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758: Bootstrap starting.
I20260709 13:21:24.102502 17790 tablet_bootstrap.cc:654] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.107547 17790 tablet_bootstrap.cc:492] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758: No bootstrap required, opened a new log
I20260709 13:21:24.108052 17790 ts_tablet_manager.cc:1403] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:21:24.109325 17812 consensus_queue.cc:1048] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.110469 17790 raft_consensus.cc:359] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.111236 17790 raft_consensus.cc:385] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.111516 17790 raft_consensus.cc:740] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.112237 17790 consensus_queue.cc:260] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.114569 17790 ts_tablet_manager.cc:1434] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:24.125372 17634 raft_consensus.cc:3060] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.135828 17803 consensus_queue.cc:1048] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.142061 17776 raft_consensus.cc:493] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.142724 17776 raft_consensus.cc:515] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.146343 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:24.149266 17776 leader_election.cc:290] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:24.150446 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:24.151221 17560 raft_consensus.cc:2393] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6db76967201e4b50b35c35b520236758 in current term 1: Already voted for candidate 69f0069ff0474bc385b3ba8565409ce6 in this term.
I20260709 13:21:24.152321 17601 leader_election.cc:304] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6db76967201e4b50b35c35b520236758; no voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6
I20260709 13:21:24.153283 17776 raft_consensus.cc:3060] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.155973 17777 raft_consensus.cc:493] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.156635 17777 raft_consensus.cc:515] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.159868 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:24.159780 17777 leader_election.cc:290] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.160320 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:24.160885 17487 raft_consensus.cc:2393] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 576ae391841648b491a9f4570aea8424 in current term 1: Already voted for candidate 6db76967201e4b50b35c35b520236758 in this term.
I20260709 13:21:24.162348 17525 leader_election.cc:304] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 576ae391841648b491a9f4570aea8424; no voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758
I20260709 13:21:24.163359 17777 raft_consensus.cc:3060] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.164876 17776 raft_consensus.cc:2749] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.171304 17777 raft_consensus.cc:2749] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.181630 17776 raft_consensus.cc:493] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.182274 17776 raft_consensus.cc:515] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.184728 17776 leader_election.cc:290] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:24.186962 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0929868c2324f058900b34ff2fdc747" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:24.187463 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0929868c2324f058900b34ff2fdc747" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:24.188160 17487 raft_consensus.cc:2468] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:24.188308 17560 raft_consensus.cc:2468] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 0.
I20260709 13:21:24.190405 17599 leader_election.cc:304] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:24.191633 17776 raft_consensus.cc:2804] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.192159 17776 raft_consensus.cc:493] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.192582 17776 raft_consensus.cc:3060] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.201412 17776 raft_consensus.cc:515] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.203614 17776 leader_election.cc:290] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:24.204618 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0929868c2324f058900b34ff2fdc747" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:24.204937 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0929868c2324f058900b34ff2fdc747" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:24.205219 17560 raft_consensus.cc:3060] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.205695 17487 raft_consensus.cc:3060] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.210783 17560 raft_consensus.cc:2468] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:24.212131 17601 leader_election.cc:304] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:24.212435 17487 raft_consensus.cc:2468] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 1.
I20260709 13:21:24.213510 17776 raft_consensus.cc:2804] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.214594 17776 raft_consensus.cc:697] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:24.215693 17776 consensus_queue.cc:237] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.225152 17382 catalog_manager.cc:5697] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 1 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.255561 17776 consensus_queue.cc:1048] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.259511 17777 raft_consensus.cc:493] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.260434 17777 raft_consensus.cc:515] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.262758 17777 leader_election.cc:290] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.263710 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a53509092a42a8a7b9c820db33c536" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6" is_pre_election: true
I20260709 13:21:24.264406 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a53509092a42a8a7b9c820db33c536" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:24.264583 17487 raft_consensus.cc:2468] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 0.
I20260709 13:21:24.265355 17635 raft_consensus.cc:2468] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 0.
I20260709 13:21:24.266440 17525 leader_election.cc:304] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:24.269984 17812 raft_consensus.cc:493] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.270583 17812 raft_consensus.cc:515] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.270803 17808 consensus_queue.cc:1048] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.271478 17777 raft_consensus.cc:2804] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.271981 17777 raft_consensus.cc:493] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.272382 17777 raft_consensus.cc:3060] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.272904 17812 leader_election.cc:290] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.274587 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44534a11d13d4683a8525787b1141d60" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758" is_pre_election: true
I20260709 13:21:24.275523 17635 raft_consensus.cc:2468] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:24.279376 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44534a11d13d4683a8525787b1141d60" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424" is_pre_election: true
I20260709 13:21:24.280336 17562 raft_consensus.cc:2468] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 0.
I20260709 13:21:24.282932 17452 leader_election.cc:304] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:24.283696 17777 raft_consensus.cc:515] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.284266 17812 raft_consensus.cc:2804] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.288225 17777 leader_election.cc:290] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.288451 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a53509092a42a8a7b9c820db33c536" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:24.289191 17485 raft_consensus.cc:3060] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.286772 17812 raft_consensus.cc:493] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.289462 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a53509092a42a8a7b9c820db33c536" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:24.290563 17635 raft_consensus.cc:3060] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.289860 17812 raft_consensus.cc:3060] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.301275 17485 raft_consensus.cc:2468] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 1.
I20260709 13:21:24.303040 17635 raft_consensus.cc:2468] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 1.
I20260709 13:21:24.302937 17525 leader_election.cc:304] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:24.303994 17812 raft_consensus.cc:515] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.306398 17812 leader_election.cc:290] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.306938 17777 raft_consensus.cc:2804] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.307096 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44534a11d13d4683a8525787b1141d60" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:24.307603 17635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44534a11d13d4683a8525787b1141d60" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:24.307829 17562 raft_consensus.cc:3060] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.308319 17635 raft_consensus.cc:3060] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.308373 17812 consensus_queue.cc:1048] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.307857 17777 raft_consensus.cc:697] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 1 LEADER]: Becoming Leader. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:24.309894 17777 consensus_queue.cc:237] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.322091 17635 raft_consensus.cc:2468] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:24.324035 17451 leader_election.cc:304] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:24.324971 17803 raft_consensus.cc:2804] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.325965 17803 raft_consensus.cc:697] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:24.326737 17562 raft_consensus.cc:2468] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 1.
I20260709 13:21:24.327073 17803 consensus_queue.cc:237] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.332283 17382 catalog_manager.cc:5697] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 576ae391841648b491a9f4570aea8424 (127.4.37.130). New cstate: current_term: 1 leader_uuid: "576ae391841648b491a9f4570aea8424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.339035 17792 consensus_queue.cc:1048] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.338496 17383 catalog_manager.cc:5697] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 1 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.398813 17792 consensus_queue.cc:1048] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.407538 17634 raft_consensus.cc:3060] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.424660 17792 consensus_queue.cc:1048] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.437539 17634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207"
dest_uuid: "6db76967201e4b50b35c35b520236758"
mode: GRACEFUL
new_leader_uuid: "69f0069ff0474bc385b3ba8565409ce6"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:21:24.438506 17634 raft_consensus.cc:606] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Received request to transfer leadership to TS 69f0069ff0474bc385b3ba8565409ce6
I20260709 13:21:24.446827 17485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0198809fa015463388126ad25fdeaeba"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
mode: GRACEFUL
new_leader_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:21:24.446936 17803 consensus_queue.cc:1048] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.447553 17485 raft_consensus.cc:606] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Received request to transfer leadership to TS 576ae391841648b491a9f4570aea8424
I20260709 13:21:24.450564 17803 consensus_queue.cc:1048] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.461580 17485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
mode: GRACEFUL
new_leader_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:21:24.462278 17485 raft_consensus.cc:606] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Received request to transfer leadership to TS 576ae391841648b491a9f4570aea8424
I20260709 13:21:24.491111 17635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0929868c2324f058900b34ff2fdc747"
dest_uuid: "6db76967201e4b50b35c35b520236758"
mode: GRACEFUL
new_leader_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:40608
I20260709 13:21:24.492089 17635 raft_consensus.cc:606] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Received request to transfer leadership to TS 576ae391841648b491a9f4570aea8424
I20260709 13:21:24.502833 17792 consensus_queue.cc:1048] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.515391 17812 consensus_queue.cc:1048] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.518613 17485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "175cf722af25496db08f28ab249ee187"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
mode: GRACEFUL
new_leader_uuid: "6db76967201e4b50b35c35b520236758"
 from {username='slave'} at 127.0.0.1:50994
I20260709 13:21:24.520408 17485 raft_consensus.cc:606] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Received request to transfer leadership to TS 6db76967201e4b50b35c35b520236758
I20260709 13:21:24.527384 17792 raft_consensus.cc:993] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6: : Instructing follower 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:24.528165 17792 raft_consensus.cc:1081] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Signalling peer 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:24.530845 17562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f"
dest_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:42182
I20260709 13:21:24.531689 17562 raft_consensus.cc:493] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.532114 17562 raft_consensus.cc:3060] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.538172 17562 raft_consensus.cc:515] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.539958 17562 leader_election.cc:290] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.541220 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:24.541229 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e65f61e33d41f9bdb261e0efc4f53f" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:24.542093 17634 raft_consensus.cc:3060] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.542179 17485 raft_consensus.cc:3055] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:24.542635 17485 raft_consensus.cc:740] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:24.543545 17485 consensus_queue.cc:260] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.544770 17485 raft_consensus.cc:3060] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.548408 17634 raft_consensus.cc:2468] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:24.549636 17526 leader_election.cc:304] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:24.550534 17777 raft_consensus.cc:2804] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:24.551154 17777 raft_consensus.cc:697] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Becoming Leader. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:24.551605 17485 raft_consensus.cc:2468] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:24.551913 17777 consensus_queue.cc:237] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.560477 17381 catalog_manager.cc:5697] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 reported cstate change: term changed from 1 to 2, leader changed from 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129) to 576ae391841648b491a9f4570aea8424 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "576ae391841648b491a9f4570aea8424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.686863 17808 raft_consensus.cc:993] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758: : Instructing follower 69f0069ff0474bc385b3ba8565409ce6 to start an election
I20260709 13:21:24.687397 17808 raft_consensus.cc:1081] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Signalling peer 69f0069ff0474bc385b3ba8565409ce6 to start an election
I20260709 13:21:24.689126 17485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
 from {username='slave'} at 127.0.0.1:50978
I20260709 13:21:24.689872 17485 raft_consensus.cc:493] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.690589 17485 raft_consensus.cc:3060] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.696417 17485 raft_consensus.cc:515] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.698487 17485 leader_election.cc:290] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.700026 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:24.700026 17562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e994c97bf324744b409e9f787c0b207" candidate_uuid: "69f0069ff0474bc385b3ba8565409ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:24.700783 17634 raft_consensus.cc:3055] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:24.700981 17562 raft_consensus.cc:3060] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.701089 17634 raft_consensus.cc:740] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:24.702028 17634 consensus_queue.cc:260] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.703186 17634 raft_consensus.cc:3060] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.707868 17562 raft_consensus.cc:2468] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 2.
I20260709 13:21:24.709213 17452 leader_election.cc:304] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:24.710003 17812 raft_consensus.cc:2804] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:24.710546 17812 raft_consensus.cc:697] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:24.711321 17812 consensus_queue.cc:237] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.718847 17634 raft_consensus.cc:2468] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f0069ff0474bc385b3ba8565409ce6 in term 2.
I20260709 13:21:24.719398 17381 catalog_manager.cc:5697] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 reported cstate change: term changed from 1 to 2, leader changed from 6db76967201e4b50b35c35b520236758 (127.4.37.131) to 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129). New cstate: current_term: 2 leader_uuid: "69f0069ff0474bc385b3ba8565409ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.731818 17777 consensus_queue.cc:1048] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.740477 17808 consensus_queue.cc:1048] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.746363 17759 consensus_queue.cc:1048] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.771629 17776 consensus_queue.cc:1048] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:24.786226 17776 raft_consensus.cc:993] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758: : Instructing follower 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:24.787398 17808 raft_consensus.cc:1081] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Signalling peer 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:24.790527 17560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0929868c2324f058900b34ff2fdc747"
dest_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:42168
I20260709 13:21:24.791081 17560 raft_consensus.cc:493] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.791767 17560 raft_consensus.cc:3060] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.799037 17560 raft_consensus.cc:515] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.799675 17812 consensus_queue.cc:1048] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.801013 17560 leader_election.cc:290] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.802228 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0929868c2324f058900b34ff2fdc747" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:24.802896 17485 raft_consensus.cc:3060] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.803097 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0929868c2324f058900b34ff2fdc747" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:24.803821 17634 raft_consensus.cc:3055] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:24.804278 17634 raft_consensus.cc:740] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:24.806113 17634 consensus_queue.cc:260] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.807835 17634 raft_consensus.cc:3060] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.813413 17485 raft_consensus.cc:2468] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:24.815563 17525 leader_election.cc:304] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:24.816756 17853 raft_consensus.cc:2804] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:24.817301 17853 raft_consensus.cc:697] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Becoming Leader. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:24.818302 17853 consensus_queue.cc:237] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.821501 17634 raft_consensus.cc:2468] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:24.824828 17812 consensus_queue.cc:1048] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:24.830807 17381 catalog_manager.cc:5697] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 reported cstate change: term changed from 1 to 2, leader changed from 6db76967201e4b50b35c35b520236758 (127.4.37.131) to 576ae391841648b491a9f4570aea8424 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "576ae391841648b491a9f4570aea8424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.842832 17812 raft_consensus.cc:993] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6: : Instructing follower 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:24.843350 17803 raft_consensus.cc:1081] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Signalling peer 576ae391841648b491a9f4570aea8424 to start an election
I20260709 13:21:24.845181 17560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0198809fa015463388126ad25fdeaeba"
dest_uuid: "576ae391841648b491a9f4570aea8424"
 from {username='slave'} at 127.0.0.1:42182
I20260709 13:21:24.846143 17560 raft_consensus.cc:493] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.846576 17560 raft_consensus.cc:3060] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.855808 17560 raft_consensus.cc:515] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.857836 17560 leader_election.cc:290] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 6db76967201e4b50b35c35b520236758 (127.4.37.131:34757)
I20260709 13:21:24.858705 17485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0198809fa015463388126ad25fdeaeba" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:24.858946 17634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0198809fa015463388126ad25fdeaeba" candidate_uuid: "576ae391841648b491a9f4570aea8424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6db76967201e4b50b35c35b520236758"
I20260709 13:21:24.859301 17485 raft_consensus.cc:3055] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:24.859539 17634 raft_consensus.cc:3060] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.859671 17485 raft_consensus.cc:740] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:24.860519 17485 consensus_queue.cc:260] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.861650 17485 raft_consensus.cc:3060] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.868252 17485 raft_consensus.cc:2468] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:24.869234 17525 leader_election.cc:304] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 69f0069ff0474bc385b3ba8565409ce6; no voters: 
I20260709 13:21:24.870100 17853 raft_consensus.cc:2804] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:24.870553 17853 raft_consensus.cc:697] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Becoming Leader. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:24.871376 17634 raft_consensus.cc:2468] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 576ae391841648b491a9f4570aea8424 in term 2.
I20260709 13:21:24.871345 17853 consensus_queue.cc:237] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.878489 17381 catalog_manager.cc:5697] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 reported cstate change: term changed from 1 to 2, leader changed from 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129) to 576ae391841648b491a9f4570aea8424 (127.4.37.130). New cstate: current_term: 2 leader_uuid: "576ae391841648b491a9f4570aea8424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.957260 17792 raft_consensus.cc:993] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6: : Instructing follower 6db76967201e4b50b35c35b520236758 to start an election
I20260709 13:21:24.957847 17812 raft_consensus.cc:1081] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Signalling peer 6db76967201e4b50b35c35b520236758 to start an election
I20260709 13:21:24.959584 17634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "175cf722af25496db08f28ab249ee187"
dest_uuid: "6db76967201e4b50b35c35b520236758"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:21:24.960083 17634 raft_consensus.cc:493] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:24.960384 17634 raft_consensus.cc:3060] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.966177 17634 raft_consensus.cc:515] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.968088 17634 leader_election.cc:290] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 2 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:24.969507 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175cf722af25496db08f28ab249ee187" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:24.970274 17560 raft_consensus.cc:3060] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.969581 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175cf722af25496db08f28ab249ee187" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:24.972162 17487 raft_consensus.cc:3055] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:24.972497 17487 raft_consensus.cc:740] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:24.973323 17487 consensus_queue.cc:260] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.975235 17487 raft_consensus.cc:3060] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:24.978447 17560 raft_consensus.cc:2468] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 2.
I20260709 13:21:24.979938 17601 leader_election.cc:304] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:24.981175 17776 raft_consensus.cc:2804] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:24.981842 17776 raft_consensus.cc:697] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 2 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:24.982749 17776 consensus_queue.cc:237] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:24.983016 17487 raft_consensus.cc:2468] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 2.
I20260709 13:21:24.990862 17381 catalog_manager.cc:5697] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 1 to 2, leader changed from 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129) to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 2 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.028599 17634 raft_consensus.cc:1275] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.030251 17853 consensus_queue.cc:1048] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:25.040616 17487 raft_consensus.cc:1275] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.042694 17759 consensus_queue.cc:1048] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:25.178512 17635 raft_consensus.cc:1275] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 69f0069ff0474bc385b3ba8565409ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.180024 17812 consensus_queue.cc:1048] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:25.190121 17560 raft_consensus.cc:1275] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Refusing update from remote peer 69f0069ff0474bc385b3ba8565409ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.192324 17803 consensus_queue.cc:1048] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:25.222193 17635 raft_consensus.cc:1275] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.224182 17759 consensus_queue.cc:1048] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:25.236315 17487 raft_consensus.cc:1275] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.238381 17759 consensus_queue.cc:1048] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:25.320550 17487 raft_consensus.cc:1275] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.322175 17759 consensus_queue.cc:1048] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:25.334708 17635 raft_consensus.cc:1275] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Refusing update from remote peer 576ae391841648b491a9f4570aea8424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.337458 17853 consensus_queue.cc:1048] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:25.480108 17487 raft_consensus.cc:1275] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Refusing update from remote peer 6db76967201e4b50b35c35b520236758: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.481464 17776 consensus_queue.cc:1048] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:25.494176 17560 raft_consensus.cc:1275] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Refusing update from remote peer 6db76967201e4b50b35c35b520236758: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:25.502012 17861 consensus_queue.cc:1048] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:27.525290 17383 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35210:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:21:27.547116 17383 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35210:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:21:27.601051  4246 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:27.647960 17525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:41821, user_credentials={real_user=slave}} blocked reactor thread for 58861.7us
I20260709 13:21:27.755271 17905 tablet.cc:1724] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:27.757476 17902 tablet.cc:1724] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:27.775815 17451 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.131:34757, user_credentials={real_user=slave}} blocked reactor thread for 48708.8us
I20260709 13:21:27.794654 17907 tablet.cc:1724] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:27.831663 17901 log.cc:927] Time spent T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:21:27.906222 17914 tablet.cc:1724] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:27.916556 17918 tablet.cc:1724] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:27.947436 17525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:41821, user_credentials={real_user=slave}} blocked reactor thread for 99437.6us
I20260709 13:21:27.963510 17923 tablet.cc:1724] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:27.958105 17919 tablet.cc:1724] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.007797 17926 tablet.cc:1724] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.025558 17916 tablet.cc:1724] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.035375 17921 tablet.cc:1724] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.046090 17930 tablet.cc:1724] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.049015 17916 tablet.cc:1724] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.067507 17929 tablet.cc:1724] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.072026 17902 tablet.cc:1724] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.117362 17918 tablet.cc:1724] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:21:28.125012 17525 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.37.129:41821, user_credentials={real_user=slave}} blocked reactor thread for 176459us
I20260709 13:21:28.074518 17914 tablet.cc:1724] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.136754 17559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9"
dest_uuid: "576ae391841648b491a9f4570aea8424"
mode: GRACEFUL
new_leader_uuid: "6db76967201e4b50b35c35b520236758"
 from {username='slave'} at 127.0.0.1:37722
I20260709 13:21:28.137548 17559 raft_consensus.cc:606] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Received request to transfer leadership to TS 6db76967201e4b50b35c35b520236758
I20260709 13:21:28.154177 17905 tablet.cc:1724] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.179060 17919 tablet.cc:1724] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.181895 17921 tablet.cc:1724] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.183000 17923 tablet.cc:1724] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.186250 17907 tablet.cc:1724] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.197502 17926 tablet.cc:1724] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.210242 17930 tablet.cc:1724] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.215241 17923 tablet.cc:1724] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.217581 17914 tablet.cc:1724] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.235219 17484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069"
dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
mode: GRACEFUL
new_leader_uuid: "6db76967201e4b50b35c35b520236758"
 from {username='slave'} at 127.0.0.1:43670
I20260709 13:21:28.235949 17484 raft_consensus.cc:606] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Received request to transfer leadership to TS 6db76967201e4b50b35c35b520236758
I20260709 13:21:28.237670  4246 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:21:28.238415  4246 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:28.238947 17929 tablet.cc:1724] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.250808 17916 tablet.cc:1724] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:28.285054 17382 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1: soft_deleted_table [id=1c8eedd6d2494247a4e8abae4bd6ac0d] alter complete (version 1)
I20260709 13:21:28.301095 17924 raft_consensus.cc:993] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424: : Instructing follower 6db76967201e4b50b35c35b520236758 to start an election
I20260709 13:21:28.301981 17933 raft_consensus.cc:1081] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Signalling peer 6db76967201e4b50b35c35b520236758 to start an election
I20260709 13:21:28.303889 17630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9"
dest_uuid: "6db76967201e4b50b35c35b520236758"
 from {username='slave'} at 127.0.0.1:40590
I20260709 13:21:28.304512 17630 raft_consensus.cc:493] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:28.304893 17630 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:28.311394 17630 raft_consensus.cc:515] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:28.313277 17630 leader_election.cc:290] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 3 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:28.314561 17559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:28.314711 17484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d6d4a91cf714a2292cccb848a14b9a9" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:28.315300 17559 raft_consensus.cc:3055] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:28.315644 17559 raft_consensus.cc:740] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 576ae391841648b491a9f4570aea8424, State: Running, Role: LEADER
I20260709 13:21:28.315668 17484 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:28.316622 17559 consensus_queue.cc:260] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:28.318466 17559 raft_consensus.cc:3060] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:28.322875 17484 raft_consensus.cc:2468] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 3.
I20260709 13:21:28.324470 17599 leader_election.cc:304] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f0069ff0474bc385b3ba8565409ce6, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:28.325531 17891 raft_consensus.cc:2804] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:28.326046 17891 raft_consensus.cc:697] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 3 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:28.326834 17559 raft_consensus.cc:2468] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 3.
I20260709 13:21:28.326794 17891 consensus_queue.cc:237] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:28.336437 17381 catalog_manager.cc:5697] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 2 to 3, leader changed from 576ae391841648b491a9f4570aea8424 (127.4.37.130) to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.452457 17897 raft_consensus.cc:993] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6: : Instructing follower 6db76967201e4b50b35c35b520236758 to start an election
I20260709 13:21:28.453029 17899 raft_consensus.cc:1081] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Signalling peer 6db76967201e4b50b35c35b520236758 to start an election
I20260709 13:21:28.454873 17630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069"
dest_uuid: "6db76967201e4b50b35c35b520236758"
 from {username='slave'} at 127.0.0.1:40592
I20260709 13:21:28.455381 17630 raft_consensus.cc:493] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:28.455731 17630 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:28.461472 17630 raft_consensus.cc:515] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:28.463423 17630 leader_election.cc:290] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 3 election: Requested vote from peers 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821), 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861)
I20260709 13:21:28.464490 17559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "576ae391841648b491a9f4570aea8424"
I20260709 13:21:28.464622 17484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920fcf8e4add4debbfc4574eb48d9069" candidate_uuid: "6db76967201e4b50b35c35b520236758" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "69f0069ff0474bc385b3ba8565409ce6"
I20260709 13:21:28.465245 17559 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:28.465265 17484 raft_consensus.cc:3055] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:28.465808 17484 raft_consensus.cc:740] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 69f0069ff0474bc385b3ba8565409ce6, State: Running, Role: LEADER
I20260709 13:21:28.466598 17484 consensus_queue.cc:260] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:28.467792 17484 raft_consensus.cc:3060] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:28.471498 17559 raft_consensus.cc:2468] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 3.
I20260709 13:21:28.472880 17601 leader_election.cc:304] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 576ae391841648b491a9f4570aea8424, 6db76967201e4b50b35c35b520236758; no voters: 
I20260709 13:21:28.473474 17484 raft_consensus.cc:2468] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6db76967201e4b50b35c35b520236758 in term 3.
I20260709 13:21:28.473740 17891 raft_consensus.cc:2804] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:28.474457 17891 raft_consensus.cc:697] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 3 LEADER]: Becoming Leader. State: Replica: 6db76967201e4b50b35c35b520236758, State: Running, Role: LEADER
I20260709 13:21:28.475466 17891 consensus_queue.cc:237] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } }
I20260709 13:21:28.483630 17381 catalog_manager.cc:5697] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 reported cstate change: term changed from 2 to 3, leader changed from 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129) to 6db76967201e4b50b35c35b520236758 (127.4.37.131). New cstate: current_term: 3 leader_uuid: "6db76967201e4b50b35c35b520236758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6db76967201e4b50b35c35b520236758" member_type: VOTER last_known_addr { host: "127.4.37.131" port: 34757 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.794921 17559 raft_consensus.cc:1275] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 3 FOLLOWER]: Refusing update from remote peer 6db76967201e4b50b35c35b520236758: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:28.796569 17891 consensus_queue.cc:1048] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:28.808969 17484 raft_consensus.cc:1275] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 3 FOLLOWER]: Refusing update from remote peer 6db76967201e4b50b35c35b520236758: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:28.811839 17942 consensus_queue.cc:1048] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:28.941927 17559 raft_consensus.cc:1275] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 3 FOLLOWER]: Refusing update from remote peer 6db76967201e4b50b35c35b520236758: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:28.943461 17942 consensus_queue.cc:1048] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "576ae391841648b491a9f4570aea8424" member_type: VOTER last_known_addr { host: "127.4.37.130" port: 45861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:28.954855 17484 raft_consensus.cc:1275] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 3 FOLLOWER]: Refusing update from remote peer 6db76967201e4b50b35c35b520236758: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:28.957166 17862 consensus_queue.cc:1048] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f0069ff0474bc385b3ba8565409ce6" member_type: VOTER last_known_addr { host: "127.4.37.129" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:29.315781  4246 tablet_server.cc:179] TabletServer@127.4.37.129:0 shutting down...
I20260709 13:21:29.358984  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:29.359818  4246 tablet_replica.cc:333] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.360802  4246 raft_consensus.cc:2243] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.361945  4246 raft_consensus.cc:2272] T 44534a11d13d4683a8525787b1141d60 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.364199  4246 tablet_replica.cc:333] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.364845  4246 raft_consensus.cc:2243] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.365321  4246 raft_consensus.cc:2272] T f1a53509092a42a8a7b9c820db33c536 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.367360  4246 tablet_replica.cc:333] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.368009  4246 raft_consensus.cc:2243] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.368472  4246 raft_consensus.cc:2272] T 0198809fa015463388126ad25fdeaeba P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.371109  4246 tablet_replica.cc:333] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.372195  4246 raft_consensus.cc:2243] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.373216  4246 raft_consensus.cc:2272] T 175cf722af25496db08f28ab249ee187 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.375605  4246 tablet_replica.cc:333] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.376178  4246 raft_consensus.cc:2243] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.376680  4246 raft_consensus.cc:2272] T 87e65f61e33d41f9bdb261e0efc4f53f P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.379233  4246 tablet_replica.cc:333] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.380019  4246 raft_consensus.cc:2243] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:21:29.380527 17599 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 13:21:29.381007  4246 raft_consensus.cc:2272] T 2e994c97bf324744b409e9f787c0b207 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.383898  4246 tablet_replica.cc:333] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.384563  4246 raft_consensus.cc:2243] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.386221  4246 raft_consensus.cc:2272] T ec99073332d645568fed5203f3442130 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:29.386144 17599 consensus_peers.cc:597] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 -> Peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Couldn't send request to peer 69f0069ff0474bc385b3ba8565409ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.388937  4246 tablet_replica.cc:333] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.389842  4246 raft_consensus.cc:2243] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.390332  4246 raft_consensus.cc:2272] T 920fcf8e4add4debbfc4574eb48d9069 P 69f0069ff0474bc385b3ba8565409ce6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.393744  4246 tablet_replica.cc:333] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.394445  4246 raft_consensus.cc:2243] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.394959  4246 raft_consensus.cc:2272] T dbeb0989430845f3a1fb0cf8e2f25168 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:29.395998 17525 consensus_peers.cc:597] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 -> Peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Couldn't send request to peer 69f0069ff0474bc385b3ba8565409ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.397583  4246 tablet_replica.cc:333] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.398324  4246 raft_consensus.cc:2243] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.399150  4246 raft_consensus.cc:2272] T 42e4fbe5927a41f9800cd78d183798c2 P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.401408  4246 tablet_replica.cc:333] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.402153  4246 raft_consensus.cc:2243] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.402673  4246 raft_consensus.cc:2272] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.405977  4246 tablet_replica.cc:333] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.406615  4246 raft_consensus.cc:2243] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.407107  4246 raft_consensus.cc:2272] T 2d6d4a91cf714a2292cccb848a14b9a9 P 69f0069ff0474bc385b3ba8565409ce6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.410645  4246 tablet_replica.cc:333] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.411556  4246 raft_consensus.cc:2243] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.412956  4246 raft_consensus.cc:2272] T 6df549a3ca8d47aaa10181adc987402d P 69f0069ff0474bc385b3ba8565409ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.415253  4246 tablet_replica.cc:333] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.415828  4246 raft_consensus.cc:2243] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.416316  4246 raft_consensus.cc:2272] T f0929868c2324f058900b34ff2fdc747 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.418344  4246 tablet_replica.cc:333] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.418939  4246 raft_consensus.cc:2243] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.419471  4246 raft_consensus.cc:2272] T ffb1969bbf6e455788991de0f0c1b9a7 P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.421766  4246 tablet_replica.cc:333] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.422324  4246 raft_consensus.cc:2243] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.423424  4246 raft_consensus.cc:2272] T f40f5b7124a24623bc51954334e2516b P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.425932  4246 tablet_replica.cc:333] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.426489  4246 raft_consensus.cc:2243] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.427076  4246 raft_consensus.cc:2272] T 50fa947202d04956a12b0386f760259f P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.429265  4246 tablet_replica.cc:333] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6: stopping tablet replica
I20260709 13:21:29.429857  4246 raft_consensus.cc:2243] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.430728  4246 raft_consensus.cc:2272] T dde0ae00446748c0b567aad72551553d P 69f0069ff0474bc385b3ba8565409ce6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.467398  4246 tablet_server.cc:196] TabletServer@127.4.37.129:0 shutdown complete.
I20260709 13:21:29.508520  4246 tablet_server.cc:179] TabletServer@127.4.37.130:0 shutting down...
W20260709 13:21:29.541760 17525 consensus_peers.cc:597] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 -> Peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Couldn't send request to peer 69f0069ff0474bc385b3ba8565409ce6. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:41821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:29.556172 17599 consensus_peers.cc:597] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 -> Peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Couldn't send request to peer 69f0069ff0474bc385b3ba8565409ce6. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:41821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.561890  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:29.562855  4246 tablet_replica.cc:333] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.563540  4246 raft_consensus.cc:2243] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.564425  4246 raft_consensus.cc:2272] T f1a53509092a42a8a7b9c820db33c536 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.566821  4246 tablet_replica.cc:333] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.567752  4246 raft_consensus.cc:2243] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.568288  4246 raft_consensus.cc:2272] T 175cf722af25496db08f28ab249ee187 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.570480  4246 tablet_replica.cc:333] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.571141  4246 raft_consensus.cc:2243] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.571657  4246 raft_consensus.cc:2272] T 2e994c97bf324744b409e9f787c0b207 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.573772  4246 tablet_replica.cc:333] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.574486  4246 raft_consensus.cc:2243] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.575383  4246 raft_consensus.cc:2272] T 87e65f61e33d41f9bdb261e0efc4f53f P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.577631  4246 tablet_replica.cc:333] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.578346  4246 raft_consensus.cc:2243] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.579173  4246 raft_consensus.cc:2272] T 0198809fa015463388126ad25fdeaeba P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.581192  4246 tablet_replica.cc:333] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.581832  4246 raft_consensus.cc:2243] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.582293  4246 raft_consensus.cc:2272] T 44534a11d13d4683a8525787b1141d60 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.584180  4246 tablet_replica.cc:333] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.584782  4246 raft_consensus.cc:2243] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.585256  4246 raft_consensus.cc:2272] T 920fcf8e4add4debbfc4574eb48d9069 P 576ae391841648b491a9f4570aea8424 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.588204  4246 tablet_replica.cc:333] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.588864  4246 raft_consensus.cc:2243] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.589767  4246 raft_consensus.cc:2272] T dbeb0989430845f3a1fb0cf8e2f25168 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.591988  4246 tablet_replica.cc:333] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.592582  4246 raft_consensus.cc:2243] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.593269  4246 raft_consensus.cc:2272] T 42e4fbe5927a41f9800cd78d183798c2 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.595299  4246 tablet_replica.cc:333] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.595886  4246 raft_consensus.cc:2243] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.596362  4246 raft_consensus.cc:2272] T ec99073332d645568fed5203f3442130 P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.598402  4246 tablet_replica.cc:333] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.599095  4246 raft_consensus.cc:2243] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.599592  4246 raft_consensus.cc:2272] T 2d6d4a91cf714a2292cccb848a14b9a9 P 576ae391841648b491a9f4570aea8424 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:29.601029 17599 consensus_peers.cc:597] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 -> Peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Couldn't send request to peer 69f0069ff0474bc385b3ba8565409ce6. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:41821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.603266  4246 tablet_replica.cc:333] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.603986  4246 raft_consensus.cc:2243] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.604538  4246 raft_consensus.cc:2272] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.606916  4246 tablet_replica.cc:333] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.607558  4246 raft_consensus.cc:2243] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.608073  4246 raft_consensus.cc:2272] T 6df549a3ca8d47aaa10181adc987402d P 576ae391841648b491a9f4570aea8424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.610335  4246 tablet_replica.cc:333] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.610934  4246 raft_consensus.cc:2243] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.611769  4246 raft_consensus.cc:2272] T f0929868c2324f058900b34ff2fdc747 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.613796  4246 tablet_replica.cc:333] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.614367  4246 raft_consensus.cc:2243] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.615252  4246 raft_consensus.cc:2272] T ffb1969bbf6e455788991de0f0c1b9a7 P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.617338  4246 tablet_replica.cc:333] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.617962  4246 raft_consensus.cc:2243] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.618450  4246 raft_consensus.cc:2272] T f40f5b7124a24623bc51954334e2516b P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.620901  4246 tablet_replica.cc:333] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.621523  4246 raft_consensus.cc:2243] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.622560  4246 raft_consensus.cc:2272] T 50fa947202d04956a12b0386f760259f P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.624722  4246 tablet_replica.cc:333] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424: stopping tablet replica
I20260709 13:21:29.625228  4246 raft_consensus.cc:2243] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.625769  4246 raft_consensus.cc:2272] T dde0ae00446748c0b567aad72551553d P 576ae391841648b491a9f4570aea8424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.667564  4246 tablet_server.cc:196] TabletServer@127.4.37.130:0 shutdown complete.
I20260709 13:21:29.702543  4246 tablet_server.cc:179] TabletServer@127.4.37.131:0 shutting down...
W20260709 13:21:29.710668 17599 consensus_peers.cc:597] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 -> Peer 69f0069ff0474bc385b3ba8565409ce6 (127.4.37.129:41821): Couldn't send request to peer 69f0069ff0474bc385b3ba8565409ce6. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.129:41821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.735047  4246 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:29.735874  4246 tablet_replica.cc:333] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.736510  4246 raft_consensus.cc:2243] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.737023  4246 raft_consensus.cc:2272] T 0198809fa015463388126ad25fdeaeba P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.739521  4246 tablet_replica.cc:333] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.740213  4246 raft_consensus.cc:2243] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.740747  4246 raft_consensus.cc:2272] T f1a53509092a42a8a7b9c820db33c536 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.743182  4246 tablet_replica.cc:333] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.743858  4246 raft_consensus.cc:2243] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.744361  4246 raft_consensus.cc:2272] T 44534a11d13d4683a8525787b1141d60 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.746713  4246 tablet_replica.cc:333] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.747641  4246 raft_consensus.cc:2243] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.748714  4246 raft_consensus.cc:2272] T 175cf722af25496db08f28ab249ee187 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.751998  4246 tablet_replica.cc:333] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.752753  4246 raft_consensus.cc:2243] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.753229  4246 raft_consensus.cc:2272] T ec99073332d645568fed5203f3442130 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.755856  4246 tablet_replica.cc:333] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.756680  4246 raft_consensus.cc:2243] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.757274  4246 raft_consensus.cc:2272] T 87e65f61e33d41f9bdb261e0efc4f53f P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:29.758725 17601 consensus_peers.cc:597] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 -> Peer 576ae391841648b491a9f4570aea8424 (127.4.37.130:45861): Couldn't send request to peer 576ae391841648b491a9f4570aea8424. Status: Network error: Client connection negotiation failed: client connection to 127.4.37.130:45861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.759737  4246 tablet_replica.cc:333] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.760349  4246 raft_consensus.cc:2243] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.760797  4246 raft_consensus.cc:2272] T 2e994c97bf324744b409e9f787c0b207 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.763010  4246 tablet_replica.cc:333] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.763778  4246 raft_consensus.cc:2243] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.765048  4246 raft_consensus.cc:2272] T d37d2bbaa22b4fb18bc3c5075cd0a4f1 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.767928  4246 tablet_replica.cc:333] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.768518  4246 raft_consensus.cc:2243] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.769052  4246 raft_consensus.cc:2272] T 42e4fbe5927a41f9800cd78d183798c2 P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.771267  4246 tablet_replica.cc:333] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.771929  4246 raft_consensus.cc:2243] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.772823  4246 raft_consensus.cc:2272] T 920fcf8e4add4debbfc4574eb48d9069 P 6db76967201e4b50b35c35b520236758 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.775458  4246 tablet_replica.cc:333] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.776130  4246 raft_consensus.cc:2243] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.776641  4246 raft_consensus.cc:2272] T dbeb0989430845f3a1fb0cf8e2f25168 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.779145  4246 tablet_replica.cc:333] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.779687  4246 raft_consensus.cc:2243] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.780519  4246 raft_consensus.cc:2272] T 2d6d4a91cf714a2292cccb848a14b9a9 P 6db76967201e4b50b35c35b520236758 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.783749  4246 tablet_replica.cc:333] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.784335  4246 raft_consensus.cc:2243] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.784919  4246 raft_consensus.cc:2272] T 50fa947202d04956a12b0386f760259f P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.787143  4246 tablet_replica.cc:333] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.787664  4246 raft_consensus.cc:2243] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.788094  4246 raft_consensus.cc:2272] T f0929868c2324f058900b34ff2fdc747 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.790123  4246 tablet_replica.cc:333] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.790637  4246 raft_consensus.cc:2243] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.791043  4246 raft_consensus.cc:2272] T ffb1969bbf6e455788991de0f0c1b9a7 P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.793013  4246 tablet_replica.cc:333] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.793520  4246 raft_consensus.cc:2243] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.793938  4246 raft_consensus.cc:2272] T f40f5b7124a24623bc51954334e2516b P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.796103  4246 tablet_replica.cc:333] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.796691  4246 raft_consensus.cc:2243] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.797117  4246 raft_consensus.cc:2272] T dde0ae00446748c0b567aad72551553d P 6db76967201e4b50b35c35b520236758 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.799057  4246 tablet_replica.cc:333] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758: stopping tablet replica
I20260709 13:21:29.799477  4246 raft_consensus.cc:2243] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:29.799871  4246 raft_consensus.cc:2272] T 6df549a3ca8d47aaa10181adc987402d P 6db76967201e4b50b35c35b520236758 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.831233  4246 tablet_server.cc:196] TabletServer@127.4.37.131:0 shutdown complete.
I20260709 13:21:29.863803  4246 master.cc:562] Master@127.4.37.190:44623 shutting down...
I20260709 13:21:29.891975  4246 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:29.892587  4246 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:29.892884  4246 tablet_replica.cc:333] T 00000000000000000000000000000000 P ce2c179605574eae8d582b3b1d045ac1: stopping tablet replica
I20260709 13:21:29.915454  4246 master.cc:584] Master@127.4.37.190:44623 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12286 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26151 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (392068 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:21:29.977873  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 432 messages since previous log ~15 seconds ago
I20260709 13:21:29.978155  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 433 messages since previous log ~15 seconds ago
I20260709 13:21:29.978350  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 433 messages since previous log ~15 seconds ago
I20260709 13:21:29.978572  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:21:29.978781  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:21:29.979000  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~163 seconds ago
I20260709 13:21:29.979213  4246 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~191 seconds ago
I20260709 13:21:29.979420  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~191 seconds ago
I20260709 13:21:29.979700  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:21:29.980031  4246 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
